MinishLab/semhash
Semantic deduplication and filtering for text and images
View on index · View in 3D Map
Related repos
- tool for finding and removing duplicate images in big datasets
- finds similar code and patterns across files
- Pipeline with a web UI for LLM training and inspection
- cross-platform tool to find and manage duplicate files
- Plain text spaced repetition system
- Finds duplicates and label errors in image datasets
- process, filter, and deduplicate large-scale text data with customizable pipelines
- Retrieval system for documents with images and text
- Locally labels image metadata using AI
