visual-layer/fastdup

Finds duplicates and outliers in image datasets

tool for finding and removing duplicate images in big datasets
huggingface/large-scale-image-deduplication
cross-platform tool to find and manage duplicate files
arsenetar/dupeguru
finds duplicate files in directories
adrianlopezroche/fdupes
Desktop tool for image compression and processing
AkiraBit/PicSharp
finds duplicate files, empty folders, similar images, junk files
qarmin/czkawka
visualize huge datasets as images with Python
holoviz/datashader
finds similar code and patterns across files
mizchi/similarity
Open source toolset for image forensics
GuidoBartoli/sherloq
billion-scale vector database for fast similarity search
wilsonzlin/CoreNN
visualize and curate computer vision datasets, analyze models, spot data issues
voxel51/fiftyone