Repository Showcase
A curated collection of interesting GitHub repositories
huggingface/datatrove
process, filter, and deduplicate large-scale text data with customizable pipelines
Related repos
- Python tools for loading and processing datasets for machine learning
- no‑code AI spreadsheet to build and enrich datasets
- tool for finding and removing duplicate images in big datasets
- text-to-speech library for generating voices with controllable style and speaker traits
- Toolkit for serving and running large language models through an inference server
- open source BI and data viz system originally built at Yandex
- data preparation and training system for parsing, generating, and evaluating high-quality data from noisy sources
- open-source DeepSeek-R1 reproduction project for reasoning models
- Graph-based RAG for text datasets
- compact multilingual AI model with long context and dual reasoning modes
