Repository Showcase
A curated collection of interesting GitHub repositories
huggingface/picotron
minimal 4D-parallelism framework for distributed LLM training and experimentation
Related repos
- framework for fast, resource-efficient LLM inference on local hardware
- LLM training in C and CUDA, minimal dependencies
- Nanotron: minimalistic library for pretraining transformer models with simple API and scalable parallelism
- massively parallel programming language for GPUs and CPUs
- Toolkit for distributed training and inference of large AI models using parallelism and memory management techniques
- OpenAI-compatible proxy that boosts LLM reasoning accuracy with 20+ optimization techniques, no retraining needed
- minimalist Rust ML framework with fast demos like whisper and LLaMA2
- Open-source framework for building stateful LLM applications
- DeepEP — communication library for Mixture-of-Experts and expert parallelism, with all-to-all GPU kernels and low-precision support
- plug and play memory layer for LLMs
