Repository Showcase
A curated collection of interesting GitHub repositories
MoonshotAI/Moonlight
Muon optimizer for training large language models
Related repos
- efficient attention for long-context LLMs
- large language model tutorials and training basics from scratch
- tiny vision language model for image understanding
- 2K text-to-image AI model with multilingual support and high-res output
- audio foundation model for understanding, generation, and conversation
- trillion-parameter AI model for coding, reasoning, and agent tasks
- minimal PyTorch code for training your own small language model from scratch
- open-source language and vision models with huge context window and hybrid attention
- chat-based open-source assistant that can run language models and connect with other apps
- toolkit for finetuning large language models like Llama and Mistral on your own machine
