Yuan-lab-LLM/Yuan3.0-Ultra

Multimodal language model with trillion parameters and expert pruning

View on index · View in 3D Map

Related repos

• large language model tutorials and training basics from scratch
• Code and tutorials for building large language models from scratch in PyTorch
• DeepSeek-V3, a Mixture-of-Experts language model with 671B parameters and 37B active per token, focused on math and coding tasks
• toolkit for finetuning large language models like Llama and Mistral on your own machine
• curated list of large language model papers, tools, and resources
• LLaMA Factory is a framework for fine-tuning large language models
• run large language models on any device
• Chinese Llama models for understanding and generating Chinese text
• Survey of unified multimodal models
• Muon optimizer for training large language models