sgl-project/mini-sglang

Runs large language models with just 5000 lines of code

View on index · View in 3D Map

Related repos

• High performance serving for language models
• toolkit for compressing and deploying large language models
• run large language models on any device
• Library for running and serving large language models
• Infinite compute language modeling benchmark
• Runs large language models on iOS and macOS
• Framework for building applications with large language models
• minimal PyTorch code for training your own small language model from scratch
• Framework for evaluating large language models
• Tool for building and optimizing prompt programs for large language models