sgl-project/sglang
Serving framework for language and vision models
View on index · View in 3D Map
Related repos
- connects language models to tons of APIs for tool use
- Run large language models locally, manage and interact with different model types
- Library for running and serving large language models
- evaluating large language models across tasks and datasets
- Programming language for cloud infrastructure and application code
- Code repository for Hands-On Large Language Models book
- Observability tool for LLM applications
- Curated resources and tools for building, fine-tuning, and deploying large language models
- B language compiler written in Go with LLVM backend
- Mixture-of-Experts vision-language model
