Repository Showcase
A curated collection of interesting GitHub repositories
vllm-project/vllm
Fast LLM inference and serving library
Related repos
- Minimal vLLM engine for fast offline LLM inference with a clean Python codebase
- AIBrix manages and scales large language model inference in the cloud for enterprise and developer workloads
- CLI tool for managing and serving LLMs with interactive terminal and server monitoring
- framework for fast, resource-efficient LLM inference on local hardware
- LLM inference in C/C++ for running and serving models locally on various hardware
- Build and train custom RL environments for LLM agents with modular tools and easy integration
- run large language models on any device
- routes API requests to the best language model using semantic understanding
- multimodal LLM inference engine in Rust and Python
