Repository Showcase
A curated collection of interesting GitHub repositories
vllm-project/aibrix
Open-source toolkit for building scalable LLM inference infrastructure
Related repos
- Minimal vLLM engine for fast offline LLM inference with a clean Python codebase
- Library for running and serving large language models
- framework for fast, resource-efficient LLM inference on local hardware
- Build and train custom RL environments for LLM agents with modular tools and easy integration
- curated list of tools and frameworks for building LLM apps
- CLI tool for managing and serving LLMs with interactive terminal and server monitoring
- multimodal LLM inference engine in Rust and Python
- lets you plug structured knowledge bases into LLMs for efficient, scalable augmentation
- run large language models on any device
