vllm-project/aibrix

Open-source toolkit for building scalable LLM inference infrastructure

View on index · View in 3D Map

Related repos

• Minimal vLLM engine for fast offline LLM inference with a clean Python codebase
• Library for running and serving large language models
• framework for fast, resource-efficient LLM inference on local hardware
• Build and train custom RL environments for LLM agents with modular tools and easy integration
• curated list of tools and frameworks for building LLM apps
• Benchmarks LLMs for end-to-end machine learning workflows
• CLI tool for managing and serving LLMs with interactive terminal and server monitoring
• multimodal LLM inference engine in Rust and Python
• Programming language for collaborating with AI language models