vllm-project/semantic-router
routes API requests to the best language model using semantic understanding
View on index · View in 3D Map
Related repos
- Decision-making layer for LLMs and agents
- Library for running and serving large language models
- core AI model router for language, image, and video
- AIBrix manages and scales large language model inference in the cloud for enterprise and developer workloads
- framework for building and orchestrating AI agents and multi-agent systems
- API gateway for traffic management and AI proxying
- AI framework for semantic search, workflows, and large language models
- Unified API for fast, secure routing to 1600+ AI models including language, vision, and audio
- Semantic layer for connecting LLMs to structured data
- Terminal coding agent with semantic code intelligence
