vllm-project/semantic-router

routes API requests to the best language model using semantic understanding

Library for running and serving large language models
vllm-project/vllm
core AI model router for language, image, and video
LMRouter/lmrouter-core
AIBrix manages and scales large language model inference in the cloud for enterprise and developer workloads
vllm-project/aibrix
framework for building and orchestrating AI agents and multi-agent systems
microsoft/semantic-kernel
AI framework for semantic search, workflows, and large language models
neuml/txtai
Unified API for fast, secure routing to 1600+ AI models including language, vision, and audio
Portkey-AI/gateway
Serving framework for language and vision models
sgl-project/sglang
run language models in your browser with webgpu, openai api compatible
mlc-ai/web-llm
ReCall: system for letting language models use and coordinate external tools
Agent-RL/ReCall
agentic language model for deep research and reasoning tasks
Alibaba-NLP/DeepResearch