BerriAI/litellm

Python SDK and proxy server for calling 100+ LLM APIs in OpenAI format

OpenAI-compatible proxy that boosts LLM reasoning accuracy with 20+ optimization techniques, no retraining needed
codelion/optillm
python library for running and managing local LLMs with simple chat and streaming support
ollama/ollama-python
Run open-source or custom language models as OpenAI-style APIs with one command
bentoml/OpenLLM
run language models in your browser with webgpu, openai api compatible
mlc-ai/web-llm
lets Claude Code use OpenAI-compatible APIs
fuergaosi233/claude-code-proxy
multi-agent framework for building LLM-powered Python apps
langroid/langroid
OpenAI API proxy server with multi-key rotation and load balancing, built in Go
tbphp/gpt-load
auto-switches llama.cpp models for OpenAI API requests
mostlygeek/llama-swap
local LLM server for Apple Silicon with OpenAI API endpoints
dinoki-ai/osaurus