BerriAI/litellm

Python SDK and proxy server for calling 100+ LLM APIs in OpenAI format

View on index · View in 3D Map

Related repos

• Converts client-only LLM requests to OpenAI-compatible API
• OpenAI-compatible proxy that boosts LLM reasoning accuracy with 20+ optimization techniques, no retraining needed
• python library for running and managing local LLMs with simple chat and streaming support
• Run open-source or custom language models as OpenAI-style APIs with one command
• run language models in your browser with webgpu, openai api compatible
• lets Claude Code use OpenAI-compatible APIs
• multi-agent framework for building LLM-powered Python apps
• OpenAI API proxy server with multi-key rotation and load balancing, built in Go
• OpenAI-compatible proxy for Claude and ChatGPT