bentoml/OpenLLM
Run open-source or custom language models as OpenAI-style APIs with one command
View on index · View in 3D Map
Related repos
- run language models in your browser with webgpu, openai api compatible
- Community .NET library for OpenAI API
- Run AI models, agents, and tools locallywith an OpenAI-compatible API
- OpenAI API code examples and guides
- chat-based open-source assistant that can run language models and connect with other apps
- Run large language models locally, manage and interact with different model types
- tools for finetuning language models with instruction datasets and preference optimization
- evaluating large language models across tasks and datasets
- local coding agent for running, editing, and generating code in your terminal using natural language prompts
- Python SDK and proxy server for calling 100+ LLM APIs in OpenAI format
