Repository Showcase
A curated collection of interesting GitHub repositories
bentoml/OpenLLM
Run open-source or custom language models as OpenAI-style APIs with one command
Related repos
- run language models in your browser with webgpu, openai api compatible
- Run AI models, agents, and tools locallywith an OpenAI-compatible API
- OpenAI API code examples and guides
- chat-based open-source assistant that can run language models and connect with other apps
- Run large language models locally, manage and interact with different model types
- tools for finetuning language models with instruction datasets and preference optimization
- evaluating large language models across tasks and datasets
- local coding agent for running, editing, and generating code in your terminal using natural language prompts
- Python SDK and proxy server for calling 100+ LLM APIs in OpenAI format
- fast BPE tokenizer for OpenAI models
