mlc-ai/web-llm

run language models in your browser with webgpu, openai api compatible

run large language models on any device
mlc-ai/mlc-llm
Run open-source or custom language models as OpenAI-style APIs with one command
bentoml/OpenLLM
Run AI models, agents, and tools locallywith an OpenAI-compatible API
mudler/LocalAI
Python SDK and proxy server for calling 100+ LLM APIs in OpenAI format
BerriAI/litellm
chat-based open-source assistant that can run language models and connect with other apps
LAION-AI/Open-Assistant
Run large language models locally, manage and interact with different model types
ollama/ollama
Python library for using different language model APIs with one interface
mozilla-ai/any-llm
self-hosted interface for running and managing AI models like Ollama and OpenAI-compatible APIs
open-webui/open-webui
Browser-LLM auto-scaling technology for serving web-browsing AI with an OpenAI-compatible API and streaming
stanford-mast/blast
open-source framework for AI web agents with world model + action engine
lavague-ai/LaVague