mlc-ai/web-llm
run language models in your browser with webgpu, openai api compatible
View on index · View in 3D Map
Related repos
- run large language models on any device
- Run open-source or custom language models as OpenAI-style APIs with one command
- Run AI models, agents, and tools locallywith an OpenAI-compatible API
- Python SDK and proxy server for calling 100+ LLM APIs in OpenAI format
- Converts client-only LLM requests to OpenAI-compatible API
- chat-based open-source assistant that can run language models and connect with other apps
- Run large language models locally, manage and interact with different model types
- Python library for using different language model APIs with one interface
- self-hosted interface for running and managing AI models like Ollama and OpenAI-compatible APIs
- Browser-LLM auto-scaling technology for serving web-browsing AI with an OpenAI-compatible API and streaming
