bentoml/OpenLLM

Hosts open-source models as APIs

View on index · View in 3D Map

Related repos

• Python library for serving and deploying AI models and custom inference systems
• Curated list of open-source language models, training code, and datasets
• Open-source cloud OS for running AI models locally
• Community .NET library for OpenAI API
• Ollama client for managing and chatting with local AI models
• Modern client for running Ollama AI models locally with a simple interface
• Cookbook for code language models
• Open-source framework for building and running AI agents, connects to tools and APIs, no invite code needed
• API code, client, server, docs, config from OpenAPI spec