Repository Showcase
A curated collection of interesting GitHub repositories
triton-inference-server/server
serving AI models from any framework with optimized inference
Related repos
- AI inference framework for running machine learning models and neural networks on different hardware
- minimal code to run Mistral AI models locally or via Python
- Python library for serving and deploying AI models and custom inference systems
- lets AI assistants work with your Notion workspace
- Toolkit for distributed training and inference of large AI models using parallelism and memory management techniques
- AI model for solving complex reasoning tasks with efficient architecture
- curated list of AI APIs and sites with model access comparisons
- framework for serving and scaling AI models over gRPC, HTTP, WebSockets
- Curated list of MCP servers for connecting AI models to tools and data sources
- AI agent framework for complex task automation
