triton-inference-server/server
serving AI models from any framework with optimized inference
View on index · View in 3D Map
Related repos
- AI inference framework for running machine learning models and neural networks on different hardware
- minimal code to run Mistral AI models locally or via Python
- Python library for serving and deploying AI models and custom inference systems
- lets AI assistants work with your Notion workspace
- Toolkit for distributed training and inference of large AI models using parallelism and memory management techniques
- AI model for solving complex reasoning tasks with efficient architecture
- curated list of AI APIs and sites with model access comparisons
- PHP framework for orchestrating AI agents
- framework for serving and scaling AI models over gRPC, HTTP, WebSockets
- Python framework for building AI agents
