ultralytics/inference

Runs YOLOv8, YOLO11, and YOLO26 models via ONNX Runtime using pure Rust.

View on index · View in 3D Map

Related repos

• multimodal LLM inference engine in Rust and Python
• YOLOv5 fast object detection models by Ultralytics
• Serve LLMs, speech, and multimodal models with one command
• framework for fast, resource-efficient LLM inference on local hardware
• Inference engine for AI models on Apple Silicon
• Rust implementation of DeepSeek-OCR inference stack
• LLM inference in C/C++ for running and serving models locally on various hardware
• Unified API for 220,000 AI models
• Simple Rust agent loop with full event streaming
• deep learning and tensor library in Rust with flexible backend support