vllm-project/vllm-omni
Serving framework for text, image, video, and audio models
View on index · View in 3D Map
Related repos
- Library for running and serving large language models
- LLM for vision, audio, and language
- Runs natural language workflows in cloud sandboxes
- Hosts open-source models as APIs
- Visual language model trained with reinforcement learning
- Embeddings for videos, images, and documents
- Open-source video foundation model
- Minimal vLLM engine for fast offline LLM inference with a clean Python codebase
- Keyboard-driven AI coding assistant for Vim
- AIBrix manages and scales large language model inference in the cloud for enterprise and developer workloads
