kubernetes-sigs/gateway-api-inference-extension

Kubernetes extension for smarter AI model routing and load balancing

View on index · View in 3D Map

Related repos

• Kubernetes gateway for microservices and AI agents
• cloud-native API gateway with AI support
• Gateway for AI model APIs
• cloud-native API gateway for routing, securing, and managing APIs and AI traffic
• Kubernetes-native distributed ML training and LLM fine-tuning
• workflow orchestration for data and ML pipelines using Python and Kubernetes
• Unified API for fast, secure routing to 1600+ AI models including language, vision, and audio
• Open source AI gateway without API harmonization
• Kubernetes cluster search and visualization with AI-powered insights
• open-source AI gateway and API portal for managing and deploying AI services