trymirai/uzu

AI inference engine for Apple Silicon, hybrid GPU/MPSGraph, easy model support

View on index · View in 3D Map

Related repos

• open-source GPU cluster manager for AI models
• run AI models across devices you already have
• Run AI models, agents, and tools locallywith an OpenAI-compatible API
• GPU-accelerated parallel programming in Python for simulations and graphics
• OpenAI API for Apple Intelligence models
• Kernel-level inference engine for local AI
• Open-source platform for training, evaluating, and deploying AI models with end-to-end tools
• Open-source cloud OS for running AI models locally
• Memory system for AI agents
• toolkit for making AI models faster, smaller, and more efficient