zml/zml

AI inference framework for running machine learning models and neural networks on different hardware

View on index

Related repos

• curated list of AI APIs and sites with model access comparisons
• Kernel-level inference engine for local AI
• Python library for serving and deploying AI models and custom inference systems
• serving AI models from any framework with optimized inference
• Toolkit for distributed training and inference of large AI models using parallelism and memory management techniques
• framework for building and orchestrating AI agents and multi-agent systems
• zkML framework for proving AI model inferences with zero-knowledge proofs
• Open-source cloud OS for running AI models locally
• open-source platform for building and managing AI agents with multi-model integration
• Open-source platform for training, evaluating, and deploying AI models with end-to-end tools