EricLBuehler/mistral.rs

multimodal LLM inference engine in Rust and Python

View on index · View in 3D Map

Related repos

• Serve LLMs, speech, and multimodal models with one command
• minimal code to run Mistral AI models locally or via Python
• Code and tutorials for building large language models from scratch in PyTorch
• Multimodal LLM inference engine for mobile devices
• toolkit for finetuning large language models like Llama and Mistral on your own machine
• minimalist Rust ML framework with fast demos like whisper and LLaMA2
• Open-source toolkit for building scalable LLM inference infrastructure
• Unified environment for developing and testing LLM agents with feedback
• Multi-provider generative AI library for Rust
• build AI agents in Python with Pydantic, supports multiple LLMs