EricLBuehler/mistral.rs

multimodal LLM inference engine in Rust and Python

Serve LLMs, speech, and multimodal models with one command
xorbitsai/inference
minimal code to run Mistral AI models locally or via Python
mistralai/mistral-inference
Code and tutorials for building large language models from scratch in PyTorch
rasbt/LLM-workshop-2024
toolkit for finetuning large language models like Llama and Mistral on your own machine
unslothai/unsloth
minimalist Rust ML framework with fast demos like whisper and LLaMA2
huggingface/candle
Open-source toolkit for building scalable LLM inference infrastructure
vllm-project/aibrix
Unified environment for developing and testing LLM agents with feedback
tensorzero/llmgym
build AI agents in Python with Pydantic, supports multiple LLMs
pydantic/pydantic-ai
PyTorch-like toolkit for building and auto-optimizing LLM workflows, from chatbots to agents
SylphAI-Inc/AdalFlow
algorithms in Rust for learning and reference
TheAlgorithms/Rust