llm-d/llm-d

Kubernetes-native framework for serving large language models at scale

View on index

Related repos

• Kubernetes-native distributed ML training and LLM fine-tuning
• run large language models on any device
• large language model tutorials and training basics from scratch
• framework for fast, resource-efficient LLM inference on local hardware
• Curated resources and tools for building, fine-tuning, and deploying large language models
• Code and tutorials for building large language models from scratch in PyTorch
• curated list of large language model papers, tools, and resources
• curated list of LLM libraries and tools for engineers
• Course for learning about large language models using roadmaps and Colab notebooks
• LLaMA Factory is a framework for fine-tuning large language models