InternLM/lmdeploy

toolkit for compressing and deploying large language models

curated list of large language model papers, tools, and resources
Hannibal046/Awesome-LLM
run large language models on any device
mlc-ai/mlc-llm
Library for running and serving large language models
vllm-project/vllm
Code repository for Hands-On Large Language Models book
HandsOnLLM/Hands-On-Large-Language-Models
toolkit for finetuning large language models like Llama and Mistral on your own machine
unslothai/unsloth
open-source large language models for chat, code, and multilingual tasks
QwenLM/Qwen
Tool for building and optimizing prompt programs for large language models
microsoft/sammo
cheatsheet and study guide for transformers and large language models
afshinea/stanford-cme-295-transformers-large-language-models
LLaMA Factory is a framework for fine-tuning large language models
hiyouga/LLaMA-Factory
Run large language models locally, manage and interact with different model types
ollama/ollama