EleutherAI/lm-evaluation-harness

framework for testing language models on benchmarks and tasks

framework for testing and benchmarking large language models with custom or built-in evaluations
openai/evals
Curated list of open-source language models, training code, and datasets
allenai/awesome-open-source-lms
Toolkit for fine-tuning and training large language and vision models
InternLM/xtuner
toolkit for compressing and deploying large language models
InternLM/lmdeploy
tools for finetuning language models with instruction datasets and preference optimization
allenai/open-instruct
Benchmark for LLMs on software engineering tasks
openai/SWELancer-Benchmark
large language model tutorials and training basics from scratch
datawhalechina/happy-llm
open notes and guides for training large language models
stas00/ml-engineering
LLM monitoring, evaluation, and optimization toolkit
langwatch/langwatch
curated list of large language model papers, tools, and resources
Hannibal046/Awesome-LLM