microsoft/SWE-bench-Live
Benchmark for software engineering tasks with monthly updates
View on index · View in 3D Map
Related repos
- Benchmark for LLMs on software engineering tasks
- Evaluates language models on GitHub issues
- Benchmark for LLMs with monthly questions to prevent contamination
- Benchmarks LLMs for end-to-end machine learning workflows
- Runtime self-evolving software engineering agent
- Platform for benchmarking agents on Windows
- LLM-generated analytical benchmark for database systems
- Evaluates LLMs on competitive programming tasks
- quick Linux server benchmark with cpu, disk, and network tests
- Benchmark for LLM tool use
