SWE-bench/SWE-bench

Benchmark for evaluating LLMs on real-world GitHub issues

View on index · View in 3D Map

Related repos

• Benchmark for LLMs on software engineering tasks
• Benchmarks LLMs for end-to-end machine learning workflows
• Benchmark for LLM agents reproducing scientific findings
• Benchmark for LLMs with contamination-free questions
• toolkit for evaluating and optimizing LLM and RAG apps
• Benchmark evaluates LLMs as agents
• Converts GitHub repositories into text for LLMs
• LLMs generate code benchmarks via sandbox interaction
• Evaluates LLMs on competitive programming tasks
• Benchmark for visual-interactive LLM code generation