SWE-bench

community

https://swe-bench.com

AI & ML interests

None defined yet.

Recent Activity

john-b-yang authored a paper 10 days ago

SWE-bench Multimodal: Do AI Systems Generalize to Visual Software Domains?

john-b-yang authored a paper 10 days ago

OpenThoughts: Data Recipes for Reasoning Models

john-b-yang authored a paper 10 days ago

LongCodeBench: Evaluating Coding LLMs at 1M Context Windows

View all activity

SWE-bench 's datasets 17

SWE-bench/SWE-prime

Viewer • Updated Apr 13 • 1.36k • 96

SWE-bench/SWE-smith-cpp

Viewer • Updated Mar 9 • 5.12k • 193

SWE-bench/SWE-smith-ts

Viewer • Updated Feb 28 • 5.03k • 506

SWE-bench/SWE-bench_Verified

Benchmark • Updated Feb 27 • 500 • 65.9k • 88

SWE-bench/SWE-smith-java

Viewer • Updated Feb 12 • 7.47k • 1.17k

SWE-bench/SWE-smith-rs

Viewer • Updated Feb 6 • 5.31k • 299 • 2

SWE-bench/SWE-smith-js

Viewer • Updated Jan 20 • 6.07k • 789

SWE-bench/SWE-smith-py

Viewer • Updated Dec 18, 2025 • 50.9k • 3.31k • 5

SWE-bench/SWE-smith-go

Viewer • Updated Dec 18, 2025 • 8.21k • 1.87k

SWE-bench/SWE-smith-php

Viewer • Updated Dec 18, 2025 • 1 • 86

SWE-bench/SWE-smith

Viewer • Updated Dec 14, 2025 • 59.1k • 19.4k • 52

SWE-bench/SWE-bench_Not_Verified

Viewer • Updated Sep 16, 2025 • 1.79k • 32

SWE-bench/SWE-bench_Multilingual

Viewer • Updated Aug 26, 2025 • 300 • 476k • 12

SWE-bench/SWE-smith-trajectories

Viewer • Updated Jul 19, 2025 • 76k • 3.58k • 60

SWE-bench/SWE-bench_Multimodal

Viewer • Updated Apr 29, 2025 • 612 • 4.83k • 10

SWE-bench/SWE-bench_Lite

Viewer • Updated Apr 29, 2025 • 323 • 29.5k • 15

SWE-bench/SWE-bench

Viewer • Updated Apr 29, 2025 • 21.5k • 7.79k • 30