BigCodeArena: Judging code generations end to end with code executions
• 21
AI & ML interests
None defined yet.
Recent Activity
View all activity
Papers
BigCodeArena: Unveiling More Reliable Human Preferences in Code Generation via Execution
BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions
Articles
bigcode/the-stack-v2-train-full-ids
Viewer • Updated • 58.4M • 941 • 62
bigcode/the-stack-v2-train-smol-ids
Viewer • Updated • 38.9M • 2.16k • 55
bigcode/the-stack-v2-dedup
Viewer • Updated • 1.26B • 7.19k • 133
bigcode/the-stack-v2
Viewer • Updated • 5.14B • 14k • 611
bigcode/autocodearena-v0
Viewer • Updated • 600 • 97 • 2
bigcode/bigcodereward
Viewer • Updated • 4.73k • 86 • 2
bigcode/bigcodereward-experiment-results
Viewer • Updated • 141k • 436
bigcode/bigcodearena-preference-5k
Viewer • Updated • 4.73k • 63 • 1
bigcode/bigcodearena-raw-14k
Viewer • Updated • 14.1k • 83 • 2
bigcode/humanevalpack
Viewer • Updated • 984 • 5.67k • 92
bigcode/bigcodebench
Viewer • Updated • 5.7k • 48k • 86
bigcode/governance-card
Updated • 522 • 12
bigcode/bigcodebench-hard-results
Viewer • Updated • 202 • 114 • 1
bigcode/bigcodebench-hard-solve-rate
Viewer • Updated • 296 • 27 • 1
bigcode/bigcodebench-hard-domain
Viewer • Updated • 372 • 27 • 1
bigcode/bigcodebench-hard-perf
Viewer • Updated • 372 • 22
bigcode/bigcodebench-results
Viewer • Updated • 202 • 4.86k • 2
bigcode/bigcodebench-solve-rate
Viewer • Updated • 2.28k • 37
bigcode/bigcodebench-domain
Viewer • Updated • 279 • 41
bigcode/bigcodebench-perf
Viewer • Updated • 279 • 24
bigcode/starcoder2data-extras
Viewer • Updated • 51.6M • 2.27k • 13
bigcode/bigcodebench-hard
Viewer • Updated • 740 • 13.1k • 3
bigcode/commitpack
Updated • 11.5k • 78
bigcode/bigcodebench-hard-elo
Viewer • Updated • 268 • 48
bigcode/bigcodebench-elo
Viewer • Updated • 222 • 46
bigcode/self-oss-instruct-sc2-exec-filter-50k
Viewer • Updated • 50.7k • 11k • 106
bigcode/starcoder2-instruct-assets
Viewer • Updated • 5 • 767
bigcode/MultiPL-E-completions
Viewer • Updated • 20.3k • 1.35k • 8
bigcode/bigcodebench-tool
Viewer • Updated • 148 • 9 • 1
bigcode/bcb_update
Viewer • Updated • 4 • 23 • 1