ProgramBench proof
Four difficult programs. Four retained completions.
ProgramBench asks an agent to rebuild a whole program from an executable and documentation—without source access, internet, or decompilation.
4retained tasks
completed
completed
For context, the official 200-task leaderboard reported a best fully resolved rate of 0.5% on July 24, 2026: one task.
Hyperfine
sharkdp__hyperfine.327d5f4298 / 298Code Minimap
wfxr__code-minimap.0ddeea5369 / 369Brotli
google__brotli.b3dc9cc606 / 606Nomino
yaa110__nomino.f892499338 / 338Inspect, don’t trust