paper_type.json (288B)
1 { 2 "paper_type": "benchmark-creation", 3 "reason": "Introduces ProjDevBench, a new benchmark with 20 end-to-end C++ project construction tasks for evaluating coding agents; the primary contribution is the benchmark framework itself, though baseline evaluations of agents are included." 4 }