paper_type.json (277B)
1 { 2 "paper_type": "benchmark-creation", 3 "reason": "The primary contribution is EvalPlus/HUMANEVAL+, a new and more rigorous code evaluation benchmark with 80x more test cases; the empirical results on 26 LLMs validate and demonstrate why this improved benchmark is needed." 4 }