paper_type.json (243B)
1 { 2 "paper_type": "benchmark-creation", 3 "reason": "Introduces DevEval, a new manually-annotated code generation benchmark from real-world repositories; LLM evaluation is secondary to demonstrating the benchmark's construction and utility." 4 }