paper_type.json (264B)
1 { 2 "paper_type": "benchmark-creation", 3 "reason": "Introduces SolEval, the first repository-level benchmark for Solidity code generation with 1,125 samples; the primary contribution is the benchmark itself, though baseline evaluations of 16 LLMs are included." 4 }