paper_type.json (281B)
1 { 2 "paper_type": "benchmark-creation", 3 "reason": "VerilogEval's primary contribution is a new benchmark with 156 Verilog problems and automated evaluation infrastructure; baseline experiments with CodeGen and GPT-3.5 validate the benchmark rather than being the main finding." 4 }