paper_type.json (266B)
1 { 2 "paper_type": "benchmark-creation", 3 "reason": "Introduces Mercury, a novel code efficiency benchmark with 1,889 Python tasks and a new Beyond metric; baseline experiments demonstrate the benchmark's utility rather than constituting the primary contribution." 4 }