paper_type.json (246B)
1 { 2 "paper_type": "benchmark-creation", 3 "reason": "Introduces Mercury, a new code efficiency benchmark comprising 1,889 Python tasks with a novel runtime-percentile-based metric (Beyond), with baseline evaluations as secondary contributions." 4 }