Model releases & benchmarks
What Do RTL Repair Benchmarks Actually Measure?
An arXiv abstract introduces RTL repair datasets and an evaluation audit, reporting that scoring choices can obscure what models use to repair code.
Why it matters: For teams evaluating coding agents on hardware repair, the abstract shows that scoring semantics and baseline choice can change what a repair score appears to measure. Its proposed controls make those factors explicit rather than treating the score alone as evidence that a model used the faulty RTL.