Agent frameworks & orchestration
SpecGuardBench: Can Coding Agents Construct Reliable Validation Harnesses from Natural Language Specifications?
A passing test suite is evidence about tested cases, not proof that code obeys its natural-language specification.
Why it matters: When reviewing agent-written tests, check whether each assertion follows the specification or merely copies the reference implementation. Otherwise, a harness may reject valid implementations and give misleading evidence about correctness.