Research & academia
ExecCritic: Learn to Test, Test to Improve for Coding Agents
ExecCritic separates test creation from code repair because execution feedback helps only when tests correctly capture the issue’s requested behavior.
Why it matters: For coding-agent systems, adding tests is not automatically beneficial: test quality can determine whether execution feedback improves repairs or misleads the agent. ExecCritic’s reported results make independent test construction and qualification central design choices.