Research & academia
What Process Evaluation of Coding Agents Actually Measures: Action, Task, and Step Are Three Different Levels
Process evaluation can conflate different questions about coding agents.
Why it matters: A plausible step can be relevant without being shown to cause success.