Agent frameworks & orchestration
The Replay Gap: Static Evaluation of Model Switching in LLM Agents Scores the Wrong World
A paper questions static replay as a way to assess agent model switching.
Why it matters: Static replay may miss later changes in an interactive trajectory, complicating comparisons of model switches.