Agent frameworks & orchestration
Screenshots or Tools? Eliciting Tool Use and Managing Multimodal Context in Hybrid GUI-MCP Computer-Use Agents
Tool access alone does not improve computer use: outcomes depend on whether an agent chooses tools and how it handles the visual context afterward.
Why it matters: Evaluating hybrid agents requires measuring both tool-use decisions and context handling: available tools can hurt, while reducing image context can cut input cost if the agent is retrained under the same observation rule.