RT-2: New model translates vision and language into action
Yevgen Chebotar, Tianhe Yu · Google DeepMind
RT-2 turns a web-trained vision-language model into a robot controller by teaching it to output language-like tokens that represent actions.
Open library
The library
The essential reading of generative AI and agents, open in a clean reading view, with Meow and Standard summaries when available. No account needed to read.
560 papers · 558 with a Meow summary · 333 posts
Key publications from Anthropic, OpenAI, Google DeepMind, Meta, DeepSeek, Qwen, Z.ai, Kimi and other labs, plus the most influential essays and blogs.