<p>Have you ever wished you had an equal who could play Counter-Strike just as well as you? Thanks to recent developments in Robot Foundation Models (RFMs), robots can learn how to play video games just like you, imitating your best and worst behaviours.</p> <p>In this talk, Thomas Endres shows how to use imitation learning to teach an RFM to play arbitrary games. He draws first blood with an introduction to Robot Foundation Models. Attendees will learn how they work, what kind of data they are designed to process, and how that makes NVIDIA’s GR00T perfect for playing video games. After that, Thomas quick-scope the concept of imitation learning, what kind of data they need to train their GR00T model, and how they can collect it from games. Finally, he tells the story of leveling up the model from total noob to global elite - one failure at a time - and share all the things they learned along the way.</p> <p>Throughout the talk, Thomas include live demos in their slides. To close the game, they challenge one member of the audience to beat GR00T live on stage in a 1v1.</p>