⚡️How Claude 3.7 Plays Pokémon
Mar 04, 2025•38 min
Listen to this episode in Metacast mobile app
Don't just listen to podcasts. Learn from them with transcripts, summaries, and chapters for every episode. Skim, search, and bookmark insights. Learn more
Summary
David Hershey from Anthropic discusses the creation and mechanics behind Claude Plays Pokémon. He explains the project's origin as a tool for experimenting with agents, the architecture, and the challenges Claude faces in navigating the game, including vision and memory limitations. David also touches on the model's learning capabilities, token usage costs, and potential future improvements.Episode description
Special lightning pod with David Hershey from Anthropic, the person behind Claude Plays Pokémon. Sonnet 3.7 is currently trying to complete Pokémon Red live on Twitch thanks to a special harness that David built so that it can see the screen, navigate through it, remember facts about the game, and more. (Since recording, it has successfully escaped Mt Moon! You can follow along on Twitch: https://www.twitch.tv/claudeplayspokemon)
This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit www.latent.space/subscribe
For the best experience, listen in Metacast app for iOS or Android