Some thoughts on the Sutton interview
Oct 04, 2025•12 min
Listen to this episode in Metacast mobile app
Don't just listen to podcasts. Learn from them with transcripts, summaries, and chapters for every episode. Skim, search, and bookmark insights. Learn more
Summary
Dwarkesh Patel revisits Sutton's perspective on AI, detailing the argument that current LLMs are inefficient, depend too much on human data, and lack true world models or continuous learning. He then counters these points, asserting that imitation learning is complementary to reinforcement learning, serving as a crucial prior for developing advanced AI capabilities. The discussion concludes by exploring how LLMs might evolve to incorporate continual learning, acknowledging Sutton's long-term vision while remaining optimistic about LLMs' path to AGI.Episode description
I have a much better understanding of Sutton’s perspective now. I wanted to reflect on it a bit.
(00:00:00) - The steelman
(00:02:42) - TLDR of my current thoughts
(00:03:22) - Imitation learning is continuous with and complementary to RL
(00:08:26) - Continual learning
(00:10:31) - Concluding thoughts
Get full access to Dwarkesh Podcast at www.dwarkesh.com/subscribe
For the best experience, listen in Metacast app for iOS or Android