Running AI models is turning into a memory game - podcast episode cover

Running AI models is turning into a memory game

Feb 17, 20266 min
--:--
--:--
Download Metacast podcast app
Listen to this episode in Metacast mobile app
Don't just listen to podcasts. Learn from them with transcripts, summaries, and chapters for every episode. Skim, search, and bookmark insights. Learn more

Episode description

When we talk about the cost of AI infrastructure, the focus is usually on Nvidia and GPUs -- but memory is an increasingly important part of the picture.

Learn more about your ad choices. Visit podcastchoices.com/adchoices

For the best experience, listen in Metacast app for iOS or Android