Is ChatGPT making you dumb? In episode 66 of Mixture of Experts , host Tim Hwang is joined by Kaoutar El Maghraoui, Kush Varshney and Volkmar Uhlig. First, ChatGPT released a new study mode. The intention is to support education, but what is the reality? Next, AI agents are changing design interfaces; is agentic experience (AX) the new UX? Then, a new paper released by Nature about generative neural networks contextualizing ancient texts. How is AI supporting historical research? Finally, specia...
Aug 01, 2025•49 min•Season 1Ep. 66
What does the White House have to say about AI? In episode 65 of Mixture of Experts , host Tim Hwang is joined by Kate Soule, Gabe Goodhart and first-time guest, Mihai Criveti. First, Google DeepMind shared that Gemini Deep Think won Gold at IMO. Next, who is using ChatGPT agents? We get our experts’ thoughts. Then, Mihai takes us through MCP Gateway and what this means for next-gen AI systems. Finally, special guest, Ryan Hagemann, joins us to analyze the White House’s new AI Action Plan, relea...
Jul 25, 2025•43 min•Season 1Ep. 65
Is Kimi K2 actually better than Claude? In episode 64 of Mixture of Experts , host Tim Hwang is joined by Abraham Daniels, Chris Hay and Kaoutar El Maghraoui. First, Moonshot AI released Kimi K2, their trillion-parameter MoE model, and our experts analyze the benchmarks and what this really means. Then, we reflect on DeepSeek-R1 6 months later; did it live up to the hype? Next, Google is investing $25 billion in AI infrastructure, and it’s not just AI chips. How does this compare to their compet...
Jul 18, 2025•48 min•Season 1Ep. 64
How will AI agents change search? In episode 63 of Mixture of Experts , host Tim Hwang is joined by Aaron Baughman, Chris Hay and Kate Soule. First, Perplexity released their Comet browser, and there are rumors that OpenAI is next. Who will win the AI browser war? Then, we discuss frontier model transparency amid Anthropic’s call for a “targeted transparency framework”. Does this only support large model developers? Later, Cloudflare blocks AI scrapers. Is this a good thing? Finally, we discuss ...
Jul 11, 2025•52 min•Season 1Ep. 63
Will AI agents run all businesses? In episode 62 of Mixture of Experts , host Tim Hwang is joined by Gabe Goodhart, Kush Varshney and Marina Danilevsky to debrief Anthropic’s Project Vend. Next, do we still need massive data centers? We analyze DiLoCoX and discuss the possibility of distributed model training. Then, the New York Times released an article discussing how computer science education has changed in the era of AI; should people still study computer science? Finally, is the paper revie...
Jul 04, 2025•50 min•Season 1Ep. 62
In episode 61 of Mixture of Experts, host Tim Hwang is joined by Kaoutar El Maghraoui, Gabe Goodhart and, joining us for the first time, Ann Funai. First up, a new paper from MIT: “Your brain on ChatGPT”. Are we using AI and LLMs to augment our intelligence, or are we becoming optimally lazy? Next, our experts explore the surprising evolution of autonomous vehicles: they are driving more aggressively, and the results might actually be... safer? Finally, a conversation about AI-generated ads, AI-...
Jun 27, 2025•36 min•Season 1Ep. 61
Could AI take your job? In episode 60 of Mixture of Experts , host Tim Hwang is joined by Phaedra Boinodiris, Chris Hay and Volkmar Uhlig. First, the impact of AI on the job market is all the rage online. Between the Godfather of AI revealing which jobs he feels are safe, and Jensen Huang responding to Dario Amodei’s thoughts, our experts analyze the chatter. Next, Scale AI is facing some fallout. What can we learn about data security? Then, an article from the New York Times details how chatbot...
Jun 20, 2025•42 min•Season 1Ep. 60
Did Apple’s WWDC 2025 live up to expectations? In episode 59 of Mixture of Experts , host Tim Hwang is joined by Chris Hay, Kaoutar El Magrahoui and Shobhit Varshney. Today, the experts analyze all things Apple—from Apple Research’s recent paper The Illusion of Thinking to Apple Intelligence. Next, OpenAI released o3-pro: we continue the analysis on AI reasoning. Then, Meta purchased Scale AI for a whopping $15 billion. Why? Finally, an exciting new announcement on fault-tolerant quantum computi...
Jun 13, 2025•52 min•Season 1Ep. 59
Is open source winning the AI race? In episode 58 of Mixture of Experts, host Tim Hwang is joined by Anthony Annunziata, Ash Minhas and Sarah Amos live from New York Tech Week. First, we dive into the various themes coming out of NY Tech Week, specifically practical uses of AI. Next, we analyze a couple of different reports about the impact of open source on AI. Finally, Claude 4 has some really weird behaviors. What does this teach us about AI safety and model development? All that and more on ...
Jun 06, 2025•45 min•Season 1Ep. 58
Claude 4’s system prompt leaked? In episode 57 of Mixture of Experts, host Tim Hwang is joined by Chris Hay, Kate Soule and Aaron Baughman to debrief a hectic week in AI. First, Anthropic’s system prompt for Claude 4 was leaked; what stuck out to our experts? Then, Rick Rubin and Anthropic are vibe coding? We debrief “ The Way of Code .” Next, OpenAI paid $6.5 billion for Jony Ive’s company, LoveFrom . Finally, Microsoft theorizes the development of “agent factories”. Is there a “winner takes al...
May 30, 2025•44 min•Season 1Ep. 57
How long until Anthropic drops Claude 5.0? On today’s bonus episode of Mixture of Experts, guest host Bryan Casey is joined by Chris Hay, Marina Danilevsky and Shobhit Varshney to analyze the newly released Claude 4.0 family: Opus 4 and Sonnet 4. What do we know about the model architecture vs. What is speculation? In this special episode we talk Anthropic, OpenAI, Google and the rest of the competition in the AI race! Who will win? Tune-in to this bonus Mixture of Experts for more! 00:01 – Intr...
May 23, 2025•28 min
Should you pay for Google’s AI Ultra subscription plan? In episode 56 of Mixture of Experts, host Tim Hwang is joined by Abraham Daniels, Gabe Goodhart and Marina Danilevsky to debrief the announcements from Google I/O 2025. Next, RedHat dropped llm-d, a Kubernetes-native distributed inference serving stack; what is it and why does it matter? Then, we analyze Microsoft’s NLWeb: is everything becoming conversational? Finally, Stack Overflow has been on a decline. Is AI to blame? Find out more on ...
May 23, 2025•42 min•Season 1Ep. 56
Can Mistral make Europe a global AI contender? In episode 55 of Mixture of Experts, host Tim Hwang is joined by Chris Hay, Volkmar Uhlig and Kaoutar El Maghraoui to discuss the drop of Mistral Medium 3. Next, we analyze the AI chip sales both NVIDIA and AMD made to Saudi Arabia. Then, with IBM’s new ITBench and OpenAI’s HealthBench, we dive deeper into benchmarks for AI evaluation. Tune in to this week’s Mixture of Experts for more! 00:01 – Intro 00:47 -- Mistral Medium 3 12:26 -- AI chips to Sa...
May 16, 2025•37 min•Season 1Ep. 55
Has AI hallucination gotten out of control? In episode 54 of Mixture of Experts, host Tim Hwang is joined by Kate Soule, Skyler Speakman and Kaoutar El Maghraoui to analyze reasoning models and rising hallucinations. Next, as IBM Think 2025 wraps, the experts unpack the biggest highlights from IBM’s biggest show of the year: new AI agents, Ferraris and ... penguins? Then, OpenAI is making moves with its acquisition of Windsurf. What does this mean? Tune in to this week’s Mixture of Experts for m...
May 09, 2025•28 min•Season 1Ep. 54
We are celebrating MoE podcast’s one year anniversary! In episode 53 of Mixture of Experts, host Tim Hwang is joined by the O.G. panel of experts from our pilot—Chris Hay, Shobhit Varshney and Kush Varshney. This week, we cover some exciting announcements at LlamaCon. Then, we discuss some new Chinese AI models from Qwen3 to the rumored DeepSeek-R2. Next, J.P. Morgan’s CISO, Patrick Opet, released “An open letter to our third-party suppliers,” covering the need for AI security. Are we doomed? Fi...
May 02, 2025•40 min•Season 1Ep. 53
Is OpenAI going to enter the social media game? In episode 52 of Mixture of Experts host, Tim Hwang is joined by Gabe Goodhart, Kate Soule and Marina Danilevsky. First, Sam Altman is rumored to be testing an internal prototype social network; why is this a potential next move for the AI giant? Next, for our paper of the week, we analyze Anthropic’s study on chain-of-thought reasoning, “Reasoning Models Don’t Always Say What They Think.” Then, AI scraping puts a strain on Wikimedia; what’s the im...
Apr 25, 2025•38 min•Season 1Ep. 52
OpenAI just dropped o3 and o4-mini! In episode 51 of Mixture of Experts host, Tim Hwang is joined by Chris Hay, Vyoma Gajjar and special guest John Willis, Owner of Botchagalupe Technologies. Today, we analyze Sam Altman’s new AI models, o3 and o4-mini. Next, Google announced that by Q3 you can run Gemini on-prem; what does this mean for enterprise AI adoption? Then, John is on the show today to take us through AI evaluation tools and why we need them. Finally, NVIDIA is planning to move AI chip...
Apr 18, 2025•42 min•Season 1Ep. 51
IBM z17 is here! In episode 50 of Mixture of Experts , host Tim Hwang is joined by Kate Soule, Shobhit Varshney and Hillery Hunter to debrief the launch of a new mainframe with robust AI infrastructure. Next, Meta dropped Llama 4 over the weekend;, how's it going? Then, Shobhit is recording live from Google Cloud Next in Las Vegas, along with Gemini 2.5 Pro. What are some of the most exciting announcements? Finally, the Pew Research Center shows perception of AI, how does this impact the industr...
Apr 11, 2025•38 min•Season 1Ep. 50
Will OpenAI be fully open source by 2027? In episode 49 of Mixture of Experts , host Tim Hwang is joined by Aaron Baughman, Ash Minhas and Chris Hay to analyze Sam Altman’s latest move towards open source. Next, we explore Anthropic's mechanistic interpretability results and the progress the AI research community is making. Then, can Apple catch up? We analyze the latest critiques on Apple Intelligence. Finally, Amazon enters the chat with AI agents. How does this elevate the competition? All th...
Apr 04, 2025•43 min•Season 1Ep. 49
What’s the best open-source model? In episode 48 of Mixture of Experts, host Tim Hwang is joined by Kate Soule, Kush Varshney and Skyler Speakman to explore the future of open-source AI models. First, we chat about the release of DeepSeek-V3-0324. Then, more announcements coming out of Google including Gemini Canvas and Gemini 2.5. Next, Extropic has entered the chat with a thermodynamic chip. Finally, AI image generation is on the rise as OpenAI released GPT-4o image generation. All that, and m...
Mar 28, 2025•42 min•Season 1Ep. 48
What’s the most exciting announcement coming out of NVIDIA GTC? In episode 47 of Mixture of Experts , host Tim Hwang is joined by Nathalie Baracaldo, Kaoutar El Maghraoui and Vyoma Gajjar. First, we dive into the latest announcements from NVIDIA GTC, including the Groot N1 model for humanoid robotics. Next, Baidu released some new AI reasoning models, and they’re not open source? Then, for our paper of the week we discuss the flaws of Chain-of-Thought reasoning. Finally, Gemini Flash 2.0 has rel...
Mar 21, 2025•39 min•Season 1Ep. 47
Is Manus a second DeepSeek moment? In episode 46 of Mixture of Experts , host Tim Hwang is joined by Chris Hay, Kaoutar El Maghraoui and Vyoma Gajjar to talk Manus! Next, the rise of vibe coding—what started as a joke has now become a thing? Then, we dive deep into the future of scaling laws. Finally, Perplexity is teaming up with Deutsche Telekom to release an AI phone—what’s the motivation here? Tune-in to today’s Mixture of Experts to find out more! 00:01 – Intro 00:37 -- Manus 14:09 – Vibe c...
Mar 14, 2025•50 min•Season 1Ep. 46
When can we expect quantum to reach consumer devices? In episode 45 of Mixture of Experts , host Tim Hwang is joined by special guest, Blake Johnson, to debrief the quantum noise in the news. Blake helps us understand the intersection between quantum and AI and how far we are from this technology. Then, veteran experts Chris Hay and Volkmar Uhlig hash out some other news in AI this week. We cover Anthropic’s Model Context Protocol, CoreWeave filing for an IPO and Sesame AI’s new voice companion....
Mar 07, 2025•45 min•Season 1Ep. 45
Is pre-training dead? In this bonus episode of Mixture of Experts , guest host Bryan Casey is joined by Kate Soule and Chris Hay. On Thursday, Sam Altman dropped GPT-4.5 just after we wrapped our weekly recording. We got a few of our veteran experts on the podcast to analyze OpenAI’s largest and “best” chat model yet. What’s the hype? Tune-in to this bonus episode to find out! 00:01 – Intro 00:25 – GPT-4.5 The opinions expressed in this podcast are solely those of the participants and do not nec...
Mar 01, 2025•24 min
Granite 3.2 is officially here! In episode 44 of Mixture of Experts , host Tim Hwang is joined by Kate Soule, Maya Murad and Kaoutar El Maghraoui to debrief a few big AI announcements. Last week we covered small vision-language models (VLMs), and this week Granite 3.2 dropped with new VLMs, enhanced reasoning capabilities, and more! Kate takes us under the hood to understand the new features and how they were created. Next, Anthropic dropped a new intelligence model, Claude 3.7 Sonnet, and a new...
Feb 28, 2025•40 min•Season 1Ep. 44
What is all the hype around Deep Research? In episode 43 of Mixture of Experts, host Tim Hwang is joined by Kate Soule, Volkmar Uhlig and Shobhit Varshney. This week, we discuss reasoning model features coming out of companies like OpenAI’s Deep Research, Google Gemini, Perplexity, xAI’s Grok-3 and more! Next, OpenAI is rumored to release an inference chip, but how likely is this to be a success in the AI chip game? Then, we analyze the capabilities of small vision-language models (VLMs). Finall...
Feb 21, 2025•46 min•Season 1Ep. 43
Live from Paris, Tim Hwang is at the AI Action Summit 2025. In episode 42 of Mixture of Experts , we welcome Anastasia Stasenko, CEO and Co-Founder of pleias along with our veteran experts Marina Danilevsky and Chris Hay. Last week, we touched on some potential conversations at the Paris AI Summit, this week we recap what actually happened. Is AI safety improving Globally? Next, for our paper of the week, we breakdown s1: Simple test-time scaling. Then, Sam Altman is back with another blog, “Thr...
Feb 14, 2025•40 min•Season 1Ep. 42
What does Sam Altman have up his sleeve? In episode 41 of Mixture of Experts, join host Tim Hwang along with experts Nathalie Baracaldo, Marina Danilevsky and Chris Hay. Last week, we covered all things DeepSeek, and this week OpenAI has some new releases to share. Today, the experts dissect deep research and o3-mini. Next, our host Tim Hwang is travelling to AI Action Summit, he asks our experts what we can expect coming out of the event. Then, we talk about Anthropic’s Constitutional Classifie...
Feb 07, 2025•38 min•Season 1Ep. 41
Let’s bust some early myths about DeepSeek. In episode 40 of Mixture of Experts, join host Tim Hwang along with experts Aaron Baughman, Chris Hay and Kate Soule. Last week, we covered the release of DeepSeek-R1; now that the entire world is up to speed, let’s separate the facts from the hype. Next, what is model distillation and why does it matter for competition in AI? Finally, Sam Altman among other tech CEOs shared his response to DeepSeek. Will R1 radically change the open-source strategy of...
Jan 31, 2025•39 min•Season 1Ep. 40
What does the future hold for DeepSeek? In episode 39 of Mixture of Experts, join host Tim Hwang along with experts Abraham Daniels, Kaoutar El Maghraoui and Skyler Speakman to discuss the release of DeepSeek-R1. Next, Mistral indicates going IPO. Then, FrontierMath’s new benchmark is particularly difficult, the experts debrief. Finally, IDC released a report on code assistants, what do we need to know about generalist and specialized coding assistants? Tune-in to this week’s episode to find out...
Jan 24, 2025•40 min•Season 1Ep. 39
