Training Data - podcast cover

Training Data

Sequoia Capitalwww.sequoiacap.com
Join us as we train our neural nets on the theme of the century: AI. Sonya Huang, Pat Grady and more Sequoia Capital partners host conversations with leading AI builders and researchers to ask critical questions and develop a deeper understanding of the evolving technologies—and their implications for technology, business and society. The content of this podcast does not constitute investment advice, an offer to provide investment advisory services, or an offer to sell or solicitation of an offer to buy an interest in any investment fund.
Last refreshed:
Follow this podcast in the Metacast mobile app to refresh it and see new episodes.
Download Metacast podcast app
Podcasts are better in Metacast mobile app
Don't just listen to podcasts. Learn from them with transcripts, summaries, and chapters for every episode. Skim, search, and bookmark insights. Learn more

Episodes

Context Engineering Our Way to Long-Horizon Agents: LangChain’s Harrison Chase

Harrison Chase, cofounder of LangChain and pioneer of AI agent frameworks, discusses the emergence of long-horizon agents that can work autonomously for extended periods. Harrison breaks down the evolution from early scaffolding approaches to today's harness-based architectures, explaining why context engineering - not just better models - has become fundamental to agent development. He shares insights on why coding agents are leading the way, the role of file systems in agent workflows, and how...

Jan 21, 202640 min

How Ricursive Intelligence’s Founders are Using AI to Shape The Future of Chip Design

Anna Goldie and Azalia Mirhoseini created AlphaChip at Google, using AI to design four generations of TPUs and reducing chip floor planning from months to hours. They explain how chip design has become the critical bottleneck for AI progress -- a process that typically takes years and costs hundreds of millions of dollars. Now at Ricursive Intelligence, they're enabling an evolution of the industry from “fabless” to "designless," where any company can create custom silicon with Ricursive Intelli...

Jan 14, 202637 min

Training General Robots for Any Task: Physical Intelligence’s Karol Hausman and Tobi Springenberg

Physical Intelligence’s Karol Hausman and Tobi Springenberg believe that robotics has been held back not by hardware limitations, but by an intelligence bottleneck that foundation models can solve. Their end-to-end learning approach combines vision, language, and action into models like π0 and π*0.6, enabling robots to learn generalizable behaviors rather than task-specific programs. The team prioritizes real-world deployment and uses RL from experience to push beyond what imitation learning alo...

Jan 06, 20261 hr 2 min

Why the Next AI Revolution Will Happen Off-Screen: Samsara CEO Sanjit Biswas

Sanjit Biswas is one of the rare founders who has scaled AI in the physical world – first with Meraki, and now with Samsara, a $20B+ public company with sensors deployed across millions of vehicles and job sites. Capturing 90 billion miles of driving data each year, Samsara operates at a scale matched only by a small handful of companies. Sanjit discusses why physical AI is fundamentally different from cloud-based AI, from running inference on two- to ten-watt edge devices to managing the messy ...

Dec 16, 202538 min

The Rise of Generative Media: fal's Bet on Video, Infrastructure, and Speed

fal is building the infrastructure layer for the generative media boom. In this episode, founders Gorkem Yurtseven, Burkay Gur, and Head of Engineering Batuhan Taskaya explain why video models present a completely different optimization problem than LLMs, one that is compute-bound, architecturally volatile, and changing every 30 days. They discuss how fal's tracing compiler, custom kernels, and globally distributed GPU fleet enable them to run more than 600 image and video models simultaneously,...

Dec 10, 20251 hr 2 min

Why IDEs Won't Die in the Age of AI Coding: Zed Founder Nathan Sobo

Nathan Sobo has spent nearly two decades pursuing one goal: building an IDE that combines the power of full-featured tools like JetBrains with the responsiveness of lightweight editors like Vim. After hitting the performance ceiling with web-based Atom, he founded Zed and rebuilt from scratch in Rust with GPU-accelerated rendering. Now with 170,000 active developers, Zed is positioned at the intersection of human and AI collaboration. Nathan discusses the Agent Client Protocol that makes Zed "Sw...

Dec 02, 202540 min

How End-to-End Learning Created Autonomous Driving 2.0: Wayve CEO Alex Kendall

Alex Kendall founded Wayve in 2017 with a contrarian vision: replace the hand-engineered autonomous vehicle stack with end-to-end deep learning. While AV 1.0 companies relied on HD maps, LiDAR retrofits, and city-by-city deployments, Wayve built a generalization-first approach that can adapt to new vehicles and cities in weeks. Alex explains how world models enable reasoning in complex scenarios, why partnering with automotive OEMs creates a path to scale beyond robo-taxis, and how language inte...

Nov 18, 202542 min

How Google’s Nano Banana Achieved Breakthrough Character Consistency

When Google launched Nano Banana, it instantly became a global phenomenon, introducing an image model that finally made it possible for people to see themselves in AI-generated worlds. In this episode, Nicole Brichtova and Hansa Srinivasan, the product and engineering leads behind Nano Banana, share the story behind the model’s creation and what it means for the future of visual AI. Nicole and Hansa discuss how they achieved breakthrough character consistency, why human evaluation remains critic...

Nov 11, 202544 min

OpenAI Sora 2 Team: How Generative Video Will Unlock Creativity and World Models

The OpenAI Sora 2 team (Bill Peebles, Thomas Dimson, Rohan Sahai) discuss how they compressed filmmaking from months to days, enabling anyone to create compelling video. Bill, who invented the diffusion transformer that powers Sora and most video generation models, explains how space-time tokens enable object permanence and physics understanding in AI-generated video, and why Sora 2 represents a leap for video. Thomas and Rohan share how they're intentionally designing the Sora product against m...

Nov 06, 20251 hr

Nvidia CTO Michael Kagan: Scaling Beyond Moore's Law to Million-GPU Clusters

Recorded live at Sequoia’s Europe100 event: Michael Kagan, co-founder of Mellanox and CTO of Nvidia, explains how the $7 billion Mellanox acquisition helped transform Nvidia from a chip company into the architect of AI infrastructure. Kagan breaks down the technical challenges of scaling from single GPUs to 100K and eventually million-GPU data centers. He reveals why network performance—not just compute power—determines AI system efficiency. He discusses the shift from training to inference work...

Oct 28, 202542 min

Securing the AI Frontier: Irregular Co-founder Dan Lahav

Irregular co-founder Dan Lahav is redefining what cybersecurity means in the age of autonomous AI. Working closely with OpenAI, Anthropic, and Google DeepMind, Dan, co-founder Omer Nevo and team are pioneering “frontier AI security”—a proactive approach to safeguarding systems where AI models act as independent agents. Dan shares how emergent behaviors, from models socially engineering each other to outmaneuvering real-world defenses like Windows Defender, signal a coming paradigm shift. Dan exp...

Oct 21, 202544 min

Why AI Will Transform Customer Experience: Cresta CEO Ping Wu and Sequoia’s Doug Leone

Ping Wu built Google's contact center business before becoming CEO of Cresta, where he's pioneering a unique approach to contact center transformation. Rather than full automation Ping advocates a dual approach, automating what's ready while using AI to assist humans with the rest. He makes the case for an abundance mindset—imagining new customer experiences like talking to airline apps or turning synchronous interactions asynchronous. Ping breaks down the technical challenges of deploying Conta...

Oct 14, 202545 min

Block CTO Dhanji Prasanna: Building the AI-First Enterprise with Goose, their Open Source Agent

As CTO of Block, Dhanji Prasanna has overseen a dramatic enterprise AI transformation, with engineers saving 8-10 hours a week through AI automation. Block’s open-source agent goose connects to existing enterprise tools through MCP, enabling everyone from engineers to sales teams to build custom applications without coding. Dhanji shares how Block reorganized from business unit silos to functional teams to accelerate AI adoption, why they chose to open-source their most valuable AI tool and why ...

Sep 30, 20251 hr

Why Businesses Are Rejecting the AI They’ve Asked For: Agency CEO Elias Torres

Elias Torres has been building AI systems since 1999, from chatbots at IBM to co-founding Drift and now Agency. He believes businesses are caught in an expectation mismatch—demanding AI while rejecting it due to imperfection anxiety. Drawing from his experience scaling HubSpot, Elias explains why human-led customer experience doesn’t scale and how Agency is building AI-first solutions that work autonomously. His contrarian approach focuses on the back-end customer experience rather than front-en...

Sep 23, 202545 min

Building the "App Store" for Robots: Hugging Face's Thomas Wolf on Physical AI

Thomas Wolf, co-founder and Chief Science Officer of Hugging Face, explains how his company is applying the same community-driven approach that made transformers accessible to everyone to the emerging field of robotics. Thomas discusses LeRobot, Hugging Face's ambitious project to democratize robotics through open-source tools, datasets, and affordable hardware. He shares his vision for turning millions of software developers into roboticists, the challenges of data scarcity in robotics versus l...

Sep 09, 202543 min

Deal Velocity, Not Billable Hours: How Crosby Uses AI to Redefine Legal Contracting

Ryan Daniels and John Sarihan are reimagining legal services by building Crosby, an AI-powered law firm that focuses on contract negotiations to start. Rather than building legal software, they've structured their company as an actual law firm with lawyers and AI engineers working side-by-side to automate human negotiations. They've eliminated billable hours in favor of per-document pricing, achieving contract turnaround times under an hour. Ryan and John explain why the law firm structure enabl...

Sep 02, 202550 min

n8n CEO Jan Oberhauser on Building the Universal AI Automation Layer

When the AI wave hit, n8n founder Jan Oberhauser faced a critical choice: become irrelevant or become indispensable. He chose the latter, transforming n8n from a simple workflow tool into a comprehensive AI automation platform that lets users connect any LLM to any application. The result? Four times the revenue growth in eight months compared to the previous six years. Jan explains how n8n’s “connect everything to anything” philosophy, combined with a thriving open source community, positioned ...

Aug 26, 202536 min

Scaling the ‘Cursor for Slides’ to $50M ARR: Gamma founder Jon Noronha

Before ChatGPT made AI mainstream, John Noronha was building Gamma with a simple insight: everyone hates making slides but needs visual communication for high-stakes ideas. His background at Optimizely proved crucial as Gamma became a testing laboratory for AI models, running hundreds of experiments to discover that Claude excels at creative taste, Gemini wins on cost efficiency, and reasoning models actually hurt creativity. John explains how solving their own blank page problem inadvertently s...

Aug 19, 202530 min

Delphi’s Dara Ladjevardian: How AI Digital Minds Can Scale Human Connection

Dara Ladjevardian, founder and CEO of Delphi, is creating digital minds that allow people to scale their thoughts and availability without replacing human connection. Inspired by Ray Kurzweil’s theory of mind as a hierarchy of pattern recognizers, Dara built an adaptive temporal knowledge graph that captures how people think and reason. From helping CEOs train new hires to enabling coaches to monetize their expertise 24/7, Delphi represents a new form of conversational media. Dara explains why a...

Aug 12, 202539 min

Vercel CEO Guillermo Rauch: Building the Generative Web with AI

Vercel CEO Guillermo Rauch has spent years obsessing over reducing the friction between having an idea and getting it online. Now with AI, he's achieving something even more ambitious: making software creation accessible to anyone with a keyboard. Guillermo explains how v0 has grown to 3 million users by focusing on reliability and quality, why ChatGPT has become their fastest-growing customer acquisition channel, and how AI is enabling “virtual coworkers” across design, development, and marketi...

Aug 05, 20251 hr 1 min

OpenAI’s IMO Team on Why Models Are Finally Solving Elite-Level Math

In just two months, a scrappy three-person team at OpenAI sprinted to fulfill what the entire AI field has been chasing for years—gold-level performance on the International Mathematical Olympiad problems. Alex Wei, Sheryl Hsu and Noam Brown discuss their unique approach using general-purpose reinforcement learning techniques on hard-to-verify tasks rather than formal verification tools. The model showed surprising self-awareness by admitting it couldn’t solve problem six, and revealed the humbl...

Jul 30, 202530 min

OpenAI Just Released ChatGPT Agent, Its Most Powerful Agent Yet

Isa Fulford, Casey Chu, and Edward Sun from OpenAI's ChatGPT agent team reveal how they combined Deep Research and Operator into a single, powerful AI agent that can perform complex, multi-step tasks lasting up to an hour. By giving the model access to a virtual computer with text browsing, visual browsing, terminal access, and API integrations—all with shared state—they've created what may be the first truly embodied AI assistant. The team discusses their reinforcement learning approach, safety...

Jul 22, 202538 min

DeepMind's Pushmeet Kohli on AI's Scientific Revolution

Pushmeet Kohli leads AI for Science at DeepMind, where his team has created AlphaEvolve, an AI system that discovers entirely new algorithms and proves mathematical results that have eluded researchers for decades. From improving 50-year-old matrix multiplication algorithms to generating interpretable code for complex problems like data center scheduling, AlphaEvolve represents a new paradigm where LLMs coupled with evolutionary search can outperform human experts. Pushmeet explains the technica...

Jul 11, 202541 min

Mapping the Mind of a Neural Net: Goodfire’s Eric Ho on the Future of Interpretability

Eric Ho is building Goodfire to solve one of AI’s most critical challenges: understanding what’s actually happening inside neural networks. His team is developing techniques to understand, audit and edit neural networks at the feature level. Eric discusses breakthrough results in resolving superposition through sparse autoencoders, successful model editing demonstrations and real-world applications in genomics with Arc Institute's DNA foundation models. He argues that interpretability will be cr...

Jul 08, 202547 min

ElevenLabs’ Mati Staniszewski: Why Voice Will Be the Fundamental Interface for Tech

Mati Staniszewski, co-founder and CEO of ElevenLabs, explains how staying laser-focused on audio innovation has allowed his company to thrive despite the push into multimodality from foundation models. From a high school friendship in Poland to building one of the fastest-growing AI companies, Mati shares how ElevenLabs transformed text-to-speech with contextual understanding and emotional delivery. He discusses the company's viral moments (from Harry Potter by Balenciaga to powering Darth Vader...

Jul 01, 20251 hr

From DevOps ‘Heart Attacks’ to AI-Powered Diagnostics With Traversal’s AI Agents

Anish Agarwal and Raj Agrawal, co-founders of Traversal, are transforming how enterprises handle critical system failures. Their AI agents can perform root cause analysis in 2-4 minutes instead of the hours typically spent by teams of engineers scrambling in Slack channels. Drawing from their academic research in causal inference and gene regulatory networks, they’ve built agents that systematically traverse complex dependency maps to identify the smoking gun logs and problematic code changes. A...

Jun 24, 202541 min

The Breakthroughs Needed for AGI Have Already Been Made: OpenAI Former Research Head Bob McGrew

As OpenAI's former Head of Research, Bob McGrew witnessed the company's evolution from GPT-3’s breakthrough to today's reasoning models. He argues that there are three legs of the stool for AGI—Transformers, scaled pre-training, and reasoning—and that the fundamentals that will shape the next decade-plus are already in place. He thinks 2025 will be defined by reasoning while pre-training hits diminishing returns. Bob discusses why the agent economy will price services at compute costs due to nea...

Jun 17, 202549 min

OpenAI Codex Team: From Coding Autocomplete to Asynchronous Autonomous Agents

Hanson Wang and Alexander Embiricos from OpenAI's Codex team discuss their latest AI coding agent that works independently in its own environment for up to 30 minutes, generating full pull requests from simple task descriptions. They explain how they trained the model beyond competitive programming to match real-world software engineering needs, the shift from pairing with AI to delegating to autonomous agents, and their vision for a future where the majority of code is written by agents working...

Jun 10, 202538 min

Google I/O Afterparty: The Future of Human-AI Collaboration, From Veo to Mariner

Fresh off impressive releases at Google’s I/O event, three Google Labs leaders explain how they’re reimagining creative tools and productivity workflows. Thomas Iljic details how video generation is merging filmmaking with gaming through generative AI cameras and world-building interfaces in Whisk and Veo. Jaclyn Konzelmann demonstrates how Project Mariner evolved from a disruptive browser takeover to an intelligent background assistant that remembers context across multiple tasks. Simon Tokumin...

Jun 03, 202554 min

From Data Centers to Dyson Spheres: P-1 AI's Path to Hardware Engineering AGI

Former Airbus CTO Paul Eremenko shares his vision for bringing AI to physical engineering, starting with Archie—an AI agent that works alongside human engineers. P-1 AI is tackling the challenge of generating synthetic training data to teach AI systems about complex physical systems, from data center cooling to aircraft design and beyond. Eremenko explains how Archie breaks down engineering tasks into primitive operations and uses a federated approach combining multiple AI models. The goal is to...

May 27, 202538 min
For the best experience, listen in Metacast app for iOS or Android