"The Cognitive Revolution" | AI Builders, Researchers, and Live Player Analysis - podcast cover

"The Cognitive Revolution" | AI Builders, Researchers, and Live Player Analysis

Erik Torenberg, Nathan Labenzwww.cognitiverevolution.ai
A biweekly podcast where hosts Nathan Labenz and Erik Torenberg interview the builders on the edge of AI and explore the dramatic shift it will unlock in the coming years. The Cognitive Revolution is part of the Turpentine podcast network. To learn more: turpentine.co

Episodes

What Biological & Social Systems Can Teach us About AI with Nora Ammann, Cofounder of PIBBSS Research

In this episode, Nathan sits down with Nora Ammann, cofounder and CEO of PIBBSS (Principles of Intelligent Behavior in Biological and Social Systems), a research initiative focused on the principles of intelligent behavior in biological and social systems. If you need an ecommerce platform, check out our sponsor Shopify: https://shopify.com/cognitive for a $1/month trial period. We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hirin...

Dec 07, 20231 hr 27 minSeason 1Ep. 84

Imbue CTO Josh Albrecht on Creating AI Agents for Reasoning, Reliability, and Robustness

In this episode, Nathan chats with Josh Albrecht, CTO of Imbue. They discuss how to create agents for reasoning, reliability, and robustness. If you need an ecommerce platform, check out our sponsor Shopify: https://shopify.com/cognitive for a $1/month trial period. We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eri...

Dec 02, 20231 hr 22 min

Vercel CEO Guillermo Rauch on AI-Powered Coding, Software 2.0, and the AI Open Source Question

In this episode, Nathan chats with Guillermo Rauch, CEO of Vercel, to discuss how AI might shape the future of code, software 2.0, and the open source question in AI. If you need an ecommerce platform, check out our sponsor Shopify: https://shopify.com/cognitive for a $1/month trial period. SPONSORS: Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, a...

Nov 29, 20231 hr 17 min

Sam Altman Fired from OpenAI: NEW Insider Context on the Board’s Decision

Nathan shares his perspective on Sam Altman’s firing from OpenAI, after being a part of the red team for GPT-4 and seeing how the board handled safety concerns. If you need an ecommerce platform, check out our sponsor Shopify: https://shopify.com/cognitive for a $1/month trial period. This is a developing story. This podcast was recorded on 11/21 at 12pm PST. SPONSORS: Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce...

Nov 22, 20232 hr 54 min

AI Discourse Deranged: Assessing LLM Generalization Takes and Polarizing Regulatory Debate

In this episode, Nathan and Erik discuss research out of Google Deepmind suggesting LLMs, Hemant Teneja’s responsible VC commitments, and why now is not the time for an ideological war on AI regulation. If you need an ecommerce platform, check out our sponsor Shopify: https://shopify.com/cognitive for a $1/month trial period. RECOMMENDED PODCAST: Every week investor and writer of the popular newsletter The Diff, Byrne Hobart, and co-host Erik Torenberg discuss today’s major inflection points in ...

Nov 17, 20231 hr 21 min

Synthetic Data with Alex Watson, Founder of Gretel AI

In this episode, Nathan interviews Alex Watson, founder and CPO of Gretel AI, about the company's work in synthetic data. They discuss why we need synthetic data, Gretel’s new pre trained tabular LLM that creates synthetic data on a zero shot basis, privacy techniques to prevent LLM memorization, and more. If you need an ecommerce platform, check out our sponsor Shopify: https://shopify.com/cognitive for a $1/month trial period. We're hiring across the board at Turpentine and for Erik's personal...

Nov 14, 20231 hr 23 minSeason 1Ep. 80

OpenAI Invests $5M Into the Self-Driving Race with John Hayes, Cofounder of Ghost Autonomy

We're joined by John Hayes, CEO and Cofounder of Ghost, a self-driving car startup using multimodal LLMs to solve the autonomous driving problem, that OpenAI just invested $5 million into. If you need an ERP platform, check out our sponsor NetSuite: http://netsuite.com/cognitive. We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, ...

Nov 09, 20232 hr 38 minSeason 1Ep. 78

OpenAI DevDay: Beyond the Headlines with Logan Kilpatrick, OpenAI's Dev Relations Lead

We’re deep diving into OpenAI DevDay with Logan Kilpatrick, Dev Relations Lead at OpenAI. If you need an ERP platform, check out our sponsor NetSuite: http://netsuite.com/cognitive. We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. SPONSORS: SHOPIFY: https://shopify.com/cognitive for a $1/month trial...

Nov 08, 20231 hr 16 minSeason 1Ep. 77

Biden's Executive Order and AI Safety with Flo Crivello, Founder of Lindy AI

In this episode, Flo Crivello, founder of Lindy AI, joins Nathan to chat about Biden’s executive order, and the state of AI safety. They discuss Flo’s thoughts on the executive order, building AGI kill switches, self driving cars, and more. If you need an ERP platform, check out our sponsor NetSuite: http://netsuite.com/cognitive. SPONSORS: Netsuite | Omneky Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US....

Nov 03, 202355 min

Hardcore AI for History with Mark Humphries, Professor of History at Wilfred Laurier University

Mark Humphries is a Professor of History at Wilfrid Laurier University, where he has published widely on various aspects of Canadian history. We invited Mark to do an episode after he reached out to tell us that hearing about how Nathan fine-tuned GPT-3.5 on GPT-4 reasoning helped him get over some hurdles in his own archival research. In addition, he chats about all the things that he'd tried that hadn't worked, and in the process proved himself to be one of the world's leading adopters of AI t...

Oct 31, 20232 hr 34 min

AI Agents, VC Insights on AI, and Building in Public with Yohei Nakajima, Creator of BabyAGI

In this episode, Yohei Nakajima, creator of BabyAGI and GP at Untapped Capital, chats with Nathan about the opportunity for AI to strengthen human understanding, AI agents, and his insights on investing in AI projects. If you need an ERP platform, check out our sponsor NetSuite: http://netsuite.com/cognitive. We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate,...

Oct 26, 20231 hr 27 min

RAG & Beyond: Semantic Storage and Retrieval

Anton Troynikov, cofounder of Chroma, joins Nathan Labenz to discuss the importance of keeping the retrieval-augmented generation (RAG) loop in house, what it means for Chroma to be in “wartime” mode right now, and how much of the data going into Chroma has never been in a database before. If you need an ERP platform, check out our sponsor NetSuite: http://netsuite.com/cognitive. SPONSORS: NetSuite | Omneky NetSuite has 25 years of providing financial software for all your business needs. More t...

Oct 24, 20231 hr 28 min

The Future of the Transformer Part 2 with Trey Kollmer

Trey Kollmer returns to discuss the latest AI research revelations with Nathan Labenz. They explore how new techniques will shave 10% off global compute needs, how analogical prompting beats few-shot prompting, and how compressive historical records can increase LLM memory and retention abilities. If you need an ERP platform, check out our sponsor NetSuite: http://netsuite.com/cognitive. SPONSORS: Shopify | NetSuite | Omneky Shopify is the global commerce platform that helps you sell at every st...

Oct 20, 20231 hr 5 min

The Future of the Transformer Part 1 with Trey Kollmer | H100 Chips will Supercharge AI Hardware

Trey Kollmer joins Nathan Labenz for a roundup of the latest AI research! They discuss Microsoft’s Self-Taught Optimizer (STOP) research and Google’s FreshLLMs, how H100 chips will supercharge development of programs with GPT-4 level compute, LLM representation of space and time, and more! If you're looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/cognitive We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating....

Oct 18, 20231 hr 22 minSeason 1Ep. 71

The AI Scouting Report: Jailbreaks and Defense

Nathan Labenz synthesizes recent research in mechanistic interpretability and AI safety, how top players in the space like Anthropic and OpenAI are addressing them, and jailbreaks like the Calvin and Hobbes one you may have seen online. Nathan's aim is to impart the equivalent of a high school AP course understanding to listeners in 90 minutes. If you're looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/cognitive Questions or topics you want us to review for futur...

Oct 13, 20231 hr 16 minSeason 1Ep. 70

AI is Supercharging Writers with Sudowrite's Founder, James Yu

In this episode, Nathan is joined by James Yu, Founder of Sudowrite, an AI writing tool.They discuss how James started Sudowrite after using GPT-3 for his own fiction writing, how Sudowrite is able to be a supportive writing partner, and Yu's experience developing its tech stack and working through the backlash he's received. f you're looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/cognitive Subscribe to the show Substack to join future conversations and submit ...

Oct 10, 20232 hr 46 min

AI Engineers, Pendants, and Competition Between OpenAI and Developers with Swyx of Latent Space

In this episode, Nathan sits down with Swyx of Latent Space to chat about AI engineers and tools to check out, competitive dynamics between OpenAI, other foundation model providers, and developers, and if Swyx would wear an AI Horcrux. We also learn that Nathan lived in the same dorm as Mark Zuckerberg back in his college days (and was a late adopter to Facebook…). If you're looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/cognitive Subscribe to the show Substack...

Oct 05, 20232 hr 34 minSeason 1Ep. 68

Gunning for Google with Perplexity CEO Aravind Srinivas

In this episode, Aravind Srinivas of Perplexity AI returns to the show. They discuss Perplexity’s growth to millions of queries per day, CEO Aravind’s favourite Perplexity use cases, and how Perplexity ships fast in a competitive landscape against Google and major AI live players creating their own search engines. If you're looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/cognitive We're hiring across the board at Turpentine and for Erik's personal team on other ...

Oct 03, 20231 hr 1 min

OpenAI, Amazon's Anthropic Investment, and the Roman Empire with Zvi Mowshowitz

Zvi Mowshowitz, the writer behind Don't Worry About the Vase, returns to catch up with Nathan on everything OpenAI, Amazon-Anthropic collab, and Google Deepmind. They also discuss Perplexity, deepfakes, and software bundling vs the Roman Empire. If you're looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/cognitive Definitely also take a moment to subscribe to Zvi's blog Don't Worry About the Vase (https://thezvi.wordpress.com/) - Zvi is an information hyperprocess...

Sep 29, 20232 hr 55 minSeason 1Ep. 65

OpenAI Fine-Tuning Update, Acceleration Debate, and Bundling AI Services

Nathan and Erik chat OpenAI GPT-3.5 fine tuning updates, using GPT 4 outputs to fine-tune 3.5, when to accelerate, and AI bundles. If you're looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/cognitive We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. SPONSORS: Shopify ...

Sep 26, 20231 hr 19 minSeason 1Ep. 64

Universal Jailbreaks with Zico Kolter, Andy Zou, and Asher Trockman

In this episode, Nathan sits down with three researchers at Carnegie Mellon studying adversarial attacks and mimetic initialization: Zico Kolter, Andy Zou, and Asher Trockman. They discuss: the motivation behind researching universal adversarial attacks on language models, how the attacks work, and the short term harms and long term risks of these jailbreaks. If you're looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/cognitive We're hiring across the board at Tur...

Sep 22, 20232 hr 17 minSeason 1Ep. 63

The Future of AI Security with Adam Wenchel, CEO of Arthur.ai

In this episode, Nathan sits down with Adam Wenchel, CEO of Arthur.ai. Adam founded the AI security company back in 2019, before GPT-2 existed. In this episode, Adam shares his unique perspective on the AI security landscape, drawing from years building commercial AI systems. They discuss the attacks Adam set out to defend against, the changing priorities of executives in the rush to adopt LLMs, and the LLM-specific techniques Adam has developed. If you're looking for an ERP platform, check out ...

Sep 19, 20231 hr 25 minSeason 1Ep. 63

AI-Powered Filmmaking with Waymark's Stephen Parker and Josh Rubin

In this episode, Nathan sits down with Stephen Parker and Josh Rubin of Waymark, and creators of The Frost, an AI-powered 12 minute short film. In this episode, we get a behind the scenes look at their creative process, the prompting and creative techniques they used to generate and animate the DALL-E results, and an overview of the current state of AI art. If you're looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/cognitive We're hiring across the board at Turpe...

Sep 14, 20232 hr 32 minSeason 1Ep. 62

Hollywood Strike Update and AI Roundup with Trey Kollmer

In this episode, Trey Kollmer, WGA Writer and Co-Executive of the show Ghosts, returns to the show to discuss updates to the Hollywood Strikes, including news on SAG-AFTRA and WGA. Trey and Nathan chat why actors are joining the strikes, how AI will change acting as a profession, Trey’s views on reasoning and how he’s experimenting with GPT-4, and much, much more. We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of St...

Sep 12, 20233 hr 34 minSeason 1Ep. 60

Why a16z Built a Town for AI People

In this episode, Nathan sits down with three members of the a16z x Convex AI Town project: Yoko Li (Partner, a16z), Martin Casado (GP, a16z), and James Cowling (CTO, Convex). AI Town is a virtual town where AI agents live, interact, and socialize. They discuss how AI Town originated from Yoko’s companion app project, unpredictability as a feature in LLMs and interacting with models like they are lifeforms, and why they chose Javascript and Convex to build AI Town. If you're looking for an ERP pl...

Sep 07, 202358 minSeason 1Ep. 60

Cryptography Will Revolutionize AI Data Privacy with Daniel Kang

In this episode, Nathan sits down with Daniel Kang, Assistant Professor of Computer Science at the University of Illinois. Kang has done pioneering work bringing zero knowledge cryptographic proofs to AI. In this episode, they chat about the cryptographic theory behind Daniel's work, how cryptography allows us to balance the tradeoff between privacy and authenticity, and how cryptography usage is needed in a world where LLMs are increasingly embedded into our daily lives. If you're looking for a...

Sep 05, 20231 hr 22 minSeason 1Ep. 59

How Hugging Face raised $235M

In this episode, Nathan and Erik sit down to analyze Hugging Face in light of its recent $235M Series D round. They analyze Hugging Face’s community and defensibility through the lens of other community businesses like ProductHunt and Yelp, assess its ability to fulfill its $4.5 billion valuation, and assess competitors and other notable companies in the space like Replit, Character, and Runway. If you're looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/cognitive...

Aug 31, 20231 hr 3 minSeason 1Ep. 58

E57: Google's PaLM 2 with Paige Bailey

In this episode, Nathan sits down with Paige Bailey, Lead Product Manager of Generative Models at Google Deepmind. In this conversation, they discuss what it's like to be a PM for an LLM as opposed to an app, defining ideal LLM behaviour, and reasoning - how do you distinguish real abilities vs pattern matching? If you're looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/cognitive We're hiring across the board at Turpentine and for Erik's personal team on other pr...

Aug 29, 202357 minSeason 1Ep. 57

E56: OpenAI’s GPT3.5 Turbo and the State of AI in Coding, Healthcare, and Education

Join Nathan Labenz and Erik Torenberg as they analyze the latest developments from OpenAI on GPT 3.5, compare GPT to other live player models like Llama2, and discuss the state of AI in coding, education, and healthcare. If you're looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/cognitive We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investmen...

Aug 25, 202354 minSeason 1Ep. 56

E55: Google’s Multimodal Med-PaLM with Vivek Natarajan and Tao Tu

In this episode, Nathan sits down with Vivek Natarajan and Tao Tu of Google’s Med-PaLM, diving into how they used one of the world’s largest medical datasets ever compiled to develop Med-PaLM M, an AI agent specialized in medical tasks. In this episode, they discuss: Med-PaLM M's “clinically superhuman” abilities and limitations, the rigorous testing and validation that went into the model, and their vision for AI to take over repetitive clerical tasks and allow doctors to focus on patients. We'...

Aug 23, 20231 hr 24 minSeason 1Ep. 55