The Attention Mechanism with Andrew Mayne - podcast cover

The Attention Mechanism with Andrew Mayne

Dog and Pony Show Audio Productions shows.acast.com

Andrew Mayne, former science communicator at OpenAI, takes you through the latest in Artificial Intelligence.


Hosted by Justin Robert Young.

Hosted on Acast. See acast.com/privacy for more information.

Episodes

From I/O to io

Justin and Andrew discuss Google I/O, focusing on the Veo 3 video generation model, its capabilities, costs, and Google's high-tier pricing strategy. They also touch on Anthropic's new models and address a controversial misunderstanding about their safety features. The main focus shifts to OpenAI's significant partnership with Jony Ive, exploring the historical parallels to Apple, speculation around their potential hardware device, and the future of AI interfaces beyond screens.

May 27, 202539 min

Apple's AI Dilemma

Justin and Andrew delve into Apple's challenges in the AI race, examining how they missed key opportunities with LLMs and the stagnation of Siri. They discuss the broader implications for search engines and Google's market position due to AI, and explore the revolutionary potential of the new Model Context Protocol (MCP) for creating agentic AI applications and redefining web interaction.

May 20, 202539 min

AGI is a Vibe Now

Justin and Andrew explore the complex debate around Artificial General Intelligence (AGI), discussing whether recent AI models have already achieved AGI or if the definition itself is subjective. They examine Tyler Cowen's "AGI moment," the challenges of evaluating AI capabilities, and the concept of a "jagged frontier" in AI development. The conversation also covers the practical implications of AGI, the potential for task-specific AI evaluations, and the societal impact of these advancements.

Apr 22, 202530 min

The Tip Jar AI Model

Meta announces not one, not two, but three LLaMA 4 models — and somehow the most impressive one isn’t actually available. Andrew and Justin dive into the weird timing of the release, the confusion around Chatbot Arena scores, and why the open-weight community is raising eyebrows. Plus: what does “open” really mean anymore, and are we on the edge of an eval collapse? Chapters 00:00 - Intro 00:30 - Llama 4 06:01 - Open Source vs. Open Weight 11:54 - AI Monetization 21:37 - A Pending Eval Crisis? 3...

Apr 08, 202532 min

Manus a Manus

Andrew and Justin discuss Manus AI from hype to results. Hosted on Acast. See acast.com/privacy for more information.

Mar 15, 202532 min

Perplexity's Comet

Agentic browsers are coming. What should we — and Google — expect? Chapters 00:00 Intro and Grok's Hardcoded AI Bias 06:43 Claude 3.7 Sonnet is Here 13:06 Agentic Browsers and the Future of Web Interaction 19:11 The Impending Disruption of Google Search 26:46 Veo 2's Avengers-sized pricing 36:11 Outro Hosted on Acast. See acast.com/privacy for more information....

Feb 25, 202537 min

Is Grok Tops?

Grok3 is out. Is it the best AI in the world? Chapters 00:00 Introduction to AI and Quantum Computing 03:00 Grok 3 and Its Implications 06:13 Evaluating Grok 3's Performance 08:55 The AI Chatbot Arena 12:10 Comparative Analysis of AI Models 14:54 The Future of AI Development 18:14 Elon Musk and the AI Landscape 20:57 Conclusion and Future Outlook Hosted on Acast. See acast.com/privacy for more information....

Feb 20, 202528 min

Wait? Which Browser Agent?

Justin and Andrew discuss the rapid advancements in AI browser agents, focusing on Operator and the newly launched Proxy. They explore the capabilities and limitations of these tools, comparing their performance on tasks like news aggregation. The conversation shifts to the broader impact of AI on automation, entrepreneurship, and the future job market, emphasizing the importance of adapting skills and embracing new opportunities.

Feb 12, 202530 min

Deep Into Deep Research

DeepSeek rioted the markets last week and this week OpenAI releases o3 and Deep Research. What does it mean? We tell you! Hosted on Acast. See acast.com/privacy for more information.

Feb 04, 202534 min

Is DeepSeek A Game Changer?

Chapters 00:00 The Rise of DeepSeek 05:50 Market Reactions: Understanding the Financial Impact 11:40 Innovation and Efficiency: The Future of AI Models 17:14 China's Role in AI Development: Opportunities and Concerns 23:13 The Compute Debate: Training vs. Operation 29:27 Cultural Relevance and the Future of AI 35:39 The Road Ahead: Predictions and Opportunities Hosted on Acast. See acast.com/privacy for more information....

Jan 28, 202540 min

To The Cosmos

Justin and Andrew discuss their holiday experiences, particularly focusing on theme parks and the latest innovations in technology. They delve into Nvidia's Cosmos, a generative video model for robotics, and the implications of AI export restrictions proposed by the Biden administration. The conversation wraps up with a review of the Meta Ray Bans, highlighting their functionality and potential in everyday use. Chapters 00:00 Welcome Back and Holiday Reflections 03:01 Theme Park Experiences and ...

Jan 14, 202530 min

Putting AI Research To The Test

Justin Young and Andrew Mayne discuss Shipmas as well as a major update in the Hunter DeButts controversy and a look at the capabilities of Google's new deep research service. Hosted on Acast. See acast.com/privacy for more information.

Dec 17, 202438 min

Sora Debuts

Andrew Mayne and Justin Robert Young discuss the recent announcements from OpenAI, particularly focusing on the launch of Sora, OpenAI's new video engine. They explore the features of Sora, the pricing models introduced, and the implications of AI development in the current tech landscape, especially in relation to Google. The discussion also touches on the collaborative features of Sora, the advancements in AI model trainability, and the overall excitement surrounding the future of AI technolog...

Dec 10, 202435 min

No Code No Problem

Justin Robert Young and Andrew Mayne discuss the rise of no-code and low-code platforms that empower users to create applications without extensive coding knowledge. The duo also delves into the implications of AI on the job market, emphasizing the shift towards gig work and the importance of financial literacy in navigating this new landscape. They highlight the need for adaptability and the potential for AI to enhance productivity and creativity in the workplace. Chapters 00:00 The Rise of AI ...

Nov 26, 202446 min

Apple Intelligence First Impressions

Justin Robert Young and Andrew Mayne discuss the new Apple Intelligence 18.2 beta, sharing their personal experiences and insights on its features and usability. They explore the integration of AI in mobile technology, particularly its potential in medical diagnostics, and the ethical considerations surrounding AI's role in healthcare. Chapters 00:00 Introduction to Apple Intelligence 18.2 Beta 03:14 Personal Experiences with AI Integration 05:55 Exploring Features and Functionality 08:57 The Fu...

Nov 19, 202432 min

Did AI Hit A Wall?

Justin Robert Young and Andrew Mayne discuss the evolving landscape of AI in the context of recent political changes, economic implications, and the current state of technology. They explore how AI has become integral to American society, the challenges of legislating rapidly advancing technology, and the potential for economic growth driven by AI innovation. The discussion also touches on the perceived limitations of AI and the importance of hands-on experience with the technology. Chapters 00:...

Nov 12, 202431 min

Time To Slow Down?

Justin Robert Young and Andrew Mayne discuss the rapid evolution of AI technology, the concerns surrounding its development speed, and the differing perspectives between technical and non-technical experts. They explore the ethical implications of slowing down AI advancements, the potential economic disruptions caused by AI, and the importance of government regulation in the AI industry. The discussion also touches on pricing strategies of AI models and the future of AI conversations as society ...

Nov 05, 202434 min

Automation

Justin Robert Young and Andrew Mayne discuss the latest advancements in AI technology, focusing on Meta's Notebook Llama, automation's role in the future, and Apple's new AI features. Hosted on Acast. See acast.com/privacy for more information.

Oct 29, 202433 min

Reasoning with Apple's Reasoning Paper

Justin Robert Young and Andrew Mayne delve into the implications of Apple's Intelligence update and the broader landscape of AI development. They discuss the complexities of AI reasoning, the limitations of current models, and the ongoing debates surrounding artificial general intelligence (AGI). The conversation also touches on the challenges of overfitting in AI, the importance of niche solutions in the startup ecosystem, and the potential for AI to enhance various business processes. They con...

Oct 22, 202446 min

Voice Cloning Isn't Going Away

Justin Robert Young and Andrew Mayne delve into voice cloning and video models. They discuss the technical challenges, ethical implications, and the potential for misuse of voice cloning technology, as well as the advancements in video generation models. The conversation also touches on Apple's upcoming AI features and the broader implications of these technologies on communication and society. Chapters 00:00 The Rise of Voice Cloning Technology 14:24 Advancements in Video Models 22:06 The Futur...

Oct 15, 202443 min

A Podcast About NotebookLM's Podcasts

Justin Robert Young and Andrew Mayne discuss the latest innovations from Google, particularly focusing on Notebook LM and its viral success. They explore the implications of AI voice interaction, the role of AI in parenting and education, and the ethical considerations surrounding AI advertising. The discussion also touches on the evolution of Google's business model, the importance of trust in AI, and the rapid development of AI tools and applications that are reshaping society. Hosted on Acast...

Oct 08, 202442 min

California AI Bill Vetoed

In this conversation, Justin Robert Young and Andrew Mayne discuss the recent developments in AI regulation in California, particularly the controversial bill that was vetoed by Governor Gavin Newsom. They explore the implications of this decision for the future of AI legislation and the importance of fostering a nurturing environment for responsible AI development. The discussion then shifts to Google's new AI tool, Notebook LM, and its innovative features. They also delve into the concept of c...

Oct 01, 202447 min

OpenAI Closes Biggest Funding Round In History

Justin Robert Young and Andrew Mayne discuss the recent financial developments surrounding OpenAI, including their significant funding round of $6.5 billion. They explore the implications of this funding for the AI industry, OpenAI's relationship with Microsoft, and the broader landscape of artificial intelligence. The conversation also touches on Sam Altman's optimistic vision for the future of AI and the societal changes that may arise as AI technology continues to evolve. Hosted on Acast. See...

Sep 24, 202444 min

o1

In this episode of The Attention Mechanism, hosts Justin Robert Young and Andrew Mayne delve into the evolving landscape of AI, focusing on the new O1 model from OpenAI. They discuss the transition from base models to instruction models, the significance of prompting techniques, and the implications of AI in coding and other fields. The conversation also touches on the potential of AI to revolutionize workflows, the challenges of evaluating AI performance, and the broader context of AI's role in...

Sep 17, 202446 min

Is OpenAI Going Broke?

The conversation explores the financial challenges faced by OpenAI and the future of AI search. OpenAI's high burn rate is attributed to the intensive operations required to train and build new AI models. However, the report of OpenAI losing $5 billion for the year is misleading, as it fails to consider the capital costs and the potential growth of the business. The success of OpenAI's ChatGPT, which has doubled its enterprise customers in just four months, indicates the potential for AI models ...

Sep 14, 202439 min

Why AI Will Revolutionize Robotics

The conversation explores the boom in robotics due to advancements in AI, specifically language models. The ability to have fine motor control and real-world understanding is crucial in robotics. With the development of language models, robotics can now have complex scene understanding and reasoning capabilities. This revolution in robotics will lead to increased capabilities and opportunities in various industries. The conversation also touches on the importance of trust and the need for AI pro...

Sep 14, 202446 min

Understanding AGI

The conversation explores the concept of AGI (Artificial General Intelligence) and its definition. It delves into the importance of crossing the threshold of AGI and the potential dangers and benefits it presents. The conversation also discusses the humor capabilities of AI models, specifically ChatGPT, and how they compare to human-produced humor. The discussion touches on the limitations and challenges of Chinese open source models due to censorship and the need to navigate sensitive topics. O...

Sep 14, 202448 min

The Role of Government in AI Regulation

The conversation explores the emerging AI elements in the platforms of political parties as they vie for the presidency. It discusses the different approaches to AI regulation, such as the California bill proposed by Scott Wiener and the European bill. The challenges of defining and enforcing AI regulations are highlighted, including the potential impact on smaller companies and the ambiguity of defining systemic risk models. The conversation also touches on the need for AI safety and security m...

Sep 14, 202440 min

The Possibility of an AI Bubble

Justin Young and Andrew Maine discuss OpenAI's new Search GPT, exploring its implications for the search engine landscape and the potential challenges it poses to established players like Google. They delve into the user experience of AI-driven search, the competitive dynamics in the market, and the broader implications of AI investments, including the potential for an AI bubble. The discussion highlights the promise of AI technology while acknowledging the challenges of implementation and marke...

Sep 14, 202441 min
For the best experience, listen in Metacast app for iOS or Android
Open in Metacast