EP52: The Groq Breakthrough, Google's Gemma 7B, Unlimited Context, Can 'Magic' Reason?

This Day in AI Podcast

Feb 22, 2024•55 min•Ep. 52

--:--

Listen in podcast apps:

Apple Podcasts

Spotify

Download

Listen to this episode in Metacast mobile app

Don't just listen to podcasts. Learn from them with transcripts, summaries, and chapters for every episode. Skim, search, and bookmark insights. Learn more

Episode description

Show notes: https://thisdayinai.com/bookmarks/32-ep52
Groq Mixtral: https://simtheory.ai/agent/567-groq-mixtral-edition
Groq Llama: https://simtheory.ai/agent/566-groq-the-speed-oriented-chat-companion
SimTheory: https://simtheory.ai
====
This week we discuss Groq's LPU Chips and the implications of low cost low latency LLMs on custom hardware. We revisit our prank calling to see if Groq's low latency gives an advantage and see if we can improve Air Canada's chatbot. We discuss the launch of Google's Open Source Gamma 7B release and Magic's $148M fundraise for an AI co-worker who can reason. We also cover ChatGPT losing it's mind during the week.

If you like the show, please consider subscribing. Thanks for listening.

====
Chapters:
00:00 - Groq, Groq API and Retell with Groq
32:48 - Google Gemma 7B Open Source Model
39:04 - The 'Magic' Breakthrough on Reasoning and Context
50:19 - Sounds for OpenAI Sora Thanks to ElevenLabs Sound FX
51:59 - ChatGPT Goes Haywire

For the best experience, listen in Metacast app for iOS or Android