Edge Devices and LLMs: What's Ahead for AI
Jun 12, 2024•42 min•Ep. 270
Listen to this episode in Metacast mobile app
Don't just listen to podcasts. Learn from them with transcripts, summaries, and chapters for every episode. Skim, search, and bookmark insights. Learn more
Episode description
In this episode of the Altium OnTrack podcast, host Tech Consultant Zach Peterson explores the fascinating world of Edge AI and how Large Language Models (LLMs) fit into the picture with Jan Jongboom, co-founder of Edge Impulse. The two discuss the evolution from GPT-2 to GPT-4, the importance of edge computing, and the hardware requirements for running AI on edge devices. Discover how reducing the size of LLMs enables efficient deployment on edge devices, gain insights into the practical applications of AI in various industries, and learn about EDGE IMPULSE.
More resources:
- Getting started w/ Edge Impulse on Renesas platforms
- Connect with Jan on LinkedIn
- Learn more about Edge Impulse
- Check out a recent video from Edge Impulse: Using GPT-4o to train a 2,000,000x smaller model (that runs directly on device)
- Exclusive 15 Days Free Altium Designer Access
For the best experience, listen in Metacast app for iOS or Android