#75- Mixtral and Mixture of Experts.
Jan 18, 2024•11 min
Listen to this episode in Metacast mobile app
Don't just listen to podcasts. Learn from them with transcripts, summaries, and chapters for every episode. Skim, search, and bookmark insights. Learn more
Episode description
Hey guys, in this episode I talk about Mixture Of Experts, more specifically about Mixtral, which is today the best open-source LLM available, and also better than ChatGPT 3.5 and Gemini Pro.
Mixtral paper: https://arxiv.org/pdf/2401.04088.pdf
Mixtral model: https://huggingface.co/mistralai/Mixtral-8x7B-v0.1
Mixtral YouTube: https://www.youtube.com/watch?v=mwO6v4BlgZQ
Instagram: https://www.instagram.com/podcast.lifewithai
For the best experience, listen in Metacast app for iOS or Android