Episode description
Episode description
Jeremy Howard is a co-founder of fast.ai, the non-profit research group behind the popular massive open online course "Practical Deep Learning for Coders", and the open source deep learning library "fastai".
Jeremy is also a co-founder of #Masks4All, a global volunteer organization founded in March 2020 that advocated for the public adoption of homemade face masks in order to help slow the spread of COVID-19. His Washington Post article "Simple DIY masks could help flatten the curve." went viral in late March/early April 2020, and is associated with the U.S CDC's change in guidance a few days later to recommend wearing masks in public.
In this episode, Jeremy explains how diffusion works and how individuals with limited compute budgets can engage meaningfully with large, state-of-the-art models. Then, as our first-ever repeat guest on Gradient Dissent, Jeremy revisits a previous conversation with Lukas on Python vs. Julia for machine learning.
Finally, Jeremy shares his perspective on the early days of COVID-19, and what his experience as one of the earliest and most high-profile advocates for widespread mask-wearing was like.
Show notes (transcript and links): http://wandb.me/gd-jeremy-howard-2
---
⏳ Timestamps:
0:00 Intro
1:06 Diffusion and generative models
14:40 Engaging with large models meaningfully
20:30 Jeremy's thoughts on Stable Diffusion and OpenAI
26:38 Prompt engineering and large language models
32:00 Revisiting Julia vs. Python
40:22 Jeremy's science advocacy during early COVID days
1:01:03 Researching how to improve children's education
1:07:43 The importance of executive buy-in
1:11:34 Outro
1:12:02 Bonus: Weights & Biases
---
📝 Links
📍 Jeremy's previous Gradient Dissent episode (8/25/2022): http://wandb.me/gd-jeremy-howard
📍 "Simple DIY masks could help flatten the curve. We should all wear them in public.", Jeremy's viral Washington Post article: https://www.washingtonpost.com/outlook/2020/03/28/masks-all-coronavirus/
📍 "An evidence review of face masks against COVID-19" (Howard et al., 2021), one of the first peer-reviewed papers on the effectiveness of wearing masks: https://www.pnas.org/doi/10.1073/pnas.2014564118
📍 Jeremy's Twitter thread summary of "An evidence review of face masks against COVID-19": https://twitter.com/jeremyphoward/status/1348771993949151232
📍 Read more about Jeremy's mask-wearing advocacy: https://www.smh.com.au/world/north-america/australian-expat-s-push-for-universal-mask-wearing-catches-fire-in-the-us-20200401-p54fu2.html
---
Connect with Jeremy and fast.ai:
📍 Jeremy on Twitter: https://twitter.com/jeremyphoward
📍 fast.ai on Twitter: https://twitter.com/FastDotAI
📍 Jeremy on LinkedIn: https://www.linkedin.com/in/howardjeremy/
---
💬 Host: Lukas Biewald
📹 Producers: Riley Fields, Angelica Pan