49. Nvidia A100, Training Game AI, Neural Networks | AI Developer Interview

Hot off the heels of the announcement of Nvidia A100, we have an AI Developer on to talk about what these massive GPU’s are actually used for – AI & ML applications.

SPONSOR: https://www.cdkoffers.com
25% Windows Code discount: brokensilicon
3% off all software: dieshrink
Win10 pro oem key 13$: https://bit.ly/2Wdfghh
Win10 Home oem key 10$: https://bit.ly/3dsbSFi
Office 2016 key 27$: https://bit.ly/2Wb3sMx
Office 2019 key 44$: https://bit.ly/2WdfBAz
Win10 pro oem+Office 2016 35$: https://bit.ly/3bkJeVb

1. 1:21 AI Buzzwords & Introductions (some sound issues)
2. 6:03 What is a Neural Network?
3. 12:53 Challenges in Training Neural Networks
4. 16:21 Sparsity and Pruning
5. 24:03 How will AI Improve our Lives?
6. 35:42 Bottlenecks to AI Research
7. 42:03 AI & ML in Gaming
8. 47:38 CUDA Intrenchment, AMD’s ability to enter the market
9. 50:58 Cerebras & Graphcore
10. 55:53 AMD vs Nvidia Graphics
11. 1:03:13 Comparing Synthetic AI to Biological Brains

https://www.thispersondoesnotexist.com/
https://devblogs.nvidia.com/nvidia-ampere-architecture-in-depth/
https://www.cerebras.net/cerebras-wafer-scale-engine-why-we-need-big-chips-for-deep-learning/
https://cirrascale.com/graphcore-cloud.php?utm_term=graphcore&utm_source=adwords&utm_medium=ppc&utm_campaign=Graphcore&hsa_net=adwords&hsa_grp=86815837387&hsa_mt=p&hsa_tgt=kwd-606839681642&hsa_kw=graphcore&hsa_src=g&hsa_acc=2793442874&hsa_cam=8112712212&hsa_ver=3&hsa_ad=397149594120&gclid=CjwKCAjwwYP2BRBGEiwAkoBpAuc9L_R5wt9rbYuJ7jeopg5W5YdYxaFBkNVpQz336TjcNJYg9jyZ2BoCX0MQAvD_BwE
https://arxiv.org/pdf/1803.03635.pdf
https://arxiv.org/pdf/1807.01281.pdf
https://podcasts.google.com/feed/aHR0cHM6Ly9jaGFuZ2Vsb2cuY29tL3ByYWN0aWNhbGFpL2ZlZWQ/episode/Y2hhbmdlbG9nLmNvbS83LzcwNA?hl=en&ved=2ahUKEwiuzYfG_7jpAhUIHs0KHSavAhAQjrkEegQIBxAE&ep=6
https://twimlai.com/upside-down-reinforcement-learning/?fbclid=IwAR18e99xWPGUN0_SVG84IKUaT5KYSKVhzwMdq37goiOdDwRuUf8s9Z_8GSI
https://en.wikipedia.org/wiki/Reinforcement_learning
https://en.wikipedia.org/wiki/Concept_learning
https://en.wikipedia.org/wiki/Unsupervised_learning#cite_note-2
https://arxiv.org/abs/1912.02875
https://arxiv.org/pdf/1912.02877.pdf
https://www.alexirpan.com/2018/02/14/rl-hard.html
https://www.microsoft.com/en-us/research/blog/turing-nlg-a-17-billion-parameter-language-model-by-microsoft/
https://ai.facebook.com/blog/state-of-the-art-open-source-chatbot/
https://openai.com/blog/jukebox/
https://www.pnas.org/content/pnas/116/43/21854.full.pdf