Broken Silicon

49. Nvidia A100, Training Game AI, Neural Networks | AI Developer Interview


Listen Later

Hot off the heels of the announcement of Nvidia A100, we have an AI Developer on to talk about what these massive GPU’s are actually used for – AI & ML applications.

SPONSOR: https://www.cdkoffers.com

25% Windows Code discount: brokensilicon
3% off all software: dieshrink
Win10 pro oem key 13$: https://bit.ly/2Wdfghh
Win10 Home oem key 10$: https://bit.ly/3dsbSFi
Office 2016 key 27$: https://bit.ly/2Wb3sMx
Office 2019 key 44$: https://bit.ly/2WdfBAz
Win10 pro oem+Office 2016 35$: https://bit.ly/3bkJeVb

  1. 1:21 AI Buzzwords & Introductions (some sound issues)
  2. 6:03 What is a Neural Network?
  3. 12:53 Challenges in Training Neural Networks
  4. 16:21 Sparsity and Pruning
  5. 24:03 How will AI Improve our Lives?
  6. 35:42 Bottlenecks to AI Research
  7. 42:03 AI & ML in Gaming
  8. 47:38 CUDA Intrenchment, AMD’s ability to enter the market
  9. 50:58 Cerebras & Graphcore
  10. 55:53 AMD vs Nvidia Graphics
  11. 1:03:13 Comparing Synthetic AI to Biological Brains
  12. https://www.thispersondoesnotexist.com/

    https://devblogs.nvidia.com/nvidia-ampere-architecture-in-depth/
    https://www.cerebras.net/cerebras-wafer-scale-engine-why-we-need-big-chips-for-deep-learning/
    https://cirrascale.com/graphcore-cloud.php?utm_term=graphcore&utm_source=adwords&utm_medium=ppc&utm_campaign=Graphcore&hsa_net=adwords&hsa_grp=86815837387&hsa_mt=p&hsa_tgt=kwd-606839681642&hsa_kw=graphcore&hsa_src=g&hsa_acc=2793442874&hsa_cam=8112712212&hsa_ver=3&hsa_ad=397149594120&gclid=CjwKCAjwwYP2BRBGEiwAkoBpAuc9L_R5wt9rbYuJ7jeopg5W5YdYxaFBkNVpQz336TjcNJYg9jyZ2BoCX0MQAvD_BwE
    https://arxiv.org/pdf/1803.03635.pdf
    https://arxiv.org/pdf/1807.01281.pdf
    https://podcasts.google.com/feed/aHR0cHM6Ly9jaGFuZ2Vsb2cuY29tL3ByYWN0aWNhbGFpL2ZlZWQ/episode/Y2hhbmdlbG9nLmNvbS83LzcwNA?hl=en&ved=2ahUKEwiuzYfG_7jpAhUIHs0KHSavAhAQjrkEegQIBxAE&ep=6
    https://twimlai.com/upside-down-reinforcement-learning/?fbclid=IwAR18e99xWPGUN0_SVG84IKUaT5KYSKVhzwMdq37goiOdDwRuUf8s9Z_8GSI
    https://en.wikipedia.org/wiki/Reinforcement_learning
    https://en.wikipedia.org/wiki/Concept_learning
    https://en.wikipedia.org/wiki/Unsupervised_learning#cite_note-2
    https://arxiv.org/abs/1912.02875
    https://arxiv.org/pdf/1912.02877.pdf
    https://www.alexirpan.com/2018/02/14/rl-hard.html
    https://www.microsoft.com/en-us/research/blog/turing-nlg-a-17-billion-parameter-language-model-by-microsoft/
    https://ai.facebook.com/blog/state-of-the-art-open-source-chatbot/
    https://openai.com/blog/jukebox/
    https://www.pnas.org/content/pnas/116/43/21854.full.pdf

    ...more
    View all episodesView all episodes
    Download on the App Store

    Broken SiliconBy Moore's Law Is Dead, Bleav

    • 4.9
    • 4.9
    • 4.9
    • 4.9
    • 4.9

    4.9

    258 ratings


    More shows like Broken Silicon

    View all
    Game Scoop! by IGN & Geek Media

    Game Scoop!

    4,034 Listeners

    The CultCast by America's favorite Apple Podcast

    The CultCast

    1,155 Listeners

    9to5Mac Happy Hour by 9to5Mac

    9to5Mac Happy Hour

    717 Listeners

    The WAN Show by Linus Tech Tips

    The WAN Show

    1,103 Listeners

    The Full Nerd by Foundry

    The Full Nerd

    196 Listeners

    The Engadget Podcast by Engadget

    The Engadget Podcast

    137 Listeners

    SpawnCast by Spawn Wave

    SpawnCast

    312 Listeners

    Sacred Symbols: A PlayStation Podcast by Last Stand Media & Studio71

    Sacred Symbols: A PlayStation Podcast

    3,332 Listeners

    Nate The Hate by Direct Feed Games, Nate The Hate, Modern Vintage Gamer

    Nate The Hate

    94 Listeners

    Defining Duke: An Xbox Podcast by Last Stand Media & Studio71

    Defining Duke: An Xbox Podcast

    859 Listeners

    Genius Bar by Audioboom

    Genius Bar

    1,043 Listeners

    TechLinked by Linus Media Group

    TechLinked

    139 Listeners

    Digital Foundry Direct Weekly by Digital Foundry & Geek Media

    Digital Foundry Direct Weekly

    91 Listeners

    The Hardware Unboxed Podcast by Hardware Unboxed

    The Hardware Unboxed Podcast

    51 Listeners

    Summon Sign: A Gaming Conversation by Last Stand Media & Studio71

    Summon Sign: A Gaming Conversation

    244 Listeners