Broken Silicon

49. Nvidia A100, Training Game AI, Neural Networks | AI Developer Interview


Listen Later

Hot off the heels of the announcement of Nvidia A100, we have an AI Developer on to talk about what these massive GPU’s are actually used for – AI & ML applications.

SPONSOR: https://www.cdkoffers.com

25% Windows Code discount: brokensilicon
3% off all software: dieshrink
Win10 pro oem key 13$: https://bit.ly/2Wdfghh
Win10 Home oem key 10$: https://bit.ly/3dsbSFi
Office 2016 key 27$: https://bit.ly/2Wb3sMx
Office 2019 key 44$: https://bit.ly/2WdfBAz
Win10 pro oem+Office 2016 35$: https://bit.ly/3bkJeVb

  1. 1:21 AI Buzzwords & Introductions (some sound issues)
  2. 6:03 What is a Neural Network?
  3. 12:53 Challenges in Training Neural Networks
  4. 16:21 Sparsity and Pruning
  5. 24:03 How will AI Improve our Lives?
  6. 35:42 Bottlenecks to AI Research
  7. 42:03 AI & ML in Gaming
  8. 47:38 CUDA Intrenchment, AMD’s ability to enter the market
  9. 50:58 Cerebras & Graphcore
  10. 55:53 AMD vs Nvidia Graphics
  11. 1:03:13 Comparing Synthetic AI to Biological Brains
  12. https://www.thispersondoesnotexist.com/

    https://devblogs.nvidia.com/nvidia-ampere-architecture-in-depth/
    https://www.cerebras.net/cerebras-wafer-scale-engine-why-we-need-big-chips-for-deep-learning/
    https://cirrascale.com/graphcore-cloud.php?utm_term=graphcore&utm_source=adwords&utm_medium=ppc&utm_campaign=Graphcore&hsa_net=adwords&hsa_grp=86815837387&hsa_mt=p&hsa_tgt=kwd-606839681642&hsa_kw=graphcore&hsa_src=g&hsa_acc=2793442874&hsa_cam=8112712212&hsa_ver=3&hsa_ad=397149594120&gclid=CjwKCAjwwYP2BRBGEiwAkoBpAuc9L_R5wt9rbYuJ7jeopg5W5YdYxaFBkNVpQz336TjcNJYg9jyZ2BoCX0MQAvD_BwE
    https://arxiv.org/pdf/1803.03635.pdf
    https://arxiv.org/pdf/1807.01281.pdf
    https://podcasts.google.com/feed/aHR0cHM6Ly9jaGFuZ2Vsb2cuY29tL3ByYWN0aWNhbGFpL2ZlZWQ/episode/Y2hhbmdlbG9nLmNvbS83LzcwNA?hl=en&ved=2ahUKEwiuzYfG_7jpAhUIHs0KHSavAhAQjrkEegQIBxAE&ep=6
    https://twimlai.com/upside-down-reinforcement-learning/?fbclid=IwAR18e99xWPGUN0_SVG84IKUaT5KYSKVhzwMdq37goiOdDwRuUf8s9Z_8GSI
    https://en.wikipedia.org/wiki/Reinforcement_learning
    https://en.wikipedia.org/wiki/Concept_learning
    https://en.wikipedia.org/wiki/Unsupervised_learning#cite_note-2
    https://arxiv.org/abs/1912.02875
    https://arxiv.org/pdf/1912.02877.pdf
    https://www.alexirpan.com/2018/02/14/rl-hard.html
    https://www.microsoft.com/en-us/research/blog/turing-nlg-a-17-billion-parameter-language-model-by-microsoft/
    https://ai.facebook.com/blog/state-of-the-art-open-source-chatbot/
    https://openai.com/blog/jukebox/
    https://www.pnas.org/content/pnas/116/43/21854.full.pdf

    ...more
    View all episodesView all episodes
    Download on the App Store

    Broken SiliconBy Moore's Law Is Dead, Bleav

    • 4.9
    • 4.9
    • 4.9
    • 4.9
    • 4.9

    4.9

    258 ratings


    More shows like Broken Silicon

    View all
    PC Perspective Podcast by PC Perspective

    PC Perspective Podcast

    191 Listeners

    The CultCast by America's favorite Apple Podcast

    The CultCast

    1,169 Listeners

    CORE - Core Gaming for Core Gamers by Scott Johnson - Jon Jagger - Beau Schwartz

    CORE - Core Gaming for Core Gamers

    295 Listeners

    The WAN Show by Linus Tech Tips

    The WAN Show

    1,111 Listeners

    The Full Nerd by Foundry

    The Full Nerd

    198 Listeners

    The Nerd Nest - A Video Game Podcast by Bill Fairchild

    The Nerd Nest - A Video Game Podcast

    367 Listeners

    Sacred Symbols: A PlayStation Podcast by Last Stand Media & Studio71

    Sacred Symbols: A PlayStation Podcast

    3,354 Listeners

    Self-Hosted by Jupiter Broadcasting

    Self-Hosted

    135 Listeners

    Brad & Will Made a Tech Pod. by Brad Shoemaker, Will Smith

    Brad & Will Made a Tech Pod.

    479 Listeners

    The MinnMax Show by MinnMax

    The MinnMax Show

    2,046 Listeners

    TechLinked by Linus Media Group

    TechLinked

    137 Listeners

    The Nextlander Podcast by The Nextlander Podcast

    The Nextlander Podcast

    1,119 Listeners

    Digital Foundry Direct Weekly by Digital Foundry & Geek Media

    Digital Foundry Direct Weekly

    99 Listeners

    The Jeff Gerstmann Show - A Podcast About Video Games by Jeff Gerstmann | QCODE

    The Jeff Gerstmann Show - A Podcast About Video Games

    1,007 Listeners

    The Hardware Unboxed Podcast by Hardware Unboxed

    The Hardware Unboxed Podcast

    51 Listeners