Broken Silicon

49. Nvidia A100, Training Game AI, Neural Networks | AI Developer Interview


Listen Later

Hot off the heels of the announcement of Nvidia A100, we have an AI Developer on to talk about what these massive GPU’s are actually used for – AI & ML applications.

SPONSOR: https://www.cdkoffers.com

25% Windows Code discount: brokensilicon
3% off all software: dieshrink
Win10 pro oem key 13$: https://bit.ly/2Wdfghh
Win10 Home oem key 10$: https://bit.ly/3dsbSFi
Office 2016 key 27$: https://bit.ly/2Wb3sMx
Office 2019 key 44$: https://bit.ly/2WdfBAz
Win10 pro oem+Office 2016 35$: https://bit.ly/3bkJeVb

  1. 1:21 AI Buzzwords & Introductions (some sound issues)
  2. 6:03 What is a Neural Network?
  3. 12:53 Challenges in Training Neural Networks
  4. 16:21 Sparsity and Pruning
  5. 24:03 How will AI Improve our Lives?
  6. 35:42 Bottlenecks to AI Research
  7. 42:03 AI & ML in Gaming
  8. 47:38 CUDA Intrenchment, AMD’s ability to enter the market
  9. 50:58 Cerebras & Graphcore
  10. 55:53 AMD vs Nvidia Graphics
  11. 1:03:13 Comparing Synthetic AI to Biological Brains
  12. https://www.thispersondoesnotexist.com/

    https://devblogs.nvidia.com/nvidia-ampere-architecture-in-depth/
    https://www.cerebras.net/cerebras-wafer-scale-engine-why-we-need-big-chips-for-deep-learning/
    https://cirrascale.com/graphcore-cloud.php?utm_term=graphcore&utm_source=adwords&utm_medium=ppc&utm_campaign=Graphcore&hsa_net=adwords&hsa_grp=86815837387&hsa_mt=p&hsa_tgt=kwd-606839681642&hsa_kw=graphcore&hsa_src=g&hsa_acc=2793442874&hsa_cam=8112712212&hsa_ver=3&hsa_ad=397149594120&gclid=CjwKCAjwwYP2BRBGEiwAkoBpAuc9L_R5wt9rbYuJ7jeopg5W5YdYxaFBkNVpQz336TjcNJYg9jyZ2BoCX0MQAvD_BwE
    https://arxiv.org/pdf/1803.03635.pdf
    https://arxiv.org/pdf/1807.01281.pdf
    https://podcasts.google.com/feed/aHR0cHM6Ly9jaGFuZ2Vsb2cuY29tL3ByYWN0aWNhbGFpL2ZlZWQ/episode/Y2hhbmdlbG9nLmNvbS83LzcwNA?hl=en&ved=2ahUKEwiuzYfG_7jpAhUIHs0KHSavAhAQjrkEegQIBxAE&ep=6
    https://twimlai.com/upside-down-reinforcement-learning/?fbclid=IwAR18e99xWPGUN0_SVG84IKUaT5KYSKVhzwMdq37goiOdDwRuUf8s9Z_8GSI
    https://en.wikipedia.org/wiki/Reinforcement_learning
    https://en.wikipedia.org/wiki/Concept_learning
    https://en.wikipedia.org/wiki/Unsupervised_learning#cite_note-2
    https://arxiv.org/abs/1912.02875
    https://arxiv.org/pdf/1912.02877.pdf
    https://www.alexirpan.com/2018/02/14/rl-hard.html
    https://www.microsoft.com/en-us/research/blog/turing-nlg-a-17-billion-parameter-language-model-by-microsoft/
    https://ai.facebook.com/blog/state-of-the-art-open-source-chatbot/
    https://openai.com/blog/jukebox/
    https://www.pnas.org/content/pnas/116/43/21854.full.pdf


    Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.

    ...more
    View all episodesView all episodes
    Download on the App Store

    Broken SiliconBy Moore's Law Is Dead, Bleav

    • 4.9
    • 4.9
    • 4.9
    • 4.9
    • 4.9

    4.9

    257 ratings


    More shows like Broken Silicon

    View all
    The WAN Show by Linus Tech Tips

    The WAN Show

    1,179 Listeners

    Game Scoop! by IGN & Geek Media

    Game Scoop!

    4,071 Listeners

    Beyond by IGN & Geek Media

    Beyond

    3,929 Listeners

    Unlocked by IGN & Geek Media

    Unlocked

    2,793 Listeners

    ACG - The Best Gaming Podcast by Jeremy Penter

    ACG - The Best Gaming Podcast

    406 Listeners

    The XB2 — A Gaming Podcast by Rand & Jez

    The XB2 — A Gaming Podcast

    253 Listeners

    The Full Nerd Podcast by Adam Patrick Murray, Brad Chacos, Alaina Yee, Will Smith

    The Full Nerd Podcast

    201 Listeners

    SpawnCast by Spawn Wave

    SpawnCast

    323 Listeners

    Sacred Symbols: A PlayStation Podcast by Last Stand Media & Studio71

    Sacred Symbols: A PlayStation Podcast

    3,373 Listeners

    Defining Duke: An Xbox Podcast by Last Stand Media & Studio71

    Defining Duke: An Xbox Podcast

    872 Listeners

    TechLinked by Linus Media Group

    TechLinked

    140 Listeners

    Digital Foundry Direct Weekly by Digital Foundry

    Digital Foundry Direct Weekly

    106 Listeners

    Friends Per Second by Friends Per Second

    Friends Per Second

    380 Listeners

    The Hardware Unboxed Podcast by Hardware Unboxed

    The Hardware Unboxed Podcast

    52 Listeners

    Next-Gen Console Watch by IGN & Geek Media

    Next-Gen Console Watch

    15 Listeners