Chaos Lever Podcast

Journey To The Center Of AI [CL80]

Listen Later
Journey To The Center Of AI

Episode: 80

Published: 10/31/2023

How to AI

AI has been in the headlines almost constantly for the last 18 months. But despite all that fanfare, ChatGPT���ing, and Faces being hugged; I have to admit that I still don���t know how it all works. Not that anyone really does, but beyond the prompt text I submit to a Chats GPT or Dalls ‘E’, I don���t know what is happening in the background. What is the software stack powering GPT 4? What type of operating system, orchestrator, and applications allow for the massive training models behind OpenAI? And what about the hardware? I know there���s a lot of GPUs, but there���s got to be more to it than that. I decided to dig into some of these layers to try and trace from the prompt down to the physical servers, and you get to come with me. So get in loser, we���re going to learn how to AI.

  • I bet OpenAI has published something about their stack… sorta
  • According to a post from 2016, OpenAI was using Python, TensorFlow, Numpy, Keras, and Anaconda
  • TensorFlow is a machine learning library with APIs available for Python and C++
  • Numpy is a Python package developed to support scientific computing
  • Flyte, a graduated project from the Linux Foundation that leverages Kubernetes
  • Nvidia H100 Spec Sheet
  • DGX SuperPod
  • Tensor Cores and CUDA cores, what is the difference?
  • Nvidia helpfully posted some example code using the cuDNN library
  • The Infiniband standard is a different protocol than Ethernet
  • Ultra Ethernet Consortium is focused on developing an open standard that meets or exceeds what Infiniband does today
  • Remember when Crypto was using as much power as the country of Argentina
  • AI is already on pace to match that by 2027
  • Microsoft���s AI for Beginners site to get down some of the terminology and lab time
  • You may also want to take a beginner course on Python

    • Intro and outro music by James Bellavance copyright 2022

    ...more
    View all episodesView all episodes
    Download on the App Store
    Chaos Lever PodcastBy Ned Bellavance and Chris Hayner
    • 4.3
    • 4.3
    • 4.3
    • 4.3
    • 4.3

    4.3

    4 ratings

    More shows like Chaos Lever Podcast

    View all
    Uncanny Valley | WIRED by WIRED

    Uncanny Valley | WIRED

    425 Listeners

    The Cloudcast by Massive Studios

    The Cloudcast

    153 Listeners

    Network Break by Packet Pushers

    Network Break

    100 Listeners

    CyberWire Daily by N2K Networks

    CyberWire Daily

    1,007 Listeners

    The Daily by The New York Times

    The Daily

    111,352 Listeners

    Darknet Diaries by Jack Rhysider

    Darknet Diaries

    7,864 Listeners

    Practical AI by Practical AI LLC

    Practical AI

    190 Listeners

    Morning Brew Daily by Morning Brew

    Morning Brew Daily

    2,953 Listeners

    The Prof G Pod with Scott Galloway by Vox Media Podcast Network

    The Prof G Pod with Scott Galloway

    5,304 Listeners

    The Real Python Podcast by Real Python

    The Real Python Podcast

    140 Listeners

    Heavy Strategy by Packet Pushers

    Heavy Strategy

    27 Listeners

    Cables2Clouds by Cables2Clouds

    Cables2Clouds

    11 Listeners

    Packet Protector by Packet Pushers

    Packet Protector

    6 Listeners

    Network Automation Nerds by Packet Pushers

    Network Automation Nerds

    3 Listeners

    Total Network Operations by Packet Pushers

    Total Network Operations

    3 Listeners