Practical AI

The landscape of AI infrastructure

Listen Later

Being that this is “practical” AI, we decided that it would be good to take time to discuss various aspects of AI infrastructure. In this full-connected episode, we discuss our personal/local infrastructure along with trends in AI, including infra for training, serving, and data management.

Join the discussion

Changelog++ members support our work, get closer to the metal, and make the ads disappear. Join today!

Sponsors:

  • DigitalOcean – Check out DigitalOcean’s dedicated vCPU Droplets with dedicated vCPU threads. Get started for free with a $100 credit. Learn more at do.co/changelog.
  • DataEngPodcast – A podcast about data engineering and modern data infrastructure.
  • Fastly – Our bandwidth partner. Fastly powers fast, secure, and scalable digital experiences. Move beyond your content delivery network to their powerful edge cloud platform. Learn more at fastly.com.
  • Rollbar – We move fast and fix things because of Rollbar. Resolve errors in minutes. Deploy with confidence. Learn more at rollbar.com/changelog.

    • Featuring:

    • Chris Benson – Website, GitHub, LinkedIn, X
    • Daniel Whitenack – Website, GitHub, X

    Show Notes:

    Our locally installed stuff:

    • Jupyter
    • Docker
    • Python
    • Go
    • Postman

      • Where we see AI workflows running:

      • AWS
      • GCP
      • Azure
      • Kubernetes and KubeFlow
      • On-prem workstations:
        • NVIDIA
        • Lambda Labs
        • System76

          • Experimentation / model development:

          • JupyterLab
          • Google Colaboratory
          • AWS SageMaker
          • Data Science platforms:
            • Domino
            • DataBricks
            • DataRobot
            • H2O.ai

              • Pipelining and automation:

              • Pachyderm
              • Airflow
              • Luigi
              • Model optimization:
                • OpenVino
                • TensorRT
                • TensorFlow Lite

                  • Serving:

                  • MXNet
                  • TensorFlow serving
                  • Seldon

                    • Monitoring/visibility:

                    • TensorBoard
                    • Netron
                    • Knock knock
                    • Prometheus
                    • ElasticSearch

                      • Something missing or broken? PRs welcome!

                      ...more
                      View all episodesView all episodes
                      Download on the App Store
                      Practical AIBy Practical AI LLC
                      • 4.4
                      • 4.4
                      • 4.4
                      • 4.4
                      • 4.4

                      4.4

                      185 ratings

                      More shows like Practical AI

                      View all
                      The AI in Business Podcast by Daniel Faggella

                      The AI in Business Podcast

                      171 Listeners

                      Super Data Science: ML & AI Podcast with Jon Krohn by Jon Krohn

                      Super Data Science: ML & AI Podcast with Jon Krohn

                      303 Listeners

                      NVIDIA AI Podcast by NVIDIA

                      NVIDIA AI Podcast

                      334 Listeners

                      Last Week in AI by Skynet Today

                      Last Week in AI

                      306 Listeners

                      Machine Learning Street Talk (MLST) by Machine Learning Street Talk (MLST)

                      Machine Learning Street Talk (MLST)

                      96 Listeners

                      Me, Myself, and AI by MIT Sloan Management Review

                      Me, Myself, and AI

                      110 Listeners

                      AI Chat: ChatGPT, AI News, Artificial Intelligence, OpenAI, Machine Learning by Jaeden Schafer

                      AI Chat: ChatGPT, AI News, Artificial Intelligence, OpenAI, Machine Learning

                      154 Listeners

                      This Day in AI Podcast by Michael Sharkey, Chris Sharkey

                      This Day in AI Podcast

                      228 Listeners

                      The AI Daily Brief: Artificial Intelligence News and Analysis by Nathaniel Whittemore

                      The AI Daily Brief: Artificial Intelligence News and Analysis

                      616 Listeners

                      AI For Humans: Making Artificial Intelligence Fun & Practical by Kevin Pereira & Gavin Purcell

                      AI For Humans: Making Artificial Intelligence Fun & Practical

                      273 Listeners

                      Everyday AI Podcast – An AI and ChatGPT Podcast by Everyday AI

                      Everyday AI Podcast – An AI and ChatGPT Podcast

                      109 Listeners

                      A Beginner's Guide to AI by Dietmar Fischer

                      A Beginner's Guide to AI

                      53 Listeners

                      AI Hustle: Make Money from AI and ChatGPT, Midjourney, NVIDIA, Anthropic, OpenAI by Jaeden Schafer and Jamie McCauley

                      AI Hustle: Make Money from AI and ChatGPT, Midjourney, NVIDIA, Anthropic, OpenAI

                      173 Listeners

                      AI + a16z by a16z

                      AI + a16z

                      36 Listeners

                      The TED AI Show by TED

                      The TED AI Show

                      48 Listeners