Practical AI

The landscape of AI infrastructure


Listen Later

Being that this is “practical” AI, we decided that it would be good to take time to discuss various aspects of AI infrastructure. In this full-connected episode, we discuss our personal/local infrastructure along with trends in AI, including infra for training, serving, and data management.

Join the discussion

Changelog++ members support our work, get closer to the metal, and make the ads disappear. Join today!

Sponsors:

  • DigitalOceanCheck out DigitalOcean’s dedicated vCPU Droplets with dedicated vCPU threads. Get started for free with a $100 credit. Learn more at do.co/changelog.
  • DataEngPodcast – A podcast about data engineering and modern data infrastructure.
  • FastlyOur bandwidth partner. Fastly powers fast, secure, and scalable digital experiences. Move beyond your content delivery network to their powerful edge cloud platform. Learn more at fastly.com.
  • RollbarWe move fast and fix things because of Rollbar. Resolve errors in minutes. Deploy with confidence. Learn more at rollbar.com/changelog.
  • Featuring:

    • Chris Benson – Website, GitHub, LinkedIn, X
    • Daniel Whitenack – Website, GitHub, X

    Show Notes:

    Our locally installed stuff:

    • Jupyter
    • Docker
    • Python
    • Go
    • Postman
    • Where we see AI workflows running:

      • AWS
      • GCP
      • Azure
      • Kubernetes and KubeFlow
      • On-prem workstations:
        • NVIDIA
        • Lambda Labs
        • System76
        • Experimentation / model development:

          • JupyterLab
          • Google Colaboratory
          • AWS SageMaker
          • Data Science platforms:
            • Domino
            • DataBricks
            • DataRobot
            • H2O.ai
            • Pipelining and automation:

              • Pachyderm
              • Airflow
              • Luigi
              • Model optimization:
                • OpenVino
                • TensorRT
                • TensorFlow Lite
                • Serving:

                  • MXNet
                  • TensorFlow serving
                  • Seldon
                  • Monitoring/visibility:

                    • TensorBoard
                    • Netron
                    • Knock knock
                    • Prometheus
                    • ElasticSearch
                    • Something missing or broken? PRs welcome!

                      ...more
                      View all episodesView all episodes
                      Download on the App Store

                      Practical AIBy Practical AI LLC

                      • 4.3
                      • 4.3
                      • 4.3
                      • 4.3
                      • 4.3

                      4.3

                      171 ratings


                      More shows like Practical AI

                      View all
                      The AI in Business Podcast by Daniel Faggella

                      The AI in Business Podcast

                      161 Listeners

                      Super Data Science: ML & AI Podcast with Jon Krohn by Jon Krohn

                      Super Data Science: ML & AI Podcast with Jon Krohn

                      298 Listeners

                      NVIDIA AI Podcast by NVIDIA

                      NVIDIA AI Podcast

                      322 Listeners

                      AI Today Podcast by AI & Data Today

                      AI Today Podcast

                      156 Listeners

                      Last Week in AI by Skynet Today

                      Last Week in AI

                      287 Listeners

                      Machine Learning Street Talk (MLST) by Machine Learning Street Talk (MLST)

                      Machine Learning Street Talk (MLST)

                      87 Listeners

                      Me, Myself, and AI by MIT Sloan Management Review and Boston Consulting Group (BCG)

                      Me, Myself, and AI

                      106 Listeners

                      AI Chat: ChatGPT & AI News, Artificial Intelligence, OpenAI, Machine Learning by Jaeden Schafer

                      AI Chat: ChatGPT & AI News, Artificial Intelligence, OpenAI, Machine Learning

                      141 Listeners

                      AI Hustle: Make Money from AI and ChatGPT, Midjourney, NVIDIA, Anthropic, OpenAI by Jaeden Schafer and Jamie McCauley

                      AI Hustle: Make Money from AI and ChatGPT, Midjourney, NVIDIA, Anthropic, OpenAI

                      66 Listeners

                      This Day in AI Podcast by Michael Sharkey, Chris Sharkey

                      This Day in AI Podcast

                      201 Listeners

                      Latent Space: The AI Engineer Podcast by swyx + Alessio

                      Latent Space: The AI Engineer Podcast

                      75 Listeners

                      The AI Daily Brief (Formerly The AI Breakdown): Artificial Intelligence News and Analysis by Nathaniel Whittemore

                      The AI Daily Brief (Formerly The AI Breakdown): Artificial Intelligence News and Analysis

                      462 Listeners

                      Everyday AI Podcast – An AI and ChatGPT Podcast by Everyday AI

                      Everyday AI Podcast – An AI and ChatGPT Podcast

                      94 Listeners

                      A Beginner's Guide to AI by Dietmar Fischer

                      A Beginner's Guide to AI

                      31 Listeners

                      The TED AI Show by TED

                      The TED AI Show

                      46 Listeners