Practical AI

Practical AI

By Daniel Whitenack and Chris BensonTechnology
Download on the App Store
  • Favorites

    316

    Followers

  • Latest release

    3 days ago

  • Typical duration

    47 min

    per episode

Based on Podcast App listening data

All Practical AI episodes

  • AI's impact on developers

    Chris & Daniel are out this week, so we’re bringing you a panel discussion from All Things Open 2023 moderated by Jerod Santo (Practical AI producer and co-host of The Changelog) and featuring keynoters Emily Freeman and James Q Quick.


    Sponsors:

    • Neo4j – NODES 2023 is coming in October! 
    • Fastly – Our bandwidth partner. Fastly powers fast, secure, and scalable digital experiences. Move beyond your content delivery network to their powerful edge cloud platform. Learn more at fastly.com
    • Fly.io – The home of Changelog.com — Deploy your apps and databases close to your users. In minutes you can run your Ruby, Go, Node, Deno, Python, or Elixir app (and databases!) all over the world. No ops required. Learn more at fly.io/changelog and check out the speedrun in their docs. 

    Featuring:

    • Emily Freeman – Website, GitHub, Mastodon, X
    • James Q Quick – Website, GitHub, X
    • Jerod Santo – GitHub, LinkedIn, Mastodon, X

    Upcoming Events: 

    • Register for upcoming webinars here!
    49 min
  • Generative models: exploration to deployment

    What is the model lifecycle like for experimenting with and then deploying generative AI models? Although there are some similarities, this lifecycle differs somewhat from previous data science practices in that models are typically not trained from scratch (or even fine-tuned). Chris and Daniel give a high level overview in this effort and discuss model optimization and serving.


    Sponsors:

    • Neo4j – NODES 2023 is coming in October! 
    • Fastly – Our bandwidth partner. Fastly powers fast, secure, and scalable digital experiences. Move beyond your content delivery network to their powerful edge cloud platform. Learn more at fastly.com
    • Fly.io – The home of Changelog.com — Deploy your apps and databases close to your users. In minutes you can run your Ruby, Go, Node, Deno, Python, or Elixir app (and databases!) all over the world. No ops required. Learn more at fly.io/changelog and check out the speedrun in their docs. 

    Featuring:

    • Chris Benson – Website, GitHub, LinkedIn, X
    • Daniel Whitenack – Website, GitHub, X

    Show Notes:

    • BigDL
    • Article: Making LLMs even more accessible with bitsandbytes, 4-bit quantization and QLoRA
    • Previous episode: Running large models on CPUs
    • Baseten’s Truss
    • Seldon
    • Hugging Face’s TGI
    • Intel Gaudi 2
    • Intel TDX

    Upcoming Events: 

    • Register for upcoming webinars here!
    50 min
  • Automate all the UIs!

    Dominik Klotz from askui joins Daniel and Chris to discuss the automation of UI, and how AI empowers them to automate any use case on any operating system. Along the way, the trio explore various approaches and the integration of generative AI, large language models, and computer vision.


    Sponsors:

    • Statsig – Build faster with confidence. Startups to Fortune 500s rely on Statsig to make data-driven decisions. Ship smarter and faster with the unified platform for feature flags, experimentation, and analytics. Our listeners get free white-glove onboarding, migration support, and 5 million free events per month. 
    • Changelog News – A podcast+newsletter combo that’s brief, entertaining & always on-point. Subscribe today. 
    • Fastly – Our bandwidth partner. Fastly powers fast, secure, and scalable digital experiences. Move beyond your content delivery network to their powerful edge cloud platform. Learn more at fastly.com
    • Fly.io – The home of Changelog.com — Deploy your apps and databases close to your users. In minutes you can run your Ruby, Go, Node, Deno, Python, or Elixir app (and databases!) all over the world. No ops required. Learn more at fly.io/changelog and check out the speedrun in their docs. 

    Featuring:

    • Dominik Klotz – GitHub, LinkedIn
    • Chris Benson – Website, GitHub, LinkedIn, X
    • Daniel Whitenack – Website, GitHub, X

    Show Notes:

    • askui.com
    • askui on GitHub
    • askui on LinkedIn
    • askui on Twitter/X

    Upcoming Events: 

    • Register for upcoming webinars here!
    44 min
  • Fine-tuning vs RAG

    In this episode we welcome back our good friend Demetrios from the MLOps Community to discuss fine-tuning vs. retrieval augmented generation. Along the way, we also chat about OpenAI Enterprise, results from the MLOps Community LLM survey, and the orchestration and evaluation of generative AI workloads.


    Sponsors:

    • Fastly – Our bandwidth partner. Fastly powers fast, secure, and scalable digital experiences. Move beyond your content delivery network to their powerful edge cloud platform. Learn more at fastly.com
    • Fly.io – The home of Changelog.com — Deploy your apps and databases close to your users. In minutes you can run your Ruby, Go, Node, Deno, Python, or Elixir app (and databases!) all over the world. No ops required. Learn more at fly.io/changelog and check out the speedrun in their docs. 
    • Typesense – Lightning fast, globally distributed Search-as-a-Service that runs in memory. You literally can’t get any faster! 

    Featuring:

    • Demetrios Brinkmann – X
    • Chris Benson – Website, GitHub, LinkedIn, X
    • Daniel Whitenack – Website, GitHub, X

    Show Notes:

    • MLOps Community
    • LLM survey report
    • LLMs in Production Event - Part III

    Upcoming Events: 

    • Register for upcoming webinars here!
    59 min
  • Automating code optimization with LLMs

    You might have heard a lot about code generation tools using AI, but could LLMs and generative AI make our existing code better? In this episode, we sit down with Mike from TurinTech to hear about practical code optimizations using AI “translation” of slow to fast code. We learn about their process for accomplishing this task along with impressive results when automated code optimization is run on existing open source projects.


    Sponsors:

    • Fastly – Our bandwidth partner. Fastly powers fast, secure, and scalable digital experiences. Move beyond your content delivery network to their powerful edge cloud platform. Learn more at fastly.com
    • Fly.io – The home of Changelog.com — Deploy your apps and databases close to your users. In minutes you can run your Ruby, Go, Node, Deno, Python, or Elixir app (and databases!) all over the world. No ops required. Learn more at fly.io/changelog and check out the speedrun in their docs. 
    • Typesense – Lightning fast, globally distributed Search-as-a-Service that runs in memory. You literally can’t get any faster! 
    • Changelog News – A podcast+newsletter combo that’s brief, entertaining & always on-point. Subscribe today. 

    Featuring:

    • Mike Basios – LinkedIn, X
    • Chris Benson – Website, GitHub, LinkedIn, X
    • Daniel Whitenack – Website, GitHub, X

    Show Notes:

    • TurinTech AI

    Upcoming Events: 

    • Register for upcoming webinars here!
    45 min
  • The new AI app stack

    Recently a16z released a diagram showing the “Emerging Architectures for LLM Applications.” In this episode, we expand on things covered in that diagram to a more general mental model for the new AI app stack. We cover a variety of things from model “middleware” for caching and control to app orchestration.


    Sponsors:

    • Fastly – Our bandwidth partner. Fastly powers fast, secure, and scalable digital experiences. Move beyond your content delivery network to their powerful edge cloud platform. Learn more at fastly.com
    • Fly.io – The home of Changelog.com — Deploy your apps and databases close to your users. In minutes you can run your Ruby, Go, Node, Deno, Python, or Elixir app (and databases!) all over the world. No ops required. Learn more at fly.io/changelog and check out the speedrun in their docs. 
    • Typesense – Lightning fast, globally distributed Search-as-a-Service that runs in memory. You literally can’t get any faster! 
    • Changelog News – A podcast+newsletter combo that’s brief, entertaining & always on-point. Subscribe today. 

    Featuring:

    • Chris Benson – Website, GitHub, LinkedIn, X
    • Daniel Whitenack – Website, GitHub, X

    Show Notes:

    Emerging Architectures for LLM Applications


    Upcoming Events: 

    • Register for upcoming webinars here!
    46 min
  • Blueprint for an AI Bill of Rights

    In this Fully Connected episode, Daniel and Chris kick it off by noting that Stability AI released their SDXL 1.0 LLM! They discuss its virtues, and then dive into a discussion regarding how the United States, European Union, and other entities are approaching governance of AI through new laws and legal frameworks. In particular, they review the White House’s approach, noting the potential for unexpected consequences.


    Sponsors:

    • Fastly – Our bandwidth partner. Fastly powers fast, secure, and scalable digital experiences. Move beyond your content delivery network to their powerful edge cloud platform. Learn more at fastly.com
    • Fly.io – The home of Changelog.com — Deploy your apps and databases close to your users. In minutes you can run your Ruby, Go, Node, Deno, Python, or Elixir app (and databases!) all over the world. No ops required. Learn more at fly.io/changelog and check out the speedrun in their docs. 
    • Typesense – Lightning fast, globally distributed Search-as-a-Service that runs in memory. You literally can’t get any faster! 
    • Changelog News – A podcast+newsletter combo that’s brief, entertaining & always on-point. Subscribe today. 

    Featuring:

    • Chris Benson – Website, GitHub, LinkedIn, X
    • Daniel Whitenack – Website, GitHub, X

    Show Notes:

    • Announcing SDXL 1.0
    • GitHub, Hugging Face, urge EU to relax open-source AI rules
    • White House: Blueprint for an AI Bill of Rights

    LEARNING RESOURCE!

    • Patterns for Building LLM-based Systems & Products

    Upcoming Events: 

    • Register for upcoming webinars here!
    42 min
  • Vector databases (beyond the hype)

    There’s so much talk (and hype) these days about vector databases. We thought it would be timely and practical to have someone on the show that has been hands on with the various options and actually tried to build applications leveraging vector search. Prashanth Rao is a real practitioner that has spent and huge amount of time exploring the expanding set of vector database offerings. After introducing vector database and giving us a mental model of how they fit in with other datastores, Prashanth digs into the trade offs as related to indices, hosting options, embedding vs. query optimization, and more.


    Sponsors:

    • Fastly – Our bandwidth partner. Fastly powers fast, secure, and scalable digital experiences. Move beyond your content delivery network to their powerful edge cloud platform. Learn more at fastly.com
    • Fly.io – The home of Changelog.com — Deploy your apps and databases close to your users. In minutes you can run your Ruby, Go, Node, Deno, Python, or Elixir app (and databases!) all over the world. No ops required. Learn more at fly.io/changelog and check out the speedrun in their docs. 
    • Typesense – Lightning fast, globally distributed Search-as-a-Service that runs in memory. You literally can’t get any faster! 
    • Changelog News – A podcast+newsletter combo that’s brief, entertaining & always on-point. Subscribe today. 

    Featuring:

    • Prashanth Rao – Website, GitHub, LinkedIn, X
    • Chris Benson – Website, GitHub, LinkedIn, X
    • Daniel Whitenack – Website, GitHub, X

    Show Notes:

    Vector databases blog posts from Prashanth:

    • (Part 1): What makes each one different?
    • (Part 2): Understanding their internals
    • (Part 3): Not all indexes are created equal

    Upcoming Events: 

    • Register for upcoming webinars here!
    52 min
  • There's a new Llama in town

    It was an amazing week in AI news. Among other things, there is a new NeRF and a new Llama in town!!! Zip-NeRF can create some amazing 3D scenes based on 2D images, and Llama 2 from Meta promises to change the LLM landscape. Chris and Daniel dive into these and they compare some of the recently released OpenAI functionality to Anthropic’s Claude 2.


    Sponsors:

    • Fastly – Our bandwidth partner. Fastly powers fast, secure, and scalable digital experiences. Move beyond your content delivery network to their powerful edge cloud platform. Learn more at fastly.com
    • Fly.io – The home of Changelog.com — Deploy your apps and databases close to your users. In minutes you can run your Ruby, Go, Node, Deno, Python, or Elixir app (and databases!) all over the world. No ops required. Learn more at fly.io/changelog and check out the speedrun in their docs. 
    • Typesense – Lightning fast, globally distributed Search-as-a-Service that runs in memory. You literally can’t get any faster! 

    Featuring:

    • Chris Benson – Website, GitHub, LinkedIn, X
    • Daniel Whitenack – Website, GitHub, X

    Show Notes:

    • What is NeRF article
    • Llama 2: 
      • Llama 2 site
      • Llama 2 paper
    • OpenAI Code Interpreter
    • Anthropic Claude 2

    Learning resources:

    • Hugging Face guide to Llama 2
    • LLaMA 2 - Every Resource you need
    • OpenAI code interpreter article

    Upcoming Events: 

    • Register for upcoming webinars here!
    49 min
  • Legal consequences of generated content

    As a technologist, coder, and lawyer, few people are better equipped to discuss the legal and practical consequences of generative AI than Damien Riehl. He demonstrated this a couple years ago by generating, writing to disk, and then releasing every possible musical melody. Damien joins us to answer our many questions about generated content, copyright, dataset licensing/usage, and the future of knowledge work.


    Sponsors:

    • Fastly – Our bandwidth partner. Fastly powers fast, secure, and scalable digital experiences. Move beyond your content delivery network to their powerful edge cloud platform. Learn more at fastly.com
    • Fly.io – The home of Changelog.com — Deploy your apps and databases close to your users. In minutes you can run your Ruby, Go, Node, Deno, Python, or Elixir app (and databases!) all over the world. No ops required. Learn more at fly.io/changelog and check out the speedrun in their docs. 
    • Typesense – Lightning fast, globally distributed Search-as-a-Service that runs in memory. You literally can’t get any faster! 

    Featuring:

    • Damien Riehl – LinkedIn, Mastodon, X
    • Chris Benson – Website, GitHub, LinkedIn, X
    • Daniel Whitenack – Website, GitHub, X

    Show Notes:

    • Talk - Legal and Practical Consequences of Generative AI (LLMs like GPT, Bart, PaLM, LLaMA, Alpaca, Codex)
    • Talk - Why All Melodies Should Be Free for Musicians to Use | Damien Riehl | TED

    Upcoming Events: 

    • Register for upcoming webinars here!
    43 min