Practical AI

Practical AI

By Daniel Whitenack and Chris BensonTechnology
Download on the App Store
  • Favorites

    316

    Followers

  • Latest release

    3 days ago

  • Typical duration

    47 min

    per episode

Based on Podcast App listening data

All Practical AI episodes

  • A developer's toolkit for SOTA AI

    Chris sat down with Varun Mohan and Anshul Ramachandran, CEO / Cofounder and Lead of Enterprise and Partnership at Codeium, respectively. They discussed how to streamline and enable modern development in generative AI and large language models (LLMs). Their new tool, Codeium, was born out of the insights they gleaned from their work in GPU software and solutions development, particularly with respect to generative AI, large language models, and supporting infrastructure. Codeium is a free AI-powered toolkit for developers, with in-house models and infrastructure - not another API wrapper.


    Sponsors:

    • Fastly – Our bandwidth partner. Fastly powers fast, secure, and scalable digital experiences. Move beyond your content delivery network to their powerful edge cloud platform. Learn more at fastly.com
    • Fly.io – The home of Changelog.com — Deploy your apps and databases close to your users. In minutes you can run your Ruby, Go, Node, Deno, Python, or Elixir app (and databases!) all over the world. No ops required. Learn more at fly.io/changelog and check out the speedrun in their docs. 
    • Typesense – Lightning fast, globally distributed Search-as-a-Service that runs in memory. You literally can’t get any faster! 

    Featuring:

    • Varun Mohan – LinkedIn
    • Anshul Ramachandran – LinkedIn
    • Chris Benson – Website, GitHub, LinkedIn, X

    Show Notes:

    • Codeium
    • What GitHub Copilot Lacks: Fine-tuning on Your Private Code

    Upcoming Events: 

    • Register for upcoming webinars here!
    43 min
  • Cambrian explosion of generative models

    In this Fully Connected episode, Daniel and Chris explore recent highlights from the current model proliferation wave sweeping the world - including Stable Diffusion XL, OpenChat, Zeroscope XL, and Salesforce XGen. They note the rapid rise of open models, and speculate that just as in open source software, open models will dominate the future. Such rapid advancement creates its own problems though, so they finish by itemizing concerns such as cybersecurity, workflow productivity, and impact on human culture.


    Sponsors:

    • Fastly – Our bandwidth partner. Fastly powers fast, secure, and scalable digital experiences. Move beyond your content delivery network to their powerful edge cloud platform. Learn more at fastly.com
    • Fly.io – The home of Changelog.com — Deploy your apps and databases close to your users. In minutes you can run your Ruby, Go, Node, Deno, Python, or Elixir app (and databases!) all over the world. No ops required. Learn more at fly.io/changelog and check out the speedrun in their docs. 
    • Typesense – Lightning fast, globally distributed Search-as-a-Service that runs in memory. You literally can’t get any faster! 
    • Changelog News – A podcast+newsletter combo that’s brief, entertaining & always on-point. Subscribe today. 

    Featuring:

    • Chris Benson – Website, GitHub, LinkedIn, X
    • Daniel Whitenack – Website, GitHub, X

    Show Notes:

    • Stable Diffusion XL 0.9
    • OpenChat
    • Zeroscope XL
    • Salesforce XGen
    • AI is Eating The World
    • LLM university

    Upcoming Events: 

    • Register for upcoming webinars here!
    43 min
  • Automated cartography using AI

    Your feed might be dominated by LLMs these days, but there are some amazing things happening in computer vision that you shouldn’t ignore! In this episode, we bring you one of those amazing stories from Gabriel Ortiz, who is working with the government of Cantabria in Spain to automate cartography and apply AI to geospatial analysis. We hear about how AI tooling fits into the GIS workflow, and Gabriel shares some of his recent work (including work that can identify individual people, invasive plant species, building and more from aerial survey data).


    Sponsors:

    • Fastly – Our bandwidth partner. Fastly powers fast, secure, and scalable digital experiences. Move beyond your content delivery network to their powerful edge cloud platform. Learn more at fastly.com
    • Fly.io – The home of Changelog.com — Deploy your apps and databases close to your users. In minutes you can run your Ruby, Go, Node, Deno, Python, or Elixir app (and databases!) all over the world. No ops required. Learn more at fly.io/changelog and check out the speedrun in their docs. 
    • Typesense – Lightning fast, globally distributed Search-as-a-Service that runs in memory. You literally can’t get any faster! 
    • Changelog News – A podcast+newsletter combo that’s brief, entertaining & always on-point. Subscribe today. 

    Featuring:

    • Gabriel Ortiz – LinkedIn
    • Daniel Whitenack – Website, GitHub, X

    Show Notes:

    • Automated cartography (integration of different models: buildings, roads, vegetation)
    • Detecting and tracking the expansion of forests (period 1957-2020) using both legacy and modern imagery
    • Tracking invader species
    • Tracking urban growth with AI
    • Spatial behavior in beaches using AI
    • Inference with SAM (Meta’s Segment Anything Model) over urban areas/viewer.html?webmap=4af373c294e24394ae25e4acadab71cc
    • SuperResolution on aerial or satellite imagery
    • More of the work of Gabriel and his team can be seen here and also on his LinkedIn profile

    Upcoming Events: 

    • Register for upcoming webinars here!
    45 min
  • From ML to AI to Generative AI

    Chris and Daniel take a step back to look at how generative AI fits into the wider landscape of ML/AI and data science. They talk through the differences in how one approaches “traditional” supervised learning and how practitioners are approaching generative AI based solutions (such as those using Midjourney or GPT family models). Finally, they talk through the risk and compliance implications of generative AI, which was in the news this week in the EU.


    Sponsors:

    • Fastly – Our bandwidth partner. Fastly powers fast, secure, and scalable digital experiences. Move beyond your content delivery network to their powerful edge cloud platform. Learn more at fastly.com
    • Fly.io – The home of Changelog.com — Deploy your apps and databases close to your users. In minutes you can run your Ruby, Go, Node, Deno, Python, or Elixir app (and databases!) all over the world. No ops required. Learn more at fly.io/changelog and check out the speedrun in their docs. 
    • Changelog News – A podcast+newsletter combo that’s brief, entertaining & always on-point. Subscribe today. 

    Featuring:

    • Chris Benson – Website, GitHub, LinkedIn, X
    • Daniel Whitenack – Website, GitHub, X

    Show Notes:

    • NYT Article: “Europeans Take a Major Step Toward Regulating A.I.”

    Upcoming Events: 

    • Register for upcoming webinars here!
    47 min
  • AI trends: a Latent Space crossover

    Daniel had the chance to sit down with @swyx and Alessio from the Latent Space pod in SF to talk about current AI trends and to highlight some key learnings from past episodes. The discussion covers open access LLMs, smol models, model controls, prompt engineering, and LLMOps. This mashup is magical. Don’t miss it!


    Sponsors:

    • Fastly – Our bandwidth partner. Fastly powers fast, secure, and scalable digital experiences. Move beyond your content delivery network to their powerful edge cloud platform. Learn more at fastly.com
    • Fly.io – The home of Changelog.com — Deploy your apps and databases close to your users. In minutes you can run your Ruby, Go, Node, Deno, Python, or Elixir app (and databases!) all over the world. No ops required. Learn more at fly.io/changelog and check out the speedrun in their docs. 
    • Typesense – Lightning fast, globally distributed Search-as-a-Service that runs in memory. You literally can’t get any faster! 

    Featuring:

    • Shawn Wang – Website, GitHub, X
    • Alessio Fanelli – Website, GitHub, X
    • Daniel Whitenack – Website, GitHub, X

    Show Notes:

    • Latent Space podcast
    • Featured Latent Space episodes: 
      • Benchmarks
      • Reza Shabani
      • MosaicML and MPT
      • Segment Anything
      • Mike Conover
    • Featured Practical AI episodes: 
      • From notebooks to Netflix scale with Metaflow
      • Capabilities of LLMs 🤯 
      • ML at small organizations
    • Prediction Guard
    • Data Dan

    Upcoming Events: 

    • Register for upcoming webinars here!
    1 hr
  • Accidentally building SOTA AI

    Lately.AI has been working for years on content generation systems that capture your unique “voice” and are tailored to your unique audience. At first, they didn’t know that they were going to build an AI system, but now they have a state-of-the-art generative platform that provides much more than “prompting” out of thin air. Lately.AI’s CEO Kate explain their journey, her perspective on generative AI in marketing, and much more in this episode!


    Sponsors:

    • Fastly – Our bandwidth partner. Fastly powers fast, secure, and scalable digital experiences. Move beyond your content delivery network to their powerful edge cloud platform. Learn more at fastly.com
    • Fly.io – The home of Changelog.com — Deploy your apps and databases close to your users. In minutes you can run your Ruby, Go, Node, Deno, Python, or Elixir app (and databases!) all over the world. No ops required. Learn more at fly.io/changelog and check out the speedrun in their docs. 
    • Changelog News – A podcast+newsletter combo that’s brief, entertaining & always on-point. Subscribe today. 

    Featuring:

    • Kate Bradley Chernis – LinkedIn, X
    • Chris Benson – Website, GitHub, LinkedIn, X
    • Daniel Whitenack – Website, GitHub, X

    Show Notes:

    • Lately.AI

    Upcoming Events: 

    • Register for upcoming webinars here!
    43 min
  • Controlled and compliant AI applications

    You can’t build robust systems with inconsistent, unstructured text output from LLMs. Moreover, LLM integrations scare corporate lawyers, finance departments, and security professionals due to hallucinations, cost, lack of compliance (e.g., HIPAA), leaked IP/PII, and “injection” vulnerabilities.

    In this episode, Chris interviews Daniel about his new company called Prediction Guard, which addresses these issues. They discuss some practical methodologies for getting consistent, structured output from compliant AI systems. These systems, driven by open access models and various kinds of LLM wrappers, can help you delight customers AND navigate the increasing restrictions on “GPT” models.


    Sponsors:

    • Fastly – Our bandwidth partner. Fastly powers fast, secure, and scalable digital experiences. Move beyond your content delivery network to their powerful edge cloud platform. Learn more at fastly.com
    • Fly.io – The home of Changelog.com — Deploy your apps and databases close to your users. In minutes you can run your Ruby, Go, Node, Deno, Python, or Elixir app (and databases!) all over the world. No ops required. Learn more at fly.io/changelog and check out the speedrun in their docs. 
    • Changelog News – A podcast+newsletter combo that’s brief, entertaining & always on-point. Subscribe today. 

    Featuring:

    • Chris Benson – Website, GitHub, LinkedIn, X
    • Daniel Whitenack – Website, GitHub, X

    Show Notes:

    • Prediction Guard
    • Prediction Guard docs
    • LLMs in Production II event

    Upcoming Events: 

    • Register for upcoming webinars here!
    50 min
  • Data augmentation with LlamaIndex

    Large Language Models (LLMs) continue to amaze us with their capabilities. However, the utilization of LLMs in production AI applications requires the integration of private data. Join us as we have a captivating conversation with Jerry Liu from LlamaIndex, where he provides valuable insights into the process of data ingestion, indexing, and query specifically tailored for LLM applications. Delving into the topic, we uncover different query patterns and venture beyond the realm of vector databases.


    Sponsors:

    • Fastly – Our bandwidth partner. Fastly powers fast, secure, and scalable digital experiences. Move beyond your content delivery network to their powerful edge cloud platform. Learn more at fastly.com
    • Fly.io – The home of Changelog.com — Deploy your apps and databases close to your users. In minutes you can run your Ruby, Go, Node, Deno, Python, or Elixir app (and databases!) all over the world. No ops required. Learn more at fly.io/changelog and check out the speedrun in their docs. 
    • Typesense – Lightning fast, globally distributed Search-as-a-Service that runs in memory. You literally can’t get any faster! 

    Featuring:

    • Jerry Liu – GitHub, X
    • Chris Benson – Website, GitHub, LinkedIn, X
    • Daniel Whitenack – Website, GitHub, X

    Show Notes:

    • LlamaIndex Docs
    • LlamaHub
    • LlamaIndex Blog

    Upcoming Events: 

    • Register for upcoming webinars here!
    45 min
  • Creating instruction tuned models

    At the recent ODSC East conference, Daniel got a chance to sit down with Erin Mikail Staples to discuss the process of gathering human feedback and creating an instruction tuned Large Language Models (LLM). They also chatted about the importance of open data and practical tooling for data annotation and fine-tuning. Do you want to create your own custom generative AI models? This is the episode for you!


    Sponsors:

    • Fastly – Our bandwidth partner. Fastly powers fast, secure, and scalable digital experiences. Move beyond your content delivery network to their powerful edge cloud platform. Learn more at fastly.com
    • Fly.io – The home of Changelog.com — Deploy your apps and databases close to your users. In minutes you can run your Ruby, Go, Node, Deno, Python, or Elixir app (and databases!) all over the world. No ops required. Learn more at fly.io/changelog and check out the speedrun in their docs. 
    • Typesense – Lightning fast, globally distributed Search-as-a-Service that runs in memory. You literally can’t get any faster! 

    Featuring:

    • Erin Mikail Staples – Mastodon, X
    • Daniel Whitenack – Website, GitHub, X

    Show Notes:

    • Label Studio
    • Slides from Erin’s recent PyData talk on RLHF

    Upcoming Events: 

    • Register for upcoming webinars here!
    27 min
  • The last mile of AI app development

    There are a ton of problems around building LLM apps in production and the last mile of that problem. Travis Fischer, builder of open AI projects like @ChatGPTBot, joins us to talk through these problems (and how to overcome them). He helps us understand the hierarchy of complexity from simple prompting to augmentation, agents, and fine-tuning. Along the way we discuss the frontend developer community that is rapidly adopting AI technology via Typescript (not Python).


    Sponsors:

    • Fastly – Our bandwidth partner. Fastly powers fast, secure, and scalable digital experiences. Move beyond your content delivery network to their powerful edge cloud platform. Learn more at fastly.com
    • Fly.io – The home of Changelog.com — Deploy your apps and databases close to your users. In minutes you can run your Ruby, Go, Node, Deno, Python, or Elixir app (and databases!) all over the world. No ops required. Learn more at fly.io/changelog and check out the speedrun in their docs. 

    Featuring:

    • Travis Fischer – GitHub, X
    • Chris Benson – Website, GitHub, LinkedIn, X
    • Daniel Whitenack – Website, GitHub, X

    Show Notes:

    • ChatGPT Hacker Community
    • ChatGPTBot

    Upcoming Events: 

    • Register for upcoming webinars here!
    39 min