Vanishing Gradients

Episode 21: Deploying LLMs in Production: Lessons Learned

Listen Later

Hugo speaks with Hamel Husain, a machine learning engineer who loves building machine learning infrastructure and tools 👷. Hamel leads and contributes to many popular open-source machine learning projects. He also has extensive experience (20+ years) as a machine learning engineer across various industries, including large tech companies like Airbnb and GitHub. At GitHub, he led CodeSearchNet, a large language model for semantic search that was a precursor to CoPilot. Hamel is the founder of Parlance-Labs, a research and consultancy focused on LLMs.

They talk about generative AI, large language models, the business value they can generate, and how to get started.

They delve into

  • Where Hamel is seeing the most business interest in LLMs (spoiler: the answer isn’t only tech);
  • Common misconceptions about LLMs;
  • The skills you need to work with LLMs and GenAI models;
  • Tools and techniques, such as fine-tuning, RAGs, LoRA, hardware, and more!
  • Vendor APIs vs OSS models.

    • LINKS

    • Our upcoming livestream LLMs, OpenAI Dev Day, and the Existential Crisis for Machine Learning Engineering with Jeremy Howard (Fast.ai), Shreya Shankar (UC Berkeley), and Hamel Husain (Parlance Labs): Sign up for free!
    • Our recent livestream Data and DevOps Tools for Evaluating and Productionizing LLMs with Hamel and Emil Sedgh, Lead AI engineer at Rechat -- in it, we showcase an actual industrial use case that Hamel and Emil are working on with Rechat, a real estate CRM, taking you through LLM workflows and tools.
    • Extended Guide: Instruction-tune Llama 2 by Philipp Schmid
    • The livestream recoding of this episode!
    • Hamel on twitter
      • ...more
      View all episodesView all episodes
      Download on the App Store
      Vanishing GradientsBy Hugo Bowne-Anderson
      • 5
      • 5
      • 5
      • 5
      • 5

      5

      11 ratings

      More shows like Vanishing Gradients

      View all
      a16z Podcast by Andreessen Horowitz

      a16z Podcast

      1,001 Listeners

      Data Skeptic by Kyle Polich

      Data Skeptic

      470 Listeners

      Super Data Science: ML & AI Podcast with Jon Krohn by Jon Krohn

      Super Data Science: ML & AI Podcast with Jon Krohn

      296 Listeners

      DataFramed by DataCamp

      DataFramed

      269 Listeners

      Practical AI by Practical AI LLC

      Practical AI

      190 Listeners

      Last Week in AI by Skynet Today

      Last Week in AI

      281 Listeners

      Machine Learning Street Talk (MLST) by Machine Learning Street Talk (MLST)

      Machine Learning Street Talk (MLST)

      88 Listeners

      Dwarkesh Podcast by Dwarkesh Patel

      Dwarkesh Podcast

      354 Listeners

      No Priors: Artificial Intelligence | Technology | Startups by Conviction

      No Priors: Artificial Intelligence | Technology | Startups

      125 Listeners

      This Day in AI Podcast by Michael Sharkey, Chris Sharkey

      This Day in AI Podcast

      190 Listeners

      Latent Space: The AI Engineer Podcast by swyx + Alessio

      Latent Space: The AI Engineer Podcast

      63 Listeners

      The AI Daily Brief (Formerly The AI Breakdown): Artificial Intelligence News and Analysis by Nathaniel Whittemore

      The AI Daily Brief (Formerly The AI Breakdown): Artificial Intelligence News and Analysis

      424 Listeners

      The Next Wave - AI and The Future of Technology by Hubspot Media

      The Next Wave - AI and The Future of Technology

      57 Listeners

      Training Data by Sequoia Capital

      Training Data

      36 Listeners

      High Signal: Data Science | Career | AI by Delphina

      High Signal: Data Science | Career | AI

      4 Listeners