Super Data Science: ML & AI Podcast with Jon Krohn

905: Why RAG Makes LLMs Less Safe (And How to Fix It), with Bloomberg’s Dr. Sebastian Gehrmann


Listen Later

RAG LLMs are not safer: Sebastian Gehrmann speaks to Jon Krohn about his latest research into how retrieval-augmented generation (RAG) actually makes LLMs less safe, the three ‘H’s for gauging the effectivity and value of a RAG, and the custom guardrails and procedures we need to use to ensure our RAG is fit-for-purpose and secure. This is a great episode for anyone who wants to know how to work with RAG in the context of LLMs, as you’ll hear how to select the best model for purpose, useful approaches and taxonomies to keep your projects secure, and which models he finds safest when RAG is applied.


Additional materials: ⁠⁠⁠⁠⁠⁠www.superdatascience.com/905⁠⁠


This episode is brought to you by, ⁠⁠⁠Adverity, the conversational analytics platform⁠⁠⁠ and by the ⁠⁠⁠Dell AI Factory with NVIDIA⁠⁠⁠.


Interested in sponsoring a SuperDataScience Podcast episode? Email [email protected] for sponsorship information.


In this episode you will learn:

  • (03:28) Findings from the paper “RAG LLMs are Not Safer: A Safety Analysis of Retrieval-Augmented Generation for Large Language Models”
  • (09:35) What attack surfaces are in the context of AI
  • (38:51) Small versus large models with RAG
  • (46:27) How to select an LLM with safety in mind
  • ...more
    View all episodesView all episodes
    Download on the App Store

    Super Data Science: ML & AI Podcast with Jon KrohnBy Jon Krohn

    • 4.6
    • 4.6
    • 4.6
    • 4.6
    • 4.6

    4.6

    290 ratings


    More shows like Super Data Science: ML & AI Podcast with Jon Krohn

    View all
    Data Skeptic by Kyle Polich

    Data Skeptic

    477 Listeners

    Talk Python To Me by Michael Kennedy

    Talk Python To Me

    583 Listeners

    The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence) by Sam Charrington

    The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)

    439 Listeners

    NVIDIA AI Podcast by NVIDIA

    NVIDIA AI Podcast

    341 Listeners

    Data Engineering Podcast by Tobias Macey

    Data Engineering Podcast

    141 Listeners

    Machine Learning Guide by OCDevel

    Machine Learning Guide

    768 Listeners

    AI Today Podcast by AI & Data Today

    AI Today Podcast

    151 Listeners

    DataFramed by DataCamp

    DataFramed

    269 Listeners

    Practical AI by Practical AI LLC

    Practical AI

    189 Listeners

    Machine Learning Street Talk (MLST) by Machine Learning Street Talk (MLST)

    Machine Learning Street Talk (MLST)

    91 Listeners

    AI Chat: ChatGPT & AI News, Artificial Intelligence, OpenAI, Machine Learning by Jaeden Schafer

    AI Chat: ChatGPT & AI News, Artificial Intelligence, OpenAI, Machine Learning

    149 Listeners

    This Day in AI Podcast by Michael Sharkey, Chris Sharkey

    This Day in AI Podcast

    200 Listeners

    Latent Space: The AI Engineer Podcast by swyx + Alessio

    Latent Space: The AI Engineer Podcast

    69 Listeners

    The AI Daily Brief (Formerly The AI Breakdown): Artificial Intelligence News and Analysis by Nathaniel Whittemore

    The AI Daily Brief (Formerly The AI Breakdown): Artificial Intelligence News and Analysis

    509 Listeners

    AI For Humans: Making Artificial Intelligence Fun & Practical by Kevin Pereira & Gavin Purcell

    AI For Humans: Making Artificial Intelligence Fun & Practical

    253 Listeners