Vanishing Gradients

Episode 36: Prompt Engineering, Security in Generative AI, and the Future of AI Research Part 1


Listen Later

Hugo speaks with three leading figures from the world of AI research: Sander Schulhoff, a recent University of Maryland graduate and lead contributor to the Learn Prompting initiative; Philip Resnik, professor at the University of Maryland, known for his pioneering work in computational linguistics; and Dennis Peskoff, a researcher from Princeton specializing in prompt engineering and its applications in the social sciences.

This is Part 1 of a special two-part episode, prompted—no pun intended—by these guys being part of a team, led by Sander, that wrote a 76-page survey analyzing prompting techniques, agents, and generative AI. The survey included contributors from OpenAI, Microsoft, the University of Maryland, Princeton, and more.

In this first part,

  • we’ll explore the critical role of prompt engineering,
  • & diving into adversarial techniques like prompt hacking and
  • the challenges of evaluating these techniques.
  • we’ll examine the impact of few-shot learning and
  • the groundbreaking taxonomy of prompting techniques from the Prompt Report.
  • Along the way,

    • we’ll uncover the rich history of natural language processing (NLP) and AI, showing how modern prompting techniques evolved from early rule-based systems and statistical methods.
    • we’ll also hear how Sander’s experimentation with GPT-3 for diplomatic tasks led him to develop Learn Prompting, and
    • how Dennis highlights the accessibility of AI through prompting, which allows non-technical users to interact with AI without needing to code.
    • Finally, we’ll explore the future of multimodal AI, where LLMs interact with images, code, and even music creation. Make sure to tune in to Part 2, where we dive deeper into security risks, prompt hacking, and more.

      LINKS

      • The livestream on YouTube
      • The Prompt Report: A Systematic Survey of Prompting Techniques
      • Learn Prompting: Your Guide to Communicating with AI
      • Vanishing Gradients on Twitter
      • Hugo on Twitter
      • Vanishing Gradients' lu.ma calendar
      • Vanishing Gradients on YouTube
      • ...more
        View all episodesView all episodes
        Download on the App Store

        Vanishing GradientsBy Hugo Bowne-Anderson

        • 5
        • 5
        • 5
        • 5
        • 5

        5

        11 ratings


        More shows like Vanishing Gradients

        View all
        a16z Podcast by Andreessen Horowitz

        a16z Podcast

        1,001 Listeners

        Data Skeptic by Kyle Polich

        Data Skeptic

        470 Listeners

        Super Data Science: ML & AI Podcast with Jon Krohn by Jon Krohn

        Super Data Science: ML & AI Podcast with Jon Krohn

        296 Listeners

        DataFramed by DataCamp

        DataFramed

        269 Listeners

        Practical AI by Practical AI LLC

        Practical AI

        190 Listeners

        Last Week in AI by Skynet Today

        Last Week in AI

        281 Listeners

        Machine Learning Street Talk (MLST) by Machine Learning Street Talk (MLST)

        Machine Learning Street Talk (MLST)

        88 Listeners

        Dwarkesh Podcast by Dwarkesh Patel

        Dwarkesh Podcast

        354 Listeners

        No Priors: Artificial Intelligence | Technology | Startups by Conviction

        No Priors: Artificial Intelligence | Technology | Startups

        125 Listeners

        This Day in AI Podcast by Michael Sharkey, Chris Sharkey

        This Day in AI Podcast

        190 Listeners

        Latent Space: The AI Engineer Podcast by swyx + Alessio

        Latent Space: The AI Engineer Podcast

        63 Listeners

        The AI Daily Brief (Formerly The AI Breakdown): Artificial Intelligence News and Analysis by Nathaniel Whittemore

        The AI Daily Brief (Formerly The AI Breakdown): Artificial Intelligence News and Analysis

        424 Listeners

        The Next Wave - AI and The Future of Technology by Hubspot Media

        The Next Wave - AI and The Future of Technology

        57 Listeners

        Training Data by Sequoia Capital

        Training Data

        36 Listeners

        High Signal: Data Science | Career | AI by Delphina

        High Signal: Data Science | Career | AI

        4 Listeners