Practical AI

OpenAI's new "dangerous" GPT-2 language model

Listen Later

This week we discuss GPT-2, a new transformer-based language model from OpenAI that has everyone talking. It’s capable of generating incredibly realistic text, and the AI community has lots of concerns about potential malicious applications. We help you understand GPT-2 and we discuss ethical concerns, responsible release of AI research, and resources that we have found useful in learning about language models.

Join the discussion

Changelog++ members support our work, get closer to the metal, and make the ads disappear. Join today!

Sponsors:

  • Linode – Our cloud server of choice. Deploy a fast, efficient, native SSD cloud server for only $5/month. Get 4 months free using the code changelog2018. Start your server - head to linode.com/changelog
  • Rollbar – We move fast and fix things because of Rollbar. Resolve errors in minutes. Deploy with confidence. Learn more at rollbar.com/changelog.
  • Fastly – Our bandwidth partner. Fastly powers fast, secure, and scalable digital experiences. Move beyond your content delivery network to their powerful edge cloud platform. Learn more at fastly.com.

    • Featuring:

    • Chris Benson – Website, GitHub, LinkedIn, X
    • Daniel Whitenack – Website, GitHub, X

    Show Notes:

    Relevant learning resources:

    • Jay Alammar “Illustrated” blog articles:
      • The illustrated transformer
      • The illustrated BERT, elmo, and co
      • Machine Learning Explained blog:
        • An In-Depth Tutorial to AllenNLP (From Basics to ELMo and BERT)
        • Paper Dissected: “BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding” Explained

          • References/notes:

          • GPT-2 blog post from OpenAI
          • GPT-2 Paper
          • GPT-2 GitHub Repo
          • GPT-2 PyTorch implementation
          • Episode 22 of Practical AI about BERT
          • OpenAI’s GPT-2: the model, the hype, and the controversy (towardsdatascience)
          • The AI Text Generator That’s Too Dangerous to Make Public (Wired)
          • Transformer paper
          • Preparing for malicious uses of AI (OpenAI blog)

            • Something missing or broken? PRs welcome!

            ...more
            View all episodesView all episodes
            Download on the App Store
            Practical AIBy Practical AI LLC
            • 4.4
            • 4.4
            • 4.4
            • 4.4
            • 4.4

            4.4

            185 ratings

            More shows like Practical AI

            View all
            The AI in Business Podcast by Daniel Faggella

            The AI in Business Podcast

            170 Listeners

            Super Data Science: ML & AI Podcast with Jon Krohn by Jon Krohn

            Super Data Science: ML & AI Podcast with Jon Krohn

            303 Listeners

            NVIDIA AI Podcast by NVIDIA

            NVIDIA AI Podcast

            334 Listeners

            Last Week in AI by Skynet Today

            Last Week in AI

            306 Listeners

            Machine Learning Street Talk (MLST) by Machine Learning Street Talk (MLST)

            Machine Learning Street Talk (MLST)

            95 Listeners

            Me, Myself, and AI by MIT Sloan Management Review

            Me, Myself, and AI

            110 Listeners

            AI Chat: ChatGPT, AI News, Artificial Intelligence, OpenAI, Machine Learning by Jaeden Schafer

            AI Chat: ChatGPT, AI News, Artificial Intelligence, OpenAI, Machine Learning

            154 Listeners

            This Day in AI Podcast by Michael Sharkey, Chris Sharkey

            This Day in AI Podcast

            227 Listeners

            The AI Daily Brief: Artificial Intelligence News and Analysis by Nathaniel Whittemore

            The AI Daily Brief: Artificial Intelligence News and Analysis

            608 Listeners

            AI For Humans: Making Artificial Intelligence Fun & Practical by Kevin Pereira & Gavin Purcell

            AI For Humans: Making Artificial Intelligence Fun & Practical

            275 Listeners

            Everyday AI Podcast – An AI and ChatGPT Podcast by Everyday AI

            Everyday AI Podcast – An AI and ChatGPT Podcast

            107 Listeners

            A Beginner's Guide to AI by Dietmar Fischer

            A Beginner's Guide to AI

            54 Listeners

            AI Hustle: Make Money from AI and ChatGPT, Midjourney, NVIDIA, Anthropic, OpenAI by Jaeden Schafer and Jamie McCauley

            AI Hustle: Make Money from AI and ChatGPT, Midjourney, NVIDIA, Anthropic, OpenAI

            173 Listeners

            AI + a16z by a16z

            AI + a16z

            35 Listeners

            The TED AI Show by TED

            The TED AI Show

            49 Listeners