Changelog Master Feed

OpenAI's new "dangerous" GPT-2 language model (Practical AI #32)

Listen Later

This week we discuss GPT-2, a new transformer-based language model from OpenAI that has everyone talking. It’s capable of generating incredibly realistic text, and the AI community has lots of concerns about potential malicious applications. We help you understand GPT-2 and we discuss ethical concerns, responsible release of AI research, and resources that we have found useful in learning about language models.

Join the discussion

Changelog++ members support our work, get closer to the metal, and make the ads disappear. Join today!

Sponsors:

  • Linode – Our cloud server of choice. Deploy a fast, efficient, native SSD cloud server for only $5/month. Get 4 months free using the code changelog2018. Start your server - head to linode.com/changelog
  • Rollbar – We move fast and fix things because of Rollbar. Resolve errors in minutes. Deploy with confidence. Learn more at rollbar.com/changelog.
  • Fastly – Our bandwidth partner. Fastly powers fast, secure, and scalable digital experiences. Move beyond your content delivery network to their powerful edge cloud platform. Learn more at fastly.com.

    • Featuring:

    • Chris Benson – Website, GitHub, LinkedIn, X
    • Daniel Whitenack – Website, GitHub, X

    Show Notes:

    Relevant learning resources:

    • Jay Alammar “Illustrated” blog articles:
      • The illustrated transformer
      • The illustrated BERT, elmo, and co
      • Machine Learning Explained blog:
        • An In-Depth Tutorial to AllenNLP (From Basics to ELMo and BERT)
        • Paper Dissected: “BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding” Explained

          • References/notes:

          • GPT-2 blog post from OpenAI
          • GPT-2 Paper
          • GPT-2 GitHub Repo
          • GPT-2 PyTorch implementation
          • Episode 22 of Practical AI about BERT
          • OpenAI’s GPT-2: the model, the hype, and the controversy (towardsdatascience)
          • The AI Text Generator That’s Too Dangerous to Make Public (Wired)
          • Transformer paper
          • Preparing for malicious uses of AI (OpenAI blog)

            • Something missing or broken? PRs welcome!

            ...more
            View all episodesView all episodes
            Download on the App Store
            Changelog Master FeedBy Changelog Media
            • 4.4
            • 4.4
            • 4.4
            • 4.4
            • 4.4

            4.4

            29 ratings

            More shows like Changelog Master Feed

            View all
            Hanselminutes with Scott Hanselman by Scott Hanselman

            Hanselminutes with Scott Hanselman

            377 Listeners

            Software Engineering Radio - the podcast for professional software developers by se-radio@computer.org

            Software Engineering Radio - the podcast for professional software developers

            272 Listeners

            The Changelog: Software Development, Open Source by Changelog Media

            The Changelog: Software Development, Open Source

            284 Listeners

            Thoughtworks Technology Podcast by Thoughtworks

            Thoughtworks Technology Podcast

            41 Listeners

            Talk Python To Me by Michael Kennedy

            Talk Python To Me

            585 Listeners

            Software Engineering Daily by Software Engineering Daily

            Software Engineering Daily

            624 Listeners

            Python Bytes by Michael Kennedy and Brian Okken

            Python Bytes

            214 Listeners

            Syntax - Tasty Web Development Treats by Wes Bos & Scott Tolinski - Full Stack JavaScript Web Developers

            Syntax - Tasty Web Development Treats

            990 Listeners

            CoRecursive: Coding Stories by Adam Gordon Bell - Software Developer

            CoRecursive: Coding Stories

            191 Listeners

            Kubernetes Podcast from Google by Abdel Sghiouar, Kaslin Fields

            Kubernetes Podcast from Google

            183 Listeners

            Practical AI by Practical AI LLC

            Practical AI

            183 Listeners

            The Stack Overflow Podcast by The Stack Overflow Podcast

            The Stack Overflow Podcast

            63 Listeners

            Oxide and Friends by Oxide Computer Company

            Oxide and Friends

            58 Listeners

            Latent Space: The AI Engineer Podcast by swyx + Alessio

            Latent Space: The AI Engineer Podcast

            72 Listeners

            The Pragmatic Engineer by Gergely Orosz

            The Pragmatic Engineer

            62 Listeners