Practical AI

BERT: one NLP model to rule them all

Listen Later

Fully Connected – a series where Chris and Daniel keep you up to date with everything that’s happening in the AI community.

This week we discuss BERT, a new method of pre-training language representations from Google for natural language processing (NLP) tasks. Then we tackle Facebook’s Horizon, the first open source reinforcement learning platform for large-scale products and services. We also address synthetic data, and suggest a few learning resources.

Join the discussion

Changelog++ members support our work, get closer to the metal, and make the ads disappear. Join today!

Sponsors:

  • Fastly – Our bandwidth partner. Fastly powers fast, secure, and scalable digital experiences. Move beyond your content delivery network to their powerful edge cloud platform. Learn more at fastly.com.
  • Rollbar – We catch our errors before our users do because of Rollbar. Resolve errors in minutes, and deploy your code with confidence. Learn more at rollbar.com/changelog.
  • Linode – Our cloud server of choice. Deploy a fast, efficient, native SSD cloud server for only $5/month. Get 4 months free using the code changelog2018. Start your server - head to linode.com/changelog
  • Algolia – Our search partner. Algolia’s full suite search APIs enable teams to develop unique search and discovery experiences across all platforms and devices. We’re using Algolia to power our site search here at Changelog.com. Get started for free and learn more at algolia.com.

    • Featuring:

    • Chris Benson – Website, GitHub, LinkedIn, X
    • Daniel Whitenack – Website, GitHub, X

    Show Notes:

    News/Discussion:

    • Is artificial intelligence set to become art’s next medium?
    • BERT (a new method for obtaining rich contextual language representations during pre-training):
      • Google research article
      • TensorFlow BERT
      • BERT paper
      • PyTorch BERT
      • NY Times article
      • Example Colab notebook
      • BERT explained article
      • Transformer paper
      • Google Open Sources BERT to Train Natural Language Models Without Breaking the Bank
      • Horizon: The first open source reinforcement learning platform for large-scale products and services
      • Does Synthetic Data Hold The Secret To Artificial Intelligence?
      • AI Experts: Moving forward with AI likely a series of small steps, not giant leaps

        • Learning resources:

        • The Backpropagation Algorithm Demystified

          • Books

          • “Grokking Deep Learning” by Andrew Trask

            • Something missing or broken? PRs welcome!

            ...more
            View all episodesView all episodes
            Download on the App Store
            Practical AIBy Practical AI LLC
            • 4.4
            • 4.4
            • 4.4
            • 4.4
            • 4.4

            4.4

            185 ratings

            More shows like Practical AI

            View all
            The AI in Business Podcast by Daniel Faggella

            The AI in Business Podcast

            170 Listeners

            Super Data Science: ML & AI Podcast with Jon Krohn by Jon Krohn

            Super Data Science: ML & AI Podcast with Jon Krohn

            303 Listeners

            NVIDIA AI Podcast by NVIDIA

            NVIDIA AI Podcast

            334 Listeners

            Last Week in AI by Skynet Today

            Last Week in AI

            306 Listeners

            Machine Learning Street Talk (MLST) by Machine Learning Street Talk (MLST)

            Machine Learning Street Talk (MLST)

            95 Listeners

            Me, Myself, and AI by MIT Sloan Management Review

            Me, Myself, and AI

            110 Listeners

            AI Chat: ChatGPT, AI News, Artificial Intelligence, OpenAI, Machine Learning by Jaeden Schafer

            AI Chat: ChatGPT, AI News, Artificial Intelligence, OpenAI, Machine Learning

            154 Listeners

            This Day in AI Podcast by Michael Sharkey, Chris Sharkey

            This Day in AI Podcast

            227 Listeners

            The AI Daily Brief: Artificial Intelligence News and Analysis by Nathaniel Whittemore

            The AI Daily Brief: Artificial Intelligence News and Analysis

            608 Listeners

            AI For Humans: Making Artificial Intelligence Fun & Practical by Kevin Pereira & Gavin Purcell

            AI For Humans: Making Artificial Intelligence Fun & Practical

            275 Listeners

            Everyday AI Podcast – An AI and ChatGPT Podcast by Everyday AI

            Everyday AI Podcast – An AI and ChatGPT Podcast

            107 Listeners

            A Beginner's Guide to AI by Dietmar Fischer

            A Beginner's Guide to AI

            54 Listeners

            AI Hustle: Make Money from AI and ChatGPT, Midjourney, NVIDIA, Anthropic, OpenAI by Jaeden Schafer and Jamie McCauley

            AI Hustle: Make Money from AI and ChatGPT, Midjourney, NVIDIA, Anthropic, OpenAI

            173 Listeners

            AI + a16z by a16z

            AI + a16z

            35 Listeners

            The TED AI Show by TED

            The TED AI Show

            49 Listeners