Super Data Science: ML & AI Podcast with Jon Krohn

929: Dragon Hatchling: The Missing Link Between Transformers and the Brain, with Adrian Kosowski


Listen Later

Breaking news: Jon Krohn welcomes Adrian Kosowski to the show to talk about the groundbreaking research happening at Pathway. Adrian and his team demonstrate how they have brought attention in AI closer to the way the brain functions, creating, in essence, a “massively parallel system of [artificial] neurons” that communicate with one another and exhibit properties similar to natural neurons. The goal is to move beyond the current limitations of transformers, where reasoning can be generalized across more complex and extended reasoning patterns, approximating a more human-like approach to problem-solving.


This episode is brought to you by the Trainium2, the latest AI chip from AWS, by ⁠Dell⁠, by ⁠Intel⁠, by and ⁠Gurobi⁠.


Additional materials: ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠www.superdatascience.com/929⁠⁠


Interested in sponsoring a SuperDataScience Podcast episode? Email [email protected] for sponsorship information.


In this episode you will learn:

  • (01:27) Pathway’s ground-breaking new biologically inspired architecture
  • (20:40) Limitless context windows
  • (34:39) BDH architecture as positive space
  • (53:11) Building multilingual models
  • (1:01:07) How to access the BDH architecture
  • ...more
    View all episodesView all episodes
    Download on the App Store

    Super Data Science: ML & AI Podcast with Jon KrohnBy Jon Krohn

    • 4.6
    • 4.6
    • 4.6
    • 4.6
    • 4.6

    4.6

    295 ratings


    More shows like Super Data Science: ML & AI Podcast with Jon Krohn

    View all
    Data Skeptic by Kyle Polich

    Data Skeptic

    479 Listeners

    Software Engineering Daily by Software Engineering Daily

    Software Engineering Daily

    624 Listeners

    Talk Python To Me by Michael Kennedy

    Talk Python To Me

    585 Listeners

    NVIDIA AI Podcast by NVIDIA

    NVIDIA AI Podcast

    332 Listeners

    AI Today Podcast by AI & Data Today

    AI Today Podcast

    152 Listeners

    DataFramed by DataCamp

    DataFramed

    269 Listeners

    Practical AI by Practical AI LLC

    Practical AI

    210 Listeners

    The Real Python Podcast by Real Python

    The Real Python Podcast

    142 Listeners

    Machine Learning Street Talk (MLST) by Machine Learning Street Talk (MLST)

    Machine Learning Street Talk (MLST)

    95 Listeners

    No Priors: Artificial Intelligence | Technology | Startups by Conviction

    No Priors: Artificial Intelligence | Technology | Startups

    135 Listeners

    AI Chat: ChatGPT, AI News, Artificial Intelligence, OpenAI, Machine Learning by Jaeden Schafer

    AI Chat: ChatGPT, AI News, Artificial Intelligence, OpenAI, Machine Learning

    152 Listeners

    This Day in AI Podcast by Michael Sharkey, Chris Sharkey

    This Day in AI Podcast

    225 Listeners

    The AI Daily Brief: Artificial Intelligence News and Analysis by Nathaniel Whittemore

    The AI Daily Brief: Artificial Intelligence News and Analysis

    607 Listeners

    AI For Humans: Making Artificial Intelligence Fun & Practical by Kevin Pereira & Gavin Purcell

    AI For Humans: Making Artificial Intelligence Fun & Practical

    272 Listeners

    Training Data by Sequoia Capital

    Training Data

    39 Listeners