The Information Bottleneck

EP16: AI News and Papers


Listen Later

In this episode, we discuss various topics in AI, including the challenges of the conference review process, the capabilities of Kimi K2 thinking, the advancements in TPU technology, the significance of real-world data in robotics, and recent innovations in AI research. We also talk about the cool "Chain of Thought Hijacking" paper, how to use simple ideas to scale RL, and the implications of the Cosmos project, which aims to enable autonomous scientific discovery through AI.

Papers and links:

  • Chain-of-Thought Hijacking - https://arxiv.org/pdf/2510.26418
  • Kosmos: An AI Scientist for Autonomous Discovery - https://t.co/9pCr6AUXAe
  • JustRL: Scaling a 1.5B LLM with a Simple RL Recipe - https://relieved-cafe-fe1.notion.site/JustRL-Scaling-a-1-5B-LLM-with-a-Simple-RL-Recipe-24f6198b0b6b80e48e74f519bfdaf0a8

Chapters

00:00 Navigating the Peer Review Process

04:17 Kimi K2 Thinking: A New Era in AI

12:27 The Future of Tool Calls in AI

17:12 Exploring Google's New TPUs

22:04 The Importance of Real-World Data in Robotics

28:10 World Models: The Next Frontier in AI

31:36 Nvidia's Dominance in AI Partnerships

32:08 Exploring Recent AI Research Papers

37:46 Chain of Thought Hijacking: A New Threat

43:05 Simplifying Reinforcement Learning Training

54:03 Cosmos: AI for Autonomous Scientific Discovery

Music:

"Kid Kodi" — Blue Dot Sessions — via Free Music Archive — CC BY-NC 4.0.

"Palms Down" — Blue Dot Sessions — via Free Music Archive — CC BY-NC 4.0.

Changes: trimmed

...more
View all episodesView all episodes
Download on the App Store

The Information BottleneckBy Ravid Shwartz-Ziv & Allen Roush

  • 5
  • 5
  • 5
  • 5
  • 5

5

4 ratings


More shows like The Information Bottleneck

View all
Odd Lots by Bloomberg

Odd Lots

1,932 Listeners

Conversations with Tyler by Mercatus Center at George Mason University

Conversations with Tyler

2,455 Listeners

The a16z Show by Andreessen Horowitz

The a16z Show

1,091 Listeners

גיקונומי by ראם שרמן ודורון ניר

גיקונומי

91 Listeners

Super Data Science: ML & AI Podcast with Jon Krohn by Jon Krohn

Super Data Science: ML & AI Podcast with Jon Krohn

301 Listeners

Google DeepMind: The Podcast by Hannah Fry

Google DeepMind: The Podcast

203 Listeners

All-In with Chamath, Jason, Sacks & Friedberg by All-In Podcast, LLC

All-In with Chamath, Jason, Sacks & Friedberg

9,942 Listeners

Last Week in AI by Skynet Today

Last Week in AI

306 Listeners

Machine Learning Street Talk (MLST) by Machine Learning Street Talk (MLST)

Machine Learning Street Talk (MLST)

96 Listeners

Dwarkesh Podcast by Dwarkesh Patel

Dwarkesh Podcast

519 Listeners

No Priors: Artificial Intelligence | Technology | Startups by Conviction

No Priors: Artificial Intelligence | Technology | Startups

132 Listeners

Latent Space: The AI Engineer Podcast by swyx + Alessio

Latent Space: The AI Engineer Podcast

93 Listeners

The AI Daily Brief: Artificial Intelligence News and Analysis by Nathaniel Whittemore

The AI Daily Brief: Artificial Intelligence News and Analysis

617 Listeners

Money Stuff: The Podcast by Bloomberg

Money Stuff: The Podcast

393 Listeners

AI + a16z by a16z

AI + a16z

36 Listeners