The Information Bottleneck

EP16: AI News and Papers


Listen Later

In this episode, we discuss various topics in AI, including the challenges of the conference review process, the capabilities of Kimi K2 thinking, the advancements in TPU technology, the significance of real-world data in robotics, and recent innovations in AI research. We also talk about the cool "Chain of Thought Hijacking" paper, how to use simple ideas to scale RL, and the implications of the Cosmos project, which aims to enable autonomous scientific discovery through AI.

Papers and links:

  • Chain-of-Thought Hijacking - https://arxiv.org/pdf/2510.26418
  • Kosmos: An AI Scientist for Autonomous Discovery - https://t.co/9pCr6AUXAe
  • JustRL: Scaling a 1.5B LLM with a Simple RL Recipe - https://relieved-cafe-fe1.notion.site/JustRL-Scaling-a-1-5B-LLM-with-a-Simple-RL-Recipe-24f6198b0b6b80e48e74f519bfdaf0a8

Chapters

00:00 Navigating the Peer Review Process

04:17 Kimi K2 Thinking: A New Era in AI

12:27 The Future of Tool Calls in AI

17:12 Exploring Google's New TPUs

22:04 The Importance of Real-World Data in Robotics

28:10 World Models: The Next Frontier in AI

31:36 Nvidia's Dominance in AI Partnerships

32:08 Exploring Recent AI Research Papers

37:46 Chain of Thought Hijacking: A New Threat

43:05 Simplifying Reinforcement Learning Training

54:03 Cosmos: AI for Autonomous Scientific Discovery

Music:

"Kid Kodi" — Blue Dot Sessions — via Free Music Archive — CC BY-NC 4.0.

"Palms Down" — Blue Dot Sessions — via Free Music Archive — CC BY-NC 4.0.

Changes: trimmed

...more
View all episodesView all episodes
Download on the App Store

The Information BottleneckBy Ravid Shwartz-Ziv & Allen Roush

  • 5
  • 5
  • 5
  • 5
  • 5

5

4 ratings


More shows like The Information Bottleneck

View all
The New Yorker Radio Hour by WNYC Studios and The New Yorker

The New Yorker Radio Hour

6,881 Listeners

Fareed Zakaria GPS by CNN Podcasts

Fareed Zakaria GPS

3,447 Listeners

Macro Voices by Hedge Fund Manager Erik Townsend

Macro Voices

3,072 Listeners

Odd Lots by Bloomberg

Odd Lots

1,993 Listeners

The a16z Show by Andreessen Horowitz

The a16z Show

1,105 Listeners

Practical AI by Practical AI LLC

Practical AI

212 Listeners

Interesting Times with Ross Douthat by New York Times Opinion

Interesting Times with Ross Douthat

7,244 Listeners

Google DeepMind: The Podcast by Hannah Fry

Google DeepMind: The Podcast

203 Listeners

Last Week in AI by Skynet Today

Last Week in AI

313 Listeners

Machine Learning Street Talk (MLST) by Machine Learning Street Talk (MLST)

Machine Learning Street Talk (MLST)

101 Listeners

Dwarkesh Podcast by Dwarkesh Patel

Dwarkesh Podcast

551 Listeners

Big Technology Podcast by Alex Kantrowitz

Big Technology Podcast

512 Listeners

Moonshots with Peter Diamandis by PHD Ventures

Moonshots with Peter Diamandis

602 Listeners

No Priors: Artificial Intelligence | Technology | Startups by Conviction

No Priors: Artificial Intelligence | Technology | Startups

150 Listeners

"Econ 102" with Noah Smith and Erik Torenberg by Turpentine

"Econ 102" with Noah Smith and Erik Torenberg

147 Listeners