The Information Bottleneck

EP1: Sampling


Listen Later

Allen and Ravid discuss a topic near and dear to their hearts, LLM Sampling!

In this episode of the Information Bottleneck Podcast, Ravid Shwartz-Ziv and Alan Rausch discuss the latest developments in AI, focusing on the controversial release of GPT-5 and its implications for users. They explore the future of large language models and the importance of sampling techniques in AI.

Chapters

00:00 Introduction to the Information Bottleneck Podcast

01:42 The GPT-5 Debacle: Expectations vs. Reality

05:48 Shifting Paradigms in AI Research

09:46 The Future of Large Language Models

12:56 OpenAI's New Model: A Mixed Bag

17:55 Corporate Dynamics in AI: Mergers and Acquisitions

21:39 The GPU Monopoly: Challenges and Opportunities

25:31 Deep Dive into Samplers in AI

35:38 Innovations in Sampling Techniques

42:31 Dynamic Sampling Methods and Their Implications

51:50 Learning Samplers: A New Frontier

59:51 Recent Papers and Their Impact on AI Research

...more
View all episodesView all episodes
Download on the App Store

The Information BottleneckBy Ravid Shwartz-Ziv & Allen Roush

  • 5
  • 5
  • 5
  • 5
  • 5

5

4 ratings


More shows like The Information Bottleneck

View all
The New Yorker Radio Hour by WNYC Studios and The New Yorker

The New Yorker Radio Hour

6,881 Listeners

Fareed Zakaria GPS by CNN Podcasts

Fareed Zakaria GPS

3,447 Listeners

Macro Voices by Hedge Fund Manager Erik Townsend

Macro Voices

3,072 Listeners

Odd Lots by Bloomberg

Odd Lots

1,993 Listeners

The a16z Show by Andreessen Horowitz

The a16z Show

1,105 Listeners

Practical AI by Practical AI LLC

Practical AI

212 Listeners

Interesting Times with Ross Douthat by New York Times Opinion

Interesting Times with Ross Douthat

7,244 Listeners

Google DeepMind: The Podcast by Hannah Fry

Google DeepMind: The Podcast

203 Listeners

Last Week in AI by Skynet Today

Last Week in AI

313 Listeners

Machine Learning Street Talk (MLST) by Machine Learning Street Talk (MLST)

Machine Learning Street Talk (MLST)

101 Listeners

Dwarkesh Podcast by Dwarkesh Patel

Dwarkesh Podcast

551 Listeners

Big Technology Podcast by Alex Kantrowitz

Big Technology Podcast

512 Listeners

Moonshots with Peter Diamandis by PHD Ventures

Moonshots with Peter Diamandis

602 Listeners

No Priors: Artificial Intelligence | Technology | Startups by Conviction

No Priors: Artificial Intelligence | Technology | Startups

150 Listeners

"Econ 102" with Noah Smith and Erik Torenberg by Turpentine

"Econ 102" with Noah Smith and Erik Torenberg

147 Listeners