Data Science at Home

From Tokens to Vectors: The Efficiency Hack That Could Save AI (Ep. 294)

Listen Later

LLMs generate text painfully slow, one low-info token at a time. Researchers just figured out how to compress 4 tokens into smart vectors & cut costs by 44%—with full code & proofs! Meanwhile OpenAI drops product ads, not papers.

We explore CALM & why open science matters. 🔥📊

 

Sponsors

This episode is brought to you by Statistical Horizons 

At Statistical Horizons, you can stay ahead with expert-led livestream seminars that make data analytics and AI methods practical and accessible.
Join thousands of researchers and professionals who’ve advanced their careers with Statistical Horizons.
Get $200 off any seminar with code DATA25 at https://statisticalhorizons.com

 

...more
View all episodesView all episodes
Download on the App Store
Data Science at HomeBy Francesco Gadaleta
  • 4.2
  • 4.2
  • 4.2
  • 4.2
  • 4.2

4.2

72 ratings

More shows like Data Science at Home

View all
On Point with Meghna Chakrabarti by WBUR

On Point with Meghna Chakrabarti

4,027 Listeners

Making Sense with Sam Harris by Sam Harris

Making Sense with Sam Harris

26,384 Listeners

Nature Podcast by Springer Nature Limited

Nature Podcast

753 Listeners

Software Engineering Daily by Software Engineering Daily

Software Engineering Daily

628 Listeners

Science Vs by Spotify Studios

Science Vs

12,133 Listeners

Science Friday by Science Friday and WNYC Studios

Science Friday

6,463 Listeners

Super Data Science: ML & AI Podcast with Jon Krohn by Jon Krohn

Super Data Science: ML & AI Podcast with Jon Krohn

305 Listeners

The Daily by The New York Times

The Daily

113,307 Listeners

Up First from NPR by NPR

Up First from NPR

56,974 Listeners

The Atlantic Interview by The Atlantic

The Atlantic Interview

15 Listeners

Modern Wisdom by Chris Williamson

Modern Wisdom

4,027 Listeners

The Peter Attia Drive by Peter Attia, MD

The Peter Attia Drive

8,037 Listeners

Practical AI by Practical AI LLC

Practical AI

209 Listeners

Consider This from NPR by NPR

Consider This from NPR

6,466 Listeners

The Ezra Klein Show by New York Times Opinion

The Ezra Klein Show

16,508 Listeners