Data Science at Home

From Tokens to Vectors: The Efficiency Hack That Could Save AI (Ep. 294)

Listen Later

LLMs generate text painfully slow, one low-info token at a time. Researchers just figured out how to compress 4 tokens into smart vectors & cut costs by 44%—with full code & proofs! Meanwhile OpenAI drops product ads, not papers.

We explore CALM & why open science matters. 🔥📊

 

Sponsors

This episode is brought to you by Statistical Horizons 

At Statistical Horizons, you can stay ahead with expert-led livestream seminars that make data analytics and AI methods practical and accessible.
Join thousands of researchers and professionals who’ve advanced their careers with Statistical Horizons.
Get $200 off any seminar with code DATA25 at https://statisticalhorizons.com

 

...more
View all episodesView all episodes
Download on the App Store
Data Science at HomeBy Francesco Gadaleta
  • 4.2
  • 4.2
  • 4.2
  • 4.2
  • 4.2

4.2

72 ratings

More shows like Data Science at Home

View all
On Point with Meghna Chakrabarti by WBUR

On Point with Meghna Chakrabarti

3,999 Listeners

Making Sense with Sam Harris by Sam Harris

Making Sense with Sam Harris

26,335 Listeners

Nature Podcast by Springer Nature Limited

Nature Podcast

766 Listeners

Software Engineering Daily by Software Engineering Daily

Software Engineering Daily

623 Listeners

Science Vs by Spotify Studios

Science Vs

12,155 Listeners

Science Friday by Science Friday and WNYC Studios

Science Friday

6,466 Listeners

Super Data Science: ML & AI Podcast with Jon Krohn by Jon Krohn

Super Data Science: ML & AI Podcast with Jon Krohn

301 Listeners

The Daily by The New York Times

The Daily

113,521 Listeners

Up First from NPR by NPR

Up First from NPR

57,033 Listeners

The Atlantic Interview by The Atlantic

The Atlantic Interview

25 Listeners

Modern Wisdom by Chris Williamson

Modern Wisdom

4,115 Listeners

The Peter Attia Drive by Peter Attia, MD

The Peter Attia Drive

8,704 Listeners

Practical AI by Practical AI LLC

Practical AI

204 Listeners

Consider This from NPR by NPR

Consider This from NPR

6,470 Listeners

The Ezra Klein Show by New York Times Opinion

The Ezra Klein Show

16,427 Listeners