Data Science at Home

From Tokens to Vectors: The Efficiency Hack That Could Save AI (Ep. 294)

Listen Later

LLMs generate text painfully slow, one low-info token at a time. Researchers just figured out how to compress 4 tokens into smart vectors & cut costs by 44%—with full code & proofs! Meanwhile OpenAI drops product ads, not papers.

We explore CALM & why open science matters. 🔥📊

 

Sponsors

This episode is brought to you by Statistical Horizons 

At Statistical Horizons, you can stay ahead with expert-led livestream seminars that make data analytics and AI methods practical and accessible.
Join thousands of researchers and professionals who’ve advanced their careers with Statistical Horizons.
Get $200 off any seminar with code DATA25 at https://statisticalhorizons.com

 

...more
View all episodesView all episodes
Download on the App Store
Data Science at HomeBy Francesco Gadaleta
  • 4.2
  • 4.2
  • 4.2
  • 4.2
  • 4.2

4.2

72 ratings

More shows like Data Science at Home

View all
On Point with Meghna Chakrabarti by WBUR

On Point with Meghna Chakrabarti

4,004 Listeners

Making Sense with Sam Harris by Sam Harris

Making Sense with Sam Harris

26,409 Listeners

Nature Podcast by Springer Nature Limited

Nature Podcast

762 Listeners

Software Engineering Daily by Software Engineering Daily

Software Engineering Daily

627 Listeners

Science Vs by Spotify Studios

Science Vs

12,159 Listeners

Science Friday by Science Friday and WNYC Studios

Science Friday

6,434 Listeners

Super Data Science: ML & AI Podcast with Jon Krohn by Jon Krohn

Super Data Science: ML & AI Podcast with Jon Krohn

302 Listeners

The Daily by The New York Times

The Daily

113,095 Listeners

Up First from NPR by NPR

Up First from NPR

56,827 Listeners

The Atlantic Interview by The Atlantic

The Atlantic Interview

27 Listeners

Modern Wisdom by Chris Williamson

Modern Wisdom

4,075 Listeners

The Peter Attia Drive by Peter Attia, MD

The Peter Attia Drive

8,192 Listeners

Practical AI by Practical AI LLC

Practical AI

215 Listeners

Consider This from NPR by NPR

Consider This from NPR

6,446 Listeners

The Ezra Klein Show by New York Times Opinion

The Ezra Klein Show

16,492 Listeners