Data Science at Home

From Tokens to Vectors: The Efficiency Hack That Could Save AI (Ep. 294)

Listen Later

LLMs generate text painfully slow, one low-info token at a time. Researchers just figured out how to compress 4 tokens into smart vectors & cut costs by 44%—with full code & proofs! Meanwhile OpenAI drops product ads, not papers.

We explore CALM & why open science matters. 🔥📊

 

Sponsors

This episode is brought to you by Statistical Horizons 

At Statistical Horizons, you can stay ahead with expert-led livestream seminars that make data analytics and AI methods practical and accessible.
Join thousands of researchers and professionals who’ve advanced their careers with Statistical Horizons.
Get $200 off any seminar with code DATA25 at https://statisticalhorizons.com

 

...more
View all episodesView all episodes
Download on the App Store
Data Science at HomeBy Francesco Gadaleta
  • 4.2
  • 4.2
  • 4.2
  • 4.2
  • 4.2

4.2

72 ratings

More shows like Data Science at Home

View all
Freakonomics Radio by Freakonomics Radio + Stitcher

Freakonomics Radio

31,971 Listeners

Global News Podcast by BBC World Service

Global News Podcast

7,575 Listeners

WSJ Your Money Briefing by The Wall Street Journal

WSJ Your Money Briefing

1,706 Listeners

The a16z Show by Andreessen Horowitz

The a16z Show

1,091 Listeners

Software Engineering Daily by Software Engineering Daily

Software Engineering Daily

623 Listeners

Talk Python To Me by Michael Kennedy

Talk Python To Me

585 Listeners

Science Magazine Podcast by Science Magazine

Science Magazine Podcast

823 Listeners

Super Data Science: ML & AI Podcast with Jon Krohn by Jon Krohn

Super Data Science: ML & AI Podcast with Jon Krohn

301 Listeners

FT Tech Tonic by Financial Times

FT Tech Tonic

99 Listeners

Worklife with Adam Grant by TED

Worklife with Adam Grant

9,161 Listeners

Practical AI by Practical AI LLC

Practical AI

207 Listeners

Last Week in AI by Skynet Today

Last Week in AI

306 Listeners

Hard Fork by The New York Times

Hard Fork

5,512 Listeners

This Day in AI Podcast by Michael Sharkey, Chris Sharkey

This Day in AI Podcast

228 Listeners

The Last Invention by Longview

The Last Invention

1,104 Listeners