Data Science at Home

From Tokens to Vectors: The Efficiency Hack That Could Save AI (Ep. 294)

Listen Later

LLMs generate text painfully slow, one low-info token at a time. Researchers just figured out how to compress 4 tokens into smart vectors & cut costs by 44%—with full code & proofs! Meanwhile OpenAI drops product ads, not papers.

We explore CALM & why open science matters. 🔥📊

 

Sponsors

This episode is brought to you by Statistical Horizons 

At Statistical Horizons, you can stay ahead with expert-led livestream seminars that make data analytics and AI methods practical and accessible.
Join thousands of researchers and professionals who’ve advanced their careers with Statistical Horizons.
Get $200 off any seminar with code DATA25 at https://statisticalhorizons.com

 

...more
View all episodesView all episodes
Download on the App Store
Data Science at HomeBy Francesco Gadaleta
  • 4.2
  • 4.2
  • 4.2
  • 4.2
  • 4.2

4.2

72 ratings

More shows like Data Science at Home

View all
Freakonomics Radio by Freakonomics Radio + Stitcher

Freakonomics Radio

32,185 Listeners

Global News Podcast by BBC World Service

Global News Podcast

7,766 Listeners

The Political Scene | The New Yorker by The New Yorker

The Political Scene | The New Yorker

4,046 Listeners

More or Less by BBC Radio 4

More or Less

891 Listeners

Software Engineering Daily by Software Engineering Daily

Software Engineering Daily

624 Listeners

Talk Python To Me by Michael Kennedy

Talk Python To Me

580 Listeners

Science Friday by Science Friday and WNYC Studios

Science Friday

6,422 Listeners

Super Data Science: ML & AI Podcast with Jon Krohn by Jon Krohn

Super Data Science: ML & AI Podcast with Jon Krohn

303 Listeners

FT Tech Tonic by Financial Times

FT Tech Tonic

93 Listeners

The Diary Of A CEO with Steven Bartlett by DOAC

The Diary Of A CEO with Steven Bartlett

8,530 Listeners

DataFramed by DataCamp

DataFramed

269 Listeners

Worklife with Adam Grant by TED

Worklife with Adam Grant

9,169 Listeners

Practical AI by Practical AI LLC

Practical AI

199 Listeners

The Rest Is History by Goalhanger

The Rest Is History

15,616 Listeners

Huberman Lab by Scicomm Media

Huberman Lab

29,277 Listeners