Sign up to save your podcasts
Or
Share From Tokens to Vectors: The Efficiency Hack That Could Save AI (Ep. 294)
Share to email
Share to Facebook
Share to X
Share to email
Share to Facebook
Share to X
Or
From Tokens to Vectors: The Efficiency Hack That Could Save AI (Ep. 294)
LLMs generate text painfully slow, one low-info token at a time. Researchers just figured out how to compress 4 tokens into smart vectors & cut costs by 44%—with full code & proofs! Meanwhile OpenAI drops product ads, not papers.
We explore CALM & why open science matters. 🔥📊
Sponsors
This episode is brought to you by Statistical Horizons
At Statistical Horizons, you can stay ahead with expert-led livestream seminars that make data analytics and AI methods practical and accessible.
Join thousands of researchers and professionals who’ve advanced their careers with Statistical Horizons.
Get $200 off any seminar with code DATA25 at https://statisticalhorizons.com
View all episodes
By Francesco Gadaleta
4.2
7171 ratings
LLMs generate text painfully slow, one low-info token at a time. Researchers just figured out how to compress 4 tokens into smart vectors & cut costs by 44%—with full code & proofs! Meanwhile OpenAI drops product ads, not papers.
We explore CALM & why open science matters. 🔥📊
Sponsors
This episode is brought to you by Statistical Horizons
At Statistical Horizons, you can stay ahead with expert-led livestream seminars that make data analytics and AI methods practical and accessible.
Join thousands of researchers and professionals who’ve advanced their careers with Statistical Horizons.
Get $200 off any seminar with code DATA25 at https://statisticalhorizons.com
More shows like Data Science at Home
View all
This Week in Startups
1,289 Listeners
The McKinsey Podcast
392 Listeners
Data Skeptic
478 Listeners
Software Engineering Daily
624 Listeners
HBR IdeaCast
175 Listeners
Soft Skills Engineering
288 Listeners
Super Data Science: ML & AI Podcast with Jon Krohn
303 Listeners
NVIDIA AI Podcast
342 Listeners
Data Engineering Podcast
146 Listeners
DataFramed
268 Listeners
Practical AI
212 Listeners
Machine Learning Street Talk (MLST)
90 Listeners
Latent Space: The AI Engineer Podcast
96 Listeners
This Day in AI Podcast
209 Listeners
The AI Daily Brief: Artificial Intelligence News and Analysis
591 Listeners