Sign up to save your podcasts
Or
Share LLM Benchmarks: How to Know Which AI Is Better
Share to email
Share to Facebook
Share to X
Share to email
Share to Facebook
Share to X
Or
LLM Benchmarks: How to Know Which AI Is Better
Beyond ChatGPT and Gemini: Anthropic's Claude and the $4 billion Amazon investment. How AI industry benchmarks work, including LMSYS Arena Elo and MMLU (Measuring Massive Multitask Language Understanding). How benchmarks are constructed, what they measure, and how to use them to evaluate LLMs. Solo episode.
Anthropic's Claude
https://claude.ai [Note: I am not sponsored by Anthropic]
LMSYS Leaderboard
https://chat.lmsys.org/?leaderboard
To stay in touch, sign up for our newsletter at https://www.superprompt.fm
View all episodes
By Tony Wan
5
1717 ratings
Beyond ChatGPT and Gemini: Anthropic's Claude and the $4 billion Amazon investment. How AI industry benchmarks work, including LMSYS Arena Elo and MMLU (Measuring Massive Multitask Language Understanding). How benchmarks are constructed, what they measure, and how to use them to evaluate LLMs. Solo episode.
Anthropic's Claude
https://claude.ai [Note: I am not sponsored by Anthropic]
LMSYS Leaderboard
https://chat.lmsys.org/?leaderboard
To stay in touch, sign up for our newsletter at https://www.superprompt.fm
More shows like Super Prompt: Generative AI
View all
Freakonomics Radio
31,971 Listeners
99% Invisible
26,224 Listeners
Mad Money w/ Jim Cramer
4,065 Listeners
The a16z Show
1,091 Listeners
Super Data Science: ML & AI Podcast with Jon Krohn
301 Listeners
NVIDIA AI Podcast
334 Listeners
Practical AI
207 Listeners
All-In with Chamath, Jason, Sacks & Friedberg
9,925 Listeners
People I (Mostly) Admire
2,072 Listeners
The Artificial Intelligence Show
197 Listeners
ReThinking
635 Listeners
The AI Daily Brief: Artificial Intelligence News and Analysis
616 Listeners
HBR On Leadership
163 Listeners
BG2Pod with Brad Gerstner and Bill Gurley
466 Listeners
Face-Off: The U.S. vs China
164 Listeners