Generative AI 101

The LMSArena Illusion


Listen Later

Ever wonder who’s really winning the Chatbot Arena and whether those wins mean anything at all? In this episode of Generative AI 101, host Emily Laird's blowing the lid off the leaderboard. Turns out, the top bots might’ve had a little… help. Like submitting 27 secret versions and quietly deleting the losers help. We break down The Leaderboard Illusion, a new research paper, is exposing how big tech plays with the rules, while open-source models get ghosted like last year’s crypto pitch. From rigged matchups to sketchy score retractions and mysteriously vanished models, this one’s part statistical roast, part AI crime scene investigation. Spoiler: the leaderboard might be lying to you. 

The Leaderboard Illusion Paper 


Connect with Us: If you enjoyed this episode or have questions, reach out to Emily Laird on LinkedIn. Stay tuned for more insights into the evolving world of generative AI. And remember, you now know more about the Leaderboard Illusion now than you did before! 
 

Connect with Emily Laird on LinkedIn 

...more
View all episodesView all episodes
Download on the App Store

Generative AI 101By Emily Laird

  • 4.8
  • 4.8
  • 4.8
  • 4.8
  • 4.8

4.8

13 ratings


More shows like Generative AI 101

View all
Gartner ThinkCast by Gartner

Gartner ThinkCast

107 Listeners

Super Data Science: ML & AI Podcast with Jon Krohn by Jon Krohn

Super Data Science: ML & AI Podcast with Jon Krohn

295 Listeners

NVIDIA AI Podcast by NVIDIA

NVIDIA AI Podcast

324 Listeners

Practical AI by Practical AI LLC

Practical AI

188 Listeners

Last Week in AI by Skynet Today

Last Week in AI

281 Listeners

Me, Myself, and AI by MIT Sloan Management Review and Boston Consulting Group (BCG)

Me, Myself, and AI

102 Listeners

AI Applied: Covering AI News, Interviews and Tools - ChatGPT, Midjourney, Gemini, OpenAI, Anthropic by Jaeden Schafer and Conor Grennan

AI Applied: Covering AI News, Interviews and Tools - ChatGPT, Midjourney, Gemini, OpenAI, Anthropic

124 Listeners

AI Chat: ChatGPT & AI News, Artificial Intelligence, OpenAI, Machine Learning by Jaeden Schafer

AI Chat: ChatGPT & AI News, Artificial Intelligence, OpenAI, Machine Learning

140 Listeners

AI Hustle: Make Money from AI and ChatGPT, Midjourney, NVIDIA, Anthropic, OpenAI by Jaeden Schafer and Jamie McCauley

AI Hustle: Make Money from AI and ChatGPT, Midjourney, NVIDIA, Anthropic, OpenAI

62 Listeners

This Day in AI Podcast by Michael Sharkey, Chris Sharkey

This Day in AI Podcast

196 Listeners

The AI Daily Brief (Formerly The AI Breakdown): Artificial Intelligence News and Analysis by Nathaniel Whittemore

The AI Daily Brief (Formerly The AI Breakdown): Artificial Intelligence News and Analysis

426 Listeners

AI For Humans: Making Artificial Intelligence Fun & Practical by Kevin Pereira & Gavin Purcell

AI For Humans: Making Artificial Intelligence Fun & Practical

234 Listeners

A Beginner's Guide to AI by Dietmar Fischer

A Beginner's Guide to AI

29 Listeners

Beyond The Prompt - How to use AI in your company by Jeremy Utley & Henrik Werdelin

Beyond The Prompt - How to use AI in your company

38 Listeners

The TED AI Show by TED

The TED AI Show

48 Listeners