Generative AI 101

The LMSArena Illusion


Listen Later

Ever wonder who’s really winning the Chatbot Arena and whether those wins mean anything at all? In this episode of Generative AI 101, host Emily Laird's blowing the lid off the leaderboard. Turns out, the top bots might’ve had a little… help. Like submitting 27 secret versions and quietly deleting the losers help. We break down The Leaderboard Illusion, a new research paper, is exposing how big tech plays with the rules, while open-source models get ghosted like last year’s crypto pitch. From rigged matchups to sketchy score retractions and mysteriously vanished models, this one’s part statistical roast, part AI crime scene investigation. Spoiler: the leaderboard might be lying to you. 

The Leaderboard Illusion Paper 


Connect with Us: If you enjoyed this episode or have questions, reach out to Emily Laird on LinkedIn. Stay tuned for more insights into the evolving world of generative AI. And remember, you now know more about the Leaderboard Illusion now than you did before! 
 

Connect with Emily Laird on LinkedIn 

...more
View all episodesView all episodes
Download on the App Store

Generative AI 101By Emily Laird

  • 4.6
  • 4.6
  • 4.6
  • 4.6
  • 4.6

4.6

20 ratings


More shows like Generative AI 101

View all
Freakonomics Radio by Freakonomics Radio + Stitcher

Freakonomics Radio

32,246 Listeners

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch by Harry Stebbings

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

536 Listeners

WSJ Tech News Briefing by The Wall Street Journal

WSJ Tech News Briefing

1,649 Listeners

Up First from NPR by NPR

Up First from NPR

56,944 Listeners

The Diary Of A CEO with Steven Bartlett by DOAC

The Diary Of A CEO with Steven Bartlett

8,876 Listeners

Cybersecurity Today by Jim Love

Cybersecurity Today

175 Listeners

Practical AI by Practical AI LLC

Practical AI

212 Listeners

On Purpose with Jay Shetty by iHeartPodcasts

On Purpose with Jay Shetty

27,584 Listeners

Cautionary Tales with Tim Harford by Pushkin Industries

Cautionary Tales with Tim Harford

5,109 Listeners

All-In with Chamath, Jason, Sacks & Friedberg by All-In Podcast, LLC

All-In with Chamath, Jason, Sacks & Friedberg

10,254 Listeners

The Ezra Klein Show by New York Times Opinion

The Ezra Klein Show

16,525 Listeners

Networth and Chill with Your Rich BFF by Vivian Tu

Networth and Chill with Your Rich BFF

1,788 Listeners

The AI Daily Brief: Artificial Intelligence News and Analysis by Nathaniel Whittemore

The AI Daily Brief: Artificial Intelligence News and Analysis

688 Listeners

Everyday AI Podcast – An AI and ChatGPT Podcast by Everyday AI

Everyday AI Podcast – An AI and ChatGPT Podcast

112 Listeners

Generative AI Basics by Anand V

Generative AI Basics

0 Listeners