Generative AI 101

The LMSArena Illusion


Listen Later

Ever wonder who’s really winning the Chatbot Arena and whether those wins mean anything at all? In this episode of Generative AI 101, host Emily Laird's blowing the lid off the leaderboard. Turns out, the top bots might’ve had a little… help. Like submitting 27 secret versions and quietly deleting the losers help. We break down The Leaderboard Illusion, a new research paper, is exposing how big tech plays with the rules, while open-source models get ghosted like last year’s crypto pitch. From rigged matchups to sketchy score retractions and mysteriously vanished models, this one’s part statistical roast, part AI crime scene investigation. Spoiler: the leaderboard might be lying to you. 

The Leaderboard Illusion Paper 


Connect with Us: If you enjoyed this episode or have questions, reach out to Emily Laird on LinkedIn. Stay tuned for more insights into the evolving world of generative AI. And remember, you now know more about the Leaderboard Illusion now than you did before! 
 

Connect with Emily Laird on LinkedIn 

...more
View all episodesView all episodes
Download on the App Store

Generative AI 101By Emily Laird

  • 4.6
  • 4.6
  • 4.6
  • 4.6
  • 4.6

4.6

20 ratings


More shows like Generative AI 101

View all
Freakonomics Radio by Freakonomics Radio + Stitcher

Freakonomics Radio

32,110 Listeners

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch by Harry Stebbings

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

543 Listeners

WSJ Tech News Briefing by The Wall Street Journal

WSJ Tech News Briefing

1,655 Listeners

Up First from NPR by NPR

Up First from NPR

56,577 Listeners

The Diary Of A CEO with Steven Bartlett by DOAC

The Diary Of A CEO with Steven Bartlett

8,542 Listeners

Cybersecurity Today by Jim Love

Cybersecurity Today

179 Listeners

Practical AI by Practical AI LLC

Practical AI

213 Listeners

On Purpose with Jay Shetty by iHeartPodcasts

On Purpose with Jay Shetty

27,831 Listeners

Cautionary Tales with Tim Harford by Pushkin Industries

Cautionary Tales with Tim Harford

5,108 Listeners

All-In with Chamath, Jason, Sacks & Friedberg by All-In Podcast, LLC

All-In with Chamath, Jason, Sacks & Friedberg

10,178 Listeners

The Ezra Klein Show by New York Times Opinion

The Ezra Klein Show

16,215 Listeners

Networth and Chill with Your Rich BFF by Vivian Tu

Networth and Chill with Your Rich BFF

1,777 Listeners

The AI Daily Brief: Artificial Intelligence News and Analysis by Nathaniel Whittemore

The AI Daily Brief: Artificial Intelligence News and Analysis

693 Listeners

Everyday AI Podcast – An AI and ChatGPT Podcast by Everyday AI

Everyday AI Podcast – An AI and ChatGPT Podcast

111 Listeners

Generative AI Basics by Anand V

Generative AI Basics

1 Listeners