"The Cognitive Revolution" | AI Builders, Researchers, and Live Player Analysis

Scaling Forecasting: AI Forecasting Tournaments & the Road to Epistemic Security, with Deger Turan, CEO of Metaculus


Listen Later

Nathan explores the cutting-edge world of AI-powered forecasting with Deger Turan, CEO of Metaculus. In this episode of The Cognitive Revolution, we discuss how AI is revolutionizing prediction markets, the potential for AI to outperform human forecasters, and Metaculus's ambitious new AI forecasting benchmark tournament. Join us for an insightful conversation about the future of decision-making and collective intelligence.

Participate in Metaculus' first of its kind bot forecasting tournament: https://www.metaculus.com/aib/

Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj


RECOMMENDED PODCAST:

🎙️ This Won't Last - Eavesdrop on Keith Rabois, Kevin Ryan, Logan Bartlett, and Zach Weinberg's monthly backchannel. They unpack their hottest takes on the future of tech, business, venture, investing, and politics.

Apple Podcasts: https://podcasts.apple.com/us/podcast/id1765665937

Spotify: https://open.spotify.com/show/2HwSNeVLL1MXy0RjFPyOSz

YouTube: https://www.youtube.com/@ThisWontLastpodcast


SPONSORS:

Building an enterprise-ready SaaS app? WorkOS has got you covered with easy-to-integrate APIs for SAML, SCIM, and more. Join top startups like Vercel, Perplexity, Jasper & Webflow in powering your app with WorkOS. Enjoy a free tier for up to 1M users! Start now at https://bit.ly/WorkOS-Turpentine-Network

80,000 Hours offers free one-on-one career advising for Cognitive Revolution listeners aiming to tackle global challenges, especially in AI. They connect high-potential individuals with experts, opportunities, and personalized career plans to maximize positive impact. Apply for a free call at https://80000hours.org/cognitiverevolution to accelerate your career and contribute to solving pressing AI-related issues.

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.


CHAPTERS:

(00:00:00) About the Show

(00:00:22) Sponsor: WorkOS

(00:01:22) About the Episode

(00:04:47) Introduction and Background

(00:08:42) Deger's Journey to Forecasting

(00:13:06) Current State of Forecasting

(00:20:23) Sponsors: 80,000 Hours | Brave

(00:22:55) Overview of Metaculous

(00:23:30) AI Forecasting Research Papers

(00:35:44) Sponsors: Omneky | Squad

(00:37:31) AI Forecasting Benchmark Tournament

(00:44:01) Improving Forecasting Accuracy

(00:51:56) Scoring System and Tournament Rules

(01:04:17) AI Forecasting Benchmark Series Details

(01:11:03) Tournament Structure and Participation

(01:17:07) Consistency in AI Forecasting

(01:34:36) Risks and Challenges in Forecasting

(01:42:43) Consensus Illusion and Policy Making

(01:53:55) Outro

...more
View all episodesView all episodes
Download on the App Store

"The Cognitive Revolution" | AI Builders, Researchers, and Live Player AnalysisBy Erik Torenberg, Nathan Labenz

  • 4.5
  • 4.5
  • 4.5
  • 4.5
  • 4.5

4.5

90 ratings


More shows like "The Cognitive Revolution" | AI Builders, Researchers, and Live Player Analysis

View all
The a16z Show by Andreessen Horowitz

The a16z Show

1,089 Listeners

Super Data Science: ML & AI Podcast with Jon Krohn by Jon Krohn

Super Data Science: ML & AI Podcast with Jon Krohn

303 Listeners

Y Combinator Startup Podcast by Y Combinator

Y Combinator Startup Podcast

226 Listeners

Practical AI by Practical AI LLC

Practical AI

208 Listeners

Machine Learning Street Talk (MLST) by Machine Learning Street Talk (MLST)

Machine Learning Street Talk (MLST)

95 Listeners

Dwarkesh Podcast by Dwarkesh Patel

Dwarkesh Podcast

512 Listeners

No Priors: Artificial Intelligence | Technology | Startups by Conviction

No Priors: Artificial Intelligence | Technology | Startups

130 Listeners

This Day in AI Podcast by Michael Sharkey, Chris Sharkey

This Day in AI Podcast

227 Listeners

The AI Daily Brief: Artificial Intelligence News and Analysis by Nathaniel Whittemore

The AI Daily Brief: Artificial Intelligence News and Analysis

608 Listeners

The MAD Podcast with Matt Turck by Matt Turck

The MAD Podcast with Matt Turck

27 Listeners

AI and I by Dan Shipper

AI and I

33 Listeners

AI + a16z by a16z

AI + a16z

35 Listeners

Lightcone Podcast by Y Combinator

Lightcone Podcast

21 Listeners

Training Data by Sequoia Capital

Training Data

40 Listeners

Uncapped with Jack Altman by Alt Capital

Uncapped with Jack Altman

44 Listeners