The Gradient: Perspectives on AI

2024 in AI, with Nathan Benaich


Listen Later

Episode 142

Happy holidays! This is one of my favorite episodes of the year — for the third time, Nathan Benaich and I did our yearly roundup of all the AI news and advancements you need to know. This includes selections from this year’s State of AI Report, some early takes on o3, a few minutes LARPing as China Guys………

If you’ve stuck around and continue to listen, I’m really thankful you’re here. I love hearing from you.

You can find Nathan and Air Street Press here on Substack and on Twitter, LinkedIn, and his personal site. Check out his writing at press.airstreet.com.

Find me on Twitter (or LinkedIn if you want…) for updates on new episodes, and reach me at [email protected] for feedback, ideas, guest suggestions.

Outline

* (00:00) Intro

* (01:00) o3 and model capabilities + reasoning capabilities

* (05:30) Economics of frontier models

* (09:24) Air Street’s year and industry shifts: product-market fit in AI, major developments in science/biology, "vibe shifts" in defense and robotics

* (16:00) Investment strategies in generative AI, how to evaluate and invest in AI companies

* (19:00) Future of BioML and scientific progress: on AlphaFold 3, evaluation challenges, and the need for cross-disciplinary collaboration

* (32:00) The AGI question and technology diffusion: Nathan’s take on AGI and timelines, technology adoption, the gap between capabilities and real-world impact

* (39:00) Differential economic impacts from AI, tech diffusion

* (43:00) Market dynamics and competition

* (50:00) DeepSeek and global AI innovation

* (59:50) A robotics renaissance? robotics coming back into focus + advances in vision-language models and real-world applications

* (1:05:00) Compute Infrastructure: NVIDIA’s dominance, GPU availability, the competitive landscape in AI compute

* (1:12:00) Industry consolidation: partnerships, acquisitions, regulatory concerns in AI

* (1:27:00) Global AI politics and regulation: international AI governance and varying approaches

* (1:35:00) The regulatory landscape

* (1:43:00) 2025 predictions

* (1:48:00) Closing

Links and Resources

From Air Street Press:

* The State of AI Report

* The State of Chinese AI

* Open-endedness is all we’ll need

* There is no scaling wall: in discussion with Eiso Kant (Poolside)

* Alchemy doesn’t scale: the economics of general intelligence

* Chips all the way down

* The AI energy wars will get worse before they get better

Other highlights/resources:

* Deepseek: The Quiet Giant Leading China’s AI Race — an interview with DeepSeek CEO Liang Wenfeng via ChinaTalk, translated by Jordan Schneider, Angela Shen, Irene Zhang and others

* A great position paper on open-endedness by Minqi Jiang, Tim Rocktäschel, and Ed Grefenstette — Minqi also wrote a blog post on this for us!

* for China Guys only: China’s AI Regulations and How They Get Made by Matt Sheehan (+ an interview I did with Matt in 2022!)

* The Simple Macroeconomics of AI by Daron Acemoglu + a critique by Maxwell Tabarrok (more links in the Report)

* AI Nationalism by Ian Hogarth (from 2018)

* Some analysis on the EU AI Act + regulation from Lawfare



Get full access to The Gradient at thegradientpub.substack.com/subscribe
...more
View all episodesView all episodes
Download on the App Store

The Gradient: Perspectives on AIBy Daniel Bashir

  • 4.7
  • 4.7
  • 4.7
  • 4.7
  • 4.7

4.7

47 ratings


More shows like The Gradient: Perspectives on AI

View all
The Gray Area with Sean Illing by Vox

The Gray Area with Sean Illing

10,685 Listeners

NVIDIA AI Podcast by NVIDIA

NVIDIA AI Podcast

323 Listeners

Practical AI by Practical AI LLC

Practical AI

190 Listeners

Thoughts on the Market by Morgan Stanley

Thoughts on the Market

1,261 Listeners

Google DeepMind: The Podcast by Hannah Fry

Google DeepMind: The Podcast

195 Listeners

Last Week in AI by Skynet Today

Last Week in AI

288 Listeners

All-In with Chamath, Jason, Sacks & Friedberg by All-In Podcast, LLC

All-In with Chamath, Jason, Sacks & Friedberg

9,050 Listeners

Machine Learning Street Talk (MLST) by Machine Learning Street Talk (MLST)

Machine Learning Street Talk (MLST)

88 Listeners

Dwarkesh Podcast by Dwarkesh Patel

Dwarkesh Podcast

386 Listeners

Hard Fork by The New York Times

Hard Fork

5,422 Listeners

Raising Health by Andreessen Horowitz, a16z Bio + Health

Raising Health

146 Listeners

The Ezra Klein Show by New York Times Opinion

The Ezra Klein Show

15,220 Listeners

Unexplainable by Vox

Unexplainable

2,182 Listeners

Latent Space: The AI Engineer Podcast by swyx + Alessio

Latent Space: The AI Engineer Podcast

76 Listeners

The Ben & Marc Show by Marc Andreessen, Ben Horowitz

The Ben & Marc Show

134 Listeners