Eye On A.I.

#323 David Ha: Why Model Merging Could Be the Next AI Breakthrough


Listen Later

This episode is sponsored by tastytrade. Trade stocks, options, futures, and crypto in one platform with low commissions and zero commission on stocks and crypto. Built for traders who think in probabilities, tastytrade offers advanced analytics, risk tools, and an AI-powered Search feature. Learn more at https://tastytrade.com/ Artificial intelligence is reaching a turning point. Instead of building bigger and bigger models, what if the real breakthrough comes from letting AI evolve?

In this episode of Eye on AI, David Ha, Co-Founder and CEO of Sakana AI, explains why evolutionary strategies and collective intelligence could reshape the future of machine learning. We explore model merging, multi-agent systems, Monte Carlo tree search, and the AI Scientist framework designed to generate and evaluate new research ideas. The conversation dives into open-ended discovery, quality and diversity in AI systems, world models, and whether artificial intelligence can push beyond the boundaries of human knowledge.

If you're interested in AGI, evolutionary AI, frontier models, AI research automation, or how AI could start discovering science on its own, this episode offers a clear look at where the field may be heading next.

Stay Updated: Craig Smith on X: https://x.com/craigss Eye on A.I. on X: https://x.com/EyeOn_AI (00:00) AI Should Evolve, Not Just Scale

(03:54) David's Journey From Finance to Evolutionary AI

(10:18) Why Gradient Descent Gets Stuck

(18:12) Model Merging and Collective Intelligence

(28:18) Combining Closed Frontier Models

(32:56) Inside the AI Scientist Experiment

(38:11) Parent Selection, Diversity and Innovation

(49:25) Can AI Discover Truly New Knowledge?

(53:05) Why Continual Learning Matter

...more
View all episodesView all episodes
Download on the App Store

Eye On A.I.By Craig S. Smith

  • 4.7
  • 4.7
  • 4.7
  • 4.7
  • 4.7

4.7

55 ratings


More shows like Eye On A.I.

View all
Data Skeptic by Kyle Polich

Data Skeptic

478 Listeners

The AI in Business Podcast by Daniel Faggella

The AI in Business Podcast

170 Listeners

NVIDIA AI Podcast by NVIDIA

NVIDIA AI Podcast

346 Listeners

AI Today Podcast by AI & Data Today

AI Today Podcast

161 Listeners

Practical AI by Practical AI LLC

Practical AI

215 Listeners

Machine Learning Street Talk (MLST) by Machine Learning Street Talk (MLST)

Machine Learning Street Talk (MLST)

99 Listeners

No Priors: Artificial Intelligence | Technology | Startups by Conviction

No Priors: Artificial Intelligence | Technology | Startups

141 Listeners

Latent Space: The AI Engineer Podcast by Latent.Space

Latent Space: The AI Engineer Podcast

100 Listeners

AI Chat: ChatGPT, AI News, Artificial Intelligence, OpenAI, Machine Learning by Jaeden Schafer

AI Chat: ChatGPT, AI News, Artificial Intelligence, OpenAI, Machine Learning

162 Listeners

This Day in AI Podcast by Michael Sharkey, Chris Sharkey

This Day in AI Podcast

228 Listeners

The AI Daily Brief: Artificial Intelligence News and Analysis by Nathaniel Whittemore

The AI Daily Brief: Artificial Intelligence News and Analysis

675 Listeners

AI For Humans: Weekly AI News, Tools & Trends by Kevin Pereira & Gavin Purcell

AI For Humans: Weekly AI News, Tools & Trends

281 Listeners

Practical: AI & Business News by Practical News

Practical: AI & Business News

25 Listeners

AI + a16z by a16z

AI + a16z

32 Listeners

Training Data by Sequoia Capital

Training Data

40 Listeners