Unsupervised Learning

Ep 12: EleutherAI's Aran Komatsuzaki on Open-Source Models' Future and Thought Cloning


Listen Later

Jacob and Jordan sit down with EleutherAI's Aran Komatsuzaki to discuss the future of open-source models, thought cloning, his work on GPT-J and more.

 

0:00 intro

01:06 Aran’s background

02:58 starting work on gpt-j

05:49 gathering data for Lion and gpt-j

08:51 history of EleutherAI

11:16 open vs. closed-source models

19:06 how will open-source models be used going forward

21:33 thought cloning

25:51 building AI models that understand video

29:35 one model to rule them all

31:58 influence of academia in the LLM space

34:33 over-hyped/under-hyped

38:01 Aran’s thoughts on AGI

 

With your co-hosts: 

@jasoncwarner 

- Former CTO GitHub, VP Eng Heroku & Canonical 

@ericabrescia 

- Former COO Github, Founder Bitnami (acq’d by VMWare) 

@patrickachase 

- Partner at Redpoint, Former ML Engineer LinkedIn 

@jacobeffron 

- Partner at Redpoint, Former PM Flatiron Health

@jordan_segall 

- Partner at Redpoint

...more
View all episodesView all episodes
Download on the App Store

Unsupervised LearningBy by Redpoint Ventures

  • 4.9
  • 4.9
  • 4.9
  • 4.9
  • 4.9

4.9

49 ratings


More shows like Unsupervised Learning

View all
This Week in Startups by Jason Calacanis

This Week in Startups

1,273 Listeners

a16z Podcast by Andreessen Horowitz

a16z Podcast

1,040 Listeners

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch by Harry Stebbings

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

519 Listeners

Y Combinator Startup Podcast by Y Combinator

Y Combinator Startup Podcast

217 Listeners

Machine Learning Street Talk (MLST) by Machine Learning Street Talk (MLST)

Machine Learning Street Talk (MLST)

88 Listeners

Dwarkesh Podcast by Dwarkesh Patel

Dwarkesh Podcast

426 Listeners

The Logan Bartlett Show by by Redpoint Ventures

The Logan Bartlett Show

186 Listeners

No Priors: Artificial Intelligence | Technology | Startups by Conviction

No Priors: Artificial Intelligence | Technology | Startups

121 Listeners

Latent Space: The AI Engineer Podcast by swyx + Alessio

Latent Space: The AI Engineer Podcast

75 Listeners

BG2Pod with Brad Gerstner and Bill Gurley by BG2Pod

BG2Pod with Brad Gerstner and Bill Gurley

461 Listeners

AI + a16z by a16z

AI + a16z

31 Listeners

Lightcone Podcast by Y Combinator

Lightcone Podcast

22 Listeners

Training Data by Sequoia Capital

Training Data

43 Listeners

Uncapped with Jack Altman by Alt Capital

Uncapped with Jack Altman

35 Listeners

Cheeky Pint by Stripe

Cheeky Pint

13 Listeners