Unsupervised Learning with Jacob Effron

Ep 12: EleutherAI's Aran Komatsuzaki on Open-Source Models' Future and Thought Cloning


Listen Later

Jacob and Jordan sit down with EleutherAI's Aran Komatsuzaki to discuss the future of open-source models, thought cloning, his work on GPT-J and more.

 

0:00 intro

01:06 Aran’s background

02:58 starting work on gpt-j

05:49 gathering data for Lion and gpt-j

08:51 history of EleutherAI

11:16 open vs. closed-source models

19:06 how will open-source models be used going forward

21:33 thought cloning

25:51 building AI models that understand video

29:35 one model to rule them all

31:58 influence of academia in the LLM space

34:33 over-hyped/under-hyped

38:01 Aran’s thoughts on AGI

 

With your co-hosts: 

@jasoncwarner 

- Former CTO GitHub, VP Eng Heroku & Canonical 

@ericabrescia 

- Former COO Github, Founder Bitnami (acq’d by VMWare) 

@patrickachase 

- Partner at Redpoint, Former ML Engineer LinkedIn 

@jacobeffron 

- Partner at Redpoint, Former PM Flatiron Health

@jordan_segall 

- Partner at Redpoint

...more
View all episodesView all episodes
Download on the App Store

Unsupervised Learning with Jacob EffronBy by Redpoint Ventures

  • 4.9
  • 4.9
  • 4.9
  • 4.9
  • 4.9

4.9

49 ratings


More shows like Unsupervised Learning with Jacob Effron

View all
This Week in Startups by Jason Calacanis

This Week in Startups

1,288 Listeners

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch by Harry Stebbings

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

538 Listeners

The a16z Show by Andreessen Horowitz

The a16z Show

1,087 Listeners

Y Combinator Startup Podcast by Y Combinator

Y Combinator Startup Podcast

226 Listeners

Machine Learning Street Talk (MLST) by Machine Learning Street Talk (MLST)

Machine Learning Street Talk (MLST)

95 Listeners

Dwarkesh Podcast by Dwarkesh Patel

Dwarkesh Podcast

511 Listeners

No Priors: Artificial Intelligence | Technology | Startups by Conviction

No Priors: Artificial Intelligence | Technology | Startups

131 Listeners

Latent Space: The AI Engineer Podcast by swyx + Alessio

Latent Space: The AI Engineer Podcast

93 Listeners

The AI Daily Brief: Artificial Intelligence News and Analysis by Nathaniel Whittemore

The AI Daily Brief: Artificial Intelligence News and Analysis

610 Listeners

BG2Pod with Brad Gerstner and Bill Gurley by BG2Pod

BG2Pod with Brad Gerstner and Bill Gurley

467 Listeners

AI + a16z by a16z

AI + a16z

35 Listeners

Lightcone Podcast by Y Combinator

Lightcone Podcast

21 Listeners

Training Data by Sequoia Capital

Training Data

39 Listeners

Uncapped with Jack Altman by Alt Capital

Uncapped with Jack Altman

44 Listeners

Cheeky Pint by Stripe

Cheeky Pint

48 Listeners