August 19, 2024

20VC: Chips, Models or Applications; Where is the Value in AI | Is Compute the Answer to All Model Performance Questions | Why Open AI Shelved AGI & Is There Any Value in Models with OpenAI Price Dumping with Aidan, Gomez, Co-Founder @ Cohere

Listen Later

58 minutes

Aidan Gomez is the Co-founder & CEO at Cohere, the leading AI platform for enterprise, having raised over $1BN from some of the best with their last round pricing the company at a whopping $5.5BN. Prior to Cohere, Aidan co-authored the paper “Attention is All You Need,” which introduced the groundbreaking Transformer architecture. He also collaborated with a number of AI luminaries, including Geoffrey Hinton and Jeff Dean, during his time at Google Brain, where the team focused their efforts on large-scale machine learning.

In Today's Episode with Aidan Gomez We Discuss:

1. Compute vs Data: What is the Bottleneck:

Does Aidan believe that more compute will result in an equal increase in performance?
How much longer do we have before it becomes a case of diminishing returns?
What does Aidan mean when he says "he has changed his mind massively on the role of data"? What did he believe? How has it changed?

2. The Value of the Model:

Given the demand for chips, the consumer need for applications, how does Aidan think about the inherent value of models today? Will any value accrue at the model layer?
How does Aidan analyze the price dumping that OpenAI are doing? Is it a race to the bottom on price?
Why does Aidan believe that "there is no value in last year's model"?
Given all of this, is it possible to be an independent model provider without being owned by an incumbent who has a cloud business that acts as a cash cow for the model business?

3. Enterprise AI: It is Changing So Fast:

What are the biggest concerns for the world's largest enterprises on adopting AI?
Are we still in the experimental budget phase for enterprises? What is causing them to move from experimental budget to core budget today?
Are we going to see a mass transition back from Cloud to On Prem with the largest enterprises not willing to let independent companies train with their data in the cloud?
What does AI not do today that will be a gamechanger for the enterprise in 3-5 years?

4. The Wider World: Remote Work, Downfall of Europe and Relationships:

Given humans spending more and more time talking to models, how does Aidan reflect on the idea of his children spending more time with models than people? Does he want that world?
Why does Aidan believe that Europe is challenged immensely? How does the UK differ to Europe?
Why does Aidan believe that remote work is just not nearly as productive as in person?

...more

View all episodes

View all episodes

Download on the App Store

Download on the App Store

Get it on Google Play

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

By Harry Stebbings

4.4

466466 ratings

August 19, 2024

20VC: Chips, Models or Applications; Where is the Value in AI | Is Compute the Answer to All Model Performance Questions | Why Open AI Shelved AGI & Is There Any Value in Models with OpenAI Price Dumping with Aidan, Gomez, Co-Founder @ Cohere

Listen Later

58 minutes

Aidan Gomez is the Co-founder & CEO at Cohere, the leading AI platform for enterprise, having raised over $1BN from some of the best with their last round pricing the company at a whopping $5.5BN. Prior to Cohere, Aidan co-authored the paper “Attention is All You Need,” which introduced the groundbreaking Transformer architecture. He also collaborated with a number of AI luminaries, including Geoffrey Hinton and Jeff Dean, during his time at Google Brain, where the team focused their efforts on large-scale machine learning.

In Today's Episode with Aidan Gomez We Discuss:

1. Compute vs Data: What is the Bottleneck:

Does Aidan believe that more compute will result in an equal increase in performance?
How much longer do we have before it becomes a case of diminishing returns?
What does Aidan mean when he says "he has changed his mind massively on the role of data"? What did he believe? How has it changed?

2. The Value of the Model:

Given the demand for chips, the consumer need for applications, how does Aidan think about the inherent value of models today? Will any value accrue at the model layer?
How does Aidan analyze the price dumping that OpenAI are doing? Is it a race to the bottom on price?
Why does Aidan believe that "there is no value in last year's model"?
Given all of this, is it possible to be an independent model provider without being owned by an incumbent who has a cloud business that acts as a cash cow for the model business?

3. Enterprise AI: It is Changing So Fast:

What are the biggest concerns for the world's largest enterprises on adopting AI?
Are we still in the experimental budget phase for enterprises? What is causing them to move from experimental budget to core budget today?
Are we going to see a mass transition back from Cloud to On Prem with the largest enterprises not willing to let independent companies train with their data in the cloud?
What does AI not do today that will be a gamechanger for the enterprise in 3-5 years?

4. The Wider World: Remote Work, Downfall of Europe and Relationships:

Given humans spending more and more time talking to models, how does Aidan reflect on the idea of his children spending more time with models than people? Does he want that world?
Why does Aidan believe that Europe is challenged immensely? How does the UK differ to Europe?
Why does Aidan believe that remote work is just not nearly as productive as in person?

...more

More shows like The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

This Week in Startups by Jason Calacanis

This Week in Startups

1,281 Listeners

a16z Podcast by Andreessen Horowitz

a16z Podcast

1,009 Listeners

The Official SaaStr Podcast: SaaS | Founders | Investors by SaaStr

The Official SaaStr Podcast: SaaS | Founders | Investors

179 Listeners

Equity by TechCrunch, Mary Ann Azevedo, Kell, Theresa Loconsolo, Rebecca Bellan, Kirsten Korosec, Devin Coldewey, Margaux MacColl

Equity

342 Listeners

Capital Allocators – Inside the Institutional Investment Industry by Ted Seides – Allocator and Asset Management Expert

Capital Allocators – Inside the Institutional Investment Industry

787 Listeners

Y Combinator Startup Podcast by Y Combinator

Y Combinator Startup Podcast

214 Listeners

All-In with Chamath, Jason, Sacks & Friedberg by All-In Podcast, LLC

All-In with Chamath, Jason, Sacks & Friedberg

8,385 Listeners

Dwarkesh Podcast by Dwarkesh Patel

Dwarkesh Podcast

320 Listeners

ACQ2 by Acquired by Ben Gilbert and David Rosenthal

ACQ2 by Acquired

199 Listeners

The Logan Bartlett Show by by Redpoint Ventures

The Logan Bartlett Show

189 Listeners

No Priors: Artificial Intelligence | Technology | Startups by Conviction

No Priors: Artificial Intelligence | Technology | Startups

106 Listeners

Crucible Moments by Sequoia Capital

Crucible Moments

88 Listeners

BG2Pod with Brad Gerstner and Bill Gurley by BG2Pod

BG2Pod with Brad Gerstner and Bill Gurley

424 Listeners

AI + a16z by a16z

AI + a16z

26 Listeners

Training Data by Sequoia Capital

Training Data

31 Listeners