Training Data

How Cursor Trained Composer on Fireworks: Distributed Infrastructure for High-Performance RL


Listen Later

Cursor's Federico Cassano and Fireworks' Dmytro Dzhulgakov explain how they collaborated to build Composer as a specialized foundation model. The core insight: models have finite capacity in their weights, and allocating all those bits to the singular task of software engineering in Cursor frees the model to be both better at the task and far more efficient at inference. Rather than start from pre-training and work up, they took an unconventional top-down approach — mid-training and RL on top of an open-source base to get a useful model into users' hands fast, then specializing the model around real Cursor usage. With Fireworks providing distributed infrastructure, Composer delivers frontier-class coding performance with the speed of a much smaller model.


Hosted by Sonya Huang, Sequoia Capital


...more
View all episodesView all episodes
Download on the App Store

Training DataBy Sequoia Capital

  • 4.2
  • 4.2
  • 4.2
  • 4.2
  • 4.2

4.2

38 ratings


More shows like Training Data

View all
This Week in Startups by Jason Calacanis

This Week in Startups

1,290 Listeners

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch by Harry Stebbings

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

546 Listeners

The a16z Show by Andreessen Horowitz

The a16z Show

1,100 Listeners

Invest Like the Best with Patrick O'Shaughnessy by Colossus | Investing & Business Podcasts

Invest Like the Best with Patrick O'Shaughnessy

2,386 Listeners

Y Combinator Startup Podcast by Y Combinator

Y Combinator Startup Podcast

225 Listeners

Practical AI by Practical AI LLC

Practical AI

211 Listeners

Dwarkesh Podcast by Dwarkesh Patel

Dwarkesh Podcast

558 Listeners

No Priors: Artificial Intelligence | Technology | Startups by Conviction

No Priors: Artificial Intelligence | Technology | Startups

146 Listeners

Latent Space: The AI Engineer Podcast by Latent.Space

Latent Space: The AI Engineer Podcast

101 Listeners

The AI Daily Brief: Artificial Intelligence News and Analysis by Nathaniel Whittemore

The AI Daily Brief: Artificial Intelligence News and Analysis

690 Listeners

Crucible Moments by Sequoia Capital

Crucible Moments

90 Listeners

BG2Pod with Brad Gerstner and Bill Gurley by BG2Pod

BG2Pod with Brad Gerstner and Bill Gurley

472 Listeners

AI + a16z by a16z

AI + a16z

32 Listeners

Uncapped with Jack Altman by Alt Capital

Uncapped with Jack Altman

42 Listeners

OpenAI Podcast by OpenAI

OpenAI Podcast

58 Listeners