LessWrong posts by zvi

“On OpenAI Dev Day” by Zvi


Listen Later

OpenAI DevDay was this week. What delicious and/or terrifying things await?

Turbo Boost

First off, we have GPT-4-Turbo.

Today we’re launching a preview of the next generation of this model, GPT-4 Turbo.

GPT-4 Turbo is more capable and has knowledge of world events up to April 2023. It has a 128k context window so it can fit the equivalent of more than 300 pages of text in a single prompt. We also optimized its performance so we are able to offer GPT-4 Turbo at a 3x cheaper price for input tokens and a 2x cheaper price for output tokens compared to GPT-4.

GPT-4 Turbo is available for all paying developers to try by passing gpt-4-1106-preview in the API and we plan to release the stable production-ready model in the coming weeks.

Knowledge up to April 2023 is a big game. Cutting the price [...]

---

Outline:

(00:09) Turbo Boost

(01:25) Function calling updates

(02:27) Improved instruction following and JSON mode

(03:21) Reproducible outputs and log probabilities

(04:34) Updated GPT-3.5 Turbo

(06:49) New Modalities

(07:03) New modalities in the API

(07:08) GPT-4 Turbo with vision

(08:02) DALL·E 3

(08:47) Text-to-speech (TTS)

(10:05) Model customization

(10:09) GPT-4 fine tuning experimental access

(11:01) Custom models

(12:19) Assistants API, Retrieval, and Code Interpreter

(15:13) GPT-GPT

(22:37) Putting It All Together

---

First published:

November 9th, 2023

Source:

https://www.lesswrong.com/posts/wdekcGpsMtakGCo5y/on-openai-dev-day

---

Narrated by TYPE III AUDIO.

...more
View all episodesView all episodes
Download on the App Store

LessWrong posts by zviBy zvi

  • 5
  • 5
  • 5
  • 5
  • 5

5

2 ratings


More shows like LessWrong posts by zvi

View all
Making Sense with Sam Harris by Sam Harris

Making Sense with Sam Harris

26,392 Listeners

Conversations with Tyler by Mercatus Center at George Mason University

Conversations with Tyler

2,462 Listeners

The a16z Show by Andreessen Horowitz

The a16z Show

1,102 Listeners

Future of Life Institute Podcast by Future of Life Institute

Future of Life Institute Podcast

109 Listeners

ChinaTalk by Jordan Schneider

ChinaTalk

296 Listeners

Politix by Politix

Politix

89 Listeners

Dwarkesh Podcast by Dwarkesh Patel

Dwarkesh Podcast

553 Listeners

Hard Fork by The New York Times

Hard Fork

5,558 Listeners

Clearer Thinking with Spencer Greenberg by Spencer Greenberg

Clearer Thinking with Spencer Greenberg

140 Listeners

LessWrong (Curated & Popular) by LessWrong

LessWrong (Curated & Popular)

14 Listeners

No Priors: Artificial Intelligence | Technology | Startups by Conviction

No Priors: Artificial Intelligence | Technology | Startups

140 Listeners

"Econ 102" with Noah Smith and Erik Torenberg by Turpentine

"Econ 102" with Noah Smith and Erik Torenberg

155 Listeners

BG2Pod with Brad Gerstner and Bill Gurley by BG2Pod

BG2Pod with Brad Gerstner and Bill Gurley

459 Listeners

LessWrong (30+ Karma) by LessWrong

LessWrong (30+ Karma)

0 Listeners

Complex Systems with Patrick McKenzie (patio11) by Patrick McKenzie

Complex Systems with Patrick McKenzie (patio11)

143 Listeners