Atila Orhon, founder of Argmax, locally hosts Bryan Catanzaro, co-creator of cuDNN, member of the Deep Speech Mafia and VP of Applied Deep Learning at Nvidia:

(00:20) Who is Bryan?

(07:38) Getting Nvidia to care about Deep Learning

(14:13) Why did Bryan leave Nvidia right when Deep Learning was taking off

(18:02) Leadership: Aligning a village of researchers

(24:12) Will the frontier flip back to open?

(32:16) Nvidia's models: Side project or core business?

(38:19) Efficiency leads to edge inference: Does Apple capture inference?

(42:43) Nvidia’s risky bets: Fewer and fewer bits

(47:19) Nvidia's misstep with Volta

(52:30) Every model is already obsolete as soon as you stop training it

Atila Orhon, founder of Argmax, locally hosts Awni Hannun, co-creator of MLX:

(00:00) AlexNet moment for Speech

(03:50) Baidu Mafia

(07:34) Grading Awni's 2021 predictions for 2030

(22:08) Personalizing ASR for mainstream adoption

(32:45) MLX

(35:35) From research tool to inference engine

(40:05) On-device AI for enthusiast users vs developer default

(45:27) Open-source philosophy

(51:05) Why did MLX expand to CUDA?

(55:45) After MLX

(56:36) Intelligence per watt

(01:01:13) Advice for researchers on negative results