I talk with James Douma, machine learning expert and Tesla investor, on the latest developments with Tesla FSD neural nets and Tesla's autonomous driving ambitions.
James Douma on Twitter: https://twitter.com/jamesdouma
Previous interview on Tesla Dojo supercomputer: https://youtu.be/Rv8T6t9dsRc
Andrej Karpathy talk at ScaledML 2020: https://www.youtube.com/watch?v=hx7BXih7zx8
Timestamps:
00:00 - Introduction
0:48 - How James got access to Tesla's neural nets
12:05 - Multiple neural nets on each camera
13:26 - Status update on camera fusion
17:19 - How is FSD integrating bird's eye view
24:35 - Is the planning relying more on bird's eye view?
27:23 - How train with bird's eye view?
34:52 - Using 3D constructing to train neural nets
38:45 - Mapping objects where things are going to be
40:36 - Auto video labeling is the holy grail
42:18 - Dojo knows the future
43:48 - How well can neural nets perceive the world?
45:22 - How much is Tesla doing now with 3D environments?
48:32 - Is anyone else doing what Tesla is doing at scale?
49:48 - Where is dojo right now?
53:04 - Tesla AI day
54:30 - Lidar
59:15 - 2021 for FSD
Social