The Gradient: Perspectives on AI

Gil Strang: Linear Algebra and Deep Learning


Listen Later

In episode 86 of The Gradient Podcast, Daniel Bashir speaks to Professor Gil Strang.

Professor Strang is one of the world’s foremost mathematics educators and a mathematician with contributions to finite element theory, the calculus of variations, wavelet analysis, and linear algebra. He has spent six decades teaching mathematics at MIT, where he was the MathWorks Professor of Mathematics. He was among the first MIT faculty members to publish a course on MIT’s OpenCourseware and has since championed both linear algebra education and open courseware.

Have suggestions for future podcast guests (or other feedback)? Let us know here or reach us at [email protected]

Subscribe to The Gradient Podcast:  Apple Podcasts  | Spotify | Pocket Casts | RSSFollow The Gradient on Twitter

Outline:

* (00:00) Intro

* (02:00) Professor Strang’s background and journey into teaching linear algebra

* (04:55) Undergrad interests

* (07:10) Writing textbooks

* (10:20) Prof. Strang’s interests in deep learning

* (11:00) How Professor Strang thought about teaching early on

* (16:20) MIT OpenCourseWare and education accessibility

* (19:50) Prof Strang’s applied/example-based approach to teaching linear algebra and closing the theory-practice gap

* (22:00) Examples!

* (27:20) Orthogonality

* (29:15) Singular values

* (34:40) Professor Strang’s favorite topics in linear algebra

* (37:55) Pedagogical approaches to deep learning, mathematical ingredients of deep learning’s complexity

* (42:04) Generalization and double descent in deep learning, powers and limitations

* (46:20) Did deep learning have to evolve as it did?

* (48:30) Teaching deep learning to younger students

* (50:50) How Prof. Strang’s approach to teaching linear algebra has evolved over time

* (53:00) The Four Fundamental Subspaces

* (56:15) Reflections on a career in teaching

* (59:49) Outro

Links:

* Professor Strang’s homepage



Get full access to The Gradient at thegradientpub.substack.com/subscribe
...more
View all episodesView all episodes
Download on the App Store

The Gradient: Perspectives on AIBy Daniel Bashir

  • 4.7
  • 4.7
  • 4.7
  • 4.7
  • 4.7

4.7

47 ratings


More shows like The Gradient: Perspectives on AI

View all
The Joe Rogan Experience by Joe Rogan

The Joe Rogan Experience

229,965 Listeners

The a16z Show by Andreessen Horowitz

The a16z Show

1,095 Listeners

NVIDIA AI Podcast by NVIDIA

NVIDIA AI Podcast

349 Listeners

Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas by Sean Carroll

Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas

4,176 Listeners

Practical AI by Practical AI LLC

Practical AI

209 Listeners

The Journal. by The Wall Street Journal & Spotify Studios

The Journal.

6,114 Listeners

All-In with Chamath, Jason, Sacks & Friedberg by All-In Podcast, LLC

All-In with Chamath, Jason, Sacks & Friedberg

10,227 Listeners

Dwarkesh Podcast by Dwarkesh Patel

Dwarkesh Podcast

548 Listeners

Hard Fork by The New York Times

Hard Fork

5,547 Listeners

The Rest Is History by Goalhanger

The Rest Is History

15,859 Listeners

Huberman Lab by Scicomm Media

Huberman Lab

29,346 Listeners

Disintegrator by Roberto Alonso Trillo, Marek Poliks, and Helena McFadzean

Disintegrator

14 Listeners

Practical: AI & Business News by Practical News

Practical: AI & Business News

26 Listeners