The Gradient: Perspectives on AI

Gil Strang: Linear Algebra and Deep Learning


Listen Later

In episode 86 of The Gradient Podcast, Daniel Bashir speaks to Professor Gil Strang.

Professor Strang is one of the world’s foremost mathematics educators and a mathematician with contributions to finite element theory, the calculus of variations, wavelet analysis, and linear algebra. He has spent six decades teaching mathematics at MIT, where he was the MathWorks Professor of Mathematics. He was among the first MIT faculty members to publish a course on MIT’s OpenCourseware and has since championed both linear algebra education and open courseware.

Have suggestions for future podcast guests (or other feedback)? Let us know here or reach us at [email protected]

Subscribe to The Gradient Podcast:  Apple Podcasts  | Spotify | Pocket Casts | RSSFollow The Gradient on Twitter

Outline:

* (00:00) Intro

* (02:00) Professor Strang’s background and journey into teaching linear algebra

* (04:55) Undergrad interests

* (07:10) Writing textbooks

* (10:20) Prof. Strang’s interests in deep learning

* (11:00) How Professor Strang thought about teaching early on

* (16:20) MIT OpenCourseWare and education accessibility

* (19:50) Prof Strang’s applied/example-based approach to teaching linear algebra and closing the theory-practice gap

* (22:00) Examples!

* (27:20) Orthogonality

* (29:15) Singular values

* (34:40) Professor Strang’s favorite topics in linear algebra

* (37:55) Pedagogical approaches to deep learning, mathematical ingredients of deep learning’s complexity

* (42:04) Generalization and double descent in deep learning, powers and limitations

* (46:20) Did deep learning have to evolve as it did?

* (48:30) Teaching deep learning to younger students

* (50:50) How Prof. Strang’s approach to teaching linear algebra has evolved over time

* (53:00) The Four Fundamental Subspaces

* (56:15) Reflections on a career in teaching

* (59:49) Outro

Links:

* Professor Strang’s homepage



Get full access to The Gradient at thegradientpub.substack.com/subscribe
...more
View all episodesView all episodes
Download on the App Store

The Gradient: Perspectives on AIBy Daniel Bashir

  • 4.7
  • 4.7
  • 4.7
  • 4.7
  • 4.7

4.7

47 ratings


More shows like The Gradient: Perspectives on AI

View all
The Joe Rogan Experience by Joe Rogan

The Joe Rogan Experience

229,169 Listeners

The a16z Show by Andreessen Horowitz

The a16z Show

1,089 Listeners

NVIDIA AI Podcast by NVIDIA

NVIDIA AI Podcast

334 Listeners

Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas by Sean Carroll | Wondery

Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas

4,182 Listeners

Practical AI by Practical AI LLC

Practical AI

211 Listeners

The Journal. by The Wall Street Journal & Spotify Studios

The Journal.

6,095 Listeners

All-In with Chamath, Jason, Sacks & Friedberg by All-In Podcast, LLC

All-In with Chamath, Jason, Sacks & Friedberg

9,927 Listeners

Dwarkesh Podcast by Dwarkesh Patel

Dwarkesh Podcast

511 Listeners

Hard Fork by The New York Times

Hard Fork

5,512 Listeners

The Rest Is History by Goalhanger

The Rest Is History

15,272 Listeners

Huberman Lab by Scicomm Media

Huberman Lab

29,246 Listeners

Disintegrator by Roberto Alonso Trillo, Marek Poliks, and Helena McFadzean

Disintegrator

10 Listeners

Practical: AI & Business News by Practical News

Practical: AI & Business News

25 Listeners