The Gradient: Perspectives on AI

Gil Strang: Linear Algebra and Deep Learning


Listen Later

In episode 86 of The Gradient Podcast, Daniel Bashir speaks to Professor Gil Strang.

Professor Strang is one of the world’s foremost mathematics educators and a mathematician with contributions to finite element theory, the calculus of variations, wavelet analysis, and linear algebra. He has spent six decades teaching mathematics at MIT, where he was the MathWorks Professor of Mathematics. He was among the first MIT faculty members to publish a course on MIT’s OpenCourseware and has since championed both linear algebra education and open courseware.

Have suggestions for future podcast guests (or other feedback)? Let us know here or reach us at [email protected]

Subscribe to The Gradient Podcast:  Apple Podcasts  | Spotify | Pocket Casts | RSSFollow The Gradient on Twitter

Outline:

* (00:00) Intro

* (02:00) Professor Strang’s background and journey into teaching linear algebra

* (04:55) Undergrad interests

* (07:10) Writing textbooks

* (10:20) Prof. Strang’s interests in deep learning

* (11:00) How Professor Strang thought about teaching early on

* (16:20) MIT OpenCourseWare and education accessibility

* (19:50) Prof Strang’s applied/example-based approach to teaching linear algebra and closing the theory-practice gap

* (22:00) Examples!

* (27:20) Orthogonality

* (29:15) Singular values

* (34:40) Professor Strang’s favorite topics in linear algebra

* (37:55) Pedagogical approaches to deep learning, mathematical ingredients of deep learning’s complexity

* (42:04) Generalization and double descent in deep learning, powers and limitations

* (46:20) Did deep learning have to evolve as it did?

* (48:30) Teaching deep learning to younger students

* (50:50) How Prof. Strang’s approach to teaching linear algebra has evolved over time

* (53:00) The Four Fundamental Subspaces

* (56:15) Reflections on a career in teaching

* (59:49) Outro

Links:

* Professor Strang’s homepage



Get full access to The Gradient at thegradientpub.substack.com/subscribe
...more
View all episodesView all episodes
Download on the App Store

The Gradient: Perspectives on AIBy Daniel Bashir

  • 4.7
  • 4.7
  • 4.7
  • 4.7
  • 4.7

4.7

47 ratings


More shows like The Gradient: Perspectives on AI

View all
The Gray Area with Sean Illing by Vox

The Gray Area with Sean Illing

10,685 Listeners

NVIDIA AI Podcast by NVIDIA

NVIDIA AI Podcast

323 Listeners

Practical AI by Practical AI LLC

Practical AI

190 Listeners

Thoughts on the Market by Morgan Stanley

Thoughts on the Market

1,261 Listeners

Google DeepMind: The Podcast by Hannah Fry

Google DeepMind: The Podcast

195 Listeners

Last Week in AI by Skynet Today

Last Week in AI

288 Listeners

All-In with Chamath, Jason, Sacks & Friedberg by All-In Podcast, LLC

All-In with Chamath, Jason, Sacks & Friedberg

9,050 Listeners

Machine Learning Street Talk (MLST) by Machine Learning Street Talk (MLST)

Machine Learning Street Talk (MLST)

88 Listeners

Dwarkesh Podcast by Dwarkesh Patel

Dwarkesh Podcast

386 Listeners

Hard Fork by The New York Times

Hard Fork

5,422 Listeners

Raising Health by Andreessen Horowitz, a16z Bio + Health

Raising Health

146 Listeners

The Ezra Klein Show by New York Times Opinion

The Ezra Klein Show

15,220 Listeners

Unexplainable by Vox

Unexplainable

2,182 Listeners

Latent Space: The AI Engineer Podcast by swyx + Alessio

Latent Space: The AI Engineer Podcast

76 Listeners

The Ben & Marc Show by Marc Andreessen, Ben Horowitz

The Ben & Marc Show

134 Listeners