Full episode with Gilbert Strang (Nov 2019): https://www.youtube.com/watch?v=lEZPfmGCEk0
New clips channel (Lex Clips): https://www.youtube.com/lexclips
Once it reaches 20,000 subscribers, I'll start posting the clips there instead. 
(more links below)

For now, new full episodes are released once or twice a week and 1-2 new clips or a new non-podcast video is released on all other days.

Clip from full episode: https://www.youtube.com/watch?v=lEZPfmGCEk0 If you enjoy these clips, subscribe to the new clips channel (Lex Clips): https://www.youtube.com/lexclips Once it reaches 20,000 subscribers, I'll start posting the clips there instead. For now, new full episodes are released once or twice a week and 1-2 new clips or a new non-podcast video is released on all other days.
(more links below)

Podcast full episodes playlist:
https://www.youtube.com/playlist?list=PLrAXtmErZgOdP_8GztsuKi9nrraNbKKp4

Podcasts clips playlist:
https://www.youtube.com/playlist?list=PLrAXtmErZgOeciFP3CBCIEElOJeitOr41

Podcast website:
https://lexfridman.com/ai

Podcast on Apple Podcasts (iTunes):
https://apple.co/2lwqZIr

Podcast on Spotify:
https://spoti.fi/2nEwCF8

Podcast RSS:
https://lexfridman.com/category/ai/feed/

Gilbert Strang is a professor of mathematics at MIT and perhaps one of the most famous and impactful teachers of math in the world. His MIT OpenCourseWare lectures on linear algebra have been viewed millions of times.

Subscribe to this YouTube channel or connect on:
- Twitter: https://twitter.com/lexfridman
- LinkedIn: https://www.linkedin.com/in/lexfridman
- Facebook: https://www.facebook.com/lexfridman
- Instagram: https://www.instagram.com/lexfridman
- Medium: https://medium.com/@lexfridman
- Support on Patreon: https://www.patreon.com/lexfridman

So what concept or theorem in linear algebra or in math you find most beautiful that gives you pause that leaves you in awe?

Well, I'll stick with linear algebra here.

I hope the viewer knows that really mathematics is amazing, amazing subject and deep, deep connections between ideas that didn't look connected.

But if we stick with linear algebra, so we have a matrix.

That's like the basic thing, a rectangle of numbers.

You're probably gonna ask me later about data science, where often data comes in a matrix.

You have, you know, maybe every column corresponds to a drug and every row corresponds to a patient and if the patient reacted favorably to the drug, then you put up some positive number in there.

Anyway, rectangle of numbers, a matrix is basic.

So the big problem is to understand all those numbers.

And so 1 of the ways to break down that matrix into simple pieces is uses something called singular values.

And that's come on as fundamental in the last, and certainly in my lifetime.

Eigenvalues, if you have viewers who've done engineering math or basic linear algebra, eigenvalues were in there, but those are restricted to square matrices and data comes in rectangular matrices.

I'm always pushing math faculty, get on, do it, singular values.

Those are a way to find the important pieces of the matrix, which add up to the whole matrix.

You're breaking a matrix into simple pieces, and the first piece is the most important part of the data, the second piece is the second most important part.

And then often, so a data scientist will like, if a data scientist can find those first and second pieces, stop there, the rest of the data is probably round off experimental error maybe.

So you're looking for the important part.

So what do you find beautiful about singular values?

Every matrix, every matrix, rectangular, square, whatever, can be written as a product of 3 very simple, special matrices.

Every matrix can be written as a rotation times a stretch, which is just a matrix, a diagonal matrix, otherwise all zeros except on the 1 diagonal.

And then the third factor is another rotation.

So rotation, stretch, rotation is the breakup of any matrix.

The structure of that, the ability that you can do that, what do you find appealing?

Well, geometrically, as I freely admit, the action of a matrix is not so easy to visualize, but everybody can visualize a rotation.

Take two-dimensional space and just turn it around the center.

So a pilot has to know about, well, what are the 3, the yaw is 1 of them.

I've forgotten all the 3 turns that a pilot makes.

Up to 10 dimensions, you've got 10 ways to turn.

So to break a matrix with all those numbers in it into something


Speaker 0: So what concept or theorem in linear algebra or in math you find most beautiful that gives you pause that leaves you in awe?

Speaker 1: Well, I'll stick with linear algebra here. I hope the viewer knows that really mathematics is amazing, amazing subject and deep, deep connections between ideas that didn't look connected. Some, they turned out they were. But if we stick with linear algebra, so we have a matrix. That's like the basic thing, a rectangle of numbers.

And it might be a rectangle of data. You're probably gonna ask me later about data science, where often data comes in a matrix. You have, you know, maybe every column corresponds to a drug and every row corresponds to a patient and if the patient reacted favorably to the drug, then you put up some positive number in there. Anyway, rectangle of numbers, a matrix is basic. So the big problem is to understand all those numbers.

You got a big set of numbers. And what are the patterns? What's going on? And so 1 of the ways to break down that matrix into simple pieces is uses something called singular values. And that's come on as fundamental in the last, and certainly in my lifetime.

Eigenvalues, if you have viewers who've done engineering math or basic linear algebra, eigenvalues were in there, but those are restricted to square matrices and data comes in rectangular matrices. So you gotta take that next step. I'm always pushing math faculty, get on, do it, singular values. Those are a way to find the important pieces of the matrix, which add up to the whole matrix. You're breaking a matrix into simple pieces, and the first piece is the most important part of the data, the second piece is the second most important part.

And then often, so a data scientist will like, if a data scientist can find those first and second pieces, stop there, the rest of the data is probably round off experimental error maybe. So you're looking for the important part.

Speaker 2: Yeah. So what do you find beautiful about singular values?

Speaker 1: Well, yeah, I didn't give the theorem. So here's the idea of singular values. Every matrix, every matrix, rectangular, square, whatever, can be written as a product of 3 very simple, special matrices. So that's the theorem. Every matrix can be written as a rotation times a stretch, which is just a matrix, a diagonal matrix, otherwise all zeros except on the 1 diagonal.

And then the third factor is another rotation. So rotation, stretch, rotation is the breakup of any matrix.

Speaker 2: The structure of that, the ability that you can do that, what do you find appealing? What do you find beautiful about it?

Speaker 1: Well, geometrically, as I freely admit, the action of a matrix is not so easy to visualize, but everybody can visualize a rotation. Take two-dimensional space and just turn it around the center. Take three-dimensional space. So a pilot has to know about, well, what are the 3, the yaw is 1 of them. I've forgotten all the 3 turns that a pilot makes.

Up to 10 dimensions, you've got 10 ways to turn. But you can visualize a rotation. Take the space and turn it. And you can visualize a stretch. So to break a matrix with all those numbers in it into something

See all Lex Fridman transcripts on Youtube

Gilbert Strang: Singular Value Decomposition