This is a clip from a conversation with Sean Carroll from Nov 2019. Check out Sean's new book on quantum mechanics titled Something Deeply Hidden: https://amzn.to/2C6aCaf New full episodes are released once or twice a week and 1-2 new clips or a new non-podcast video is released on all other days. You can watch the full conversation here: https://www.youtube.com/watch?v=iNqqOLscOBY
(more links below)

Podcast full episodes playlist:
https://www.youtube.com/playlist?list=PLrAXtmErZgOdP_8GztsuKi9nrraNbKKp4

Podcasts clips playlist:
https://www.youtube.com/playlist?list=PLrAXtmErZgOeciFP3CBCIEElOJeitOr41

Podcast website:
https://lexfridman.com/ai

Podcast on Apple Podcasts (iTunes):
https://apple.co/2lwqZIr

Podcast on Spotify:
https://spoti.fi/2nEwCF8

Podcast RSS:
https://lexfridman.com/category/ai/feed/

Note: I select clips with insights from these much longer conversation with the hope of helping make these ideas more accessible and discoverable. Ultimately, this podcast is a small side hobby for me with the goal of sharing and discussing ideas. I did a poll and 92% of people either liked or loved the posting of daily clips, 2% were indifferent, and 6% hated it, some suggesting that I post them on a separate YouTube channel. I hear the 6% and partially agree, so am torn about the whole thing. I tried creating a separate clips channel but the YouTube algorithm makes it very difficult for that channel to grow. So for a little while, I'll keep posting clips on this channel. I ask for your patience and to see these clips as supporting the dissemination of knowledge contained in nuanced discussion. If you enjoy it, consider subscribing, sharing, and commenting.

Sean Carroll is a theoretical physicist at Caltech and Santa Fe Institute specializing in quantum mechanics, arrow of time, cosmology, and gravitation. He is the author of several popular books and is a host of a great podcast called Mindscape.

Subscribe to this YouTube channel or connect on:
- Twitter: https://twitter.com/lexfridman
- LinkedIn: https://www.linkedin.com/in/lexfridman
- Facebook: https://www.facebook.com/lexfridman
- Instagram: https://www.instagram.com/lexfridman
- Medium: https://medium.com/@lexfridman
- Support on Patreon: https://www.patreon.com/lexfridman

What is Hilbert space and Euclidean space?

Yeah, you know, I think that people are very welcome to go through their lives not knowing what Hilbert space is.

But if you want to dig into a little bit more into quantum mechanics, it becomes necessary.

You know, the English language was invented long before quantum mechanics or various forms of higher mathematics were invented.

So we use the word space to mean different things.

Of course, most of us think of space as this three-dimensional world in which we live, right?

I mean, some of us just think of it as outer space.

But okay, but space around us, it gives us the three-dimensional location of things and objects.

But mathematicians use any generic abstract collection of elements as a space, okay?

A space of possibilities, momentum space, etc.

So, Hilbert space is the space of all possible quantum wave functions, either for the universe or for some specific system.

And it could be an infinite dimensional space or it could be just really, really large dimensional but finite.

We don't know because we don't know the final theory of everything, but this abstract Hilbert space is really, really, really big and has no immediate connection to the three-dimensional space in which we live.

What do dimensions in Hilbert space mean?

You know, it's just a way of mathematically representing how much information is contained in the state of the system.

How many numbers do you have to give me to specify what the thing is doing?

So in classical mechanics, I give you the location of something by giving you 3 numbers, right?

But then I might wanna give you its entire state, physical state, which means both its position and also its velocity.

So its state lives in something called phase space, which is 6 dimensional, 3 dimensions of position, 3 dimensions of velocity.

And then if it also has an orientation in space, that's another 3 dimensions and so forth.

So As you describe more and more information about the system, you have an abstract mathematical space that has more and more numbers that you need to give, and each 1 of those numbers corresponds to a dimension in that space.

So in terms of the amount of information, what is entropy?

This mystical word that's overused in math and physics, but has a very specific meaning in this context.

Sadly, it has more than 1 very specific meaning.

Entropy means different things even to different physicists.

But 1 way of thinking about it is a measure of how much we don't know about the state of a system, right?

So if I have a bottle of water molecules and I know that, okay, there's a certain number of water molecules, I could weigh it, right, and figure out.

I know the volume of it and I know the temperature and pressure and things like that.

I certainly don't know the exact position and velocity of every water molecule, right?

So there's a certain amount of information I know, certain amount that I don't know that is part of the complete state of the system.

And that's what the entropy characterizes, how much unknown information there is, the difference between what I do know about the system and its full exact microscopic state.

So when we try to describe a quantum mechanical system, Is it infinite or finite but very large?

You know, it's easy to mathematically write down a system that would have a potentially infinite entropy, an infinite dimensional Hilbert space.

We said that the Hilbert space was the space in which quantum wave functions lived.

For different systems, that will be different sizes.

So that's the number of numbers, the number of pieces of information you could potentially give me about the system.

So the bigger Hilbert space is, the bigger the entropy of that system could be, depending on what I know about it.

If I don't know anything about it, then it has a huge entropy, right?

But only up to the size of its Hilbert space.

So we don't know in the real physical world whether or not this region of space that contains that water bottle has potentially an infinite entropy or just a finite entropy.

We have different arguments on different sides.

So if it's infinite, how do you think about infinity?

Is this something you can, your cognitive abilities are able to process?

We can use mathematical tools to manipulate infinity very, very accurately.

You can define what we mean, you know, for any number N there's a number bigger than it.

So there's something called the total number of all numbers, that's infinite.

But it is hard to wrap your brain around that.

And I think that gives people pause because we talk about infinity as if it's a number, but it has plenty of properties that real numbers don't have.

You know, if you multiply infinity by 2, you get infinity again, right?

That's a little bit different than what we're used to.

Okay, but are you comfortable with the idea that in thinking of what the real world actually is, that infinity could be part of that world?

Are you comfortable that a world in some dimension, in some aspect-

I mean, you know, I don't want my level of comfort to affect what I think about the world.

You know, I'm pretty open-minded about what the world could be at the fundamental level.

It's a question of, is it an overreach of our intuition?

Sort of, it could be a convenient, almost like when you add a constant to an equation just because it'll help.

It just feels like it's useful to at least be able to imagine a concept, not directly, but in some kind of way that this feels like it's a description of the real world.

There's 0, there's 1, and there's infinity.

Like that, you need a lot of bits to give me what that number

But 0 and 1 and infinity, like once you have 300 things, you might as well have infinity things, right?

Otherwise you have to say when to stop making the things.

So there's a sense in which infinity is a very natural number of things to exist.

I was never comfortable with infinity because it's just such a, It was too good to be true.

Because in math, it just helps make things work out.

When things get very large, close to infinity, things seem to work out nicely.

It's kind of like, because my deepest passion is probably psychology.

And I'm uncomfortable how in the average, the beauty of the very, how much we vary is lost.

In that same kind of sense, infinity seems like a convenient way to erase the details.

But the thing about infinity is, it seems to pop up whether we like it or

Like you're trying to be a computer scientist, you ask yourself, well how long will it take this program to run?

And you realize, well, for some of them, the answer is infinitely long.


Speaker 0: What is Hilbert space and Euclidean space?

Speaker 1: Yeah, you know, I think that people are very welcome to go through their lives not knowing what Hilbert space is. But if you want to dig into a little bit more into quantum mechanics, it becomes necessary. You know, the English language was invented long before quantum mechanics or various forms of higher mathematics were invented. So we use the word space to mean different things. Of course, most of us think of space as this three-dimensional world in which we live, right?

I mean, some of us just think of it as outer space. But okay, but space around us, it gives us the three-dimensional location of things and objects. But mathematicians use any generic abstract collection of elements as a space, okay? A space of possibilities, momentum space, etc. So, Hilbert space is the space of all possible quantum wave functions, either for the universe or for some specific system.

And it could be an infinite dimensional space or it could be just really, really large dimensional but finite. We don't know because we don't know the final theory of everything, but this abstract Hilbert space is really, really, really big and has no immediate connection to the three-dimensional space in which we live.

Speaker 0: What do dimensions in Hilbert space mean?

Speaker 1: You know, it's just a way of mathematically representing how much information is contained in the state of the system. How many numbers do you have to give me to specify what the thing is doing? So in classical mechanics, I give you the location of something by giving you 3 numbers, right? Up, down, left, XYZ coordinates. But then I might wanna give you its entire state, physical state, which means both its position and also its velocity.

The velocity also has 3 components. So its state lives in something called phase space, which is 6 dimensional, 3 dimensions of position, 3 dimensions of velocity. And then if it also has an orientation in space, that's another 3 dimensions and so forth. So As you describe more and more information about the system, you have an abstract mathematical space that has more and more numbers that you need to give, and each 1 of those numbers corresponds to a dimension in that space.

Speaker 0: So in terms of the amount of information, what is entropy? This mystical word that's overused in math and physics, but has a very specific meaning in this context.

Speaker 1: Sadly, it has more than 1 very specific meaning. This is the reason why it's hard. Entropy means different things even to different physicists. But 1 way of thinking about it is a measure of how much we don't know about the state of a system, right? So if I have a bottle of water molecules and I know that, okay, there's a certain number of water molecules, I could weigh it, right, and figure out.

I know the volume of it and I know the temperature and pressure and things like that. I certainly don't know the exact position and velocity of every water molecule, right? So there's a certain amount of information I know, certain amount that I don't know that is part of the complete state of the system. And that's what the entropy characterizes, how much unknown information there is, the difference between what I do know about the system and its full exact microscopic state.

Speaker 0: So when we try to describe a quantum mechanical system, Is it infinite or finite but very large?

Speaker 1: Yeah, we don't know. That depends on the system. You know, it's easy to mathematically write down a system that would have a potentially infinite entropy, an infinite dimensional Hilbert space. So let's go back a little bit. We said that the Hilbert space was the space in which quantum wave functions lived.

For different systems, that will be different sizes. They could be infinite or finite. So that's the number of numbers, the number of pieces of information you could potentially give me about the system. So the bigger Hilbert space is, the bigger the entropy of that system could be, depending on what I know about it. If I don't know anything about it, then it has a huge entropy, right?

But only up to the size of its Hilbert space. So we don't know in the real physical world whether or not this region of space that contains that water bottle has potentially an infinite entropy or just a finite entropy. We have different arguments on different sides.

Speaker 0: So if it's infinite, how do you think about infinity? Is this something you can, your cognitive abilities are able to process? Or is it just a mathematical tool?

Speaker 1: It's somewhere in between, right? I mean, we can say things about it. We can use mathematical tools to manipulate infinity very, very accurately. You can define what we mean, you know, for any number N there's a number bigger than it. So there's no biggest number, right?

So there's something called the total number of all numbers, that's infinite. But it is hard to wrap your brain around that. And I think that gives people pause because we talk about infinity as if it's a number, but it has plenty of properties that real numbers don't have. You know, if you multiply infinity by 2, you get infinity again, right? That's a little bit different than what we're used to.

Speaker 0: Okay, but are you comfortable with the idea that in thinking of what the real world actually is, that infinity could be part of that world? Are you comfortable that a world in some dimension, in some aspect-

Speaker 1: I'm comfortable with lots of things. I mean, you know, I don't want my level of comfort to affect what I think about the world. You know, I'm pretty open-minded about what the world could be at the fundamental level.

Speaker 0: Yeah, but infinity is a tricky 1. It's not almost a question of comfort. It's a question of, is it an overreach of our intuition? Sort of, it could be a convenient, almost like when you add a constant to an equation just because it'll help. It just feels like it's useful to at least be able to imagine a concept, not directly, but in some kind of way that this feels like it's a description of the real world.

Speaker 1: Think of it this way. There's only 3 numbers that are simple. There's 0, there's 1, and there's infinity. A number like 318 is just bizarre. Like that, you need a lot of bits to give me what that number

Speaker 0: is.

Speaker 1: But 0 and 1 and infinity, like once you have 300 things, you might as well have infinity things, right? Otherwise you have to say when to stop making the things. So there's a sense in which infinity is a very natural number of things to exist.

Speaker 0: I was never comfortable with infinity because it's just such a, It was too good to be true. Because in math, it just helps make things work out. When things get very large, close to infinity, things seem to work out nicely. It's kind of like, because my deepest passion is probably psychology. And I'm uncomfortable how in the average, the beauty of the very, how much we vary is lost.

In that same kind of sense, infinity seems like a convenient way to erase the details.

Speaker 1: But the thing about infinity is, it seems to pop up whether we like it or

Speaker 0: not.

Speaker 1: Right. Like you're trying to be a computer scientist, you ask yourself, well how long will it take this program to run? And you realize, well, for some of them, the answer is infinitely long. It's not because you tried to get there.

See all Lex Fridman transcripts on Youtube

Sean Carroll: Hilbert Space and Infinity