One of the most important, yet least understood, concepts in all of physics. Head to https://brilliant.org/veritasium to start your free 30-day trial, and the first 200 people get 20% off an annual premium subscription.

If you're looking for a molecular modeling kit, try Snatoms - a kit I invented where the atoms snap together magnetically: https://snatoms.com

▀▀▀
A huge thank you to those who helped us understand different aspects of this complicated topic - Dr. Ashmeet Singh, Supriya Krishnamurthy, Dr. Jos Thijssen, Dr. Bijoy Bera, Dr. Timon Idema, Álvaro Bermejillo Seco and Dr. Misha Titov. 

▀▀▀
References:  
Carnot, S. (1824). Reflections on the motive power of heat: and on machines fitted to develop that power.  - https://ve42.co/Carnot1890 

Harnessing The True Power Of Atoms | Order And Disorder Documentaries, Spark via YouTube - https://ve42.co/OrderDisorder 

A better description of entropy, Steve Mould via YouTube -  https://ve42.co/Mould2016   

Dugdale, J. S. (1996). Entropy and its physical meaning. CRC Press. - https://ve42.co/Dugdale1996 

Schroeder, D. V. (1999). An introduction to thermal physics. - https://ve42.co/Schroeder2021 

Fowler, M. Heat Engines: the Carnot Cycle, University of Virginia. - https://ve42.co/Fowler2023  

Chandler, D.L. (2010). Explained: The Carnot Limit, MIT News -  https://ve42.co/Chandler2010 

Entropy, Wikipedia - https://ve42.co/EntropyWiki 

Clausius, R. (1867). The mechanical theory of heat. Van Voorst. - https://ve42.co/Clausius1867 

What is entropy? TED-Ed via YouTube - https://ve42.co/Phillips2017 

Thijssen, J. (2018) Lecture Notes Statistical Physics, TU Delft.

Schneider, E. D., & Kay, J. J. (1994). Life as a manifestation of the second law of thermodynamics. Mathematical and computer modelling, 19(6-8), 25-48. - https://ve42.co/Schneider1994  

Lineweaver, C. H., & Egan, C. A. (2008). Life, gravity and the second law of thermodynamics. Physics of Life Reviews, 5(4), 225-242. - https://ve42.co/Lineweaver2008 

Michaelian, K. (2012). HESS Opinions" Biological catalysis of the hydrological cycle: life's thermodynamic function". Hydrology and Earth System Sciences, 16(8), 2629-2645. - https://ve42.co/Michaelian2012 

England, J. L. (2013). Statistical physics of self-replication. The Journal of chemical physics, 139(12), 09B623_1. - https://ve42.co/England2013 

England, J. L. (2015). Dissipative adaptation in driven self-assembly. Nature nanotechnology, 10(11), 919-923. - https://ve42.co/England2015 

Wolchover, N. (2014). A New Physics Theory of Life, Quantamagazine  - https://ve42.co/Wolchover2014 

Lineweaver, C. H. (2013). The entropy of the universe and the maximum entropy production principle. In Beyond the Second Law: Entropy Production and Non-equilibrium Systems (pp. 415-427). Berlin, Heidelberg: Springer Berlin Heidelberg. - https://ve42.co/LineweaverEntropy 

Bekenstein, J.D. (1972). Black holes and the second law. Lett. Nuovo Cimento 4, 737–740. - https://ve42.co/Bekenstein1972 

Carroll, S.M. (2022). The Biggest Ideas in the Universe: Space, Time, and Motion. Penguin Publishing Group. - https://ve42.co/Carroll2022 

Black hole thermodynamics, Wikipedia - https://ve42.co/BlackHoleTD  

Cosmology and the arrow of time: Sean Carroll at TEDxCaltech, TEDx Talks via YouTube - https://ve42.co/CarrollTEDx 

Carroll, S. M. (2008). The cosmic origins of time’s arrow. Scientific American, 298(6), 48-57. - https://ve42.co/Carroll2008 

The Passage of Time and the Meaning of Life | Sean Carroll (Talk + Q&A), Long Now Foundation via YouTube - https://ve42.co/CarrollLNF  

▀▀▀
Special thanks to our Patreon supporters:
Emil Abu Milad, Tj Steyn, meg noah, Bernard McGee, KeyWestr, Amadeo Bee, TTST, Balkrishna Heroor, John H. Austin, Jr., john kiehl, Anton Ragin, Diffbot, Gnare, Dave Kircher, Burt Humburg, Blake Byers, Evgeny Skvortsov, Meekay, Bill Linder, Paul Peijzel, Josh Hibschman, Mac Malkawi, Juan Benet, Ubiquity Ventures, Richard Sundvall, Lee Redden, Stephen Wilcox, Marinus Kuivenhoven, Michael Krugman, Sam Lutfi.

▀▀▀
Written by Casper Mebius, Derek Muller & Petr Lebedev
Edited by Trenton Oliver & Jamie MacLeod
Animated by Mike Radjabov, Ivy Tello, Fabio Albertelli and Jakub Misiek
Filmed by Derek Muller, Albert Leung & Raquel Nuno
Molecular collisions video by CSIRO's Data61 via YouTube: Simulation of air 
Additional video/photos supplied by Getty Images, Pond5 and by courtesy of NASA, NASA's Goddard Space Flight Center, NASA Goddard Flight Lab/ CI Lab, NASA/SDO and the AIA, EVE, HMI, and WMAP science teams. As well as the Advanced Visualization Laboratory at the National Center for Supercomputing Applications, B. Robertson, L. Hernquist
Music from Epidemic Sound & Jonny Hyman
Produced by Derek Muller, Petr Lebedev, Emily Zhang, & Casper Mebius

This is a video about 1 of the most important, yet least understood, concepts in all of physics.

It governs everything from molecular collisions to humongous storms, from the beginning of the universe through its entire evolution to its inevitable end.

It may in fact determine the direction of time and even be the reason that life exists.

To see the confusion around this topic you need ask only 1 simple question.

Vitamin D, we get vitamin D from the sun?

We do get vitamin D from the ultraviolet rays.

What does the Earth get from this energy?

Every day the Earth gets a certain amount of energy from the sun, and then how much energy does the earth radiate back into space relative to that amount that it gets from the Sun?

I don't believe it's just radiating right back.

But the thing about energy is it never really goes away.

It would have to break even, wouldn't it?

You know, cause and effect, it'd be equal in some ways, right?

For most of the Earth's history, it should be exactly the same amount of energy in from the Sun as Earth radiates into space.

Because if we didn't do that, then the Earth would get a lot hotter.

So, if that is the case, then what are we really getting from the sun?

We're getting something special from the sun.

To answer that, we have to go back to a discovery made 2 centuries ago.

In the winter of 1813, France was being invaded by the armies of Austria, Prussia, and Russia.

The son of 1 of Napoleon's generals was Sadi Carnot, a 17-year-old student.

On December 29th, he writes a letter to Napoleon to request to join in the fight.

Napoleon, preoccupied in battle, never replies.

But Carnot gets his wish a few months later when Paris is attacked.

The students defend a chateau just east of the city.

But they're no match for the advancing armies, and Paris falls after only a day of fighting.

7 years later, he goes to visit his father, who's fled to Prussia after Napoleon's downfall.

His father was not only a general, but also a physicist.

He wrote an essay on how energy is most efficiently transferred in mechanical systems.

When his son comes to visit, they talk at length about the big breakthrough of the time, steam engines.

Steam engines were already being used to power ships, mine ore, and excavate ports.

And it was clear that the future industrial and military might of nations depended on having the best steam engines.

But French designs were falling behind those of other countries like Britain.

So Sadi Carnot took it upon himself to figure out why.

At the time, even the best steam engines only converted around 3% of thermal energy into useful mechanical work.

If he could improve on that, he could give France a huge advantage and restore its place in the world.

So He spends the next 3 years studying heat engines.

And 1 of his key insights involves how an ideal heat engine would work, 1 with no friction and no losses to the environment.

Take 2 really big metal bars, 1 hot and 1 cold.

The engine consists of a chamber filled with air, where heat can only flow in or out through the bottom.

Inside the chamber is a piston, which is connected to a flywheel.

The air starts at a temperature just below that of the hot bar.

So first the hot bar is brought into contact with the chamber, the air inside expands with heat flowing into it to maintain its temperature.

This pushes the piston up, turning the flywheel.

Next, the hot bar is removed, but the air in the chamber continues to expand.

Except now, without heat entering, the temperature decreases, in the ideal case, until it is the temperature of the cold bar.

The cold bar is brought into contact with the chamber and the flywheel pushes the piston down and as the air is compressed heat is transferred into the cold bar.

The cold bar is removed, the flywheel compresses the gas further increasing its temperature until it is just below that of the hot bar.

Then the hot bar is connected again and the cycle repeats.

Through this process, heat from the hot bar is converted into the energy of the flywheel.

And what's interesting to note about Carnot's ideal engine is that it is completely reversible.

If you ran the engine in reverse, first the air expands, lowering the temperature, then the chamber is brought into contact with the cold bar.

The air expands more, drawing in heat from the cold bar.

Next, the air is compressed, increasing its temperature.

The chamber is placed on top of the hot bar and the energy of the flywheel is used to return the heat back into the hot bar.

However many cycles were run in the forward direction, you could run the same number in reverse and at the end, everything would return to its original state with no additional input of energy required.

So by running an ideal engine, nothing really changes.

So what is the efficiency of this engine?

Since it's fully reversible, you might expect the efficiency to be 100%, But that is not the case.

Each cycle, the energy of the flywheel increases by the amount of heat flowing into the chamber from the hot bar minus the heat flowing out of the chamber at the cold bar.

So to calculate the efficiency, we divide this energy by the heat input from the hot bar.

Now the heat in on the hot side is equal to the work done by the gas on the piston.

And this will always be greater than the work done by the piston on the gas on the cold side, which equals the heat out.

And this is because on the hot side, the hot gas exerts a greater pressure on the piston than that same gas when cold.

To increase the efficiency of the engine, you could increase the temperature of the hot side, or decrease the temperature of the cold side, or both.

Lord Kelvin learns of Carnot's ideal heat engine and realizes it could form the basis for an absolute temperature scale.

Imagine that the gas is allowed to expand an extreme amount, so much that it cools to the point where all the gas particles effectively stop moving.

Then they would exert no pressure on the piston, and it would take no work to compress it on the cold side, so no heat would be lost.

This is the idea of absolute 0, and it would make for a 100% efficient engine.

Using this absolute temperature scale, the Kelvin scale, we can replace the amount of heat in and out with the temperature of the hot and cold side respectively because they are directly proportional so we can express efficiency like this which we can rewrite like this What we have learned is that the efficiency of an ideal heat engine doesn't depend on the materials or the design of the engine But fundamentally on the temperatures of the hot and cold sides.

To reach a hundred percent efficiency You'd need infinite temperature on the hot side or absolute 0 on the cold side, both of which are impossible in practice.

So even with no friction or losses to the environment, it's impossible to make a heat engine 100% efficient.

And that's because to return the piston to its original position, you need to dump heat into the cold bar, so not all the energy stays in the flywheel.

Now in Carnot's time, high-pressure steam engines could only reach temperatures up to 160 degrees Celsius, so their theoretical maximum efficiency was 32%.

But their real efficiency was more like 3%.

That's because real engines experience friction, dissipate heat to the environment, and they don't transfer heat at constant temperatures.

So for just as much heat going in, less energy ends up in the flywheel.

The rest is spread out over the walls of the cylinder, the axle of the flywheel, and is radiated out into the environment.

When energy spreads out like this, it is impossible to get it back.

The total amount of energy didn't change, but it became less usable.

Energy is most usable when it is concentrated, and less usable when it's spread out.

Decades later, German physicist Rudolf Clausius studies Carnot's engine, and he comes up with a way to measure how spread out the energy is.

When all the energy is concentrated in the hot bar, that is low entropy.

But as the energy spreads to the surroundings, the walls of the chamber and the axle, well, entropy increases.

This means the same amount of energy is present, but in this more dispersed form, it is less available to do work.

In 1865, Clausius summarizes the first 2 laws of thermodynamics like this.

First, the energy of the universe is constant.

And second, the entropy of the universe tends to a maximum.

In other words, energy spreads out over time.

The second law is core to so many phenomena in the world.

It's why hot things cool down and cool things heat up, why gas expands to fill a container, why you can't have a perpetual motion machine, because the amount of usable energy in a closed system is always decreasing.

The most common way to describe entropy is as disorder.

Which makes sense because it is associated with things becoming more mixed, random, and less ordered.

But I think the best way to think about entropy is as the tendency of energy to spread out.

I mean, most of the laws of physics work exactly the same way forwards or backwards in time.

So how does this clear time dependence arise?

Well, let's consider 2 small metal bars, 1 hot and 1 cold.

For this simple model, we'll consider only 8 atoms per bar.

Each atom vibrates according to the number of energy packets it has.

So let's start with 7 packets of energy in the left bar and 3 in the right.

The number of energy packets in each bar is what we'll call a state.

It has 7 energy packets which are free to move around the lattice.

The energy packets hop randomly from atom to atom, giving different configurations of energy.

But the total energy stays the same the whole time.

Now let's bring the cold bar back in with only 3 packets and touch them together.

The energy packets can now hop around between both bars creating different configurations.

Each unique configuration is equally likely.

So what happens if we take a snapshot at 1 instant in time and see where all the energy packets are?

Now there are 9 energy packets in the left bar and only 1 in the right bar.

Shouldn't that be impossible because it decreases entropy?

Well, this is where Ludwig Boltzmann made an important insight.

Heat flowing from cold to hot is not impossible.

There are 91, 520 configurations with 9 energy packets in the left bar, but 627, 264 with 5 energy packets in each bar.

That is, the energy is more than 6 times as likely to be evenly spread between the bars.

But if you add up all the possibilities, you find there's still a 10.5% chance that the left bar ends up with more energy packets than it started.

So why don't we observe this happening around us?

Well watch what happens as we increase the number of atoms to 80 per bar and the energy packets to a hundred with 70 in the left bar and 30 in the right.

There is now only a 0.05% chance that the left solid ends up hotter than it started.

And this trend continues as we keep scaling up the system.

In everyday solids, there are around 100 trillion trillion atoms and even more energy packets.

So heat flowing from cold to hot is just so unlikely that it never happens.

Right now it is completely solved, but I'm going to close my eyes and make some turns at random.

If I keep doing this it will get further and further from being solved.

But how can I be confident that I'm really messing this cube up?

Well, because there's only 1 way for it to be solved, a few ways for it to be almost solved, and quintillions of ways for it to be almost entirely random.

Without thought and effort, every turn moves the Rubik's Cube from a highly unlikely state, that of it being solved, to a more likely state, a total mess.

So if the natural tendency of energy is to spread out and for things to get messier, then how is it possible to have something like air conditioning, where The cold interior of a house gets cooler and the hot exterior gets hotter.

Energy is going from cold to hot, decreasing the entropy of the house.

Well, this decrease in entropy is only possible by increasing the entropy a greater amount somewhere else.

In this case, at a power plant, the concentrated chemical energy and coal is being released, heating up the power plant and its environment, spreading to the turbine, the electric generators, heating the wires all the way to the house, and producing waste heat in the fans and compressor.

Whatever decrease in entropy is achieved at the house is more than paid for by an increase in entropy required to make that happen.

But if total entropy is constantly increasing and anything we do only accelerates that increase, then how is there any structure left on Earth?

How are there hot parts separate from cold parts?

Well if the Earth were a closed system, the energy would spread out completely, meaning all life would cease, everything would decay and mix, and eventually reach the same temperature.

But luckily, Earth is not a closed system because we have the sun.

What the sun really gives us is a steady stream of low entropy that is concentrated, bundled up energy.

The energy that we get from the sun is more useful than the energy we give back.

It's more compact, it's more clumped together.

Plants capture this energy and use it to grow and create sugars.

Then animals eat plants and use that energy to maintain their bodies and move around.

Bigger animals get their energy by eating smaller animals and so on.

And each step of the way, the energy becomes more spread out.

Ultimately, all the energy that reaches Earth from the sun is converted into thermal energy, and then it's radiated back into space.

The increase in entropy can be seen in the relative number of photons arriving at and leaving the Earth.

For each photon received from the sun, 20 photons are emitted.

And everything that happens on Earth, plants growing, trees falling, Herds stampeding, hurricanes and tornadoes, people eating, sleeping, and breathing, all of it happens in the process of converting fewer, higher energy photons into 20 times as many, lower energy photons.

Without a source of concentrated energy and a way to discard the spread out energy, life on Earth would not be possible.

It has even been suggested that life itself may be a consequence of the second law of thermodynamics.

If the universe tends toward maximum entropy, then life offers a way to accelerate that natural tendency, because life is spectacularly good at converting low entropy into high entropy.

For example, the surface layer of seawater produces between 30 to 680% more entropy when cyanobacteria and other organic matter is present than when it's not.

Jeremy England takes this 1 step further.

He's proposed that if there is a constant stream of clumped up energy, this could favor structures that dissipate that energy.

And over time, this results in better and better energy dissipators, eventually resulting in life.

Or in his own words, you start with a random clump of atoms, and if you shine light on it for long enough, it should not be so surprising that you get a plant.

So life on Earth survives on the low entropy from the sun.

But then where did the Sun get its low entropy?

If we know that the total entropy of the universe is increasing with time, then it was lower entropy yesterday, and even lower entropy the day before that, and so on all the way back to the Big Bang.

So right after the Big Bang, that is when the entropy was lowest.

It doesn't explain why the entropy was low, just that it must have been that way for the universe to unfold as it has.

But the early universe was hot, dense, and almost completely uniform.

I mean everything was mixed and the temperature was basically the same everywhere, varying by at most 0.001%.

Well, the thing we've left out is gravity.

So taking gravity into account, having matter all spread out like this would be an extremely unlikely state.

Over time, as the universe expanded and cooled, matter started to clump together in more dense regions.

And in doing so, enormous amounts of potential energy were turned into kinetic energy.

And this energy could also be used, like how water flowing downhill can power a turbine.

But as bits of matter started hitting each other, some of their kinetic energy was converted into heat, so the amount of useful energy decreased, thereby increasing entropy.

In doing so, stars, planets, galaxies, and life were formed, increasing entropy all along.

The universe started with around 10 to the 88 Boltzmann constants worth of entropy.

Nowadays, all the stars in the observable universe have about 9.5 times 10 to the 80.

The interstellar and intergalactic medium combined have almost 10 times more, but still only a fraction of the early universe.

A lot More is contained in neutrinos and in photons of the cosmic microwave background.

In 1972, Jacob Bekenstein proposed another source of entropy, black holes.

He suggested that the entropy of a black hole should be proportional to its surface area.

So as a black hole grows, its entropy increases.

Famous physicists thought the idea was nonsense, and for good reason.

According to classical thermodynamics, if black holes have entropy, then they should also have a temperature.

But if they have temperatures, they should emit radiation and not be black after all.

The person who set out to prove Bekenstein wrong was Stephen Hawking.

But to his surprise his results showed that black holes do emit radiation, now known as Hawking radiation, and they do have a temperature.

The black hole at the center of the Milky Way has a temperature of about a hundred trillionth of a Kelvin, emitting radiation that is far too weak to detect, so still pretty black.

But Hawking confirmed that black holes have entropy, and Bekenstein was right.

Hawking was able to refine Bekenstein's proposal and determine just how much entropy they have.

The supermassive black hole at the center of the Milky Way has about 10 to the 91 Boltzmann constants of entropy.

That is a thousand times as much as the early observable universe, and 10 times more than all the other particles combined.

All black holes together account for 3 times 10 to the 104 Boltzmann constants worth of entropy.

So Almost all the entropy of the universe is tied up in black holes.

That means the early universe only had about 0.000000000000003% of the entropy it has now.

So the entropy was low, and everything that happens in the universe, like planetary systems forming, galaxies merging, asteroids crashing, stars dying, to life itself flourishing, all of that can happen because the entropy of the universe was low and it has been increasing.

We never see an asteroid uncrash or a planetary system unmix into the cloud of dust and gas that made it up.

There is a clear difference between going to the past and the future and that difference comes from entropy.

The fact that we are going from unlikely to more likely states is why there is an arrow of time.

This is expected to continue until eventually the energy gets spread out so completely that nothing interesting will ever happen again.

In the distant future, more than 10 to the 100 years from now, after the last black hole has evaporated, the universe will be in its most probable state.

Now, even on large scales, you would not be able to tell the difference between time moving forwards or backwards.

The arrow of time itself would disappear.

So it sounds like entropy is this awful thing that leads us inevitably towards the dullest outcome imaginable.

But just because maximum entropy has low complexity does not mean that low entropy has maximum complexity.

It's actually more like this tea and milk.

I mean, holding it like this, it's not very interesting.

But as I pour the milk in, the 2 start to mix, and these beautiful patterns emerge.

They arise in an instant, and before you know it, they're gone, back to being featureless.

See all Veritasium transcripts on Youtube

The Most Misunderstood Concept in Physics