← back to chamber
H = −Σ pi log pi   |   H = 0.00 bits · maximum order
entropy dial  ·  titrate disorder
order chaos
0.00
crystal living system gas
Shannon entropy H(p)
0.00 H bits
1.00 info capacity
1.00 predictability
starting form
particles
200
state
ordered
micro­states
Ω = 1
arrow of time
time flows → toward disorder

Entropy: Why Time Has a Direction

Boltzmann · Shannon · thermodynamics

The laws of physics at the microscopic level are time-symmetric — a video of two billiard balls colliding looks equally valid played forward or backward. Yet at the macroscopic level, time has an unmistakable direction. Entropy is the reason why.

Boltzmann's insight. Entropy S = k·ln(Ω) counts the number of microstates Ω that produce the same macrostate. A crystal has one microstate — every atom exactly placed. A gas has an astronomical number — particles can be anywhere. The system evolves toward higher entropy not because of any force, but because there are vastly more disordered states than ordered ones. Disorder wins by sheer probability.
Shannon's reformulation. Information entropy H = −Σ pᵢ log pᵢ measures surprise. If you know exactly where every particle is (crystal), H = 0 — no information needed to describe the system beyond "it's the crystal." If particles are uniformly random (gas), H is maximal — every observation carries maximum information because nothing was predictable. Order is cheap to describe. Chaos requires the most bits.
The paradox of life. Living systems — the middle of the dial — are local pockets of decreasing entropy, maintained by consuming energy. A cell is more ordered than the molecules it's made from. This doesn't violate the second law: the total entropy of cell + environment increases. Life is a temporary eddy of order in a river flowing toward chaos. The term for this: a dissipative structure.
Why you can't reverse time. Press reverse: the simulation resists. A scrambled egg does not unscramble. Smoke does not re-enter a chimney. The reason is combinatorial — for every ordered arrangement, there are 10²³ disordered ones. The probability of spontaneous re-ordering is not zero. It is just so close to zero that the universe's entire lifespan is too short to expect it to happen once.

slide the dial to titrate disorder  ·  watch H update in the equation  ·  try to reverse time