Drop a drop of ink into a glass of water. It spreads — slowly, irreversibly — until uniformly distributed. You will never see the ink spontaneously re-concentrate. Crack an egg: you cannot uncrack it. A hot cup of coffee cools to room temperature; a cold cup never spontaneously heats up. These everyday observations share a single physical explanation: entropy. Entropy is the quantity that increases in all natural processes and defines the direction of time. It is one of the most profound concepts in physics, touching thermodynamics, information theory, cosmology, and the deepest questions about why time flows in one direction.
Thermodynamic entropy (Clausius, 1865): ΔS = Q_rev/T — entropy change equals reversible heat transfer divided by absolute temperature. Unit: J/K.
Statistical entropy (Boltzmann, 1877): S = k_B ln W — entropy is proportional to the logarithm of the number of microstates W corresponding to a macrostate. The second definition shows entropy is fundamentally about probability and disorder.
Entropy as Disorder: Macrostates and Microstates
A macrostate is what we can observe: temperature, pressure, volume, colour. A microstate is the exact position and momentum of every single molecule. Many different microstates can correspond to the same macrostate.
Consider 4 gas molecules in a box with two equal halves. How many ways can they be arranged?
| Macrostate | Number of microstates W | Probability |
|---|---|---|
| All 4 in left half | 1 | 1/16 = 6.25% |
| 3 left, 1 right | 4 | 4/16 = 25% |
| 2 left, 2 right | 6 | 6/16 = 37.5% (most likely) |
| 1 left, 3 right | 4 | 4/16 = 25% |
| All 4 in right half | 1 | 1/16 = 6.25% |
The most disordered macrostate (equal distribution) has the most microstates and is the most probable. The perfectly ordered macrostate (all molecules in one half) has only 1 microstate out of 16 — improbable with 4 molecules. With 10²³ molecules (a realistic gas), the ratio of microstates between ordered and disordered states is so astronomically large that spontaneous ordering is effectively impossible. This is why entropy increases: it is overwhelmingly probable.
Boltzmann's Entropy Formula
where k_B = 1.38 × 10⁻²³ J/K is Boltzmann's constant and W is the number of microstates available to the system. This equation — so fundamental it is inscribed on Boltzmann's tombstone — unifies thermodynamic entropy with statistical mechanics. It shows that entropy measures the multiplicity of a system: high W (many microstates) = high entropy = high disorder.
For two systems in contact, the total number of microstates is the product W_total = W₁ × W₂. But entropy is additive: S_total = S₁ + S₂ = k_B ln W₁ + k_B ln W₂ = k_B ln(W₁W₂). The logarithm converts the multiplicative property of probabilities to the additive property we expect of extensive thermodynamic quantities.
The Thermodynamic Definition
For a reversible heat transfer at temperature T:
Entropy increases (ΔS > 0) when heat is added at temperature T. Entropy decreases when heat is removed. For irreversible processes, the actual entropy change of the universe is always greater than Q/T — extra entropy is generated by irreversibilities (friction, mixing, unrestrained expansion).
Example: Melting ice
Melting 1 kg of ice at 0°C (273 K) requires L = 334,000 J. Entropy change:
The entropy of the water is 1,223 J/K greater than the entropy of the ice — water has more microstates available than ice because its molecules can move freely rather than being locked in a crystal lattice.
Entropy and Information
In 1948, Claude Shannon developed information theory and defined a quantity he called information entropy — mathematically identical in form to Boltzmann's entropy. Shannon entropy measures the amount of information (or uncertainty) in a message. High entropy = highly random, unpredictable = maximum information content. Low entropy = highly ordered, predictable = minimum information.
This mathematical identity is not a coincidence. Erasing one bit of information in a computer requires a minimum of k_B T ln 2 of energy to be dissipated as heat — Landauer's principle — directly connecting information processing to thermodynamic entropy. Maxwell's demon thought experiment (a demon controlling a partition between two gases) seems to allow entropy to decrease — but the demon must store and erase information, generating entropy that more than compensates.
Entropy and the Arrow of Time
The fundamental laws of physics — Newton's laws, Maxwell's equations, quantum mechanics — are all time-symmetric: they work equally well forward and backward. Yet macroscopic processes have a clear direction. The arrow of time is the direction of increasing entropy.
A film of a glass shattering looks wrong in reverse because the reverse process would involve entropy spontaneously decreasing — overwhelmingly improbable but not impossible in principle. A film of two molecules colliding looks identical forward and backward — microscopic processes are reversible.
The ultimate reason time appears to flow in one direction is that the universe started in an extraordinarily low-entropy state — the Big Bang. The universe has been evolving toward higher entropy ever since. Stars, planets, life, and complexity are all temporary low-entropy structures that form when large entropy increases are available elsewhere (the Sun radiates low-entropy photons and receives high-entropy waste heat).
Frequently Asked Questions
What Is Entropy?
Entropy S is a measure of the disorder or randomness of a system — more precisely, the number of microscopic arrangements (microstates) consistent with the system's macroscopic state. High entropy means many possible arrangements (disordered); low entropy means few (ordered). The SI unit is joules per kelvin (J/K). Entropy is a state function: like internal energy, it depends only on the current state, not on how the system got there.
The Entropy Formula
For a reversible process transferring heat Q at temperature T:
For the statistical definition (Boltzmann's formula):
where W is the number of microstates and k_B = 1.381 × 10⁻²³ J/K. This is carved on Boltzmann's tombstone in Vienna. For an irreversible process: ΔS > Q/T (entropy increases more than heat divided by temperature).
The Second Law and Entropy
The second law of thermodynamics: the total entropy of an isolated system never decreases. ΔS_universe ≥ 0. For reversible processes: ΔS_universe = 0. For irreversible processes: ΔS_universe > 0. This means the universe tends toward higher entropy — greater disorder — over time. Heat flows from hot to cold (not the reverse) because this increases entropy. Ice melts at room temperature. Gases expand to fill containers. These are all entropy increases.
Worked Example: Melting Ice
1 kg of ice melts at 0°C (273 K). Latent heat of fusion = 334,000 J/kg. Find the entropy change of the ice.
The water molecules gain freedom of movement during melting — many more microstates are accessible in liquid water than in the ordered ice crystal lattice. This increased disorder is reflected in the positive entropy change.
Entropy and Information
Claude Shannon showed in 1948 that information entropy is mathematically identical to thermodynamic entropy. A highly ordered message (low entropy) carries more information than a random string of characters (high entropy). The connection is deep: Maxwell's demon thought experiment (1867) proposed a demon that could sort fast and slow molecules, reducing entropy without doing work — seemingly violating the second law. The resolution (Landauer, 1961): the demon must store information about each molecule. Erasing this information dissipates heat, restoring the entropy balance. Information and entropy are two sides of the same coin.
Frequently Asked Questions
What is entropy in physics?
Entropy is a measure of the number of microscopic arrangements (microstates) consistent with a system's macroscopic state. Boltzmann's formula: S = k_B ln W, where W is the number of microstates. More disorder means more microstates, hence higher entropy. For heat transfer: ΔS = Q/T (reversible process). The second law states that the total entropy of an isolated system can only increase or stay the same — it can never spontaneously decrease. This asymmetry defines the arrow of time: why processes like mixing, heat flow, and gas expansion are irreversible.
Why does entropy always increase?
Statistically, disordered states are overwhelmingly more probable than ordered ones. Consider 100 gas molecules in a box: there's only one arrangement where all are in the left half, but an astronomical number of arrangements where they're spread throughout. Any random motion will almost certainly increase disorder — not because of a law "forbidding" order, but because ordered states are vanishingly rare. The second law is fundamentally a statistical statement: entropy increases because disordered states are so much more probable that we never observe spontaneous transitions to order on macroscopic scales.
Can entropy decrease?
Entropy can decrease locally (in part of a system) as long as it increases by at least as much elsewhere. A refrigerator decreases the entropy of its contents (by removing heat) but increases the entropy of the room (by releasing more heat). Living organisms maintain low internal entropy by consuming high-quality energy (food, sunlight) and releasing high-entropy waste heat. Earth receives low-entropy sunlight and radiates high-entropy infrared — the Earth-Sun system's entropy increases, allowing life to maintain local order. Only in a completely isolated system can entropy never decrease.
What is the relationship between entropy and the arrow of time?
Entropy's unidirectional increase gives time its direction — the "arrow of time." The fundamental physical laws (Newton's laws, Maxwell's equations, quantum mechanics) are time-symmetric: they work equally well forward and backward in time. But the second law breaks this symmetry: entropy increases toward the future, not the past. This is why we remember the past but not the future, why videos of breaking glass look wrong when played backward, and why cause precedes effect. The low-entropy initial state of the universe (the Big Bang) is the ultimate origin of time's directionality.
What is thermodynamic entropy vs information entropy?
Thermodynamic entropy (Boltzmann/Clausius) measures physical disorder in a system — the number of microscopic arrangements consistent with macroscopic observations. Shannon entropy (information theory) measures the uncertainty or information content in a signal: H = −Σ p_i log₂ p_i. Mathematically they are identical in form. The connection is physical: Landauer's principle shows that erasing one bit of information generates at least k_B T ln 2 of heat — connecting information deletion to thermodynamic entropy. This means computation has a fundamental thermodynamic cost, and Maxwell's demon cannot violate the second law because storing and erasing its memories produces entropy.
What is entropy?
Entropy (S) measures the number of microscopic arrangements (microstates) available to a system: S = k_B ln W. Higher entropy means more disorder and more possible arrangements. Thermodynamically: ΔS = Q_rev/T. The second law states that total entropy of the universe always increases in natural processes.
Why does entropy always increase?
Because disordered states have vastly more microstates than ordered ones. A system evolving randomly is overwhelmingly likely to move toward higher-entropy (more microstate) configurations. With 10²³ molecules, the probability of spontaneous ordering is so vanishingly small that it is effectively impossible — entropy increases as a matter of statistics, not absolute prohibition.
Can entropy decrease?
Local entropy can decrease — ice forming from water decreases the water's entropy — but only by increasing entropy elsewhere (the surroundings gain heat and entropy). Total entropy of the universe always increases or stays the same. The second law applies to isolated systems or to the universe as a whole.
What is the relationship between entropy and disorder?
"Disorder" is an intuitive shorthand for entropy's precise meaning: the number of microstates. A disordered system (gas spread throughout a container) has many more possible molecular arrangements than an ordered one (all molecules in one corner), so it has higher entropy. The ordered state is not forbidden — just astronomically less probable.
What is entropy in everyday life?
Entropy is why heat flows from hot to cold (more microstates become available), why perfume spreads from a bottle (more positions available to molecules), why buildings decay unless maintained (destruction has more microstates than ordered structure), and why you must put energy into a refrigerator to move heat from cold to hot against the natural entropy increase.
Is entropy the same as energy?
No. Entropy (J/K) and energy (J) are different quantities, though deeply related. Energy can be conserved while entropy increases — the first law and second law are independent. High-entropy energy (dispersed thermal energy) is less useful for doing work than low-entropy energy (organised, like electricity or gravitational potential). Entropy measures the quality (usefulness) of energy, not its quantity.
Share this article
Written by
Physics Fundamentals Editorial Team
Written and reviewed by our team of physics educators. Content is aligned with A-Level, GCSE, AP Physics, and undergraduate curricula.
About Physics Fundamentals →
