EVOPEDIA

← all systems · see it in The System

Entropy

'Entropy is a thermodynamic state variable that quantifies the probabilistic distribution of accessible microstates in a system.' 'Entropy is central to the second law of thermodynamics, which states that the entropy of an isolated system left to spontaneous evolution cannot decrease with time.' S = k_B ln Omega; dS = delta q_rev / T.

Properties published scienceour proposal

Sourced fields, and our own readings.

born atquantity: the early universe; idea: 1850-1865
born precisionera for the quantity; year for the idea
boundaryEntropy belongs to a system and its macrostate: inside is the set of microstates compatible with what is fixed (energy, volume, constraints, what is known before observation, o56); outside is the bath or surroundings it trades heat and matter with. For an open system the change splits into transfer across the boundary and production inside (o54).
nested levelBuilt from the microstates of thermal energy, radiation, horizons or symbols; embedded in thermodynamics and statistical mechanics as their central quantity; carried, as a measure, into information theory and cryptography.
scalefield

Measures (44) published science

SI unit of entropyJ/K unit
Rankine's 'thermodynamic function'; Clausius's definition and name1850; 1865 year
Boltzmann's statistical entropy of an ideal gas (proportional to ln of the number of microstates)1877 year
Shannon's information entropy1948 year
calorimetric entropy: integration from near absolute zero up tousually 25 C
humankind's capacity to store entropically compressed information2.6 (1986) to 295 (2007) exabytes
characteristic clock: none given in the sources (a state variable; its rise gives a direction, not a period)n/a
Boltzmann constant (exact, SI)1.380649e-23 J/K
Landauer bound at room temperatureabout 3e-21 (k_B T ln 2 at 300 K) J per erased bit
finite-time erasure heat<Q> = k_B T (ln 2 + B/tau): extra heat falls as 1/tau (fit in Berut's Fig. 8)
characteristic clock: relaxation of a colloidal bead in its trapabout 0.1 s
information-to-energy conversion efficiency28% dimensionless
Szilard engine fidelity per feedback cycleabout 75% fraction of cycles
E. coli heat output against the self-replication boundless than 3x the bound ratio
ecosystem light-to-biomass efficiency against the thermodynamic efficiencyunder 3% (natural ecosystems) against about 18% (thermodynamic, from energy conversions) dimensionless
redundancy of written Englishroughly 50% (statistical structure up to about eight letters) dimensionless
time saved on a noiseless telegraph by proper encodingabout 50% time
entropy of supermassive black holes in the observable universe3.1 (+3.0, -1.7) e104 k_B
entropy of the cosmic event horizon2.6 +/- 0.3 x 10^122 k
entropy of the cosmic background photons5.40 +/- 0.15 e89 k_B
entropy of the relic neutrinos5.16 +/- 0.15 e89 k_B
entropy of stellar black holes5.9 e97 (2.5-15 solar-mass holes) k_B
entropy of all stars in the observable universe9.5 +/- 4.5 e80 k_B
entropy of the interstellar and intergalactic medium7.1 +/- 5.6 e81 k_B
holographic bound on the observable universe's entropyabout 1e123 k_B
Bekenstein-Hawking entropyS = A/4 (Planck units) k_B
phase-space ratio when a wall is removed (one mole, one litre)of order 2^N, about 10^(10^20) ratio
Penrose's phase-space ratio, final crunch over the initial stateabout 10^(10^123) ratio
cooling time to reach a temperature (third law)the obtainable temperature can scale as an inverse power of the cooling time relation
Clausius's definition and name; Boltzmann's statistical form; Shannon's information entropy1865; 1877; 1948 year
entropy of one bitk_B ln 2 J/K
bead relaxation time in the trapabout 0.1 s
Poincare recurrence time after a constraint is liftedenormous, of the order of the phase-space ratio (not given as a number) time
phase-space ratio after a wall is removed (1 mole in 1 litre)of order 2^N, about 10^(10^20) ratio
entropy of the observable universe3.1 (+3.0, -1.7) x 10^104 k
holographic bound quoted as the capabout 10^123 k
redundancy of Englishroughly 50% fraction
sunlight to biomasstypically 1% or less fraction
photosynthesis efficiency, observed against thermodynamic maximumunder 3% observed; about 12% thermodynamic maximum (17% from spectrum alone) fraction of sunlight
Earth system power from sunlightless than 1% fraction of incoming sunlight
vegetation's effect on continental rainfallabout +50% (model estimate) fraction
solar panel efficiencyabout 20% fraction
thermal energy scale at E. coli growth temperatureabout 4.3e-21 J (1/beta)
min-entropy per sampleestimated per noise source; defined by the likeliest output bits per sample

Open contentions (11) open contention

Where sources or readings disagree. Both stay on the map.

Partners and parts published science

Built from / builds (4)

Sits inside / holds (6)

Trades with (valence) (40)

expressed by (3)

floor filled by (34)

represents (1)

Kinds (12)

wired (2)

Notes published science

Layers

The ways it takes in its world, where they meet, and how it acts back, each from L1 (where it meets the world) up.

entropy (own: accessible microstates of thermal energy)

  1. L1: Microstates of a thermal body: heat spreading from warmer to cooler
  2. L2: The count of one bit: k_B ln 2
  3. L3: The heat relation S = Q/T (Clausius)
  4. L4: The second law's quantity: additive, extensive, never decreasing when isolated
  5. L5: Equilibrium: isolated systems relax to the state of highest entropy
  6. L6: Absolute zero: the third law's constant (residual entropy where many ground arrangements remain)

entropy as physicists and information theorists describe it (reader's view: the world it counts, the count, heat and temperature, one number for the whole, the second law, direction and price, budgets and uses)

  1. L1: The world it counts: many particles, photons, horizons, symbols; a wall lifted, heat in, a source choosing messages
  2. L2: The count: Boltzmann's log of phase-space volume; Shannon's H; von Neumann and Renyi; min-entropy relative to what is known
  3. L3: Heat and temperature: Clausius's dq/T, agreeing with the count in equilibrium
  4. L4: One number for the whole: additive and extensive, ordering adiabatic accessibility
  5. L5: The second law: never decreasing when isolated; production never negative; statistical at small scale (C-117)
  6. L6: Direction and price: the arrow from a low-entropy start, unavailable energy T_R S, k_B T ln 2 per erased bit
  7. L7: Budgets and uses: the universe's total, the Earth's sunlight-to-heat budget that life runs on, min-entropy securing keys

entropy under gravity: clumping, black holes and the cosmos (gravitational field)

  1. L1: Gravity raises entropy by clumping
  2. L2: Black holes: entropy A/4 and the generalized second law
  3. L3: Negative heat capacity: a hole cannot settle with an infinite bath
  4. L4: The cosmic budget: supermassive black holes hold most of the observable universe's entropy

the boardroom (shared floors)

  1. L4: One number for the state: entropy is additive over parts and extensive, and it orders which states can be reached adiabatically from which (Lieb-Yngvason)
  2. L5: The second law: in an isolated system the sum never decreases; for open systems the production term is never negative; at single-trajectory scale it holds for the mean (C-117); with horizons, the generalized law (C-074)
  3. L6: Direction and price: the arrow from a very low-entropy start (C-1205); energy T_R S unavailable for work; k_B T ln 2 per erased bit (C-722)
  4. L7: Budgets and uses: the observable universe's total (black holes hold most), the Earth's sunlight-to-heat budget that life runs on, and the min-entropy that secures keys

way in: A constraint lifted inside: a wall removed, gases mixing

  1. L1: An isolated fluid held to part of its box by a wall
  2. L2: The phase-space volume open to the system grows enormously (about 10^(10^20) for a mole in a litre)
  3. L3: Time-symmetric laws carry almost every microstate into the larger region

way in: Entanglement: quantum correlations between a region and the rest

  1. L1: A subregion of a many-body ground state, correlated with the rest
  2. L2: Von Neumann and Renyi entropies of the reduced state
  3. L3: Area law: the entropy grows with the boundary, not the volume

way in: Gravity: clumping and collapse into black holes

  1. L1: Strongly gravitating matter: it gets lumpier as entropy rises
  2. L2: Horizons: area A/4 in the role of entropy
  3. L3: The generalized second law: outside entropy plus a multiple of area never falls

way in: Heat: thermal energy flowing in from a warmer body

  1. L1: A warmer body or room in contact: a warm room around a glass of ice water
  2. L2: The receiving body's microstates: the count Boltzmann gives each state
  3. L3: Clausius's quotient: heat over the temperature it enters at

way in: Matter in and out of an open system: low-entropy food in, high-entropy waste and heat out

  1. L1: A living cell taking in low-entropy food and giving out high-entropy waste
  2. L2: Entropy transfer across the boundary plus entropy produced inside
  3. L3: Self-replication must be fuelled by entropy production; E. coli under three times the minimum heat

way in: Measurement: information about a small system's state (Maxwell's demon, Szilard's engine)

  1. L1: A single electron in a box or a bead in a double well, in a bath
  2. L2: One bit: two equally likely states hold k_B ln 2
  3. L3: The measured bit turned into k_B T ln 2 of work from the bath, paid back when the memory is erased

way in: Messages: a source choosing symbols (Shannon's entropy)

  1. L1: A source selecting messages from a set of possible messages
  2. L2: H = -sum p log p over the source's probabilities
  3. L3: Redundancy: the share fixed by the structure; English about 50%

way in: Physical noise sampled: a noise source feeding a random bit generator

  1. L1: A noise source: the non-deterministic process behind the bits
  2. L2: Min-entropy per sample, defined relative to what is known before observation
  3. L3: Conditioning (often an approved hash function) reduces bias or raises the entropy rate; health tests watch for failure

way in: Radiation: photons absorbed and re-emitted, low-entropy sunlight to high-entropy heat radiation

  1. L1: Sunlight from the hot Sun reaching the cold Earth
  2. L2: White thermal noise: for a given power the most entropic signal
  3. L3: Conversion: free energy made from sunlight before re-emission as heat radiation

way out: Entropic force: the statistical push toward more microstates

  1. L1: The hydrophobic force: water's 3D network loses entropy around a solute, which pushes solutes together
  2. L3: The hydrophobic force is one
  3. L6: Toward more microstates

way out: Heat given off: the toll paid to the surroundings

  1. L1: The bath warmed: the Earth re-emits as high-entropy terrestrial radiation
  2. L3: A replicator releases heat into its bath, bounded below by growth rate, internal entropy and durability
  3. L6: The price: erasing a bit releases at least k_B T ln 2

way out: Processes run one way: the irreversible processes of the world

  1. L1: The world: clustering, supernovae, weather, chemistry, life all run one way
  2. L3: Energy spread in ever more probable ways
  3. L5: The second law sets the sign
  4. L6: Some processes are irreversible

way out: Radiation out: a black hole's Hawking radiation

  1. L5: The area may fall, but the generalized sum does not

way out: Radiation out: high-entropy heat radiation to space

  1. L1: Re-emitted as high-entropy terrestrial radiation
  2. L7: The Earth's sunlight budget

way out: Unpredictability out: min-entropy delivered as secret keys and random bits

  1. L1: Keys whose first-guess success is set by min-entropy
  2. L3: Conditioned bits, checked by health tests
  3. L7: The noise source is the root of security; nothing downstream can make up for missing entropy

Who fills each layer

Sources (46) published science

Entropy (Wikipedia, rev 1376020512, via Wikimedia Enterprise snapshot copy)
Boltzmann constant (encyclopedia, Wikimedia Enterprise cache) (behind its links)
Shannon C.E. (1948) A mathematical theory of communication. Bell System Technical Journal 27:379-423, 623-656 (reprint with corrections) (behind its links)
Entropy as an arrow of time (Wikipedia, via Wikimedia Enterprise, wiki-reader copy) (behind its links)
Lebowitz J.L. (1994/1996) Microscopic reversibility and macroscopic behavior: physical explanations and mathematical derivations. arXiv:cond-mat/9605183 (behind its links)
Lieb E.H., Yngvason J. (1998) A guide to entropy and the second law of thermodynamics. Notices AMS 45:571. arXiv:math-ph/9805005 (behind its links)
Entropic force (Wikipedia, via Wikimedia Enterprise) (behind its links)
Bérut, Petrosyan & Ciliberto, Information and thermodynamics: Experimental verification of Landauer's erasure principle, arXiv:1503.06537 (J. Stat. Mech. 2015) (behind its links)
Toyabe, Sagawa, Ueda, Muneyuki and Sano, Information heat engine: converting information to energy by feedback control (arXiv 1009.5287, 2010) (behind its links)
Koski J.V., Maisi V.F., Pekola J.P., Averin D.V. (2014) Experimental realization of a Szilard engine with a single electron. PNAS 111:13786. arXiv:1402.5907 (behind its links)
England, Statistical physics of self-replication (arXiv 1209.1179, 2012) (behind its links)
Kleidon A. (2024) The second law of thermodynamics, life and Earth's planetary machinery revisited. arXiv:2410.10213 (preprint) (behind its links)
Egan & Lineweaver, A larger estimate of the entropy of the universe (ApJ 710, 1825; arXiv:0909.3983) (behind its links)
Wald, R. M. (2001) The thermodynamics of black holes, Living Rev. Relativ. 4:6, arXiv:gr-qc/9912119 (sections 2-6 read) (behind its links)
Masanes L., Oppenheim J. (2017) A general derivation and quantification of the third law of thermodynamics. Nat Commun 8:14538. arXiv:1412.3828 (behind its links)
Kleidon 2020, Understanding the Earth as a whole system: from the Gaia hypothesis to thermodynamic optimality and human societies (arXiv:2005.09216) (behind its links)
Turan et al. 2018, NIST SP 800-90B, Recommendation for the entropy sources used for random bit generation (doi:10.6028/NIST.SP.800-90B) (behind its links)
Bennett CH (2003) Notes on Landauer's principle, reversible computation, and Maxwell's Demon. Stud Hist Philos Mod Phys 34:501-510. arXiv:physics/0210005 (behind its links)
Prigogine 1977, Time, structure and fluctuations (Nobel lecture in chemistry) (behind its links)
Newman G.E., Keil F.C., Kuhlmeier V.A., Wynn K. (2010) Early understandings of the link between agents and order. PNAS 107:17140. doi:10.1073/pnas.0914056107 (PMC2951444; abstract via NCBI) (behind its links)
Eisert J., Cramer M., Plenio M.B. (2010) Colloquium: Area laws for the entanglement entropy. Rev Mod Phys 82:277. arXiv:0808.3773 (behind its links)
Micelle (Wikipedia, rev 1369618086, 2026-08-16) (behind its links)
Radvanyi P., Villain J., The discovery of radioactivity, Comptes Rendus Physique 18 (2017) 544-550, doi:10.1016/j.crhy.2017.10.008 (behind its links)
Aimet et al. 2025, Experimentally probing Landauer's principle in the quantum many-body regime, Nature Physics 21, 1326 (behind its links)
Hartle JB. The Physics of 'Now'. arXiv:gr-qc/0403001 (2004; the arXiv copy was read; models of information gathering and utilizing systems, IGUSes) (behind its links)
Statistical mechanics (encyclopedia, Wikimedia Enterprise snapshot 2026-11-01, version 1382848818) (behind its links)
Grimus W. On the 100th anniversary of the Sackur-Tetrode equation. arXiv:1112.3748 (v2 2013) (behind its links)
Crystallization (Wikipedia, rev 1365295279, via Wikimedia Enterprise Snapshot) (behind its links)
Jacobson, T. (1995) Thermodynamics of spacetime: the Einstein equation of state, PRL 75:1260, arXiv:gr-qc/9504004 (behind its links)
Kolchinsky, A. & Wolpert, D. H. (2020) Thermodynamic costs of Turing machines. Physical Review Research (arXiv:1912.04685) (behind its links)
Energy (encyclopedia, Wikimedia Enterprise snapshot 2026-11-01, version 1378442640) (behind its links)
Chemical equilibrium (encyclopedia, WME snapshot; cache enwiki-Chemical_equilibrium.md) (behind its links)
Data processing inequality (encyclopedia; WME) (behind its links)
Shannon, Communication Theory of Secrecy Systems, Bell System Technical Journal 28(4), 1949 (doi:10.1002/j.1538-7305.1949.tb00928.x) (behind its links)
Tokamak (Wikipedia) (behind its links)
Sedlmeir J, Buhl HU, Fridgen G, Keller R (2020) The Energy Consumption of Blockchain Technology: Beyond Myth. Bus Inf Syst Eng 62(6):599-608. doi:10.1007/s12599-020-00656-x (open access) (behind its links)
Berut A., Petrosyan A., Ciliberto S. (2015) Information and thermodynamics: experimental verification of Landauer's erasure principle. arXiv:1503.06537 (J. Stat. Mech. 2015 P06015) (behind its links)
Laws of thermodynamics (encyclopedia, Wikimedia Enterprise) (behind its links)
Lyapunov exponent (Wikipedia, via Wikimedia Enterprise snapshot 2026-11-01) (behind its links)
Holmberg K, Erdemir A (2017) Influence of tribology on global energy consumption, costs and emissions. Friction 5:263-284. doi:10.1007/s40544-017-0183-5 (open access; abstract read from the publisher page) (behind its links)
Entropy of mixing (encyclopedia; Wikimedia Enterprise, cache enwiki-Entropy_of_mixing.md) (behind its links)
Yadav A, Caravelli F, Wolpert D (2024) Entropy production bounds for systems running computer programs. arXiv:2411.16088 (behind its links)
Third law of thermodynamics (Wikipedia, via Wikimedia Enterprise) (behind its links)
Entropy (information theory) (Wikipedia, via Wikimedia Enterprise snapshot copy 2026-11-01) (behind its links)
Seifert, Stochastic thermodynamics, fluctuation theorems, and molecular machines (arXiv 1205.4176, 2012) (behind its links)
Residual entropy (Wikipedia, via Wikimedia Enterprise) (behind its links)