EVOPEDIA

← all systems · see it in The System

Experiment, measurement and uncertainty (the physics lab as a practice: designing, measuring, estimating error)

An experiment is a procedure carried out to support or refute a hypothesis, or determine the efficacy or likelihood of something previously untried. In metrology's words, the result of a measurement is only an estimate of the value of the measurand and is complete only when accompanied by a statement of its uncertainty.

Properties published scienceour proposal

Sourced fields, and our own readings.

born at1021 (Book of Optics)
born precisioncontested by centuries either way
boundaryInside: the prepared phenomenon and its controls, the apparatus and its sensors (eyes included), readout and triggers, data reduction with its uncertainty, comparison with models and other data, the strategies and checks that decide belief, and the claim. Outside: the systems measured (electrons, the Higgs boson), the units and standards it borrows (sys:measurement), the statistics and probability it uses, and the science that holds its results.
nested levelA human practice (rung 11) built on hypothesis testing seen in infants, carried by labs and collaborations, feeding the scientific record; its apparatus reaches down to particles (rung 3) and fields.
scalesocial

Measures (23) published science

Physics measurement uncertainty halving time (characteristic clock of the practice)about 15 years per factor-of-2 improvement (nuclear and particle physics; constants twice as fast)
ATLAS minimum time between first-level accepts (simple dead-time)100 ns (4 bunch crossings)
ATLAS collision rate inup to 40 MHz
ATLAS first-level trigger maximum output100 kHz (75 kHz in Run 1), set by detector readout capability
ATLAS recording rate outabout 1 kHz
Trigger chain kept fraction (recorded / collisions)about 1/40000 ratio (1 kHz / 40 MHz), a selection, not a toll
Discovery threshold (5 sigma, one tail)3e-7 p-value, or smaller
Earlier new-particle criteria3 sigma (0.27% per bin), later 4 sigma (0.0064%) probability per bin
5 sigma claim with systematics underestimated by 22.5 sigma; p-value up by a factor of 2e4 significance
Fraction of measurement pairs disagreeing by more than 5 sigmaas high as 0.12 (against 6e-7 for a Normal distribution) fraction
Student-t degrees of freedom of measurement disagreementsabout 2-3 (best consistency about 10) nu
Measurements analysed in Bailey 201741000 measurements of 3200 quantities count
Median improvement over best previous uncertainty (Nuclear; Constants; Particle; Stable; Medical)2.0; 1.8; 1.7; 1.3; 0.62 u_best/u_new
Higgs observation significance (ATLAS 2012)5.9 sigma; background fluctuation probability 1.7e-9 significance
Higgs mass measured (ATLAS 2012)126.0 +/- 0.4(stat) +/- 0.4(sys) GeV
OPERA neutrino baselineabout 730 km
OPERA corrected (v-c)/c(2.7 +/- 3.1 (stat) +3.4/-3.3 (sys)) x 1e-6 relative
Millikan drops published versus recorded58 published; about 175 in the notebooks (Nov 1911 - Apr 1912); of about 100 in the 63 days used, about 25 aborted drops
Millikan-Fletcher elementary charge1.5924(17)e-19 C, about 0.6% from 1.602176634e-19 C
Personal equation between Bessel and his assistantmore than 1 s
Coverage factor ktypically 2 to 3 dimensionless
Odds of students spontaneously improving their methods after comparison-cycle training12 times (and 4 times more likely to identify a model's limitation) relative to control
Infants in Stahl & Feigenson 2015110 (11-month-olds) infants

Open contentions (9) open contention

Where sources or readings disagree. Both stay on the map.

Partners and parts published science

Built from / builds (9)

Sits inside / holds (2)

Trades with (valence) (10)

expressed by (22)

floor filled by (21)

Kinds (8)

Notes published science

Layers

The ways it takes in its world, where they meet, and how it acts back, each from L1 (where it meets the world) up.

experiment: a prepared intervention read through instruments and weighed against its uncertainty (reader's view)

  1. L1: The phenomenon under prepared conditions: the measurand, one factor manipulated, others held by controls, influence quantities that are never held perfectly constant
  2. L2: The apparatus and its sensors: instrument, detector, observer's eye; calibrated by reproducing known phenomena; finite resolution
  3. L3: Readout and data taking: indications, repeated observations, trigger selection; every indication carries random and systematic error
  4. L4: Data reduction and uncertainty: corrections, the measurement model, Type A and Type B evaluation; the result is complete only with its uncertainty
  5. L5: Comparison: data with data and data with models; significance against a background-only hypothesis
  6. L6: Scrutiny: strategies for reasonable belief, consistency checks, blind analysis, the decision that the result will stand up
  7. L7: The claim: supporting or refuting a hypothesis, a discovery at 5 sigma, a new experiment designed

the boardroom (shared floors)

  1. L4: Data reduction and uncertainty: corrections for systematic effects, Type A and Type B evaluation, the measurement model, combined standard uncertainty
  2. L5: Comparison: data against data and data against models; significance against a background-only hypothesis
  3. L6: Scrutiny and belief: calibration, elimination of alternative explanations, independent confirmation, blind analysis, consistency checks; when to stop
  4. L7: The claim and what it changes: a measured value with uncertainty, a discovery at 5 sigma, a refuted model, the next experiment

way in: Critique: colleagues, collaboration members and critics disputing or weighing the result

  1. L1: Objections from critics
  2. L5: Different members of a large group find different evidence convincing

way in: Detector: particles from collisions or decays registered by detector layers and selected by triggers

  1. L1: Collision products at up to 40 MHz of bunch crossings
  2. L2: Detector layers around the interaction point (inner tracker, calorimeters, muon spectrometer)
  3. L3: Hardware first-level trigger, then events buffered and passed to the software high-level trigger

way in: Electrical: voltmeters and electronics reading potentials and currents, over a thermal noise floor

  1. L1: The potential difference across the device measured
  2. L2: The instrument loads the circuit (finite impedance) and adds thermal noise of its own
  3. L3: The indication, limited by resolution

way in: Environment: influence quantities (temperature, pressure, stray currents) that act on the apparatus

  1. L1: Influence quantities not held completely constant
  2. L2: Their effect on the apparatus: thermal expansion of a metal ruler; railway leakage currents in LEP's vacuum pipe
  3. L3: Monitoring that reveals them (or does not: the unknown unknown)

way in: Literature: earlier published values and others' results

  1. L1: Published values of the same quantity (Review of Particle Physics, Table of Radionuclides)
  2. L4: Compatibility check against them

way in: Reference: standards, reference materials and known phenomena the apparatus is checked against

  1. L1: Measurement standards and reference materials, with inexact values
  2. L2: Calibration: the apparatus made to reproduce known phenomena (the Balmer series in a new spectrometer)
  3. L3: Type B input: uncertainty from an assumed distribution

way in: Sight: the experimenter reading scales, dials, screens and the drops in the eyepiece

  1. L1: Light from the object watched and the instrument's scale (an oil drop held in the field of view)
  2. L3: The reading, carrying personal bias in reading analogue instruments

way in: Surprise: the felt jolt of an unexpected result

  1. L1: An event that violates expectation (an object passing through a wall; data that disagree with both models)
  2. L4: Surprise: more looking, a changed face, and learning directed at the surprising object

way in: Thought: the hypothesis or model the experiment is built to test

  1. L1: The hypothesis (where it comes from is contested: C-413)
  2. L4: The mathematical model of the measurement and the prediction it gives

way in: Timing: the observer marking when something happens (transits, falls), by eye and ear and pulse

  1. L1: An event in time: a star crossing the wires of a reticule; a ball passing marks on Galileo's inclined plane
  2. L2: A timer the body sets: Galileo's pendulum synchronised to the human pulse
  3. L3: The recorded time, offset by the observer's own reaction (the personal equation)

way out: Calibrating: the apparatus corrected against standards

  1. L2: Instrument adjusted or calibrated against standards
  2. L6: The check fails or drifts

way out: Intervening: changing the apparatus and the conditions (the next run, the improved method)

  1. L1: One factor manipulated in the world, the rest held by controls
  2. L2: The apparatus adjusted (the oil-drop voltage tuned until the drop hangs still)
  3. L7: Deciding what to change

way out: Reporting: the result written with its uncertainty, and claimed (or not) as a discovery

  1. L1: The paper and the lab notebook
  2. L4: The value with its stated uncertainty
  3. L7: Whether to call it a discovery

Sources (28) published science

Experiment (Wikipedia, via Wikimedia Enterprise snapshot 2026-11-01)
Holmes N.G., Wieman C.E., Bonn D.A. (2015) Teaching critical thinking. PNAS 112:11199 (doi:10.1073/pnas.1505329112) (behind its links)
JCGM 100:2008, Evaluation of measurement data: Guide to the expression of uncertainty in measurement (GUM 1995 with minor corrections), BIPM (free PDF; all rights reserved, short quotes only) (behind its links)
Oil drop experiment (Wikipedia, via Wikimedia Enterprise snapshot 2026-11-01) (behind its links)
Roodman A. (2003) Blind Analysis in Particle Physics, PHYSTAT2003 (arXiv:physics/0312102) (behind its links)
ATLAS Collaboration (2017) Performance of the ATLAS Trigger System in 2015. Eur. Phys. J. C 77:317 (arXiv:1611.09661) (behind its links)
Stahl A.E., Feigenson L. (2015) Observing the unexpected enhances infants' learning and exploration. Science 348:91 (doi:10.1126/science.aaa3799; PMC5861377 author manuscript) (behind its links)
Lyons L. (2013) Discovering the significance of 5 sigma (arXiv:1310.1284) (behind its links)
Bailey D.C. (2017) Not Normal: the uncertainties of scientific measurements. R. Soc. Open Sci. 4:160600 (arXiv:1612.00778) (behind its links)
Committee for the Prize in Economic Sciences 2021, Scientific Background: Answering causal questions using observational data (behind its links)
Blinded experiment (Wikipedia, via Wikimedia Enterprise snapshot 2026-11-01) (behind its links)
Holmes N.G., Olsen J., Thomas J.L., Wieman C.E. (2017) Value added or misattributed? A multi-institution study on the educational benefit of labs for reinforcing physics content. Phys. Rev. Phys. Educ. Res. 13:010129 (arXiv:1705.03580) (behind its links)
Committee for the Prize in Economic Sciences 2019, Scientific Background: Understanding development and poverty alleviation (behind its links)
Experimental economics (Wikipedia, via Wikimedia Enterprise snapshot 2026-11-01) (behind its links)
Franklin A. & Perovic S., Experiment in Physics, Stanford Encyclopedia of Philosophy (peer-reviewed reference work) (behind its links)
ATLAS Collaboration (2012) Observation of a new particle in the search for the Standard Model Higgs boson with the ATLAS detector at the LHC. Phys. Lett. B 716:1 (arXiv:1207.7214) (behind its links)
OPERA Collaboration, Measurement of the neutrino velocity with the OPERA detector in the CNGS beam (arXiv:1109.4897, v4 corrected) (behind its links)
Goodstein D. (2000) In defense of Robert Andrews Millikan. Engineering and Science 63(4):30-38, Caltech (behind its links)
Personal equation (Wikipedia, via Wikimedia Enterprise snapshot 2026-11-01) (behind its links)
Observational error (Wikipedia, via Wikimedia Enterprise snapshot 2026-11-01) (behind its links)
Johnson-Nyquist noise (Wikipedia, via Wikimedia Enterprise snapshot 2026-11-01) (behind its links)
ATLAS Collaboration. A detailed map of Higgs boson interactions by the ATLAS experiment ten years after the discovery. Nature 607, 52-59 (2022). doi:10.1038/s41586-022-04893-w (arXiv:2207.00092, CC-BY-4.0) (behind its links)
Tokamak (Wikipedia) (behind its links)
Hollingsworth, S. A. & Dror, R. O. (2018) Molecular dynamics simulation for all. Neuron 99, 1129, doi:10.1016/j.neuron.2018.08.011 (PMC6209097) (behind its links)
History of experiments (Wikipedia, via Wikimedia Enterprise) (behind its links)
OPERA experiment (Wikipedia, via Wikimedia Enterprise), abstract and tau-neutrino section (behind its links)
Phillips A.M., Sundstrom M., Wu D.G., Holmes N.G. (2021) Not engaging with problems in the lab: Students' navigation of conflicting data and models (arXiv:2103.02032) (behind its links)
Golub R. (2023) Blind analysis in Physics experiments: Is this trip necessary? (arXiv:2311.13542) (behind its links)