Measurement Error, Systematic Bias & Uncertainty Budgets
A measurement result is an estimate of a defined measurand accompanied by uncertainty, not a hidden true value plus a known error. A defensible uncertainty budget models every important input, propagates covariance through the measurement equation, applies justified corrections, and preserves metrological traceability.
A numerical reading is not yet a measurement result. One must define the measurand—the quantity intended to be measured—specify the conditions and model connecting observations to it, apply justified corrections, and state the uncertainty that remains. “The voltage is 10 V” is incomplete if bandwidth, location, waveform convention, loading, calibration, and relevant environment are unspecified.
Error and uncertainty are different concepts #
Measurement error is the difference between a measured value and a reference quantity value. The exact error is ordinarily unknown because the true quantity value is unknown. Uncertainty describes the dispersion of values that could reasonably be attributed to the measurand, given the model and available information.
This distinction prevents two common mistakes:
- A correction for known bias changes the estimate; its imperfect value contributes uncertainty.
- Repeated readings can estimate scatter but do not reveal a constant calibration bias shared by every reading.
“Random” and “systematic” describe how effects behave across repetitions or conditions. Type A and Type B describe how uncertainty is evaluated. Type A uses statistical analysis of observations; Type B uses other information such as calibration certificates, specifications, resolution, prior data, or physical bounds. A systematic effect can have a Type A evaluation, and a randomly varying effect can be evaluated from prior Type B information.
Build a measurement model #
Represent the output quantity as
where the include direct readings, calibration corrections, environmental influences, geometry, constants, and any other inputs that materially affect the measurand. Each input estimate has a standard uncertainty and may be correlated with other inputs.
For a sufficiently linear model near the estimates, the combined standard uncertainty is
The sensitivity coefficient converts uncertainty in input units into output units. The covariance terms are load-bearing: a shared reference can make errors move together, so treating inputs as independent may either understate or overstate uncertainty.
flowchart TD D["Define measurand and conditions"] --> M["Write measurement model"] M --> I["Estimate inputs and correlations"] I --> P["Propagate distributions or covariance"] P --> R["Report estimate, uncertainty, coverage and traceability"]
For strong nonlinearity, bounded inputs near a limit, asymmetric distributions, or discontinuous decision rules, first-order propagation can be misleading. Propagating input distributions numerically is then more faithful, but it does not repair an incomplete model.
Worked uncertainty budget #
Power is computed from independent voltage and current measurements:
with , , , and . The estimate is . Sensitivities are and , so
An expanded uncertainty with is about , so one could report with the stated coverage convention and assumptions. The current term contributes four times as much variance as the voltage term: improving voltage accuracy alone has little leverage.
If voltage and current came from a shared gain reference, add their covariance. If the quoted ± limits are rectangular bounds rather than standard deviations, convert them according to the justified input distribution before propagation. Never silently treat every specification limit as one standard deviation.
What belongs in an uncertainty budget #
| Input effect | Estimate/evaluation | Typical diagnostic |
|---|---|---|
| Repeatability | Replicated observations under defined conditions | Time plot and within-run standard deviation |
| Calibration correction | Certificate value and its uncertainty | Traceability chain and certificate scope |
| Resolution/quantization | Instrument step and rounding model | Compare step size with observed scatter |
| Drift | Check standards over time | Control chart or before/after calibration |
| Loading and method | Physical model or comparison method | Change impedance, geometry, bandwidth, or method |
| Environment | Measured sensitivity to temperature, humidity, vibration | Deliberate perturbation or characterized coefficient |
| Sampling | Spatial/temporal variability of the measurand | Repeat across the intended population, not one point |
Traceability is not a brand name or an unbroken stack of stickers. It is a documented chain of calibrations, each contributing uncertainty, connecting a result to a stated reference.
Bias, correction, and validation #
If an instrument reads units on a reference with an estimated correction uncertainty of , apply a correction when the model and conditions justify it, then include and other reference uncertainties in the budget. Leaving the known effect uncorrected and merely widening an interval loses information and can leave the estimate systematically wrong.
Validation asks whether the model contains all relevant effects. Vary conditions, compare independent methods, measure reference materials, reverse polarity or geometry where meaningful, and inspect residuals against time and environment. Agreement between repeated readings tests repeatability, not accuracy.
Reporting without false precision #
A complete result states the estimate, unit, measurand definition, combined or expanded uncertainty, coverage factor or probability interpretation, important assumptions, and traceability. Round uncertainty to a sensible number of significant digits, then round the estimate to the same decimal place.
Uncertainty is not a mistake bar and not a guarantee that the true value lies inside a symmetric interval. It is the quantified consequence of a measurement model. The most dangerous budget is a precise calculation around the wrong measurand or a missing systematic effect.
Sources
- bookData Recognition and Classification: Lecture Notespdfnotes
- docsGuidelines for Evaluating and Expressing the Uncertainty of NIST Measurement Resultspdf
- docsBIPM: Guides in Metrology
- docsJCGM Working Group 1: Guide to the Expression of Uncertainty in Measurement