Measurement Error, Systematic Bias & Uncertainty Budgets

A measurement result is an estimate of a defined measurand accompanied by uncertainty, not a hidden true value plus a known error. A defensible uncertainty budget models every important input, propagates covariance through the measurement equation, applies justified corrections, and preserves metrological traceability.

builds onError Propagation & Condition NumbersExpectation, Variance & Moments

A numerical reading is not yet a measurement result. One must define the measurand—the quantity intended to be measured—specify the conditions and model connecting observations to it, apply justified corrections, and state the uncertainty that remains. “The voltage is 10 V” is incomplete if bandwidth, location, waveform convention, loading, calibration, and relevant environment are unspecified.

Error and uncertainty are different concepts #

Measurement error is the difference between a measured value and a reference quantity value. The exact error is ordinarily unknown because the true quantity value is unknown. Uncertainty describes the dispersion of values that could reasonably be attributed to the measurand, given the model and available information.

This distinction prevents two common mistakes:

  • A correction for known bias changes the estimate; its imperfect value contributes uncertainty.
  • Repeated readings can estimate scatter but do not reveal a constant calibration bias shared by every reading.

“Random” and “systematic” describe how effects behave across repetitions or conditions. Type A and Type B describe how uncertainty is evaluated. Type A uses statistical analysis of observations; Type B uses other information such as calibration certificates, specifications, resolution, prior data, or physical bounds. A systematic effect can have a Type A evaluation, and a randomly varying effect can be evaluated from prior Type B information.

Build a measurement model #

Represent the output quantity as

Y=f(X1,…,Xm),Y=f(X_1,\ldots,X_m),

where the XiX_i include direct readings, calibration corrections, environmental influences, geometry, constants, and any other inputs that materially affect the measurand. Each input estimate xix_i has a standard uncertainty u(xi)u(x_i) and may be correlated with other inputs.

For a sufficiently linear model near the estimates, the combined standard uncertainty is

uc2(y)=∑ici2u2(xi)+2∑i<jcicju(xi,xj),ci=∂f∂Xi∣x.u_c^2(y)=\sum_i c_i^2u^2(x_i)+2\sum_{i<j}c_ic_j u(x_i,x_j), \qquad c_i=\left.\frac{\partial f}{\partial X_i}\right|_{x}.

The sensitivity coefficient cic_i converts uncertainty in input units into output units. The covariance terms are load-bearing: a shared reference can make errors move together, so treating inputs as independent may either understate or overstate uncertainty.

For strong nonlinearity, bounded inputs near a limit, asymmetric distributions, or discontinuous decision rules, first-order propagation can be misleading. Propagating input distributions numerically is then more faithful, but it does not repair an incomplete model.

Worked uncertainty budget #

Power is computed from independent voltage and current measurements:

P=VI,P=VI,

with V=10.00 VV=10.00\ \mathrm{V}, u(V)=0.05 Vu(V)=0.05\ \mathrm{V}, I=2.00 AI=2.00\ \mathrm{A}, and u(I)=0.02 Au(I)=0.02\ \mathrm{A}. The estimate is P=20.00 WP=20.00\ \mathrm{W}. Sensitivities are ∂P/∂V=I\partial P/\partial V=I and ∂P/∂I=V\partial P/\partial I=V, so

uc(P)=(2.00⋅0.05)2+(10.00⋅0.02)2=0.224 W.u_c(P)=\sqrt{(2.00\cdot0.05)^2+(10.00\cdot0.02)^2}=0.224\ \mathrm{W}.

An expanded uncertainty U=kucU=ku_c with k=2k=2 is about 0.45 W0.45\ \mathrm{W}, so one could report P=(20.00±0.45) WP=(20.00\pm0.45)\ \mathrm{W} with the stated coverage convention and assumptions. The current term contributes four times as much variance as the voltage term: improving voltage accuracy alone has little leverage.

If voltage and current came from a shared gain reference, add their covariance. If the quoted ± limits are rectangular bounds rather than standard deviations, convert them according to the justified input distribution before propagation. Never silently treat every specification limit as one standard deviation.

What belongs in an uncertainty budget #

Input effect Estimate/evaluation Typical diagnostic
Repeatability Replicated observations under defined conditions Time plot and within-run standard deviation
Calibration correction Certificate value and its uncertainty Traceability chain and certificate scope
Resolution/quantization Instrument step and rounding model Compare step size with observed scatter
Drift Check standards over time Control chart or before/after calibration
Loading and method Physical model or comparison method Change impedance, geometry, bandwidth, or method
Environment Measured sensitivity to temperature, humidity, vibration Deliberate perturbation or characterized coefficient
Sampling Spatial/temporal variability of the measurand Repeat across the intended population, not one point

Traceability is not a brand name or an unbroken stack of stickers. It is a documented chain of calibrations, each contributing uncertainty, connecting a result to a stated reference.

Bias, correction, and validation #

If an instrument reads +0.30+0.30 units on a reference with an estimated correction uncertainty of 0.050.05, apply a −0.30-0.30 correction when the model and conditions justify it, then include 0.050.05 and other reference uncertainties in the budget. Leaving the known effect uncorrected and merely widening an interval loses information and can leave the estimate systematically wrong.

Validation asks whether the model contains all relevant effects. Vary conditions, compare independent methods, measure reference materials, reverse polarity or geometry where meaningful, and inspect residuals against time and environment. Agreement between repeated readings tests repeatability, not accuracy.

Reporting without false precision #

A complete result states the estimate, unit, measurand definition, combined or expanded uncertainty, coverage factor or probability interpretation, important assumptions, and traceability. Round uncertainty to a sensible number of significant digits, then round the estimate to the same decimal place.

Uncertainty is not a mistake bar and not a guarantee that the true value lies inside a symmetric interval. It is the quantified consequence of a measurement model. The most dangerous budget is a precise calculation around the wrong measurand or a missing systematic effect.

Sources

  1. bookData Recognition and Classification: Lecture Notespdfnotes
  2. docsGuidelines for Evaluating and Expressing the Uncertainty of NIST Measurement Resultspdf
  3. docsBIPM: Guides in Metrology
  4. docsJCGM Working Group 1: Guide to the Expression of Uncertainty in Measurement

Searches titles, aliases, headings, summaries, and full text.↑↓ move ↵ open esc close