WORKSHOP LENGTH CHECKSSource-based notes · UK English
MeasureProofSHOP CHECKS, NOT CERTIFICATES

SOURCE-BASED NOTE · 6 MIN READ

Resolution is not capability

Display resolution, a stated accuracy figure and the scatter of a real check are three different numbers. Keep them in three columns.

THE SHORT ANSWER

A digital caliper that displays 0.01 mm is showing a resolution. A manual that prints ±0.02 mm is stating a specification. The range of repeats on a known block is an observed spread. None of those three, on its own, is a measurement capability, and this site has not published an observed spread.

Close still-life of a digital caliper head with a dark, blank display.
Explanatory still-life: a blank display is not a capability. Not a MeasureProof reading.

Three columns that must stay apart

ColumnTypical sourceWhat it is not
Display resolutionThe least count on the digital display, for example 0.01 mm.Not the accuracy of the instrument, and not a shop capability.
Stated accuracyThe manufacturer’s specification, for example ±0.02 mm on a 0–100 mm digital caliper in Sparber’s write-up of that manual.Not a measured result on your instrument today.
Observed range of repeatsLargest minus smallest reading on a named block, same day, same contact.Not a calibration uncertainty and not a UKAS calibration and measurement capability.

ISOBudgets writes the standard teaching term for a digital indication’s resolution contribution as Resolution / (2√3). That is a component in an uncertainty budget, for people who are writing one. It is not a certificate, and it does not become a capability because the arithmetic is tidy. The same note is explicit that a grade 0 block used as a reference does not remove the caliper’s resolution as a limiting term.

Shop rules of thumb stay labelled

CNC Cookbook’s “use twice the stated accuracy” line — 0.002 inch from a 0.001 inch statement — is a teaching shortcut from that site. It is not rewritten here as a verified UK workshop standard. Sparber’s ±0.02 mm / ±0.03 mm bands are the manual he was reading, drawn as an envelope around his own later tests. Those tests remain his.

NPL GPG 40 reminds the reader that force and temperature sit outside the display. A stable last digit can still be wrong for the object in the jaws.

The observed column is empty here

MeasureProof has not published an observed range of repeats for a micrometer or a caliper. The third column on any capability-style table from this publication stays empty until a dated record exists. Do not read a stated ±0.02 mm as “this site found 0.02 mm”.

A later original series will have to print the stated figure, the display resolution and the observed range as three numbers, with the instrument, the block and the temperature attached. Until then, use the blank record and keep the columns separate.

Sources and scope

Sources checked on 23 September 2026. Numbered references point to the original publishers. Their sample measurements are not MeasureProof measurements. Manufacturer and forum material is identified separately.

  1. ISOBudgets, How to calculate resolution uncertainty ↗Richard Hogan, 28 April 2016. Teaching derivation for a digital indication: Resolution / (2√3). ISOBudgets LLC also sells laboratory consulting.
  2. CNC Cookbook, Digital caliper complete guide ↗States a common 6-inch digital caliper as 0.001 inch accuracy and 0.0005 inch resolution. That is a teaching statement.
  3. Sparber, Repeatability and Accuracy of the Harbor Freight Caliper ↗Personal workshop PDF, version 3, 5 June 2007. The specification envelope and temperature cross-test belong to the author.
  4. NPL Good Practice Guide 40, Callipers and micrometers ↗National Physical Laboratory. UK authority for use conditions, measuring force and temperature. It is not a workshop certificate.

No instrument in this note has been tested or certified by this publication. Evidence policy · Corrections

Keep the conditions with the reading.

The CSV has column headings and one empty row. It contains no fabricated sample readings.

Download workshop-check record ↓

KEEP READING