Methods and formulas for the effective resolution of measurements in Evaluate Measurement Process (EMP Crossed)

Probable error
0.674490 * (Repeatability)0.5
Lower bound of increment
0.1 * (Probable error)
Smallest effective increment
0.22 * (Probable error)
Current measurement increment
When the analysis determines the increment and the measurements have decimals, the increment is 1 unit of the least, non-zero, place value in the measurements. For example, for the values 1.100, 1.400, and 1.900, the increment is 0.1. If the measurements do not have decimals, the analysis reports that the increment is 1. You can specify an increment for the analysis.
Largest effective increment
2.2 * (Probable error)