Steps To Evaluating Measurement Uncertainty
Steps To Evaluating Measurement Uncertainty
1. What am I measuring?
2. How will I measure it?
3. Select the measurement method or procedure to be used.
4. Select the equipment that will be used (e.g. min and max) of my measurement
capability?
5. Select the desired range of the measurement function.
6. Determine the test-points to be evaluated.
1
Best Places to Find Sources of Uncertainty
When you need to find sources of uncertainty, it helps to have a list of available resources.
Below is a list of places, including links, that you can use to help you find sources of
uncertainty.
1. Manufacturer Manuals
2. Manufacturer Datasheets
3. Technical Notes & Guides
4. Conference Papers
5. Textbooks
Using the items in the list above, you should be able determine how much uncertainty is
contributed from each source.
2
Evaluate Information and Select the Right Data
Now you need to evaluate the information that you have and find data that you will use for
estimating uncertainty. You need to find data related to your uncertainty analysis and
eliminate the rest.
a. measurement function,
b. measurement range, and
c. test-point.
Analyse the Data
Then, analyse the data that you have using appropriate methods of analysis to find the
magnitude of each uncertainty component. Choose methods that are appropriate for the
data you are analysing.
Use your results to quantify each uncertainty component and add the values to your
uncertainty budget.
You can add the uncertainty and unit of measurement directly into your uncertainty budget.
Or, you can add uncertainties, their unit of measurement, and a sensitivity coefficient to your
uncertainty budgets. The option is yours.
Adding detailed notes to your uncertainty budgets will help you remember how you did it and
why.
Sources of Uncertainty
Here is my list of the minimum recommended sources of uncertainty to include in every
uncertainty budget.
1. Repeatability
2. Reproducibility
3. Stability
4. Bias
5. Drift
6. Resolution
7. Reference Standard Uncertainty
8. Reference Standard Stability
9. Other Significant Contributors
3
Repeatability
Error is the average of readings minus the certified valuein your measurement process.
4
1. Review your certified value.
2. Calculate the average
3. Calculate the difference.
Drift
Drift is an evaluation of the systematic change in your measurement process or system over
time.
5
How to Calculate Reference Standard Stability
Type A Uncertainty
Type B Uncertainty
uncertainty estimates using statistics (from repeated readings) is Type A & uncertainty
estimates from any other information, i.e., from past experience of the measurements, from
6
calibration certificates, manufacturer’s specifications, from calculations or from scientific
evaluation is Type B.
Probability Distributions
This is an important step because the probability distribution that you select will determine
how your source of uncertainty is converted to a standard deviation in the next step.
Although there are many different types of probability distributions that you can choose from,
the Normal (i.e. Gaussian) and Rectangular (i.e. Uniform) distributions are the most commonly
used.
Some of the most common probability distributions used to estimate uncertainty are;
Use the chart below to help you select the appropriate probability distribution.
To assign the appropriate distribution, consider how to characterize the data set for each
source of uncertainty.
7
If you evaluated Type A uncertainty data, calibration results, or used an accuracy specification,
you most likely want to assign a Normal distribution.
If you evaluated resolution, environmental or physical influences, you may want to use a
rectangular distribution.
If you are not sure what distribution you should use, then it is typically less risk to assign a
rectangular distribution.
Refer to the chart below to find the divisor associated with the probability distribution.
8
Next, divide your uncertainty components by the appropriate divisor to convert them to a
standard uncertainty. Afterward, all of your contributors should be on the same confidence
level (i.e. 1-sigma or 68.27%) and equivalent to a standard deviation.
Normal Distribution
If you select a Normal distribution, then you will divide your uncertainty by it’s associated
coverage factor, k.
Take a closer look at the sources of uncertainty that you are evaluating to determine what
coverage factor you should use. Typically, your contributors will have a confidence level of
68%, 95.45%, or 99%. Respectively, this means that you will use a divisor of 1, 2, or 2.576.
Rectangular Distribution
If you select a Rectangular distribution, then you will divide your uncertainty component by
the square root of 3 or 1.7321
U-Shaped Distribution
If you select a U-shaped distribution, then you will divide your uncertainty component by the
square root of 2 or 1.4142
Triangular Distribution
If you select a Triangular distribution, then you will divide your uncertainty component by the
square root of 6 or 2.4495
Quadratic Distribution
If you select a Quadratic distribution, then you will divide your uncertainty component by the
square root of 5 or 2.2361
Log-Normal Distribution
If you select a Log-Normal distribution, then you will divide your uncertainty component by
2.3750
9
Rayleigh Distribution
If you select a Rayleigh distribution, then you will divide your uncertainty component by
2.4477
This is critical before calculating the combined uncertainty. Otherwise, your estimated
uncertainty will not be correct.
You cannot combine uncertainties with different units of measurement (without the
use of sensitivity coefficients).
If you have contributors with different units of measurement, you will need to use sensitivity
coefficients to convert them to units of measurement that match the measurement result or
a term relative to the measurement result (e.g. percent). This is a mistake many people make
when estimating uncertainty of measurement. So, make sure to check for this before you
calculate the combined standard uncertainty.
10
When you combine uncertainty sources, you are also combining their probability
distributions.
According to the Central Limit Theorem, the sum of the set of independent random variables
(i.e. uncertainty sources) will approach a normal distribution regardless of the individual
variable’s distribution.
Therefore, the probability distribution associated with your combined uncertainty will now be
normal.
Below, you will see the equation for calculating the combined uncertainty.
Where,
u1 = uncertainty of 1st component
u2 = uncertainty of 2nd component
Look at the image below to see the normal probability distribution when you expand your
uncertainty to 2-sigma or 95.45% confidence.
11
The result will be the expanded uncertainty and if you use a coverage factor of 2 or 1.96, you
will expand uncertainty to a 95% confidence level.
Check out the simplified equation below for calculating the expanded uncertainty.
Where,
EU – Expanded Uncertainty
k – Coverage Factor
CU – Combined Uncertainty
In the next section, you will learn some options for selecting a coverage factor.
12
Selecting a Coverage Factor
The coverage factor is the multiplier that you will use to expand uncertainty to a 95%
confidence interval. However, you have some options. You can use:
The result is the expanded uncertainty (i.e. U). This is your uncertainty in measurement
estimated to a 95% confidence interval.
For this evaluation, calculate the significance of each source of uncertainty and analyse how
much it influences your total measurement uncertainty. Double-check uncertainty
components with excessively large and small percentages to verify their value is correct.
13
THE END
14