CLAS Certificate Number 94-03

Company name Miller Instruments Ltd.
Company address #1 – 3871 North Fraser Way
Burnaby, British Columbia V5J 5G6
Contact Bill Miller, P.Eng.
Telephone: (604) 431-8882
Fax: (604) 431-8714
Email: miller@miller.bc.ca
Clients served
  • All interested parties
  • Some calibration services are available on-site. See Remarks for details.
Fields of calibration
SCC accreditation
(ISO/IEC 17025)
  • SCC file number: 15208
  • First issued
  • Issue 12.1e

This CLAS Certificate is published by the CLAS program of the National Research Council of Canada (NRC) in cooperation with the laboratory accreditation program of the Standards Council of Canada (SCC), Canada's accreditation body for calibration and testing laboratories. The SCC accredits the capability of the named laboratory for being able to perform calibrations as per the listed Calibration and Measurement Capabilities with metrological traceability to the International System of Units (SI) or to standards acceptable to the CLAS program. See supplementary notes.

Electrical

Measured Quantity & Range or Instrument Frequency Expanded Measurement Uncertainty Type Remarks
Current, AC
100 μA to 1000 μA 45 Hz to 10 kHz 0.26 % to 0.05 % II

For the calibration of ac current sources and measurement devices.

Both the measure and generate capabilities are monitored using a digital multimeter. See Annex A for details.
1 mA to 10 mA 45 Hz to 10 kHz 0.26 % to 0.05 %
10 mA to 100 mA 45 Hz to 10 kHz 0.26 % to 0.05 %
100 mA to 1 A 45 Hz to 5 kHz 0.3 % to 0.1 %
1 A to 2 A 45 Hz to 100 Hz 0.09 % II Both the measure and generate capabilities are monitored with a digital multimeter using resistance shunts.
2 A to 3 A 45 Hz to 100 Hz 0.06 %
3 A to 5 A 45 Hz to 100 Hz 0.05 %
5 A to 100 A 45 Hz to 100 Hz 0.04 %
100 mA to 1.1 A 45 Hz to 100 kHz 0.011 % to 0.12 % II Measure: For the calibration of AC current source devices using a reference current shunt and a digital multimeter. See Annex E for details.
1 A to 11 A 45 Hz to 100 kHz 0.011 % to 0.13 %
100 mA to 0.33 A 45 Hz to 30 kHz 0.017 % to 0.064 % II

Source: For the calibration of AC current measurement devices using a reference current shunt and a digital multimeter. See Annex F for details.
0.33 A to 1.1 A 45 Hz to 10 kHz 0.011 % to 0.025 %
1 A to 3 A 45 Hz to 10 kHz 0.018 % to 0.046 %
3 A to 11 A 45 Hz to 5 kHz 0.011 % to 0.026 %
100 A to 2000 A 60 Hz 0.086 % to 0.25 % II Measure: For the calibration of AC current source devices using a reference current transducer and a digital multimeter. See Annex G for details.
100 A to 1500 A 60 Hz 0.086 % to 0.25 % II Source: For the calibration of AC current measurement devices using a reference current transducer and a digital multimeter. See Annex G for details.
Measured Quantity & Range or Instrument Frequency Expanded Measurement Uncertainty Type Remarks
Current, DC
10 pA to 100 μA 0.13 % to 0.018 % II Source: For the calibration of DC current measuring devices using a DC voltage source, resistors and an electrometer. See Annex J for details.
10 pA to 100 μA 0.18 % to 0.022 % II Measure: For the calibration of DC current source devices using a DC voltage source, resistors and an electrometer. See Annex K for details.
1 μA to 10 μA 0.002 % + 0.1 nA II For the calibration of dc current sources and measurement devices.
Both the measure and generate capabilities are monitored using a digital multimeter.
10 μA to 100 μA 0.002 % + 0.8 nA
100 μA to 1 mA 0.002 % + 5 nA
1 mA to 10 mA 0.002 % + 50 nA
10 mA to 100 mA 0.0035 % + 500 nA
100 mA to 1 A 0.011 % + 10 μA
1 A to 100 A 0.03 % II For the calibration of dc current sources and measurement devices.
Both the measure and generate capabilities are monitored with a digital multimeter using resistance shunts.
100 mA to 1.1 A 0.0026 % to 0.0089 % II Measure and Source: For the calibration of DC current source devices and DC current measurement devices using a reference current shunt and a digital multimeter. See Annex H for details.
1 A to 11 A 0.004 % to 0.09 % II Measure and Source: For the calibration of DC current source devices and DC current measurement devices using a reference current shunt and a digital multimeter. See Annex H for details.
100 A to 1000 A 0.026 % to 0.052 % II Measure and Source: For the calibration of DC current source devices and DC current measurement devices using a reference current transducer and a digital multimeter. See Annex H for details.
Measured Quantity & Range or Instrument Frequency Expanded Measurement Uncertainty Type Remarks
Power, AC
At power factor ranging from 1 to 0.5 leading and lagging.
12 W to 10.08 kW
Voltage range: 120 V to 480 V
Current range: 0.2 A to 21 A		 60 Hz 0.018 % of reading II For the calibration of sinusoidal power measurement devices and the ac power function of multifunction calibrators by comparison to a reference wattmeter. This service applies to both leading and lagging power factor (PF).
Measure and generate
48 W to 12.6 kW
Voltage range: 480 V to 600 V
Current range: 0.2 A to 21 A		 60 Hz 0.018 % to 0.024 % of reading II For the calibration of sinusoidal power measurement devices and the ac power function of multifunction calibrators by comparison to a reference wattmeter. This service applies to both leading and lagging power factor (PF).
Measure and generate
The uncertainty increases linearly with voltage.
Measured Quantity & Range or Instrument Frequency Expanded Measurement Uncertainty Type Remarks
Power, DC
0.1 mW to 330 W
Current range: 0.33 mA to 330 mA
Voltage range: 0.33 V to 1000 V		 0.017 % to 0.028 % of reading II Generate for the calibration of DC power measurement devices using a multi-function calibrator for the independent generation of current and voltage.
See Annex D for details.
0.1 W to 3000 W
Current range: 330 mA to 3 A
Voltage range: 0.33 V to 1000 V		 0.026 % to 0.041 % of reading II Generate for the calibration of DC power measurement devices using a multi-function calibrator for the independent generation of current and voltage.
See Annex D for details.
1 W to 11 kW
Current range: 3 A to 11 A
Voltage range: 0.33 V to 1000 V		 0.055 % to 0.067 % of reading II Generate for the calibration of DC power measurement devices using a multi-function calibrator for the independent generation of current and voltage.
See Annex D for details.
3.6 W to 20.5 kW
Current range: 11 A to 20.5 A
Voltage range: 0.33 V to 1000 V		 0.11 % of reading II Generate for the calibration of DC power measurement devices using a multi-function calibrator for the independent generation of current and voltage.
See Annex D for details.
Measured Quantity & Range or Instrument Expanded Measurement Uncertainty Type Remarks
Resistance, DC
10 Ω to 500 Ω 1 μΩ/Ω II For the calibration of resistors and the resistance of temperature probes such as SPRTs and PRTs at the triple point of water using a resistance bridge.
10 μΩ to 100 μΩ 390 μΩ/Ω to 200 μΩ/Ω II For the calibration of resistors and resistance measuring devices in air at 23 °C using standard resistors, a nanovolt meter, and a constant current source.
0.1 mΩ to 1 mΩ 210 μΩ/Ω to 190 μΩ/Ω
1 mΩ to 10 mΩ 210 μΩ/Ω to 150 μΩ/Ω
10 mΩ to 100 mΩ 350 μΩ/Ω to 98 μΩ/Ω
0.1 Ω to 1 Ω 96 μΩ/Ω to 87 μΩ/Ω
1 Ω to 10 Ω (19 μΩ/Ω + 50 μΩ) II For the calibration of resistors and resistance measuring devices in air at 23 °C using a multifunction calibrator that is dynamically monitored by a digital multimeter.
10 Ω to 100 Ω (16 μΩ/Ω + 0.5 mΩ)
100 Ω to 1 kΩ (14 μΩ/Ω + 0.5 mΩ)
1 kΩ to 10 kΩ (14 μΩ/Ω + 5 mΩ)
10 kΩ to 100 kΩ (14 μΩ/Ω + 50 mΩ)
100 kΩ to 1 MΩ (19 μΩ/Ω + 2 Ω)
1 MΩ to 10 MΩ (54 μΩ/Ω + 100 Ω)
10 MΩ to 100 MΩ (500 μΩ/Ω + 1 kΩ)
100 MΩ to 330 MΩ (0.5 % + 10 kΩ)
330 MΩ to 1GΩ (0.5 % + 10 kΩ) II For the measurement of resistance in air at 23 °C using a digital multimeter.
100 MΩ to 10 GΩ 0.015 % II For the calibration of resistors and resistance measuring devices using reference standard resistors and a high value resistance bridge that consists of two programmable DC voltage sources and an electrometer.
10 GΩ 4to 100 GΩ 0.015 % to 0.14 %
100 GΩ to 1 TΩ 0.14 %
1 TΩ to 10 TΩ 0.14 % to 0.5 %
Measured Quantity & Range or Instrument Frequency Expanded Measurement Uncertainty Type Remarks
Resistance, AC
1 Ω to 100 kΩ 50 Hz to 10 kHz 0.04 % to 0.2 % of value II Measure and Source
For the calibration of AC resistors or AC resistance measurement devices using standard AC resistors and an LCR meter. See Annex C for details.
1 Ω 60 Hz, 1 kHz & 10 kHz 0.09 % to 0.2 % II Measure and Source
For the calibration of 1 Ω, 10 Ω, 100 Ω, 1 kΩ and 10 kΩ AC resistors by substitution method using an LCR meter. GenRad 1689 LCR meter and standard resistors (1 Ω, 10 Ω, 100 Ω, 1 kΩ and 10 kΩ).
See Annex C for details.
10 Ω 60 Hz, 1 kHz & 10 kHz 0.04 % to 0.08 %
100 Ω 60 Hz, 1 kHz & 10 kHz 0.04 % to 0.07 %
1 KΩ 60 Hz, 1 kHz & 10 kHz 0.04 % to 0.07 %
10 KΩ 60 Hz, 1 kHz & 10 kHz 0.04 % to 0.07 %
Measured Quantity & Range or Instrument Frequency Expanded Measurement Uncertainty Type Remarks
Voltage, AC
1 mV to 10 mV 10 Hz to 1 MHz 2.4 % to 0.04 % II

For the calibration of ac voltage sources.
The measure capability is monitored with a digital multimeter. See Annex B.
10 mV to 100 mV 10 Hz to 1 MHz 2.0 % to 0.008 %
0.1 V to 1 V 10 Hz to 1 MHz 1.5 % to 0.007 %
1 V to 10 V 10 Hz to 1 MHz 1.5 % to 0.007 %
10 V to 100 V 10 Hz to 1 MHz 3.5 % to 0.008 %
100 V to 1050 V 10 Hz to 100 kHz 0.13 % to 0.012 %
1 mV to 10 mV 10 Hz to 500 kHz 2.4 % to 0.04 % II

For the calibration of ac measurement devices.
The generate capability is monitored with a digital multimeter. See Annex L.
10 mV to 100 mV 10 Hz to 500 kHz 2.0 % to 0.008 %
0.1 V to 1 V 10 Hz to 500 kHz 1.5 % to 0.007 %
1 V to 3.3 V 10 Hz to 500 kHz 1.8 % to 0.008 %
3.3 V to 10 V 10 Hz to 100 kHz 1.3 % to 0.007 %
10 V to 33 V 10 Hz to 100 kHz 0.1 % to 0.009 %
33 V to 100 V 45 Hz to 100 kHz 0.07 % to 0.008 %
100 V to 330 V 45 Hz to 100 kHz 0.13 % to 0.017 %
330 V to 1020 V 45 Hz to 10 kHz 0.08 % to 0.012 %
1 kV to 10 kV 50 Hz to 60 Hz 0.38 % II Measure and Source: For the calibration of voltage sources and voltage measuring devices using high voltage divider and digital multimeter.
10 kV to 85 kV 60 Hz 0.38 % II Measure: For the calibration of voltage sources using high voltage divider and digital multimeter.
Measured Quantity & Range or Instrument Expanded Measurement Uncertainty Type Remarks
Voltage, DC
1 mV to 100 mV (9 μV/V + 1 μV) II For the calibration of voltage sources and voltage measuring devices using a multifunction calibrator that is monitored with a digital multimeter.
0.1 V to 1 V (8 μV/V + 1 μV)
1 V to 10 V (8 μV/V + 2 μV)
10 V to 100 V (10 μV/V + 30 μV)
100 V to 1000 V (10 μV/V + 100 μV)
1 kV to 120 kV 0.02 % II Measure: For the calibration of voltage sources using high voltage divider and digital multimeter.
1 kV to 70 kV 0.02 % II Source: For the calibration of voltage measuring devices using high voltage divider and digital multimeter.
Measured Quantity & Range or Instrument Frequency Expanded Measurement Uncertainty Type Remarks
Capacitance
10 pF 1 kHz 0.025 % II For the calibration of capacitors and capacitance measuring devices of the same nominal value by comparison to reference standard capacitors using a substitution method.
100 pF 1 kHz 0.006 %
1000 pF 1 kHz 0.006 %
0.01 μF 1 kHz 0.015 %
0.1 μF 1 kHz 0.015 %
1 μF 1 kHz 0.017 %
100 μF to 110 mF DC 0.025 % of value II Measurement using a constant current and DMM. Suitable for the calibration of capacitors, capacitance measuring devices, and the capacitance function of multifunction calibrators such as a Fluke 5520A.
10 pF to 65 μF 50 Hz to 10 kHz 0.015 % to 13 % II For the calibration of capacitors and capacitance measuring devices using an LCR meter. See Annex I for details.
65 μF to 100 μF 50 Hz to 5 kHz 0.072 % to 2.3 %
 
Top of page

Electrical Calibration by Simulation

Measured Quantity & Range or Instrument Expanded Measurement Uncertainty Type Remarks
Conductivity
1 μS/cm to 100 mS/cm 0.07 % II By electrical simulation using resistance reference standards without realization or measurement of conductivity
pH meters
0 pH to 14 pH 0.01 pH II For the calibration of pH meters by electrical simulation without realization or measurement of pH
pH simulators
0 mV to 100 mV 0.01 mV II For the calibration of pH simulators by electrical simulation without realization or measurement of pH
100 mV to 415 mV 0.02 mV

Electrical Calibration of Temperature Indicators and Sources

Measured Quantity & Range or Instrument Expanded Measurement Uncertainty Type Remarks
Thermocouple simulation
Type E
-250 °C to -100 °C 0.44 °C II

By electrical simulation using a multifunction calibrator without realisation or measurement of physical temperatures. Temperature sensors are not calibrated.

The International Temperature Scale of 1990 (ITS-90) is used to express temperature values.

Standard reference functions published in NIST Monograph 175:1993 and ASTM E230-98 are used to convert voltage or resistance signals to units of simulated temperature. Results are reported in simulated degrees Celsius or the equivalent on the Fahrenheit scale.
-100 °C to -25 °C 0.14 °C
-25 °C to 350 °C 0.12 °C
350 °C to 650 °C 0.14 °C
650 °C to 1000 °C 0.19 °C
Type J
-210 °C to -100 °C 0.25 °C II

By electrical simulation using a multifunction calibrator without realisation or measurement of physical temperatures. Temperature sensors are not calibrated.

The International Temperature Scale of 1990 (ITS-90) is used to express temperature values.

Standard reference functions published in NIST Monograph 175:1993 and ASTM E230-98 are used to convert voltage or resistance signals to units of simulated temperature. Results are reported in simulated degrees Celsius or the equivalent on the Fahrenheit scale.
-100 °C to -30 °C 0.14 °C
-30 °C to 150 °C 0.12 °C
150 °C to 760 °C 0.15 °C
760 °C to 1200 °C 0.21 °C
Type K
-200 °C to -100 °C 0.31 °C II

By electrical simulation using a multifunction calibrator without realisation or measurement of physical temperatures. Temperature sensors are not calibrated.

The International Temperature Scale of 1990 (ITS-90) is used to express temperature values.

Standard reference functions published in NIST Monograph 175:1993 and ASTM E230-98 are used to convert voltage or resistance signals to units of simulated temperature. Results are reported in simulated degrees Celsius or the equivalent on the Fahrenheit scale.
-100 °C to -25 °C 0.18 °C
-25 °C to 120 °C 0.15 °C
120 °C to 1000 °C 0.23 °C
1000 °C to 1372 °C 0.35 °C
Type N
-200 °C to -100 °C 0.35 °C II

By electrical simulation using a multifunction calibrator without realisation or measurement of physical temperatures. Temperature sensors are not calibrated.

The International Temperature Scale of 1990 (ITS-90) is used to express temperature values.

Standard reference functions published in NIST Monograph 175:1993 and ASTM E230-98 are used to convert voltage or resistance signals to units of simulated temperature. Results are reported in simulated degrees Celsius or the equivalent on the Fahrenheit scale.
-100 °C to -25 °C 0.20 °C
-25 °C to 120 °C 0.18 °C
120 °C to 410 °C 0.17 °C
410 °C to 1300 °C 0.25 °C
Type R
0 °C to 250 °C 0.58 °C II

By electrical simulation using a multifunction calibrator without realisation or measurement of physical temperatures. Temperature sensors are not calibrated.

The International Temperature Scale of 1990 (ITS-90) is used to express temperature values.

Standard reference functions published in NIST Monograph 175:1993 and ASTM E230-98 are used to convert voltage or resistance signals to units of simulated temperature. Results are reported in simulated degrees Celsius or the equivalent on the Fahrenheit scale.
250 °C to 400 °C 0.37 °C
400 °C to 1000 °C 0.35 °C
1000 °C to 1760 °C 0.38 °C
Type S
0 °C to 250 °C 0.56 °C II

By electrical simulation using a multifunction calibrator without realisation or measurement of physical temperatures. Temperature sensors are not calibrated.

The International Temperature Scale of 1990 (ITS-90) is used to express temperature values.

Standard reference functions published in NIST Monograph 175:1993 and ASTM E230-98 are used to convert voltage or resistance signals to units of simulated temperature. Results are reported in simulated degrees Celsius or the equivalent on the Fahrenheit scale.
250 °C to 1000 °C 0.38 °C
1000 °C to 1400 °C 0.37 °C
1400 °C to 1760 °C 0.42 °C
Type T
-250 °C to -150 °C 0.55 °C II

By electrical simulation using a multifunction calibrator without realisation or measurement of physical temperatures. Temperature sensors are not calibrated.

The International Temperature Scale of 1990 (ITS-90) is used to express temperature values.

Standard reference functions published in NIST Monograph 175:1993 and ASTM E230-98 are used to convert voltage or resistance signals to units of simulated temperature. Results are reported in simulated degrees Celsius or the equivalent on the Fahrenheit scale.
-150 °C to 0 °C 0.21 °C
0 °C to 120 °C 0.14 °C
120 °C to 400 °C 0.12 °C
Resistance Temperature Devices
Pt 385 (100 Ω)
-200 °C to 800 °C 0.06 °C to 0.27 °C II

Indicators only. By electrical simulation using a multifunction calibrator without realisation or measurement of physical temperatures. Temperature sensors are not calibrated.

The International Temperature Scale of 1990 (ITS-90) is used to express temperature values.

Standard reference functions published in NIST Monograph 175:1993 and ASTM E230-98 are used to convert voltage or resistance signals to units of simulated temperature. Results are reported in simulated degrees Celsius or the equivalent on the Fahrenheit scale.
Pt 385 (200 Ω)
-190 °C to 630 °C 0.05 °C to 0.18 °C II

Indicators only. By electrical simulation using a multifunction calibrator without realisation or measurement of physical temperatures. Temperature sensors are not calibrated.

The International Temperature Scale of 1990 (ITS-90) is used to express temperature values.

Standard reference functions published in NIST Monograph 175:1993 and ASTM E230-98 are used to convert voltage or resistance signals to units of simulated temperature. Results are reported in simulated degrees Celsius or the equivalent on the Fahrenheit scale.
Pt 385 (500 Ω)
-190 °C to 630 °C 0.05 °C to 0.13 °C II

Indicators only. By electrical simulation using a multifunction calibrator without realisation or measurement of physical temperatures. Temperature sensors are not calibrated.

The International Temperature Scale of 1990 (ITS-90) is used to express temperature values.

Standard reference functions published in NIST Monograph 175:1993 and ASTM E230-98 are used to convert voltage or resistance signals to units of simulated temperature. Results are reported in simulated degrees Celsius or the equivalent on the Fahrenheit scale.
Pt 385 (1000 Ω)
-190 °C to 630 °C 0.036 °C to 0.27 °C II

Indicators only. By electrical simulation using a multifunction calibrator without realisation or measurement of physical temperatures. Temperature sensors are not calibrated.

The International Temperature Scale of 1990 (ITS-90) is used to express temperature values.

Standard reference functions published in NIST Monograph 175:1993 and ASTM E230-98 are used to convert voltage or resistance signals to units of simulated temperature. Results are reported in simulated degrees Celsius or the equivalent on the Fahrenheit scale.
 
Top of page

Time and Frequency

Measured Quantity & Range or Instrument Expanded Measurement Uncertainty Type Remarks
Frequency
10 MHz 3.3 x 10-10 I For the calibration of frequency standards, frequency counters, and frequency measuring devices using a Rubidium frequency standard and a frequency counter.
1 Hz to 550 MHz 3.3 x 10-10
Timers
Timebase error 0.16 s II For the calibration of manually-activated time interval measurement devices, including stopwatches and timers using a frequency counter and a quartz reference standard that is referenced to a Rubidium frequency standard.

Thermometry

Measured Quantity & Range or Instrument Expanded Measurement Uncertainty Type Remarks
0.000 °C 6 mK II For the realisation of a reference ice point in accordance with ASTM E563.
0.000 °C 7 mK II For the calibration of RTD sensors using a reference ice point in accordance with ASTM E563. This service is available on-site.
Hg Triple Point 2.0 mK II For the calibration of long-stem SPRTs. The uncertainty associated with temperatures between the fixed points is obtained by considering the effect of the error propagation associated with the ITS-90 equations.
H2O Triple Point 0.5 mK
Ga Melting Point 2.5 mK
In Freezing Point 2.0 mK
Sn Freezing Point 2.3 mK
Zn Freezing Point 3.7 mK
-95 °C to -40 °C 0.065 °C II For the calibration of RTD sensors and direct reading thermometers, using a liquid bath or dry block and reference SPRT thermometer.
-40 °C to 0 °C 0.010 °C
0 °C to 40 °C 0.010 °C
40 °C to 100 °C 0.007 °C
100 °C to 200 °C 0.010 °C
200 °C to 300 °C 0.017 °C
300 °C to 425 °C 0.29 °C
425 °C to 650 °C 0.46 °C
-95 °C to 0 °C 0.35 °C to 0.20 °C II For the calibration of Type E, J, K, N, R, S, and T thermocouples using a liquid bath or dry block and reference PRT thermometer.
0 °C to 400 °C 0.2 °C to 0.6 °C
400 °C to 600 °C 0.6 °C to 1.4 °C
-78 °C to 0 °C 0.10 °C II For the calibration of liquid-in-glass thermometers using a liquid bath and reference PRT thermometer.
0 °C to 300 °C 0.05 °C
35 °C to 75 °C 0.10 °C II For on-site service: calibration of direct reading thermometers using a dry block calibrator and reference PRT thermometer.
75 °C to 150 °C 0.20 °C
150 °C to 250 °C 0.40 °C
250 °C to 400 °C 0.60 °C
-95 °C to -50 °C 0.052 °C II For the calibration of temperature block (i.e., dryblock or drywell) calibrators using a standard PRT thermometer following the guidelines of EA 10/13.
-50 °C to 155 °C 0.018 °C
155 °C to 425 °C 0.06 °C
425 °C to 600 °C 0.23 °C
Infrared radiation thermometers
35 °C to 500 °C
Emissivity 0.9 to 1.0 with spectral band of 8 to 14 μm (0.37 °C + 0.0037T) T in°C II For the calibration of infrared thermometers using an infrared calibrator (Fluke model 4181).
95 °F to 932 °F
Emissivity 0.9 to 1.0 with spectral band of 8 to 14 μm (0.55 °F + 0.0037T)
T in°F		 II For the calibration of infrared thermometers using an infrared calibrator (Fluke model 4181).
Temperature chambers
-40 °C to 0 °C 0.24 °C II For the characterization of temperature chambers. This service is also available on-site.
0 °C to 200 °C 0.21 °C
200 °C to 250 °C 0.27 °C
250 °C to 400 °C 0.9 °C
400 °C to 600 °C 1.7 °C
 
Top of page

Pressure

Measured Quantity & Range or Instrument Expanded Measurement Uncertainty Type Remarks
Pneumatic deadweight tester
25 psi to 100 psi 90 parts per 106 or 0.0028 psi
(whichever is greater)		 II Pneumatic deadweight tester by direct comparison against a high precision reference transducer.
100 psi to 1000 psi 87 parts per 106 or 0.05 psi
(whichever is greater)		 Pneumatic deadweight tester by cross floating against a reference pneumatic deadweight tester.
Hydraulic deadweight tester
87 psi to 810 psi 92 parts per 106 or 0.025 psi
(whichever is greater)		 II Hydraulic deadweight tester by cross floating against a reference hydraulic deadweight tester.
810 psi to 16000 psi 92 parts per 106 or 0.5 psi
(whichever is greater)		 Hydraulic deadweight tester by cross floating against a reference hydraulic deadweight tester.
Pressure & Vacuum
Absolute mode
0.02 psi to 15 psi 0.012 % of reading or 0.001 psi (whichever is greater) II

For the calibration of pressure measuring devices with absolute reference.

Pneumatic pressure by direct comparison against a high precision reference transducer.
15 psi to 45 psi 0.013 % of reading or 0.0025 psi (whichever is greater)
45 psi to 115 psi 0.012 % of reading or 0.0062 psi (whichever is greater)
115 psi to 315 psi 0.012 % of reading or 0.019 psi (whichever is greater)
315 psi to 1015 psi 0.012 % of reading or 0.06 psi (whichever is greater)
2000 psi to 20000 psi 2.3 psi
Gauge mode
-14.5 psi to 0 psi 0.0023 psi II

For the calibration of pressure measuring devices including differential manometers with atmospheric reference.

Pneumatic pressure by direct comparison against a high precision reference transducer.
0 psi to 30 psi 0.01 % of reading or 0.0018 psi (whichever is greater)
30 psi to 100 psi 0.01 % of reading or 0.0059 psi (whichever is greater)
100 psi to 300 psi 0.01 % of reading or 0.018 psi (whichever is greater)
300 psi to 1000 psi 0.01 % of reading or 0.059 psi (whichever is greater)
100 psi to 1015 psi 83 parts per 106 II

For the calibration of pressure measuring devices including differential manometers with atmospheric reference.

Pneumatic pressure by direct comparison with a dead weight tester.
30 psi to 16 000 psi 88 parts per 106 II

For the calibration of pressure measuring devices including differential manometers with atmospheric reference.

Hydraulic pressure by direct comparison with a dead weight tester.
-14 psi to 30 psi 0.018 psi II

For the calibration of pressure measuring devices including differential manometers with atmospheric reference.

Pneumatic pressure measured on-site by direct comparison against a reference pressure manometer.

Above 400 psi, the customer must provide the pressure generator.
30 psi to 1000 psi 0.12 % of reading or 0.24 psi (whichever is greater)
0 psi to 300 psi 0.12 % of reading or 0.07 psi (whichever is greater) II

For the calibration of pressure measuring devices including differential manometers with atmospheric reference.

Hydraulic pressure by direct comparison against a reference pressure manometer.

This service is also available on-site.
300 psi to 10 000 psi 0.12 % of reading or 0.47 psi (whichever is greater)
2000 psi to 20 000 psi 2.3 psi
 
Top of page

Dimensional

Measured Quantity & Range or Instrument Expanded Measurement Uncertainty Type Remarks
Gauge block, length
Steel and ceramic, rectangular and square
Inch, 0.01 inches up to 4 inches (4.36 + 0.868L) μinch
(Note: L in 'inches')		 I Comparison to reference gauge blocks.
Metric, 0.254 mm to 102 mm (0.111 + 0.000868L) μm
(Note: L in 'mm')
Steel, rectangular and square
Inch, 4 inches up to 10 inches (1.836 + 1.468L) μinch
(Note: L in 'inches')		 I Comparison to reference gauge blocks.
Metric, 102 mm to 254 mm (0.0466 + 0.001468L) μm
(Note: L in 'mm')
Micrometer, outside
Inch, up to 6 inches (45 + 2L) μinch
(L in inches)		 II Comparison to gauge blocks.
Inch, >6 inches to 12 inches (50+4.2L) μinch
(L in inches)
Caliper, inside
Inch, up to 12 inches 310 μinch II Comparison to gauge blocks.
Caliper, outside
Inch, up to 12 inches 310 μinch II Comparison to gauge blocks.
Over 12 to 24 inches 570 μinch
Over 24 to 40 inches 710 μinch
Caliper, depth
Inch, up to 12 inches 310 μinch II Comparison to gauge blocks.
Dial indicator
0.0001 inch graduation 22 μinch II Up to 2 inch travel. Comparison to gauge blocks.
0.0005 inch graduation 180 μinch Up to 2 inch travel. Comparison to gauge blocks.
0.001 mm graduation 0.38 μm Up to 58 mm travel. Comparison to gauge blocks.
0.01 mm graduation 1.8 μm Up to 58 mm travel. Comparison to gauge blocks.
Digital indicator
0.0001 inch resolution 70 μinch II Up to 2 inch travel. Comparison to gauge blocks.
0.0005 inch resolution 350 μinch Up to 2 inch travel. Comparison to gauge blocks.
0.00005 inch resolution 37 μinch Up to 2 inch travel. Comparison to gauge blocks.
0.001 mm resolution 0.76 μm Up to 58 mm travel. Comparison to gauge blocks.
0.01 mm resolution 6.9 μm Up to 58 mm travel. Comparison to gauge blocks.
Height gauge
Inch, up to 12 inches 300 μinch II Comparison to gauge blocks.
Metric, up to 300 mm 0.0076 mm
Inch, 12 to 24 inches
0.0005 inch resolution 350 μinch
0.001 inch resolution 0.0006 inch
Metric, 300 to 600 mm
0.01 mm resolution 0.009 mm
0.02 mm resolution 0.015 mm
Cylindrical ring gauge, diameter
Inch, 1 inch to 4 inches (17.0 + 3.0D) μinch, D in inch I Comparison to master ring gauge.
Inch, >4 inches to 6 inches (17.0 + 2.9D) μinch, D in inch
Metric, 25.4 mm to 101.6 mm (0.44 + 0.003D) μm, D in mm
Metric, >101.6 mm to 152.4 mm (0.42 + 0.003D) μm, D in mm
Micrometer Setting Standard
Inch, 1 inch to 11 inches (11 + 3.5L) μin, L in inch I Comparison to gauge blocks.
Metric, 25.4 mm to 279.4 mm (0.27 + 0.0035L) μm, L in mm
 
Top of page

Mass

Measured Quantity & Range or Instrument Expanded Measurement Uncertainty Type Remarks
Mass, conventional
1 mg 0.0020 mg I

For the calibration of masses with traceability to the International System of Units (SI) using a mass comparator and an analytical balance.

Calibration results are reported in terms of conventional mass as defined by the Organisation internationale de métrologie légale (OIML): "The conventional value of the value of the result of weighing a body in air is equal to mass of a standard, of conventionally chosen density (8000 kg/m3), at a conventionally chosen temperature (20 °C), which balances this body at this reference temperature in air of conventionally chosen density (1.2 kg/m3)."
2 mg 0.0021 mg
3 mg 0.0022 mg
5 mg 0.0020 mg
10 mg 0.0020 mg
20 mg 0.0020 mg
30 mg 0.0040 mg
50 mg 0.0021 mg
100 mg 0.0023 mg
200 mg 0.0025 mg
300 mg 0.0048 mg
500 mg 0.0068 mg
1 g 0.0070 mg
2 g 0.0070 mg
3 g 0.014 mg
5 g 0.010 mg
10 g 0.02 mg
20 g 0.04 mg
30 g 0.06 mg
50 g 0.06 mg
100 g 0.09 mg
200 g 0.14 mg
220 g 0.17 mg
5 g to 1000 g 0.015 g I

For the calibration of masses with traceability to the International System of Units (SI).

Calibration results are reported in terms of conventional mass as defined by the Organisation internationale de métrologie légale (OIML): "The conventional value of the value of the result of weighing a body in air is equal to mass of a standard, of conventionally chosen density (8000 kg/m3), at a conventionally chosen temperature (20 °C), which balances this body at this reference temperature in air of conventionally chosen density (1.2 kg/m3)."
1000 g to 3000 g 0.018 g
3000 g to 6000 g 0.029 g
6000 g to 10000 g 0.09 g
20 Kg 0.09 g I

For the calibration of masses with traceability to the International System of Units (SI).

Calibration results are reported in terms of conventional mass as defined by the Organisation internationale de métrologie légale (OIML): "The conventional value of the value of the result of weighing a body in air is equal to mass of a standard, of conventionally chosen density (8000 kg/m3), at a conventionally chosen temperature (20 °C), which balances this body at this reference temperature in air of conventionally chosen density (1.2 kg/m3)."
Scales
9 kg to 12 kg 0.2 g II Calibration of scales using standard weights.
>12 kg to 22 kg 0.4 g
>22 kg to 45 kg 1.0 g
>45 kg to 90 kg 1.7 g
>90 kg to 135 kg 2.7 g
>135 kg to 177 kg 3.2 g
>177 kg to 220 kg 3.9 g
>220 kg to 227 kg 5.3 g
Balances (Electronic, non-automatic)
Up to 200 mg 0.0024 mg II

The calibration uses ASTM Class 1 or OIML E2 reference weights.

Calibrations are also available on-site.
> 200 mg to 500 mg 0.0047 mg
> 500 mg to 2 g 0.0070 mg
> 2 g to 5 g 0.011 mg
> 5 g to 10 g 0.018 mg
> 10 g to 20 g 0.034 mg
> 20 g to 50 g 0.052 mg
> 50 g to 100 g 0.11 mg
> 100 g to 200 g 0.13 mg
> 200 g to 500 g 0.25 mg
> 500 g to 1 kg 0.5 mg
> 1 kg to 2 kg 1.0 mg
> 2 kg to 5 kg 3.2 mg
> 5 kg to 9 kg 5.3 mg
 
Top of page

Force

Measured Quantity & Range or Instrument Expanded Measurement Uncertainty Type Remarks
0 pound force to 1 pound force 0.0002 pound force II Calibration of force measuring instruments using standard weights.
1 pound force to 5 pound force 0.001 pound force
5 pound force to 20 pound force 0.024 % of reading
20 pound force to 200 pound force 0.02 % of reading

Annex A

Calibration Measurement Capability in the Measurement of AC Current and in the Calibration of Digital Multimeters and AC Current Measuring Devices, expressed as ± { (% of reading) + residual }

Current, AC Frequency
45 Hz to 100 Hz 100 Hz to 5 kHz 5 kHz to 10 kHz
100 μA to 1 mA 0.06 % + 0.2 μA 0.03 % + 0.2 μA 0.07 % + 0.2 μA
1 mA to 10 mA 0.06 % + 2 μA 0.03 % + 2 μA 0.07 % + 2 μA
10 mA to 100 mA 0.06 % + 20 μA 0.03 % + 20 μA 0.07 % + 20 μA
0.1 A to 1 A 0.08 % + 0.2 mA 0.1 % + 0.2 mA n/a

Annex B

Calibration Measurement Capability in the Measurement of AC Voltage, expressed as ± {(% of reading) + residual}

Voltage, AC Frequency
10 Hz to 2 kHz 2 kHz to 10 kHz 10 kHz to 30 kHz 30 kHz to 100 kHz 100 kHz to 300 kHz 300 kHz to 1 MHz
1 mV to 10 mV 0.025 % +1.1 μV 0.033 % +1.1 μV 0.034 % +1.1 μV 0.3 % +1.1 μV 1 % + 4 μV 2 % + 4 μV
10 mV to 100 mV 0.0068 % + 0.5 μV 0.011 % + 0.5 μV 0.021 % + 1 μV 0.051 % +5 μV 0.2 % +30 μV 1 % + 100 μV
0.1 V to 1 V 0.0064 % +5 μV 0.011 % + 5 μV 0.021 % + 10 μV 0.051 % + 50 μV 0.2 % + 300 μV 1 % + 1 mV
1 V to 10 V 0.0064 % +50 μV 0.011 % + 50 μV 0.021 % + 100 μV 0.051 % + 500 μV 0.2 % + 3 mV 1 % + 10 mV
10 V to 100 V 0.007 % +500 μV 0.009 % + 500 μV 0.021 % + 1 mV 0.051 % + 5 mV 0.35 % + 50 mV 1 % + 500 mV
100 V to 1050 V 0.009 % +25 mV 0.009 % + 25 mV 0.021 % + 25 mV 0.051 % + 100 mV n/a n/a

Annex C

Uncertainty in the Measurement of AC Resistance Expressed as % of Value

Frequency
Resistance (Ω) 0.05 kHz 0.10 kHz 0.20 kHz 0.40 kHz 0.60 kHz 0.80 kHz 1.00 kHz 2.00 kHz 4.00 kHz 6.00 kHz 8.00 kHz 10.00 kHz
1 0.20 0.20 0.18 0.16 0.13 0.10 0.08 0.09 0.12 0.14 0.17 0.20
2 0.20 0.20 0.18 0.16 0.13 0.10 0.08 0.09 0.12 0.14 0.17 0.20
3 0.20 0.20 0.18 0.16 0.13 0.10 0.08 0.09 0.12 0.14 0.17 0.20
4 0.20 0.20 0.18 0.16 0.13 0.10 0.08 0.09 0.12 0.14 0.17 0.20
5 0.20 0.20 0.18 0.16 0.13 0.10 0.08 0.09 0.12 0.14 0.17 0.20
6 0.20 0.20 0.18 0.16 0.13 0.10 0.08 0.09 0.12 0.14 0.17 0.20
7 0.20 0.20 0.18 0.16 0.13 0.10 0.08 0.09 0.12 0.14 0.17 0.20
8 0.20 0.20 0.18 0.16 0.13 0.10 0.08 0.09 0.12 0.14 0.17 0.20
9 0.20 0.20 0.18 0.16 0.13 0.10 0.08 0.09 0.12 0.14 0.17 0.20
10 0.08 0.07 0.07 0.06 0.05 0.05 0.04 0.04 0.05 0.06 0.07 0.08
20 0.08 0.07 0.07 0.06 0.05 0.05 0.04 0.04 0.05 0.06 0.07 0.08
30 0.08 0.07 0.07 0.06 0.05 0.05 0.04 0.04 0.05 0.06 0.07 0.08
40 0.08 0.07 0.07 0.06 0.05 0.05 0.04 0.04 0.05 0.06 0.07 0.08
50 0.08 0.07 0.07 0.06 0.05 0.05 0.04 0.04 0.05 0.06 0.07 0.08
60 0.08 0.07 0.07 0.06 0.05 0.05 0.04 0.04 0.05 0.06 0.07 0.08
70 0.08 0.07 0.07 0.06 0.05 0.05 0.04 0.04 0.05 0.06 0.07 0.08
80 0.08 0.07 0.07 0.06 0.05 0.05 0.04 0.04 0.05 0.06 0.07 0.08
90 0.08 0.07 0.07 0.06 0.05 0.05 0.04 0.04 0.05 0.06 0.07 0.08
100 0.07 0.06 0.06 0.05 0.05 0.04 0.04 0.04 0.05 0.05 0.06 0.07
200 0.07 0.06 0.06 0.05 0.05 0.04 0.04 0.04 0.05 0.05 0.06 0.07
300 0.07 0.06 0.06 0.05 0.05 0.04 0.04 0.04 0.05 0.05 0.06 0.07
400 0.07 0.06 0.06 0.05 0.05 0.04 0.04 0.04 0.05 0.05 0.06 0.07
500 0.07 0.06 0.06 0.05 0.05 0.04 0.04 0.04 0.05 0.05 0.06 0.07
600 0.07 0.06 0.06 0.05 0.05 0.04 0.04 0.04 0.05 0.05 0.06 0.07
700 0.07 0.06 0.06 0.05 0.05 0.04 0.04 0.04 0.05 0.05 0.06 0.07
800 0.07 0.06 0.06 0.05 0.05 0.04 0.04 0.04 0.05 0.05 0.06 0.07
900 0.07 0.06 0.06 0.05 0.05 0.04 0.04 0.04 0.05 0.05 0.06 0.07
1000 0.07 0.06 0.06 0.06 0.05 0.05 0.04 0.05 0.06 0.06 0.07 0.07
2000 0.07 0.06 0.06 0.06 0.05 0.05 0.04 0.05 0.06 0.06 0.07 0.07
3000 0.07 0.06 0.06 0.06 0.05 0.05 0.04 0.05 0.06 0.06 0.07 0.07
4000 0.07 0.06 0.06 0.06 0.05 0.05 0.04 0.05 0.06 0.06 0.07 0.07
5000 0.07 0.06 0.06 0.06 0.05 0.05 0.04 0.05 0.06 0.06 0.07 0.07
6000 0.07 0.06 0.06 0.06 0.05 0.05 0.04 0.05 0.06 0.06 0.07 0.07
7000 0.07 0.06 0.06 0.06 0.05 0.05 0.04 0.05 0.06 0.06 0.07 0.07
8000 0.07 0.06 0.06 0.06 0.05 0.05 0.04 0.05 0.06 0.06 0.07 0.07
9000 0.07 0.06 0.06 0.06 0.05 0.05 0.04 0.05 0.06 0.06 0.07 0.07
10000 0.07 0.07 0.07 0.06 0.06 0.06 0.05 0.14 0.14 0.14 0.14 0.14
20000 0.07 0.07 0.07 0.06 0.06 0.06 0.05 0.14 0.14 0.14 0.14 0.14
30000 0.07 0.07 0.07 0.06 0.06 0.06 0.05 0.14 0.14 0.14 0.14 0.14
40000 0.07 0.07 0.07 0.06 0.06 0.06 0.05 0.14 0.14 0.14 0.14 0.14
50000 0.07 0.07 0.07 0.06 0.06 0.06 0.05 0.14 0.14 0.14 0.14 0.14
60000 0.07 0.07 0.07 0.06 0.06 0.06 0.05 0.14 0.14 0.14 0.14 0.14
70000 0.07 0.07 0.07 0.06 0.06 0.06 0.05 0.14 0.14 0.14 0.14 0.14
80000 0.07 0.07 0.07 0.06 0.06 0.06 0.05 0.14 0.14 0.14 0.14 0.14
90000 0.07 0.07 0.07 0.06 0.06 0.06 0.05 0.14 0.14 0.14 0.14 0.14
100000 0.07 0.07 0.07 0.06 0.06 0.06 0.05 0.14 0.14 0.14 0.14 0.14
 
Top of page

Annex D

Uncertainty in the Measurement of DC Power Expressed as % of Value

Current Voltage
0.33 V 0.5 V 1 V 3 V 5 V 10 V 30 V 50 V 100 V 300 V 500 V 1000 V
0.33 mA 0.028 0.028 0.028 0.027 0.028 0.027 0.027 0.028 0.028 0.027 0.028 0.028
0.5 mA 0.023 0.023 0.023 0.023 0.023 0.023 0.023 0.023 0.023 0.023 0.023 0.023
1.0 mA 0.020 0.019 0.019 0.019 0.019 0.019 0.019 0.019 0.019 0.019 0.019 0.019
3.0 mA 0.018 0.017 0.017 0.017 0.017 0.017 0.017 0.017 0.017 0.017 0.017 0.017
5.0 mA 0.020 0.019 0.019 0.019 0.019 0.019 0.019 0.019 0.019 0.019 0.019 0.019
10 mA 0.018 0.018 0.018 0.018 0.018 0.018 0.018 0.018 0.018 0.018 0.018 0.018
30 mA 0.017 0.017 0.017 0.017 0.017 0.017 0.017 0.017 0.017 0.017 0.017 0.017
50 mA 0.020 0.019 0.019 0.019 0.019 0.019 0.019 0.019 0.019 0.019 0.019 0.019
100 mA 0.018 0.018 0.018 0.018 0.018 0.018 0.018 0.018 0.018 0.018 0.018 0.018
320 mA 0.017 0.017 0.017 0.017 0.017 0.017 0.017 0.017 0.017 0.017 0.017 0.017
0.33 A 0.034 0.034 0.034 0.034 0.034 0.034 0.034 0.034 0.034 0.034 0.034 0.034
0.5 A 0.030 0.030 0.030 0.030 0.030 0.030 0.030 0.030 0.030 0.030 0.030 0.030
1.0 A 0.027 0.027 0.027 0.026 0.027 0.026 0.026 0.027 0.026 0.026 0.027 0.026
2.0 A 0.041 0.041 0.041 0.041 0.041 0.041 0.041 0.041 0.041 0.041 0.041 0.041
2.9 A 0.041 0.041 0.041 0.041 0.041 0.041 0.041 0.041 0.041 0.041 0.041 0.041
3.0 A 0.067 0.067 0.067 0.067 0.067 0.067 0.067 0.067 0.067 0.067 0.067 0.067
5.0 A 0.060 0.060 0.060 0.060 0.060 0.060 0.060 0.060 0.060 0.060 0.060 0.060
10.9 A 0.055 0.055 0.055 0.055 0.055 0.055 0.055 0.055 0.055 0.055 0.055 0.055
11.0 A 0.113 0.113 0.113 0.113 0.113 0.113 0.113 0.113 0.113 0.113 0.113 0.113
15.0 A 0.109 0.109 0.109 0.109 0.109 0.109 0.109 0.109 0.109 0.109 0.109 0.109
20.0 A 0.107 0.107 0.107 0.107 0.107 0.107 0.107 0.107 0.107 0.107 0.107 0.107

Annex E

Uncertainty in the Measurement of AC Current Expressed as % of Value

Current (A) Frequency
0.045 kHz 0.1 kHz 0.2 kHz 0.5 kHz 1 kHz 2 kHz 5 kHz 10 kHz 20 kHz 30 kHz 50 kHz 100 kHz
0.1 0.037 0.037 0.037 0.037 0.045 0.045 0.045 0.045 0.064 0.064 0.12 0.12
0.2 0.023 0.023 0.023 0.023 0.031 0.031 0.031 0.031 0.049 0.049 0.11 0.11
0.3 0.018 0.018 0.018 0.018 0.026 0.026 0.026 0.026 0.044 0.044 0.10 0.10
0.4 0.016 0.016 0.016 0.016 0.024 0.024 0.024 0.024 0.042 0.042 0.10 0.10
0.5 0.014 0.014 0.014 0.014 0.022 0.022 0.022 0.022 0.041 0.041 0.098 0.098
0.6 0.013 0.013 0.013 0.013 0.021 0.021 0.021 0.021 0.040 0.040 0.097 0.097
0.7 0.012 0.012 0.012 0.012 0.021 0.021 0.021 0.021 0.039 0.039 0.096 0.096
0.8 0.012 0.012 0.012 0.012 0.020 0.020 0.020 0.020 0.038 0.038 0.096 0.096
0.9 0.012 0.012 0.012 0.012 0.020 0.020 0.020 0.020 0.038 0.038 0.096 0.096
1 0.011 0.011 0.011 0.011 0.019 0.019 0.019 0.019 0.038 0.038 0.095 0.095
1.1 0.011 0.011 0.011 0.011 0.019 0.019 0.019 0.019 0.037 0.037 0.095 0.095
Current (A) Frequency
0.045 kHz 0.1 kHz 0.2 kHz 0.5 kHz 1 kHz 2 kHz 5 kHz 10 kHz 20 kHz 30 kHz 50 kHz 100 kHz
1 0.037 0.037 0.037 0.037 0.045 0.045 0.046 0.046 0.064 0.064 0.12 0.12
2 0.023 0.023 0.023 0.023 0.031 0.031 0.031 0.031 0.050 0.050 0.11 0.11
3 0.018 0.018 0.018 0.018 0.026 0.026 0.026 0.027 0.045 0.045 0.10 0.10
4 0.016 0.016 0.016 0.016 0.024 0.024 0.024 0.024 0.043 0.043 0.10 0.10
5 0.014 0.014 0.014 0.014 0.022 0.022 0.023 0.023 0.041 0.041 0.099 0.099
6 0.013 0.013 0.013 0.013 0.021 0.021 0.022 0.022 0.040 0.040 0.098 0.098
7 0.013 0.013 0.013 0.013 0.021 0.021 0.021 0.021 0.040 0.040 0.097 0.097
8 0.012 0.012 0.012 0.012 0.020 0.020 0.020 0.021 0.039 0.039 0.096 0.097
9 0.012 0.012 0.012 0.012 0.020 0.020 0.020 0.020 0.039 0.039 0.096 0.096
10 0.012 0.012 0.012 0.012 0.019 0.019 0.019 0.020 0.038 0.038 0.096 0.096
11 0.011 0.011 0.011 0.011 0.019 0.019 0.019 0.020 0.038 0.038 0.095 0.096

Annex F

Uncertainty in the Measurement of AC Current Expressed as % of Value

Current (A) Frequency
0.045 kHz 0.1 kHz 0.2 kHz 0.5 kHz 1 kHz 2 kHz 5 kHz 10 kHz 20 kHz 30 kHz
0.1 0.037 0.037 0.037 0.037 0.045 0.045 0.045 0.045 0.064 0.064
0.2 0.023 0.023 0.023 0.023 0.031 0.031 0.031 0.031 0.049 0.049
0.3 0.018 0.018 0.018 0.018 0.026 0.026 0.026 0.026 0.044 0.044
0.33 0.017 0.017 0.017 0.017 0.025 0.025 0.025 0.025 0.043 0.043
0.4 0.016 0.016 0.016 0.016 0.024 0.024 0.024 0.024 n/a n/a
0.5 0.014 0.014 0.014 0.014 0.022 0.022 0.022 0.022 n/a n/a
0.6 0.013 0.013 0.013 0.013 0.021 0.021 0.021 0.021 n/a n/a
0.7 0.012 0.012 0.012 0.012 0.021 0.021 0.021 0.021 n/a n/a
0.8 0.012 0.012 0.012 0.012 0.020 0.020 0.020 0.020 n/a n/a
0.9 0.012 0.012 0.012 0.012 0.020 0.020 0.020 0.020 n/a n/a
1 0.011 0.011 0.011 0.011 0.019 0.019 0.019 0.019 n/a n/a
1.1 0.011 0.011 0.011 0.011 0.019 0.019 0.019 0.019 n/a n/a
Current (A) Frequency
0.045 kHz 0.1 kHz 0.2 kHz 0.5 kHz 1 kHz 2 kHz 5 kHz 10 kHz
1 0.037 0.037 0.037 0.037 0.045 0.045 0.046 0.046
2 0.023 0.023 0.023 0.023 0.031 0.031 0.031 0.031
3 0.018 0.018 0.018 0.018 0.026 0.026 0.026 0.027
4 0.016 0.016 0.016 0.016 0.024 0.024 0.024 n/a
5 0.014 0.014 0.014 0.014 0.022 0.022 0.023 n/a
6 0.013 0.013 0.013 0.013 0.021 0.021 0.022 n/a
7 0.013 0.013 0.013 0.013 0.021 0.021 0.021 n/a
8 0.012 0.012 0.012 0.012 0.020 0.020 0.020 n/a
9 0.012 0.012 0.012 0.012 0.020 0.020 0.020 n/a
10 0.012 0.012 0.012 0.012 0.019 0.019 0.019 n/a
11 0.011 0.011 0.011 0.011 0.019 0.019 0.019 n/a
 
Top of page

Annex G

Uncertainty in the Measurement of AC Current Expressed as % of Value.  Current from 100 A to 1500 A applies to both source and measure.  Current from 1500 A to 2000 A applies to measure only.

Current (A) Frequency 60 Hz
100 0.15
120 0.14
140 0.13
160 0.12
180 0.12
200 0.12
220 0.11
240 0.11
260 0.11
280 0.11
300 0.25
320 0.24
340 0.23
360 0.21
380 0.21
400 0.20
420 0.19
440 0.19
460 0.18
480 0.18
500 0.17
520 0.16
540 0.16
560 0.16
580 0.15
600 0.15
620 0.14
640 0.14
660 0.14
680 0.14
700 0.14
720 0.13
740 0.13
760 0.13
780 0.13
800 0.13
820 0.12
840 0.12
860 0.12
880 0.12
900 0.12
920 0.12
940 0.12
960 0.11
980 0.11
1000 0.11
1020 0.11
1040 0.11
1060 0.11
1080 0.11
1100 0.11
1120 0.11
1140 0.10
1160 0.10
1180 0.10
1200 0.10
1220 0.10
1240 0.10
1260 0.10
1280 0.10
1300 0.099
1320 0.099
1340 0.098
1360 0.098
1380 0.097
1400 0.097
1420 0.096
1440 0.095
1460 0.095
1480 0.094
1500 0.094
1520 0.094
1540 0.093
1560 0.093
1580 0.092
1600 0.092
1620 0.092
1640 0.091
1660 0.091
1680 0.090
1700 0.090
1720 0.090
1740 0.089
1760 0.089
1780 0.089
1800 0.089
1820 0.088
1840 0.088
1860 0.088
1880 0.088
1900 0.087
1920 0.087
1940 0.087
1960 0.087
1980 0.086
2000 0.086
 
Top of page

Annex H

Current (A) Uncertainty
% of Value
0.1 0.0089
0.2 0.0049
0.3 0.0037
0.4 0.0033
0.5 0.0030
0.6 0.0029
0.7 0.0028
0.8 0.0027
0.9 0.0027
1.0 0.0027
1.1 0.0026
Current (A) Uncertainty
% of Value
1 0.009
2 0.006
3 0.005
4 0.004
5 0.004
6 0.004
7 0.004
8 0.004
9 0.004
10 0.004
11 0.004
Current (A) Uncertainty
% of Value
100 0.052
110 0.050
120 0.047
130 0.045
140 0.044
150 0.043
160 0.041
170 0.040
180 0.039
190 0.039
200 0.038
210 0.037
220 0.037
230 0.036
240 0.036
250 0.035
260 0.035
270 0.034
280 0.034
290 0.033
300 0.033
310 0.033
320 0.033
330 0.032
340 0.032
350 0.031
360 0.031
370 0.031
380 0.030
390 0.030
400 0.030
410 0.029
420 0.029
430 0.029
440 0.029
450 0.028
460 0.028
470 0.028
480 0.027
490 0.027
500 0.027
510 0.027
520 0.027
530 0.027
540 0.027
550 0.027
560 0.026
570 0.026
580 0.026
590 0.026
600 0.026
610 0.026
620 0.026
630 0.026
640 0.026
650 0.026
660 0.026
670 0.026
680 0.026
690 0.026
700 0.026
710 0.026
720 0.026
730 0.026
740 0.026
750 0.026
760 0.026
770 0.026
780 0.026
790 0.026
800 0.026
810 0.026
820 0.026
830 0.026
840 0.026
850 0.026
860 0.026
870 0.026
880 0.026
890 0.026
900 0.026
910 0.026
920 0.026
930 0.026
940 0.026
950 0.026
960 0.026
970 0.026
980 0.026
990 0.026
1000 0.026

Annex I

Uncertainty in the Measurement of Capacitance Expressed as % of Value

Capacitance Frequency
0.05 kHz 0.1 kHz 0.2 kHz 0.4 kHz 0.6 kHz 0.8 kHz 1 kHz 2 kHz 4 kHz 6 kHz 8 kHz 10 kHz
10 pF 0.070 0.027 0.025 0.020 0.017 0.015 0.015 0.015 0.021 0.031 0.042 0.053
20 pF 13 6.4 3.2 1.1 0.71 0.54 0.21 0.32 0.38 0.22 0.32 0.22
30 pF 7.5 3.7 1.9 0.62 0.42 0.31 0.13 0.19 0.22 0.12 0.15 0.084
60 pF 2.1 1.1 0.54 0.18 0.12 0.090 0.037 0.054 0.064 0.032 0.042 0.053
80 pF 0.80 0.40 0.20 0.069 0.046 0.035 0.018 0.023 0.029 0.031 0.042 0.053
100 pF 0.029 0.027 0.024 0.020 0.016 0.015 0.017 0.015 0.021 0.031 0.042 0.053
200 pF 2.2 1.1 0.58 0.21 0.13 0.093 0.047 0.026 0.029 0.037 0.046 0.056
300 pF 1.3 0.67 0.35 0.13 0.081 0.054 0.032 0.025 0.029 0.036 0.046 0.056
600 pF 0.39 0.21 0.12 0.056 0.031 0.025 0.025 0.025 0.029 0.036 0.046 0.056
800 pF 0.16 0.095 0.061 0.038 0.026 0.025 0.025 0.025 0.029 0.036 0.046 0.056
1 nF 0.034 0.033 0.032 0.029 0.027 0.025 0.025 0.025 0.029 0.036 0.046 0.056
2 nF 0.14 0.064 0.040 0.032 0.026 0.022 0.020 0.022 0.034 0.050 0.068 0.087
3 nF 0.088 0.048 0.040 0.032 0.026 0.022 0.020 0.022 0.034 0.050 0.068 0.087
6 nF 0.050 0.044 0.040 0.032 0.026 0.022 0.020 0.022 0.033 0.050 0.068 0.087
8 nF 0.046 0.044 0.040 0.032 0.026 0.022 0.020 0.022 0.033 0.050 0.068 0.087
10 nF 0.046 0.044 0.040 0.032 0.026 0.022 0.020 0.022 0.033 0.050 0.068 0.087
20 nF 0.056 0.054 0.049 0.039 0.031 0.025 0.023 0.025 0.041 0.062 0.084 0.11
30 nF 0.056 0.054 0.049 0.039 0.031 0.025 0.023 0.025 0.041 0.062 0.084 0.11
60 nF 0.056 0.054 0.049 0.039 0.031 0.025 0.023 0.025 0.041 0.062 0.084 0.11
80 nF 0.056 0.054 0.049 0.039 0.031 0.025 0.023 0.025 0.041 0.062 0.084 0.11
100 nF 0.056 0.054 0.049 0.039 0.031 0.025 0.023 0.025 0.041 0.062 0.084 0.11
200 nF 0.056 0.054 0.049 0.039 0.031 0.025 0.023 0.025 0.041 0.062 0.084 0.11
300 nF 0.056 0.054 0.049 0.039 0.031 0.025 0.023 0.025 0.041 0.062 0.084 0.11
600 nF 0.056 0.054 0.049 0.039 0.031 0.025 0.023 0.025 0.041 0.062 0.084 0.11
800 nF 0.056 0.054 0.049 0.039 0.031 0.025 0.023 0.025 0.041 0.062 0.084 0.11
1 µF 0.056 0.054 0.049 0.039 0.031 0.025 0.023 0.025 0.041 0.062 0.084 0.11
2 µF 0.064 0.063 0.061 0.051 0.048 0.046 0.034 0.046 0.072 0.098 0.16 0.20
3 µF 0.064 0.063 0.061 0.051 0.048 0.046 0.034 0.046 0.073 0.098 0.16 0.20
6 µF 0.064 0.063 0.061 0.051 0.048 0.046 0.034 0.046 0.073 0.10 0.17 0.21
8 µF 0.064 0.063 0.061 0.051 0.048 0.046 0.034 0.046 0.074 0.10 0.17 0.20
10 µF 0.064 0.063 0.061 0.051 0.048 0.046 0.034 0.046 0.073 0.098 0.16 0.20
20 µF 0.10 0.10 0.10 0.096 0.11 0.12 0.072 0.24 0.67 0.99 1.7 2.2
30 µF 0.10 0.10 0.10 0.096 0.11 0.12 0.073 0.24 0.67 0.99 1.8 2.2
60 µF 0.10 0.10 0.10 0.096 0.11 0.12 0.076 0.25 0.68 1.0 1.8 2.3
80 µF 0.10 0.10 0.10 0.097 0.11 0.12 0.074 0.24 0.67 N/A N/A N/A
100 µF 0.10 0.10 0.10 0.096 0.11 0.12 0.072 0.24 0.66 N/A N/A N/A
 
Top of page

Annex J

Uncertainty in the Measurement of DC Current Expressed as % of Value

Current Range (A) % of Full Scale
10 % 20 % 30 % 40 % 50 % 60 % 70 % 80 % 90 % 100 %
10 pA to 100 pA 0.13 0.095 0.091 0.092 0.089 0.088 0.094 0.094 0.093 0.093
0.1 nA to 1 nA 0.060 0.061 0.060 0.060 0.060 0.060 0.060 0.060 0.060 0.060
1 nA to 10 nA 0.033 0.031 0.031 0.031 0.031 0.031 0.031 0.031 0.031 0.031
10 nA to 100 nA 0.032 0.031 0.031 0.031 0.031 0.031 0.031 0.031 0.031 0.031
0.1 µA to 1 µA 0.028 0.024 0.023 0.023 0.023 0.023 0.022 0.022 0.022 0.022
1 µA to 10 µA 0.024 0.020 0.020 0.019 0.019 0.019 0.019 0.019 0.019 0.019
10 µA to 100 µA 0.023 0.019 0.019 0.019 0.018 0.018 0.018 0.018 0.018 0.018

Annex K

Uncertainty in the Measurement of DC Current Expressed as % of Value

Current Range (A) % of Full Scale
10 % 20 % 30 % 40 % 50 % 60 % 70 % 80 % 90 % 100 %
10 pA to 100 pA 0.18 0.13 0.12 0.12 0.12 0.12 0.12 0.12 0.12 0.12
0.1 nA to 1 nA 0.088 0.093 0.093 0.092 0.092 0.092 0.092 0.092 0.092 0.092
1 nA to 10 nA 0.045 0.045 0.044 0.044 0.048 0.047 0.047 0.047 0.047 0.047
10 nA to 100 nA 0.045 0.045 0.045 0.044 0.044 0.044 0.048 0.048 0.048 0.048
0.1 µA to 1 µA 0.031 0.028 0.028 0.027 0.027 0.028 0.028 0.028 0.028 0.027
1 µA to 10 µA 0.026 0.023 0.023 0.023 0.023 0.023 0.023 0.023 0.023 0.022
10 µA to 100 µA 0.025 0.023 0.023 0.022 0.022 0.022 0.022 0.022 0.022 0.022

Note: Uncertainties may be linearly interpolated between points.

Annex L

Calibration Measurement Capability in the Calibration of Digital Multimeters and AC Voltage Measuring Devices, expressed as ± {(% of reading) +  residual}

Voltage, AC Frequency
10 Hz to
2 kHz		 2 kHz to
10 kHz		 10 kHz to
30 kHz		 30 kHz to
100 kHz		 100 kHz to
300 kHz		 300 kHz to
500 kHz
1 mV to 10 mV 0.025 % + 1.1 μV 0.033 % + 1.1 μV 0.034 % + 1.1 μV 0.3 % + 1.1 μV 1 % + 4 μV 2 % + 4 μV
10 mV to 100 mV 0.0068 % + 0.5 μV 0.011 % + 0.5 μV 0.021 % + 1 μV 0.051 % + 5 μV 0.2 % + 30 μV 1 % + 100 μV
0.1 V to 1 V 0.0064 % + 5 μV 0.011 % + 5 μV 0.021 % + 10 μV 0.051 % + 50 μV 0.2 % + 300 μV 1 % + 1 mV
1 V to 3.3 V 0.0064 % + 50 μV 0.011 % + 50 μV 0.021 % + 100 μV 0.051 % + 500 μV 0.2 % + 3 mV 1 % + 10 mV
3.3 V to 10 V 0.0064 % + 50 μV 0.011 % + 50 μV 0.021 % + 100 μV 0.051 % + 500 μV n/a n/a
10 V to 33 V 0.007 % + 500 μV 0.009 % + 500 μV 0.021 % + 1 mV 0.051 % + 5 mV n/a n/a
Voltage, AC Frequency
45 Hz to
2 kHz		 2 kHz to
10 kHz		 10 kHz to
30 kHz		 30 kHz to
100 kHz
33 V to 100 V 0.007 % +500 μV 0.009 % + 500 μV 0.021 % + 1 mV 0.051 % + 5 mV
100 V to 330 V 0.009 % +25 mV 0.009 % + 25 mV 0.021 % + 25 mV 0.051 % + 100 mV
330 V to 1020 V 0.009 % +25 mV 0.009 % + 25 mV n/a n/a
 
Top of page

From: National Research Council Canada

 
 
Date modified: