Company name | Miller Instruments Ltd. |
---|---|
Company address | #1 – 3871 North Fraser Way Burnaby, British Columbia V5J 5G6 |
Contact | Laurie Dubovik, President Telephone: (604) 431-8882 Email: laurie@miller.bc.ca |
Clients served |
|
Fields of calibration | |
Accreditation body |
|
ISO/IEC 17025 |
|
This CLAS Certificate is published by the CLAS service of the National Research Council of Canada (NRC) in cooperation with the laboratory accreditation program of the accreditation body.
The accreditation body recognizes the capability of the named laboratory for being able to perform calibrations as per the listed Calibration and Measurement Capabilities with metrological traceability to the International System of Units (SI) or to standards acceptable to CLAS.
See supplementary notes.
Electrical
Measured Quantity & Range or Instrument | Frequency | Expanded Measurement Uncertainty |
Type | Remarks |
---|---|---|---|---|
Current, AC | ||||
100 μA to 1000 μA | 45 Hz to 10 kHz | 0.26 % to 0.05 % | II |
For the calibration of ac current sources and measurement devices. Both the measure and generate capabilities are monitored using a digital multimeter. See Annex A for details. |
1 mA to 10 mA | 45 Hz to 10 kHz | 0.26 % to 0.05 % | ||
10 mA to 100 mA | 45 Hz to 10 kHz | 0.26 % to 0.05 % | ||
100 mA to 1 A | 45 Hz to 5 kHz | 0.3 % to 0.1 % | ||
1 A to 2 A | 45 Hz to 100 Hz | 0.09 % | II | Both the measure and generate capabilities are monitored with a digital multimeter using resistance shunts. |
2 A to 3 A | 45 Hz to 100 Hz | 0.06 % | ||
3 A to 5 A | 45 Hz to 100 Hz | 0.05 % | ||
5 A to 100 A | 45 Hz to 100 Hz | 0.04 % | ||
100 mA to 1.1 A | 45 Hz to 100 kHz | 0.011 % to 0.12 % | II |
Measure: For the calibration of AC current source devices using a reference current shunt and a digital multimeter. See Annex E for details. |
1 A to 11 A | 45 Hz to 100 kHz | 0.011 % to 0.13 % | ||
100 mA to 0.33 A | 45 Hz to 30 kHz | 0.017 % to 0.064 % | II |
Source: For the calibration of AC current measurement devices using a reference current shunt and a digital multimeter. See Annex F for details. |
0.33 A to 1.1 A | 45 Hz to 10 kHz | 0.011 % to 0.025 % | ||
1 A to 3 A | 45 Hz to 10 kHz | 0.018 % to 0.046 % | ||
3 A to 11 A | 45 Hz to 5 kHz | 0.011 % to 0.026 % | ||
100 A to 2000 A | 60 Hz | 0.086 % to 0.25 % | II | Measure: For the calibration of AC current source devices using a reference current transducer and a digital multimeter. See Annex G for details. |
100 A to 1500 A | 60 Hz | 0.086 % to 0.25 % | II | Source: For the calibration of AC current measurement devices using a reference current transducer and a digital multimeter. See Annex G for details. |
Measured Quantity & Range or Instrument Frequency | Expanded Measurement Uncertainty | Type | Remarks |
---|---|---|---|
Current, DC | |||
10 pA to 100 μA | 0.13 % to 0.018 % | II | Source: For the calibration of DC current measuring devices using a DC voltage source, resistors and an electrometer. See Annex J for details. |
10 pA to 100 μA | 0.18 % to 0.022 % | II | Measure: For the calibration of DC current source devices using a DC voltage source, resistors and an electrometer. See Annex K for details. |
1 μA to 10 μA | 0.002 % + 0.1 nA | II | For the calibration of dc current sources and measurement devices. Both the measure and generate capabilities are monitored using a digital multimeter. |
10 μA to 100 μA | 0.002 % + 0.8 nA | ||
100 μA to 1 mA | 0.002 % + 5 nA | ||
1 mA to 10 mA | 0.002 % + 50 nA | ||
10 mA to 100 mA | 0.0035 % + 500 nA | ||
100 mA to 1 A | 0.011 % + 10 μA | ||
1 A to 100 A | 0.03 % | II | For the calibration of dc current sources and measurement devices. Both the measure and generate capabilities are monitored with a digital multimeter using resistance shunts. |
100 mA to 1.1 A | 0.0026 % to 0.0089 % | II | Measure and Source: For the calibration of DC current source devices and DC current measurement devices using a reference current shunt and a digital multimeter. See Annex H for details. |
1 A to 11 A | 0.004 % to 0.09 % | II | Measure and Source: For the calibration of DC current source devices and DC current measurement devices using a reference current shunt and a digital multimeter. See Annex H for details. |
100 A to 1000 A | 0.026 % to 0.052 % | II | Measure and Source: For the calibration of DC current source devices and DC current measurement devices using a reference current transducer and a digital multimeter. See Annex H for details. |
Measured Quantity & Range or Instrument | Frequency | Expanded Measurement Uncertainty | Type | Remarks |
---|---|---|---|---|
Power, AC At power factor ranging from 1 to 0.5 leading and lagging. |
||||
12 W to 10.08 kW | ||||
Voltage range: 120 V to 480 V Current range: 0.2 A to 21 A |
60 Hz | 0.018 % of reading | II | For the calibration of sinusoidal power measurement devices and the ac power function of multifunction calibrators by comparison to a reference wattmeter. This service applies to both leading and lagging power factor (PF). Measure and generate. |
48 W to 12.6 kW | ||||
Voltage range: 480 V to 600 V Current range: 0.2 A to 21 A |
60 Hz | 0.018 % to 0.024 % of reading | II | For the calibration of sinusoidal power measurement devices and the ac power function of multifunction calibrators by comparison to a reference wattmeter. This service applies to both leading and lagging power factor (PF). Measure and generate. The uncertainty increases linearly with voltage. |
Measured Quantity & Range or Instrument Frequency | Expanded Measurement Uncertainty | Type | Remarks |
---|---|---|---|
Power, DC | |||
0.1 mW to 330 W | |||
Current range: 0.33 mA to 330 mA Voltage range: 0.33 V to 1000 V |
0.017 % to 0.028 % of reading | II | Generate for the calibration of DC power measurement devices using a multi-function calibrator for the independent generation of current and voltage. See Annex D for details. |
0.1 W to 3000 W | |||
Current range: 330 mA to 3 A Voltage range: 0.33 V to 1000 V |
0.026 % to 0.041 % of reading | II | Generate for the calibration of DC power measurement devices using a multi-function calibrator for the independent generation of current and voltage. See Annex D for details. |
1 W to 11 kW | |||
Current range: 3 A to 11 A Voltage range: 0.33 V to 1000 V |
0.055 % to 0.067 % of reading | II | Generate for the calibration of DC power measurement devices using a multi-function calibrator for the independent generation of current and voltage. See Annex D for details. |
3.6 W to 20.5 kW | |||
Current range: 11 A to 20.5 A Voltage range: 0.33 V to 1000 V |
0.11 % of reading | II | Generate for the calibration of DC power measurement devices using a multi-function calibrator for the independent generation of current and voltage. See Annex D for details. |
Measured Quantity & Range or Instrument | Expanded Measurement Uncertainty | Type | Remarks |
---|---|---|---|
Resistance, DC | |||
10 Ω to 500 Ω | 1 μΩ/Ω | II | For the calibration of resistors and the resistance of temperature probes such as SPRTs and PRTs at the triple point of water using a resistance bridge. |
10 μΩ to 100 μΩ | 390 μΩ/Ω to 200 μΩ/Ω | II | For the calibration of resistors and resistance measuring devices in air at 23 °C using standard resistors, a nanovolt meter, and a constant current source. |
0.1 mΩ to 1 mΩ | 210 μΩ/Ω to 190 μΩ/Ω | ||
1 mΩ to 10 mΩ | 210 μΩ/Ω to 150 μΩ/Ω | ||
10 mΩ to 100 mΩ | 350 μΩ/Ω to 98 μΩ/Ω | ||
0.1 Ω to 1 Ω | 96 μΩ/Ω to 87 μΩ/Ω | ||
1 Ω to 10 Ω | (19 μΩ/Ω + 50 μΩ) | II | For the calibration of resistors and resistance measuring devices in air at 23 °C using a multifunction calibrator that is dynamically monitored by a digital multimeter. |
10 Ω to 100 Ω | (16 μΩ/Ω + 0.5 mΩ) | ||
100 Ω to 1 kΩ | (14 μΩ/Ω + 0.5 mΩ) | ||
1 kΩ to 10 kΩ | (14 μΩ/Ω + 5 mΩ) | ||
10 kΩ to 100 kΩ | (14 μΩ/Ω + 50 mΩ) | ||
100 kΩ to 1 MΩ | (19 μΩ/Ω + 2 Ω) | ||
1 MΩ to 10 MΩ | (54 μΩ/Ω + 100 Ω) | ||
10 MΩ to 100 MΩ | (500 μΩ/Ω + 1 kΩ) | ||
100 MΩ to 330 MΩ | (0.5 % + 10 kΩ) | ||
330 MΩ to 1GΩ | (0.5 % + 10 kΩ) | II | For the measurement of resistance in air at 23 °C using a digital multimeter. |
100 MΩ to 10 GΩ | 0.015 % | II | For the calibration of resistors and resistance measuring devices using reference standard resistors and a high value resistance bridge that consists of two programmable DC voltage sources and an electrometer. |
10 GΩ 4to 100 GΩ | 0.015 % to 0.14 % | ||
100 GΩ to 1 TΩ | 0.14 % | ||
1 TΩ to 10 TΩ | 0.14 % to 0.5 % |
Measured Quantity & Range or Instrument | Frequency | Expanded Measurement Uncertainty | Type | Remarks |
---|---|---|---|---|
Resistance, AC | ||||
1 Ω to 100 kΩ | 50 Hz to 10 kHz | 0.04 % to 0.2 % of value | II | Measure and Source For the calibration of AC resistors or AC resistance measurement devices using standard AC resistors and an LCR meter. See Annex C for details. |
1 Ω | 60 Hz, 1 kHz & 10 kHz | 0.09 % to 0.2 % | II | Measure and Source For the calibration of 1 Ω, 10 Ω, 100 Ω, 1 kΩ and 10 kΩ AC resistors by substitution method using an LCR meter. GenRad 1689 LCR meter and standard resistors (1 Ω, 10 Ω, 100 Ω, 1 kΩ and 10 kΩ). See Annex C for details. |
10 Ω | 60 Hz, 1 kHz & 10 kHz | 0.04 % to 0.08 % | ||
100 Ω | 60 Hz, 1 kHz & 10 kHz | 0.04 % to 0.07 % | ||
1 KΩ | 60 Hz, 1 kHz & 10 kHz | 0.04 % to 0.07 % | ||
10 KΩ | 60 Hz, 1 kHz & 10 kHz | 0.04 % to 0.07 % |
Measured Quantity & Range or Instrument | Frequency | Expanded Measurement Uncertainty | Type | Remarks |
---|---|---|---|---|
Voltage, AC | ||||
1 mV to 10 mV | 10 Hz to 1 MHz | 2.4 % to 0.04 % | II |
For the calibration of ac voltage sources. |
10 mV to 100 mV | 10 Hz to 1 MHz | 2.0 % to 0.008 % | ||
0.1 V to 1 V | 10 Hz to 1 MHz | 1.5 % to 0.007 % | ||
1 V to 10 V | 10 Hz to 1 MHz | 1.5 % to 0.007 % | ||
10 V to 100 V | 10 Hz to 1 MHz | 3.5 % to 0.008 % | ||
100 V to 1050 V | 10 Hz to 100 kHz | 0.13 % to 0.012 % | ||
1 mV to 10 mV | 10 Hz to 500 kHz | 2.4 % to 0.04 % | II |
For the calibration of ac measurement devices. |
10 mV to 100 mV | 10 Hz to 500 kHz | 2.0 % to 0.008 % | ||
0.1 V to 1 V | 10 Hz to 500 kHz | 1.5 % to 0.007 % | ||
1 V to 3.3 V | 10 Hz to 500 kHz | 1.8 % to 0.008 % | ||
3.3 V to 10 V | 10 Hz to 100 kHz | 1.3 % to 0.007 % | ||
10 V to 33 V | 10 Hz to 100 kHz | 0.1 % to 0.009 % | ||
33 V to 100 V | 45 Hz to 100 kHz | 0.07 % to 0.008 % | ||
100 V to 330 V | 45 Hz to 100 kHz | 0.13 % to 0.017 % | ||
330 V to 1020 V | 45 Hz to 10 kHz | 0.08 % to 0.012 % | ||
1 kV to 10 kV | 50 Hz to 60 Hz | 0.38 % | II | Measure: For the calibration of voltage sources and voltage measuring devices using high voltage divider and digital multimeter.
This service is also available on-site. |
1 kV to 10 kV | 50 Hz to 60 Hz | 0.38 % | II | Source: For the calibration of voltage sources and voltage measuring devices using high voltage divider and digital multimeter. |
10 kV to 85 kV | 60 Hz | 0.38 % | II | Measure: For the calibration of voltage sources using high voltage divider and digital multimeter.
This service is also available on-site. |
Measured Quantity & Range or Instrument | Expanded Measurement Uncertainty | Type | Remarks |
---|---|---|---|
Voltage, DC | |||
1 mV to 100 mV | (9 μV/V + 1 μV) | II | For the calibration of voltage sources and voltage measuring devices using a multifunction calibrator that is monitored with a digital multimeter. |
0.1 V to 1 V | (8 μV/V + 1 μV) | ||
1 V to 10 V | (8 μV/V + 2 μV) | ||
10 V to 100 V | (10 μV/V + 30 μV) | ||
100 V to 1000 V | (10 μV/V + 100 μV) | ||
1 kV to 120 kV | 0.02 % | II | Measure: For the calibration of voltage sources using high voltage divider and digital multimeter.
This service is also available on-site. |
1 kV to 70 kV | 0.02 % | II | Source: For the calibration of voltage measuring devices using high voltage divider and digital multimeter. |
Measured Quantity & Range or Instrument | Frequency | Expanded Measurement Uncertainty | Type | Remarks |
---|---|---|---|---|
Capacitance | ||||
10 pF | 1 kHz | 0.025 % | II | For the calibration of capacitors and capacitance measuring devices of the same nominal value by comparison to reference standard capacitors using a substitution method. |
100 pF | 1 kHz | 0.006 % | ||
1000 pF | 1 kHz | 0.006 % | ||
0.01 μF | 1 kHz | 0.015 % | ||
0.1 μF | 1 kHz | 0.015 % | ||
1 μF | 1 kHz | 0.017 % | ||
100 μF to 110 mF | DC | 0.025 % of value | II | Measurement using a constant current and DMM. Suitable for the calibration of capacitors, capacitance measuring devices, and the capacitance function of multifunction calibrators such as a Fluke 5520A. |
10 pF to 65 μF | 50 Hz to 10 kHz | 0.015 % to 13 % | II | For the calibration of capacitors and capacitance measuring devices using an LCR meter. See Annex I for details. |
65 μF to 100 μF | 50 Hz to 5 kHz | 0.072 % to 2.3 % |
Electrical Calibration by Simulation
Measured Quantity & Range or Instrument | Expanded Measurement Uncertainty | Type | Remarks |
---|---|---|---|
Conductivity | |||
1 μS/cm to 100 mS/cm | 0.07 % | II | By electrical simulation using resistance reference standards without realization or measurement of conductivity |
pH meters | |||
0 pH to 14 pH | 0.01 pH | II | For the calibration of pH meters by electrical simulation without realization or measurement of pH |
pH simulators | |||
0 mV to 100 mV | 0.01 mV | II | For the calibration of pH simulators by electrical simulation without realization or measurement of pH |
100 mV to 415 mV | 0.02 mV |
Electrical Calibration of Temperature Indicators and Sources
Measured Quantity & Range or Instrument | Expanded Measurement Uncertainty | Type | Remarks |
---|---|---|---|
Thermocouple simulation | |||
Type E | |||
-250 °C to -100 °C | 0.44 °C | II |
By electrical simulation using a multifunction calibrator without realisation or measurement of physical temperatures. Temperature sensors are not calibrated. The International Temperature Scale of 1990 (ITS-90) is used to express temperature values. Standard reference functions published in NIST Monograph 175:1993 and ASTM E230-98 are used to convert voltage or resistance signals to units of simulated temperature. Results are reported in simulated degrees Celsius or the equivalent on the Fahrenheit scale. |
-100 °C to -25 °C | 0.14 °C | ||
-25 °C to 350 °C | 0.12 °C | ||
350 °C to 650 °C | 0.14 °C | ||
650 °C to 1000 °C | 0.19 °C | ||
Type J | |||
-210 °C to -100 °C | 0.25 °C | II |
By electrical simulation using a multifunction calibrator without realisation or measurement of physical temperatures. Temperature sensors are not calibrated. The International Temperature Scale of 1990 (ITS-90) is used to express temperature values. Standard reference functions published in NIST Monograph 175:1993 and ASTM E230-98 are used to convert voltage or resistance signals to units of simulated temperature. Results are reported in simulated degrees Celsius or the equivalent on the Fahrenheit scale. |
-100 °C to -30 °C | 0.14 °C | ||
-30 °C to 150 °C | 0.12 °C | ||
150 °C to 760 °C | 0.15 °C | ||
760 °C to 1200 °C | 0.21 °C | ||
Type K | |||
-200 °C to -100 °C | 0.31 °C | II |
By electrical simulation using a multifunction calibrator without realisation or measurement of physical temperatures. Temperature sensors are not calibrated. The International Temperature Scale of 1990 (ITS-90) is used to express temperature values. Standard reference functions published in NIST Monograph 175:1993 and ASTM E230-98 are used to convert voltage or resistance signals to units of simulated temperature. Results are reported in simulated degrees Celsius or the equivalent on the Fahrenheit scale. |
-100 °C to -25 °C | 0.18 °C | ||
-25 °C to 120 °C | 0.15 °C | ||
120 °C to 1000 °C | 0.23 °C | ||
1000 °C to 1372 °C | 0.35 °C | ||
Type N | |||
-200 °C to -100 °C | 0.35 °C | II |
By electrical simulation using a multifunction calibrator without realisation or measurement of physical temperatures. Temperature sensors are not calibrated. The International Temperature Scale of 1990 (ITS-90) is used to express temperature values. Standard reference functions published in NIST Monograph 175:1993 and ASTM E230-98 are used to convert voltage or resistance signals to units of simulated temperature. Results are reported in simulated degrees Celsius or the equivalent on the Fahrenheit scale. |
-100 °C to -25 °C | 0.20 °C | ||
-25 °C to 120 °C | 0.18 °C | ||
120 °C to 410 °C | 0.17 °C | ||
410 °C to 1300 °C | 0.25 °C | ||
Type R | |||
0 °C to 250 °C | 0.58 °C | II |
By electrical simulation using a multifunction calibrator without realisation or measurement of physical temperatures. Temperature sensors are not calibrated. The International Temperature Scale of 1990 (ITS-90) is used to express temperature values. Standard reference functions published in NIST Monograph 175:1993 and ASTM E230-98 are used to convert voltage or resistance signals to units of simulated temperature. Results are reported in simulated degrees Celsius or the equivalent on the Fahrenheit scale. |
250 °C to 400 °C | 0.37 °C | ||
400 °C to 1000 °C | 0.35 °C | ||
1000 °C to 1760 °C | 0.38 °C | ||
Type S | |||
0 °C to 250 °C | 0.56 °C | II |
By electrical simulation using a multifunction calibrator without realisation or measurement of physical temperatures. Temperature sensors are not calibrated. The International Temperature Scale of 1990 (ITS-90) is used to express temperature values. Standard reference functions published in NIST Monograph 175:1993 and ASTM E230-98 are used to convert voltage or resistance signals to units of simulated temperature. Results are reported in simulated degrees Celsius or the equivalent on the Fahrenheit scale. |
250 °C to 1000 °C | 0.38 °C | ||
1000 °C to 1400 °C | 0.37 °C | ||
1400 °C to 1760 °C | 0.42 °C | ||
Type T | |||
-250 °C to -150 °C | 0.55 °C | II |
By electrical simulation using a multifunction calibrator without realisation or measurement of physical temperatures. Temperature sensors are not calibrated. The International Temperature Scale of 1990 (ITS-90) is used to express temperature values. Standard reference functions published in NIST Monograph 175:1993 and ASTM E230-98 are used to convert voltage or resistance signals to units of simulated temperature. Results are reported in simulated degrees Celsius or the equivalent on the Fahrenheit scale. |
-150 °C to 0 °C | 0.21 °C | ||
0 °C to 120 °C | 0.14 °C | ||
120 °C to 400 °C | 0.12 °C | ||
Resistance Temperature Devices | |||
Pt 385 (100 Ω) | |||
-200 °C to 800 °C | 0.06 °C to 0.27 °C | II |
Indicators only. By electrical simulation using a multifunction calibrator without realisation or measurement of physical temperatures. Temperature sensors are not calibrated. The International Temperature Scale of 1990 (ITS-90) is used to express temperature values. Standard reference functions published in NIST Monograph 175:1993 and ASTM E230-98 are used to convert voltage or resistance signals to units of simulated temperature. Results are reported in simulated degrees Celsius or the equivalent on the Fahrenheit scale. |
Pt 385 (200 Ω) | |||
-190 °C to 630 °C | 0.05 °C to 0.18 °C | II |
Indicators only. By electrical simulation using a multifunction calibrator without realisation or measurement of physical temperatures. Temperature sensors are not calibrated. The International Temperature Scale of 1990 (ITS-90) is used to express temperature values. Standard reference functions published in NIST Monograph 175:1993 and ASTM E230-98 are used to convert voltage or resistance signals to units of simulated temperature. Results are reported in simulated degrees Celsius or the equivalent on the Fahrenheit scale. |
Pt 385 (500 Ω) | |||
-190 °C to 630 °C | 0.05 °C to 0.13 °C | II |
Indicators only. By electrical simulation using a multifunction calibrator without realisation or measurement of physical temperatures. Temperature sensors are not calibrated. The International Temperature Scale of 1990 (ITS-90) is used to express temperature values. Standard reference functions published in NIST Monograph 175:1993 and ASTM E230-98 are used to convert voltage or resistance signals to units of simulated temperature. Results are reported in simulated degrees Celsius or the equivalent on the Fahrenheit scale. |
Pt 385 (1000 Ω) | |||
-190 °C to 630 °C | 0.036 °C to 0.27 °C | II |
Indicators only. By electrical simulation using a multifunction calibrator without realisation or measurement of physical temperatures. Temperature sensors are not calibrated. The International Temperature Scale of 1990 (ITS-90) is used to express temperature values. Standard reference functions published in NIST Monograph 175:1993 and ASTM E230-98 are used to convert voltage or resistance signals to units of simulated temperature. Results are reported in simulated degrees Celsius or the equivalent on the Fahrenheit scale. |
Time and Frequency
Measured Quantity & Range or Instrument | Expanded Measurement Uncertainty | Type | Remarks |
---|---|---|---|
Frequency | |||
10 MHz | 3.3 x 10-10 | I | For the calibration of frequency standards, frequency counters, and frequency measuring devices using a Rubidium frequency standard and a frequency counter. |
1 Hz to 550 MHz | 3.3 x 10-10 | ||
Timers | |||
Timebase error | 0.16 s | II | For the calibration of manually-activated time interval measurement devices, including stopwatches and timers using a frequency counter and a quartz reference standard that is referenced to a Rubidium frequency standard. |
Thermometry
Measured Quantity & Range or Instrument | Expanded Measurement Uncertainty | Type | Remarks |
---|---|---|---|
0.000 °C | 6 mK | II | For the realisation of a reference ice point in accordance with ASTM E563. |
0.000 °C | 7 mK | II | For the calibration of RTD sensors using a reference ice point in accordance with ASTM E563. This service is available on-site. |
Hg Triple Point | 2.0 mK | II | For the calibration of long-stem SPRTs. The uncertainty associated with temperatures between the fixed points is obtained by considering the effect of the error propagation associated with the ITS-90 equations. |
H2O Triple Point | 0.5 mK | ||
Ga Melting Point | 2.5 mK | ||
In Freezing Point | 2.0 mK | ||
Sn Freezing Point | 2.3 mK | ||
Zn Freezing Point | 3.7 mK | ||
-95 °C to -40 °C | 0.065 °C | II | For the calibration of RTD sensors and direct reading thermometers, using a liquid bath or dry block and reference SPRT thermometer. |
-40 °C to 0 °C | 0.010 °C | ||
0 °C to 40 °C | 0.010 °C | ||
40 °C to 100 °C | 0.007 °C | ||
100 °C to 200 °C | 0.010 °C | ||
200 °C to 300 °C | 0.017 °C | ||
300 °C to 425 °C | 0.29 °C | ||
425 °C to 650 °C | 0.46 °C | ||
-95 °C to 0 °C | 0.35 °C to 0.20 °C | II | For the calibration of Type E, J, K, N, R, S, and T thermocouples using a liquid bath or dry block and reference PRT thermometer. |
0 °C to 400 °C | 0.2 °C to 0.6 °C | ||
400 °C to 600 °C | 0.6 °C to 1.4 °C | ||
-78 °C to 0 °C | 0.10 °C | II | For the calibration of liquid-in-glass thermometers using a liquid bath and reference PRT thermometer. |
0 °C to 300 °C | 0.05 °C | ||
35 °C to 75 °C | 0.10 °C | II | For on-site service: calibration of direct reading thermometers using a dry block calibrator and reference PRT thermometer. |
75 °C to 150 °C | 0.20 °C | ||
150 °C to 250 °C | 0.40 °C | ||
250 °C to 400 °C | 0.60 °C | ||
-95 °C to -50 °C | 0.052 °C | II | For the calibration of temperature block (i.e., dryblock or drywell) calibrators using a standard PRT thermometer following the guidelines of EA 10/13. |
-50 °C to 155 °C | 0.018 °C | ||
155 °C to 425 °C | 0.06 °C | ||
425 °C to 600 °C | 0.23 °C | ||
Infrared radiation thermometers | |||
35 °C to 500 °C | |||
Emissivity 0.9 to 1.0 with spectral band of 8 to 14 μm | (0.37 °C + 0.0037T) T in°C | II | For the calibration of infrared thermometers using an infrared calibrator. |
95 °F to 932 °F | |||
Emissivity 0.9 to 1.0 with spectral band of 8 to 14 μm | (0.55 °F + 0.0037T) T in°F |
II | For the calibration of infrared thermometers using an infrared calibrator. |
Temperature chambers | |||
-40 °C to 0 °C | 0.24 °C | II | For the characterization of temperature chambers.
This service is also available on-site. |
0 °C to 200 °C | 0.21 °C | ||
200 °C to 250 °C | 0.27 °C | ||
250 °C to 400 °C | 0.9 °C | ||
400 °C to 600 °C | 1.7 °C |
Pressure
Measured Quantity & Range or Instrument | Expanded Measurement Uncertainty | Type | Remarks |
---|---|---|---|
Pneumatic deadweight tester | |||
25 psi to 100 psi | 90 parts per 106 or 0.0028 psi (whichever is greater) |
II | Pneumatic deadweight tester by direct comparison against a high precision reference transducer. |
100 psi to 1000 psi | 87 parts per 106 or 0.05 psi (whichever is greater) |
Pneumatic deadweight tester by cross floating against a reference pneumatic deadweight tester. | |
Hydraulic deadweight tester | |||
87 psi to 810 psi | 92 parts per 106 or 0.025 psi (whichever is greater) |
II | Hydraulic deadweight tester by cross floating against a reference hydraulic deadweight tester. |
810 psi to 16000 psi | 92 parts per 106 or 0.5 psi (whichever is greater) |
Hydraulic deadweight tester by cross floating against a reference hydraulic deadweight tester. | |
Pressure & Vacuum | |||
Absolute mode | |||
0.02 psi to 15 psi | 0.012 % of reading or 0.001 psi (whichever is greater) | II |
For the calibration of pressure measuring devices with absolute reference. Pneumatic pressure by direct comparison against a high precision reference transducer. |
15 psi to 45 psi | 0.013 % of reading or 0.0025 psi (whichever is greater) | ||
45 psi to 115 psi | 0.012 % of reading or 0.0062 psi (whichever is greater) | ||
115 psi to 315 psi | 0.012 % of reading or 0.019 psi (whichever is greater) | ||
315 psi to 1015 psi | 0.012 % of reading or 0.06 psi (whichever is greater) | ||
2000 psi to 20000 psi | 2.3 psi |
Hydraulic pressure by direct comparison against a high precision reference transducer. |
|
Gauge mode | |||
-14.5 psi to 0 psi | 0.0023 psi | II |
For the calibration of pressure measuring devices including differential manometers with atmospheric reference. Pneumatic pressure by direct comparison against a high precision reference transducer. |
0 psi to 30 psi | 0.01 % of reading or 0.0018 psi (whichever is greater) | ||
30 psi to 100 psi | 0.01 % of reading or 0.0059 psi (whichever is greater) | ||
100 psi to 300 psi | 0.01 % of reading or 0.018 psi (whichever is greater) | ||
300 psi to 1000 psi | 0.01 % of reading or 0.059 psi (whichever is greater) | ||
100 psi to 1015 psi | 83 parts per 106 | II |
For the calibration of pressure measuring devices including differential manometers with atmospheric reference. Pneumatic pressure by direct comparison with a dead weight tester. |
30 psi to 16 000 psi | 88 parts per 106 | II |
For the calibration of pressure measuring devices including differential manometers with atmospheric reference. Hydraulic pressure by direct comparison with a dead weight tester. |
-14 psi to 30 psi | 0.018 psi | II |
For the calibration of pressure measuring devices including differential manometers with atmospheric reference. Pneumatic pressure measured on-site by direct comparison against a reference pressure manometer. Above 400 psi, the customer must provide the pressure generator. |
30 psi to 1000 psi | 0.12 % of reading or 0.24 psi (whichever is greater) | ||
0 psi to 300 psi | 0.12 % of reading or 0.07 psi (whichever is greater) | II |
For the calibration of pressure measuring devices including differential manometers with atmospheric reference. Hydraulic pressure by direct comparison against a reference pressure manometer. This service is also available on-site. |
300 psi to 10 000 psi | 0.12 % of reading or 0.47 psi (whichever is greater) | ||
2000 psi to 20 000 psi | 2.3 psi |
Dimensional
Measured Quantity & Range or Instrument | Expanded Measurement Uncertainty | Type | Remarks |
---|---|---|---|
Gauge block, length | |||
Steel and ceramic, rectangular and square | |||
Inch, 0.01 inches up to 4 inches | (4.36 + 0.868L) μinch (Note: L in 'inches') |
I | Comparison to reference gauge blocks. |
Metric, 0.254 mm to 102 mm | (0.111 + 0.000868L) μm (Note: L in 'mm') |
||
Steel, rectangular and square | |||
Inch, 4 inches up to 10 inches | (1.836 + 1.468L) μinch (Note: L in 'inches') |
I | Comparison to reference gauge blocks. |
Metric, 102 mm to 254 mm | (0.0466 + 0.001468L) μm (Note: L in 'mm') |
||
Micrometer, outside | |||
Inch, up to 6 inches | (45 + 2L) μinch (L in inches) |
II | Comparison to gauge blocks. |
Inch, > 6 inches to 12 inches | (50+4.2L) μinch (L in inches) |
||
Caliper, inside | |||
Inch, up to 12 inches | 310 μinch | II | Comparison to gauge blocks. |
Caliper, outside | |||
Inch, up to 12 inches | 310 μinch | II | Comparison to gauge blocks. |
Over 12 to 24 inches | 570 μinch | ||
Over 24 to 40 inches | 710 μinch | ||
Caliper, depth | |||
Inch, up to 12 inches | 310 μinch | II | Comparison to gauge blocks. |
Dial indicator | |||
0.0001 inch graduation | 22 μinch | II | Up to 2 inch travel. Comparison to gauge blocks. |
0.0005 inch graduation | 180 μinch | Up to 2 inch travel. Comparison to gauge blocks. | |
0.001 mm graduation | 0.38 μm | Up to 58 mm travel. Comparison to gauge blocks. | |
0.01 mm graduation | 1.8 μm | Up to 58 mm travel. Comparison to gauge blocks. | |
Digital indicator | |||
0.0001 inch resolution | 70 μinch | II | Up to 2 inch travel. Comparison to gauge blocks. |
0.0005 inch resolution | 350 μinch | Up to 2 inch travel. Comparison to gauge blocks. | |
0.00005 inch resolution | 37 μinch | Up to 2 inch travel. Comparison to gauge blocks. | |
0.001 mm resolution | 0.76 μm | Up to 58 mm travel. Comparison to gauge blocks. | |
0.01 mm resolution | 6.9 μm | Up to 58 mm travel. Comparison to gauge blocks. | |
Height gauge | |||
Inch, up to 12 inches | 300 μinch | II | Comparison to gauge blocks. |
Metric, up to 300 mm | 0.0076 mm | ||
Inch, 12 to 24 inches | |||
0.0005 inch resolution | 350 μinch | ||
0.001 inch resolution | 0.0006 inch | ||
Metric, 300 to 600 mm | |||
0.01 mm resolution | 0.009 mm | ||
0.02 mm resolution | 0.015 mm | ||
Cylindrical ring gauge, diameter | |||
Inch, 1 inch to 4 inches | (17.0 + 3.0D) μinch, D in inch | I | Comparison to master ring gauge. |
Inch, > 4 inches to 6 inches | (17.0 + 2.9D) μinch, D in inch | ||
Metric, 25.4 mm to 101.6 mm | (0.44 + 0.003D) μm, D in mm | ||
Metric, > 101.6 mm to 152.4 mm | (0.42 + 0.003D) μm, D in mm | ||
Micrometer Setting Standard | |||
Inch, 1 inch to 11 inches | (11 + 3.5L) μin, L in inch | I | Comparison to gauge blocks. |
Metric, 25.4 mm to 279.4 mm | (0.27 + 0.0035L) μm, L in mm |
Mass
Measured Quantity & Range or Instrument | Expanded Measurement Uncertainty | Type | Remarks |
---|---|---|---|
Mass, conventional | |||
1 mg | 0.0020 mg | I |
For the calibration of masses with traceability to the International System of Units (SI) using a mass comparator and an analytical balance. Calibration results are reported in terms of conventional mass as defined by the Organisation internationale de métrologie légale (OIML): "The conventional value of the value of the result of weighing a body in air is equal to mass of a standard, of conventionally chosen density (8000 kg/m3), at a conventionally chosen temperature (20 °C), which balances this body at this reference temperature in air of conventionally chosen density (1.2 kg/m3)." |
2 mg | 0.0021 mg | ||
3 mg | 0.0022 mg | ||
5 mg | 0.0020 mg | ||
10 mg | 0.0020 mg | ||
20 mg | 0.0020 mg | ||
30 mg | 0.0040 mg | ||
50 mg | 0.0021 mg | ||
100 mg | 0.0023 mg | ||
200 mg | 0.0025 mg | ||
300 mg | 0.0048 mg | ||
500 mg | 0.0068 mg | ||
1 g | 0.0070 mg | ||
2 g | 0.0070 mg | ||
3 g | 0.014 mg | ||
5 g | 0.010 mg | ||
10 g | 0.02 mg | ||
20 g | 0.04 mg | ||
30 g | 0.06 mg | ||
50 g | 0.06 mg | ||
100 g | 0.09 mg | ||
200 g | 0.14 mg | ||
220 g | 0.17 mg | ||
300 g | 0.22 mg | ||
500 g | 0.27 mg | ||
1000 g | 0.56 mg | ||
2000 g | 1.1 mg | ||
3000 g | 1.7 mg | ||
5000 g | 2.9 mg | ||
5 g to 1000 g | 0.015 g | I |
For the calibration of masses with traceability to the International System of Units (SI). Calibration results are reported in terms of conventional mass as defined by the Organisation internationale de métrologie légale (OIML): "The conventional value of the value of the result of weighing a body in air is equal to mass of a standard, of conventionally chosen density (8000 kg/m3), at a conventionally chosen temperature (20 °C), which balances this body at this reference temperature in air of conventionally chosen density (1.2 kg/m3)." |
1000 g to 3000 g | 0.018 g | ||
3000 g to 6000 g | 0.029 g | ||
6000 g to 10000 g | 0.09 g | ||
20 Kg | 0.09 g | I |
For the calibration of masses with traceability to the International System of Units (SI). Calibration results are reported in terms of conventional mass as defined by the Organisation internationale de métrologie légale (OIML): "The conventional value of the value of the result of weighing a body in air is equal to mass of a standard, of conventionally chosen density (8000 kg/m3), at a conventionally chosen temperature (20 °C), which balances this body at this reference temperature in air of conventionally chosen density (1.2 kg/m3)." |
Scales | |||
9 kg to 12 kg | 0.2 g | II | Calibration of scales using standard weights. |
> 12 kg to 22 kg | 0.4 g | ||
> 22 kg to 45 kg | 1.0 g | ||
> 45 kg to 90 kg | 1.7 g | ||
> 90 kg to 135 kg | 2.7 g | ||
> 135 kg to 177 kg | 3.2 g | ||
> 177 kg to 220 kg | 3.9 g | ||
> 220 kg to 227 kg | 5.3 g | ||
Balances (Electronic, non-automatic) | |||
Up to 200 mg | 0.0024 mg | II |
The calibration uses ASTM Class 1 or OIML E2 reference weights. Calibrations are also available on-site. |
> 200 mg to 500 mg | 0.0047 mg | ||
> 500 mg to 2 g | 0.0070 mg | ||
> 2 g to 5 g | 0.011 mg | ||
> 5 g to 10 g | 0.018 mg | ||
> 10 g to 20 g | 0.034 mg | ||
> 20 g to 50 g | 0.052 mg | ||
> 50 g to 100 g | 0.11 mg | ||
> 100 g to 200 g | 0.13 mg | ||
> 200 g to 500 g | 0.25 mg | ||
> 500 g to 1 kg | 0.5 mg | ||
> 1 kg to 2 kg | 1.0 mg | ||
> 2 kg to 5 kg | 3.2 mg | ||
> 5 kg to 9 kg | 5.3 mg |
Force
Measured Quantity & Range or Instrument | Expanded Measurement Uncertainty | Type | Remarks |
---|---|---|---|
0 pound force to 1 pound force | 0.0002 pound force | II | Calibration of force measuring instruments in tension and compression using standard weights. This service is also available on-site. |
1 pound force to 5 pound force | 0.001 pound force | ||
5 pound force to 20 pound force | 0.024 % of reading | ||
20 pound force to 250 pound force | 0.02 % of reading | ||
Torque. Clockwise and Counter clockwise | |||
12.5 lbf•ft to 250 lbf•ft | 0.80 % of reading | II | For the calibration of torque tools by comparison with a reference torque transducer |
Annex A
Calibration Measurement Capability in the Measurement of AC Current and in the Calibration of Digital Multimeters and AC Current Measuring Devices, expressed as ± { (% of reading) + residual }
Current, AC | Frequency | ||
---|---|---|---|
45 Hz to 100 Hz | 100 Hz to 5 kHz | 5 kHz to 10 kHz | |
100 μA to 1 mA | 0.06 % + 0.2 μA | 0.03 % + 0.2 μA | 0.07 % + 0.2 μA |
1 mA to 10 mA | 0.06 % + 2 μA | 0.03 % + 2 μA | 0.07 % + 2 μA |
10 mA to 100 mA | 0.06 % + 20 μA | 0.03 % + 20 μA | 0.07 % + 20 μA |
0.1 A to 1 A | 0.08 % + 0.2 mA | 0.1 % + 0.2 mA | n/a |
Annex B
Calibration Measurement Capability in the Measurement of AC Voltage, expressed as ± {(% of reading) + residual}
Voltage, AC | Frequency | |||||
---|---|---|---|---|---|---|
10 Hz to 2 kHz | 2 kHz to 10 kHz | 10 kHz to 30 kHz | 30 kHz to 100 kHz | 100 kHz to 300 kHz | 300 kHz to 1 MHz | |
1 mV to 10 mV | 0.025 % +1.1 μV | 0.033 % +1.1 μV | 0.034 % +1.1 μV | 0.3 % +1.1 μV | 1 % + 4 μV | 2 % + 4 μV |
10 mV to 100 mV | 0.0068 % + 0.5 μV | 0.011 % + 0.5 μV | 0.021 % + 1 μV | 0.051 % +5 μV | 0.2 % +30 μV | 1 % + 100 μV |
0.1 V to 1 V | 0.0064 % +5 μV | 0.011 % + 5 μV | 0.021 % + 10 μV | 0.051 % + 50 μV | 0.2 % + 300 μV | 1 % + 1 mV |
1 V to 10 V | 0.0064 % +50 μV | 0.011 % + 50 μV | 0.021 % + 100 μV | 0.051 % + 500 μV | 0.2 % + 3 mV | 1 % + 10 mV |
10 V to 100 V | 0.007 % +500 μV | 0.009 % + 500 μV | 0.021 % + 1 mV | 0.051 % + 5 mV | 0.35 % + 50 mV | 1 % + 500 mV |
100 V to 1050 V | 0.009 % +25 mV | 0.009 % + 25 mV | 0.021 % + 25 mV | 0.051 % + 100 mV | n/a | n/a |
Annex C
Uncertainty in the Measurement of AC Resistance Expressed as % of Value
Frequency | ||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|
Resistance (Ω) | 0.05 kHz | 0.10 kHz | 0.20 kHz | 0.40 kHz | 0.60 kHz | 0.80 kHz | 1.00 kHz | 2.00 kHz | 4.00 kHz | 6.00 kHz | 8.00 kHz | 10.00 kHz |
1 | 0.20 | 0.20 | 0.18 | 0.16 | 0.13 | 0.10 | 0.08 | 0.09 | 0.12 | 0.14 | 0.17 | 0.20 |
2 | 0.20 | 0.20 | 0.18 | 0.16 | 0.13 | 0.10 | 0.08 | 0.09 | 0.12 | 0.14 | 0.17 | 0.20 |
3 | 0.20 | 0.20 | 0.18 | 0.16 | 0.13 | 0.10 | 0.08 | 0.09 | 0.12 | 0.14 | 0.17 | 0.20 |
4 | 0.20 | 0.20 | 0.18 | 0.16 | 0.13 | 0.10 | 0.08 | 0.09 | 0.12 | 0.14 | 0.17 | 0.20 |
5 | 0.20 | 0.20 | 0.18 | 0.16 | 0.13 | 0.10 | 0.08 | 0.09 | 0.12 | 0.14 | 0.17 | 0.20 |
6 | 0.20 | 0.20 | 0.18 | 0.16 | 0.13 | 0.10 | 0.08 | 0.09 | 0.12 | 0.14 | 0.17 | 0.20 |
7 | 0.20 | 0.20 | 0.18 | 0.16 | 0.13 | 0.10 | 0.08 | 0.09 | 0.12 | 0.14 | 0.17 | 0.20 |
8 | 0.20 | 0.20 | 0.18 | 0.16 | 0.13 | 0.10 | 0.08 | 0.09 | 0.12 | 0.14 | 0.17 | 0.20 |
9 | 0.20 | 0.20 | 0.18 | 0.16 | 0.13 | 0.10 | 0.08 | 0.09 | 0.12 | 0.14 | 0.17 | 0.20 |
10 | 0.08 | 0.07 | 0.07 | 0.06 | 0.05 | 0.05 | 0.04 | 0.04 | 0.05 | 0.06 | 0.07 | 0.08 |
20 | 0.08 | 0.07 | 0.07 | 0.06 | 0.05 | 0.05 | 0.04 | 0.04 | 0.05 | 0.06 | 0.07 | 0.08 |
30 | 0.08 | 0.07 | 0.07 | 0.06 | 0.05 | 0.05 | 0.04 | 0.04 | 0.05 | 0.06 | 0.07 | 0.08 |
40 | 0.08 | 0.07 | 0.07 | 0.06 | 0.05 | 0.05 | 0.04 | 0.04 | 0.05 | 0.06 | 0.07 | 0.08 |
50 | 0.08 | 0.07 | 0.07 | 0.06 | 0.05 | 0.05 | 0.04 | 0.04 | 0.05 | 0.06 | 0.07 | 0.08 |
60 | 0.08 | 0.07 | 0.07 | 0.06 | 0.05 | 0.05 | 0.04 | 0.04 | 0.05 | 0.06 | 0.07 | 0.08 |
70 | 0.08 | 0.07 | 0.07 | 0.06 | 0.05 | 0.05 | 0.04 | 0.04 | 0.05 | 0.06 | 0.07 | 0.08 |
80 | 0.08 | 0.07 | 0.07 | 0.06 | 0.05 | 0.05 | 0.04 | 0.04 | 0.05 | 0.06 | 0.07 | 0.08 |
90 | 0.08 | 0.07 | 0.07 | 0.06 | 0.05 | 0.05 | 0.04 | 0.04 | 0.05 | 0.06 | 0.07 | 0.08 |
100 | 0.07 | 0.06 | 0.06 | 0.05 | 0.05 | 0.04 | 0.04 | 0.04 | 0.05 | 0.05 | 0.06 | 0.07 |
200 | 0.07 | 0.06 | 0.06 | 0.05 | 0.05 | 0.04 | 0.04 | 0.04 | 0.05 | 0.05 | 0.06 | 0.07 |
300 | 0.07 | 0.06 | 0.06 | 0.05 | 0.05 | 0.04 | 0.04 | 0.04 | 0.05 | 0.05 | 0.06 | 0.07 |
400 | 0.07 | 0.06 | 0.06 | 0.05 | 0.05 | 0.04 | 0.04 | 0.04 | 0.05 | 0.05 | 0.06 | 0.07 |
500 | 0.07 | 0.06 | 0.06 | 0.05 | 0.05 | 0.04 | 0.04 | 0.04 | 0.05 | 0.05 | 0.06 | 0.07 |
600 | 0.07 | 0.06 | 0.06 | 0.05 | 0.05 | 0.04 | 0.04 | 0.04 | 0.05 | 0.05 | 0.06 | 0.07 |
700 | 0.07 | 0.06 | 0.06 | 0.05 | 0.05 | 0.04 | 0.04 | 0.04 | 0.05 | 0.05 | 0.06 | 0.07 |
800 | 0.07 | 0.06 | 0.06 | 0.05 | 0.05 | 0.04 | 0.04 | 0.04 | 0.05 | 0.05 | 0.06 | 0.07 |
900 | 0.07 | 0.06 | 0.06 | 0.05 | 0.05 | 0.04 | 0.04 | 0.04 | 0.05 | 0.05 | 0.06 | 0.07 |
1000 | 0.07 | 0.06 | 0.06 | 0.06 | 0.05 | 0.05 | 0.04 | 0.05 | 0.06 | 0.06 | 0.07 | 0.07 |
2000 | 0.07 | 0.06 | 0.06 | 0.06 | 0.05 | 0.05 | 0.04 | 0.05 | 0.06 | 0.06 | 0.07 | 0.07 |
3000 | 0.07 | 0.06 | 0.06 | 0.06 | 0.05 | 0.05 | 0.04 | 0.05 | 0.06 | 0.06 | 0.07 | 0.07 |
4000 | 0.07 | 0.06 | 0.06 | 0.06 | 0.05 | 0.05 | 0.04 | 0.05 | 0.06 | 0.06 | 0.07 | 0.07 |
5000 | 0.07 | 0.06 | 0.06 | 0.06 | 0.05 | 0.05 | 0.04 | 0.05 | 0.06 | 0.06 | 0.07 | 0.07 |
6000 | 0.07 | 0.06 | 0.06 | 0.06 | 0.05 | 0.05 | 0.04 | 0.05 | 0.06 | 0.06 | 0.07 | 0.07 |
7000 | 0.07 | 0.06 | 0.06 | 0.06 | 0.05 | 0.05 | 0.04 | 0.05 | 0.06 | 0.06 | 0.07 | 0.07 |
8000 | 0.07 | 0.06 | 0.06 | 0.06 | 0.05 | 0.05 | 0.04 | 0.05 | 0.06 | 0.06 | 0.07 | 0.07 |
9000 | 0.07 | 0.06 | 0.06 | 0.06 | 0.05 | 0.05 | 0.04 | 0.05 | 0.06 | 0.06 | 0.07 | 0.07 |
10000 | 0.07 | 0.07 | 0.07 | 0.06 | 0.06 | 0.06 | 0.05 | 0.14 | 0.14 | 0.14 | 0.14 | 0.14 |
20000 | 0.07 | 0.07 | 0.07 | 0.06 | 0.06 | 0.06 | 0.05 | 0.14 | 0.14 | 0.14 | 0.14 | 0.14 |
30000 | 0.07 | 0.07 | 0.07 | 0.06 | 0.06 | 0.06 | 0.05 | 0.14 | 0.14 | 0.14 | 0.14 | 0.14 |
40000 | 0.07 | 0.07 | 0.07 | 0.06 | 0.06 | 0.06 | 0.05 | 0.14 | 0.14 | 0.14 | 0.14 | 0.14 |
50000 | 0.07 | 0.07 | 0.07 | 0.06 | 0.06 | 0.06 | 0.05 | 0.14 | 0.14 | 0.14 | 0.14 | 0.14 |
60000 | 0.07 | 0.07 | 0.07 | 0.06 | 0.06 | 0.06 | 0.05 | 0.14 | 0.14 | 0.14 | 0.14 | 0.14 |
70000 | 0.07 | 0.07 | 0.07 | 0.06 | 0.06 | 0.06 | 0.05 | 0.14 | 0.14 | 0.14 | 0.14 | 0.14 |
80000 | 0.07 | 0.07 | 0.07 | 0.06 | 0.06 | 0.06 | 0.05 | 0.14 | 0.14 | 0.14 | 0.14 | 0.14 |
90000 | 0.07 | 0.07 | 0.07 | 0.06 | 0.06 | 0.06 | 0.05 | 0.14 | 0.14 | 0.14 | 0.14 | 0.14 |
100000 | 0.07 | 0.07 | 0.07 | 0.06 | 0.06 | 0.06 | 0.05 | 0.14 | 0.14 | 0.14 | 0.14 | 0.14 |
Annex D
Uncertainty in the Measurement of DC Power Expressed as % of Value
Current | Voltage | |||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|
0.33 V | 0.5 V | 1 V | 3 V | 5 V | 10 V | 30 V | 50 V | 100 V | 300 V | 500 V | 1000 V | |
0.33 mA | 0.028 | 0.028 | 0.028 | 0.027 | 0.028 | 0.027 | 0.027 | 0.028 | 0.028 | 0.027 | 0.028 | 0.028 |
0.5 mA | 0.023 | 0.023 | 0.023 | 0.023 | 0.023 | 0.023 | 0.023 | 0.023 | 0.023 | 0.023 | 0.023 | 0.023 |
1.0 mA | 0.020 | 0.019 | 0.019 | 0.019 | 0.019 | 0.019 | 0.019 | 0.019 | 0.019 | 0.019 | 0.019 | 0.019 |
3.0 mA | 0.018 | 0.017 | 0.017 | 0.017 | 0.017 | 0.017 | 0.017 | 0.017 | 0.017 | 0.017 | 0.017 | 0.017 |
5.0 mA | 0.020 | 0.019 | 0.019 | 0.019 | 0.019 | 0.019 | 0.019 | 0.019 | 0.019 | 0.019 | 0.019 | 0.019 |
10 mA | 0.018 | 0.018 | 0.018 | 0.018 | 0.018 | 0.018 | 0.018 | 0.018 | 0.018 | 0.018 | 0.018 | 0.018 |
30 mA | 0.017 | 0.017 | 0.017 | 0.017 | 0.017 | 0.017 | 0.017 | 0.017 | 0.017 | 0.017 | 0.017 | 0.017 |
50 mA | 0.020 | 0.019 | 0.019 | 0.019 | 0.019 | 0.019 | 0.019 | 0.019 | 0.019 | 0.019 | 0.019 | 0.019 |
100 mA | 0.018 | 0.018 | 0.018 | 0.018 | 0.018 | 0.018 | 0.018 | 0.018 | 0.018 | 0.018 | 0.018 | 0.018 |
320 mA | 0.017 | 0.017 | 0.017 | 0.017 | 0.017 | 0.017 | 0.017 | 0.017 | 0.017 | 0.017 | 0.017 | 0.017 |
0.33 A | 0.034 | 0.034 | 0.034 | 0.034 | 0.034 | 0.034 | 0.034 | 0.034 | 0.034 | 0.034 | 0.034 | 0.034 |
0.5 A | 0.030 | 0.030 | 0.030 | 0.030 | 0.030 | 0.030 | 0.030 | 0.030 | 0.030 | 0.030 | 0.030 | 0.030 |
1.0 A | 0.027 | 0.027 | 0.027 | 0.026 | 0.027 | 0.026 | 0.026 | 0.027 | 0.026 | 0.026 | 0.027 | 0.026 |
2.0 A | 0.041 | 0.041 | 0.041 | 0.041 | 0.041 | 0.041 | 0.041 | 0.041 | 0.041 | 0.041 | 0.041 | 0.041 |
2.9 A | 0.041 | 0.041 | 0.041 | 0.041 | 0.041 | 0.041 | 0.041 | 0.041 | 0.041 | 0.041 | 0.041 | 0.041 |
3.0 A | 0.067 | 0.067 | 0.067 | 0.067 | 0.067 | 0.067 | 0.067 | 0.067 | 0.067 | 0.067 | 0.067 | 0.067 |
5.0 A | 0.060 | 0.060 | 0.060 | 0.060 | 0.060 | 0.060 | 0.060 | 0.060 | 0.060 | 0.060 | 0.060 | 0.060 |
10.9 A | 0.055 | 0.055 | 0.055 | 0.055 | 0.055 | 0.055 | 0.055 | 0.055 | 0.055 | 0.055 | 0.055 | 0.055 |
11.0 A | 0.113 | 0.113 | 0.113 | 0.113 | 0.113 | 0.113 | 0.113 | 0.113 | 0.113 | 0.113 | 0.113 | 0.113 |
15.0 A | 0.109 | 0.109 | 0.109 | 0.109 | 0.109 | 0.109 | 0.109 | 0.109 | 0.109 | 0.109 | 0.109 | 0.109 |
20.0 A | 0.107 | 0.107 | 0.107 | 0.107 | 0.107 | 0.107 | 0.107 | 0.107 | 0.107 | 0.107 | 0.107 | 0.107 |
Annex E
Uncertainty in the Measurement of AC Current Expressed as % of Value
Current (A) | Frequency | |||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|
0.045 kHz | 0.1 kHz | 0.2 kHz | 0.5 kHz | 1 kHz | 2 kHz | 5 kHz | 10 kHz | 20 kHz | 30 kHz | 50 kHz | 100 kHz | |
0.1 | 0.037 | 0.037 | 0.037 | 0.037 | 0.045 | 0.045 | 0.045 | 0.045 | 0.064 | 0.064 | 0.12 | 0.12 |
0.2 | 0.023 | 0.023 | 0.023 | 0.023 | 0.031 | 0.031 | 0.031 | 0.031 | 0.049 | 0.049 | 0.11 | 0.11 |
0.3 | 0.018 | 0.018 | 0.018 | 0.018 | 0.026 | 0.026 | 0.026 | 0.026 | 0.044 | 0.044 | 0.10 | 0.10 |
0.4 | 0.016 | 0.016 | 0.016 | 0.016 | 0.024 | 0.024 | 0.024 | 0.024 | 0.042 | 0.042 | 0.10 | 0.10 |
0.5 | 0.014 | 0.014 | 0.014 | 0.014 | 0.022 | 0.022 | 0.022 | 0.022 | 0.041 | 0.041 | 0.098 | 0.098 |
0.6 | 0.013 | 0.013 | 0.013 | 0.013 | 0.021 | 0.021 | 0.021 | 0.021 | 0.040 | 0.040 | 0.097 | 0.097 |
0.7 | 0.012 | 0.012 | 0.012 | 0.012 | 0.021 | 0.021 | 0.021 | 0.021 | 0.039 | 0.039 | 0.096 | 0.096 |
0.8 | 0.012 | 0.012 | 0.012 | 0.012 | 0.020 | 0.020 | 0.020 | 0.020 | 0.038 | 0.038 | 0.096 | 0.096 |
0.9 | 0.012 | 0.012 | 0.012 | 0.012 | 0.020 | 0.020 | 0.020 | 0.020 | 0.038 | 0.038 | 0.096 | 0.096 |
1 | 0.011 | 0.011 | 0.011 | 0.011 | 0.019 | 0.019 | 0.019 | 0.019 | 0.038 | 0.038 | 0.095 | 0.095 |
1.1 | 0.011 | 0.011 | 0.011 | 0.011 | 0.019 | 0.019 | 0.019 | 0.019 | 0.037 | 0.037 | 0.095 | 0.095 |
Current (A) | Frequency | |||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|
0.045 kHz | 0.1 kHz | 0.2 kHz | 0.5 kHz | 1 kHz | 2 kHz | 5 kHz | 10 kHz | 20 kHz | 30 kHz | 50 kHz | 100 kHz | |
1 | 0.037 | 0.037 | 0.037 | 0.037 | 0.045 | 0.045 | 0.046 | 0.046 | 0.064 | 0.064 | 0.12 | 0.12 |
2 | 0.023 | 0.023 | 0.023 | 0.023 | 0.031 | 0.031 | 0.031 | 0.031 | 0.050 | 0.050 | 0.11 | 0.11 |
3 | 0.018 | 0.018 | 0.018 | 0.018 | 0.026 | 0.026 | 0.026 | 0.027 | 0.045 | 0.045 | 0.10 | 0.10 |
4 | 0.016 | 0.016 | 0.016 | 0.016 | 0.024 | 0.024 | 0.024 | 0.024 | 0.043 | 0.043 | 0.10 | 0.10 |
5 | 0.014 | 0.014 | 0.014 | 0.014 | 0.022 | 0.022 | 0.023 | 0.023 | 0.041 | 0.041 | 0.099 | 0.099 |
6 | 0.013 | 0.013 | 0.013 | 0.013 | 0.021 | 0.021 | 0.022 | 0.022 | 0.040 | 0.040 | 0.098 | 0.098 |
7 | 0.013 | 0.013 | 0.013 | 0.013 | 0.021 | 0.021 | 0.021 | 0.021 | 0.040 | 0.040 | 0.097 | 0.097 |
8 | 0.012 | 0.012 | 0.012 | 0.012 | 0.020 | 0.020 | 0.020 | 0.021 | 0.039 | 0.039 | 0.096 | 0.097 |
9 | 0.012 | 0.012 | 0.012 | 0.012 | 0.020 | 0.020 | 0.020 | 0.020 | 0.039 | 0.039 | 0.096 | 0.096 |
10 | 0.012 | 0.012 | 0.012 | 0.012 | 0.019 | 0.019 | 0.019 | 0.020 | 0.038 | 0.038 | 0.096 | 0.096 |
11 | 0.011 | 0.011 | 0.011 | 0.011 | 0.019 | 0.019 | 0.019 | 0.020 | 0.038 | 0.038 | 0.095 | 0.096 |
Annex F
Uncertainty in the Measurement of AC Current Expressed as % of Value
Current (A) | Frequency | |||||||||
---|---|---|---|---|---|---|---|---|---|---|
0.045 kHz | 0.1 kHz | 0.2 kHz | 0.5 kHz | 1 kHz | 2 kHz | 5 kHz | 10 kHz | 20 kHz | 30 kHz | |
0.1 | 0.037 | 0.037 | 0.037 | 0.037 | 0.045 | 0.045 | 0.045 | 0.045 | 0.064 | 0.064 |
0.2 | 0.023 | 0.023 | 0.023 | 0.023 | 0.031 | 0.031 | 0.031 | 0.031 | 0.049 | 0.049 |
0.3 | 0.018 | 0.018 | 0.018 | 0.018 | 0.026 | 0.026 | 0.026 | 0.026 | 0.044 | 0.044 |
0.33 | 0.017 | 0.017 | 0.017 | 0.017 | 0.025 | 0.025 | 0.025 | 0.025 | 0.043 | 0.043 |
0.4 | 0.016 | 0.016 | 0.016 | 0.016 | 0.024 | 0.024 | 0.024 | 0.024 | n/a | n/a |
0.5 | 0.014 | 0.014 | 0.014 | 0.014 | 0.022 | 0.022 | 0.022 | 0.022 | n/a | n/a |
0.6 | 0.013 | 0.013 | 0.013 | 0.013 | 0.021 | 0.021 | 0.021 | 0.021 | n/a | n/a |
0.7 | 0.012 | 0.012 | 0.012 | 0.012 | 0.021 | 0.021 | 0.021 | 0.021 | n/a | n/a |
0.8 | 0.012 | 0.012 | 0.012 | 0.012 | 0.020 | 0.020 | 0.020 | 0.020 | n/a | n/a |
0.9 | 0.012 | 0.012 | 0.012 | 0.012 | 0.020 | 0.020 | 0.020 | 0.020 | n/a | n/a |
1 | 0.011 | 0.011 | 0.011 | 0.011 | 0.019 | 0.019 | 0.019 | 0.019 | n/a | n/a |
1.1 | 0.011 | 0.011 | 0.011 | 0.011 | 0.019 | 0.019 | 0.019 | 0.019 | n/a | n/a |
Current (A) | Frequency | |||||||
---|---|---|---|---|---|---|---|---|
0.045 kHz | 0.1 kHz | 0.2 kHz | 0.5 kHz | 1 kHz | 2 kHz | 5 kHz | 10 kHz | |
1 | 0.037 | 0.037 | 0.037 | 0.037 | 0.045 | 0.045 | 0.046 | 0.046 |
2 | 0.023 | 0.023 | 0.023 | 0.023 | 0.031 | 0.031 | 0.031 | 0.031 |
3 | 0.018 | 0.018 | 0.018 | 0.018 | 0.026 | 0.026 | 0.026 | 0.027 |
4 | 0.016 | 0.016 | 0.016 | 0.016 | 0.024 | 0.024 | 0.024 | n/a |
5 | 0.014 | 0.014 | 0.014 | 0.014 | 0.022 | 0.022 | 0.023 | n/a |
6 | 0.013 | 0.013 | 0.013 | 0.013 | 0.021 | 0.021 | 0.022 | n/a |
7 | 0.013 | 0.013 | 0.013 | 0.013 | 0.021 | 0.021 | 0.021 | n/a |
8 | 0.012 | 0.012 | 0.012 | 0.012 | 0.020 | 0.020 | 0.020 | n/a |
9 | 0.012 | 0.012 | 0.012 | 0.012 | 0.020 | 0.020 | 0.020 | n/a |
10 | 0.012 | 0.012 | 0.012 | 0.012 | 0.019 | 0.019 | 0.019 | n/a |
11 | 0.011 | 0.011 | 0.011 | 0.011 | 0.019 | 0.019 | 0.019 | n/a |
Annex G
Uncertainty in the Measurement of AC Current Expressed as % of Value. Current from 100 A to 1500 A applies to both source and measure. Current from 1500 A to 2000 A applies to measure only.
Current (A) | Frequency 60 Hz |
---|---|
100 | 0.15 |
120 | 0.14 |
140 | 0.13 |
160 | 0.12 |
180 | 0.12 |
200 | 0.12 |
220 | 0.11 |
240 | 0.11 |
260 | 0.11 |
280 | 0.11 |
300 | 0.25 |
320 | 0.24 |
340 | 0.23 |
360 | 0.21 |
380 | 0.21 |
400 | 0.20 |
420 | 0.19 |
440 | 0.19 |
460 | 0.18 |
480 | 0.18 |
500 | 0.17 |
520 | 0.16 |
540 | 0.16 |
560 | 0.16 |
580 | 0.15 |
600 | 0.15 |
620 | 0.14 |
640 | 0.14 |
660 | 0.14 |
680 | 0.14 |
700 | 0.14 |
720 | 0.13 |
740 | 0.13 |
760 | 0.13 |
780 | 0.13 |
800 | 0.13 |
820 | 0.12 |
840 | 0.12 |
860 | 0.12 |
880 | 0.12 |
900 | 0.12 |
920 | 0.12 |
940 | 0.12 |
960 | 0.11 |
980 | 0.11 |
1000 | 0.11 |
1020 | 0.11 |
1040 | 0.11 |
1060 | 0.11 |
1080 | 0.11 |
1100 | 0.11 |
1120 | 0.11 |
1140 | 0.10 |
1160 | 0.10 |
1180 | 0.10 |
1200 | 0.10 |
1220 | 0.10 |
1240 | 0.10 |
1260 | 0.10 |
1280 | 0.10 |
1300 | 0.099 |
1320 | 0.099 |
1340 | 0.098 |
1360 | 0.098 |
1380 | 0.097 |
1400 | 0.097 |
1420 | 0.096 |
1440 | 0.095 |
1460 | 0.095 |
1480 | 0.094 |
1500 | 0.094 |
1520 | 0.094 |
1540 | 0.093 |
1560 | 0.093 |
1580 | 0.092 |
1600 | 0.092 |
1620 | 0.092 |
1640 | 0.091 |
1660 | 0.091 |
1680 | 0.090 |
1700 | 0.090 |
1720 | 0.090 |
1740 | 0.089 |
1760 | 0.089 |
1780 | 0.089 |
1800 | 0.089 |
1820 | 0.088 |
1840 | 0.088 |
1860 | 0.088 |
1880 | 0.088 |
1900 | 0.087 |
1920 | 0.087 |
1940 | 0.087 |
1960 | 0.087 |
1980 | 0.086 |
2000 | 0.086 |
Annex H
Current (A) | Uncertainty |
---|---|
% of Value | |
0.1 | 0.0089 |
0.2 | 0.0049 |
0.3 | 0.0037 |
0.4 | 0.0033 |
0.5 | 0.0030 |
0.6 | 0.0029 |
0.7 | 0.0028 |
0.8 | 0.0027 |
0.9 | 0.0027 |
1.0 | 0.0027 |
1.1 | 0.0026 |
Current (A) | Uncertainty |
---|---|
% of Value | |
1 | 0.009 |
2 | 0.006 |
3 | 0.005 |
4 | 0.004 |
5 | 0.004 |
6 | 0.004 |
7 | 0.004 |
8 | 0.004 |
9 | 0.004 |
10 | 0.004 |
11 | 0.004 |
Current (A) | Uncertainty |
---|---|
% of Value | |
100 | 0.052 |
110 | 0.050 |
120 | 0.047 |
130 | 0.045 |
140 | 0.044 |
150 | 0.043 |
160 | 0.041 |
170 | 0.040 |
180 | 0.039 |
190 | 0.039 |
200 | 0.038 |
210 | 0.037 |
220 | 0.037 |
230 | 0.036 |
240 | 0.036 |
250 | 0.035 |
260 | 0.035 |
270 | 0.034 |
280 | 0.034 |
290 | 0.033 |
300 | 0.033 |
310 | 0.033 |
320 | 0.033 |
330 | 0.032 |
340 | 0.032 |
350 | 0.031 |
360 | 0.031 |
370 | 0.031 |
380 | 0.030 |
390 | 0.030 |
400 | 0.030 |
410 | 0.029 |
420 | 0.029 |
430 | 0.029 |
440 | 0.029 |
450 | 0.028 |
460 | 0.028 |
470 | 0.028 |
480 | 0.027 |
490 | 0.027 |
500 | 0.027 |
510 | 0.027 |
520 | 0.027 |
530 | 0.027 |
540 | 0.027 |
550 | 0.027 |
560 | 0.026 |
570 | 0.026 |
580 | 0.026 |
590 | 0.026 |
600 | 0.026 |
610 | 0.026 |
620 | 0.026 |
630 | 0.026 |
640 | 0.026 |
650 | 0.026 |
660 | 0.026 |
670 | 0.026 |
680 | 0.026 |
690 | 0.026 |
700 | 0.026 |
710 | 0.026 |
720 | 0.026 |
730 | 0.026 |
740 | 0.026 |
750 | 0.026 |
760 | 0.026 |
770 | 0.026 |
780 | 0.026 |
790 | 0.026 |
800 | 0.026 |
810 | 0.026 |
820 | 0.026 |
830 | 0.026 |
840 | 0.026 |
850 | 0.026 |
860 | 0.026 |
870 | 0.026 |
880 | 0.026 |
890 | 0.026 |
900 | 0.026 |
910 | 0.026 |
920 | 0.026 |
930 | 0.026 |
940 | 0.026 |
950 | 0.026 |
960 | 0.026 |
970 | 0.026 |
980 | 0.026 |
990 | 0.026 |
1000 | 0.026 |
Annex I
Uncertainty in the Measurement of Capacitance Expressed as % of Value
Capacitance | Frequency | |||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|
0.05 kHz | 0.1 kHz | 0.2 kHz | 0.4 kHz | 0.6 kHz | 0.8 kHz | 1 kHz | 2 kHz | 4 kHz | 6 kHz | 8 kHz | 10 kHz | |
10 pF | 0.070 | 0.027 | 0.025 | 0.020 | 0.017 | 0.015 | 0.015 | 0.015 | 0.021 | 0.031 | 0.042 | 0.053 |
20 pF | 13 | 6.4 | 3.2 | 1.1 | 0.71 | 0.54 | 0.21 | 0.32 | 0.38 | 0.22 | 0.32 | 0.22 |
30 pF | 7.5 | 3.7 | 1.9 | 0.62 | 0.42 | 0.31 | 0.13 | 0.19 | 0.22 | 0.12 | 0.15 | 0.084 |
60 pF | 2.1 | 1.1 | 0.54 | 0.18 | 0.12 | 0.090 | 0.037 | 0.054 | 0.064 | 0.032 | 0.042 | 0.053 |
80 pF | 0.80 | 0.40 | 0.20 | 0.069 | 0.046 | 0.035 | 0.018 | 0.023 | 0.029 | 0.031 | 0.042 | 0.053 |
100 pF | 0.029 | 0.027 | 0.024 | 0.020 | 0.016 | 0.015 | 0.017 | 0.015 | 0.021 | 0.031 | 0.042 | 0.053 |
200 pF | 2.2 | 1.1 | 0.58 | 0.21 | 0.13 | 0.093 | 0.047 | 0.026 | 0.029 | 0.037 | 0.046 | 0.056 |
300 pF | 1.3 | 0.67 | 0.35 | 0.13 | 0.081 | 0.054 | 0.032 | 0.025 | 0.029 | 0.036 | 0.046 | 0.056 |
600 pF | 0.39 | 0.21 | 0.12 | 0.056 | 0.031 | 0.025 | 0.025 | 0.025 | 0.029 | 0.036 | 0.046 | 0.056 |
800 pF | 0.16 | 0.095 | 0.061 | 0.038 | 0.026 | 0.025 | 0.025 | 0.025 | 0.029 | 0.036 | 0.046 | 0.056 |
1 nF | 0.034 | 0.033 | 0.032 | 0.029 | 0.027 | 0.025 | 0.025 | 0.025 | 0.029 | 0.036 | 0.046 | 0.056 |
2 nF | 0.14 | 0.064 | 0.040 | 0.032 | 0.026 | 0.022 | 0.020 | 0.022 | 0.034 | 0.050 | 0.068 | 0.087 |
3 nF | 0.088 | 0.048 | 0.040 | 0.032 | 0.026 | 0.022 | 0.020 | 0.022 | 0.034 | 0.050 | 0.068 | 0.087 |
6 nF | 0.050 | 0.044 | 0.040 | 0.032 | 0.026 | 0.022 | 0.020 | 0.022 | 0.033 | 0.050 | 0.068 | 0.087 |
8 nF | 0.046 | 0.044 | 0.040 | 0.032 | 0.026 | 0.022 | 0.020 | 0.022 | 0.033 | 0.050 | 0.068 | 0.087 |
10 nF | 0.046 | 0.044 | 0.040 | 0.032 | 0.026 | 0.022 | 0.020 | 0.022 | 0.033 | 0.050 | 0.068 | 0.087 |
20 nF | 0.056 | 0.054 | 0.049 | 0.039 | 0.031 | 0.025 | 0.023 | 0.025 | 0.041 | 0.062 | 0.084 | 0.11 |
30 nF | 0.056 | 0.054 | 0.049 | 0.039 | 0.031 | 0.025 | 0.023 | 0.025 | 0.041 | 0.062 | 0.084 | 0.11 |
60 nF | 0.056 | 0.054 | 0.049 | 0.039 | 0.031 | 0.025 | 0.023 | 0.025 | 0.041 | 0.062 | 0.084 | 0.11 |
80 nF | 0.056 | 0.054 | 0.049 | 0.039 | 0.031 | 0.025 | 0.023 | 0.025 | 0.041 | 0.062 | 0.084 | 0.11 |
100 nF | 0.056 | 0.054 | 0.049 | 0.039 | 0.031 | 0.025 | 0.023 | 0.025 | 0.041 | 0.062 | 0.084 | 0.11 |
200 nF | 0.056 | 0.054 | 0.049 | 0.039 | 0.031 | 0.025 | 0.023 | 0.025 | 0.041 | 0.062 | 0.084 | 0.11 |
300 nF | 0.056 | 0.054 | 0.049 | 0.039 | 0.031 | 0.025 | 0.023 | 0.025 | 0.041 | 0.062 | 0.084 | 0.11 |
600 nF | 0.056 | 0.054 | 0.049 | 0.039 | 0.031 | 0.025 | 0.023 | 0.025 | 0.041 | 0.062 | 0.084 | 0.11 |
800 nF | 0.056 | 0.054 | 0.049 | 0.039 | 0.031 | 0.025 | 0.023 | 0.025 | 0.041 | 0.062 | 0.084 | 0.11 |
1 µF | 0.056 | 0.054 | 0.049 | 0.039 | 0.031 | 0.025 | 0.023 | 0.025 | 0.041 | 0.062 | 0.084 | 0.11 |
2 µF | 0.064 | 0.063 | 0.061 | 0.051 | 0.048 | 0.046 | 0.034 | 0.046 | 0.072 | 0.098 | 0.16 | 0.20 |
3 µF | 0.064 | 0.063 | 0.061 | 0.051 | 0.048 | 0.046 | 0.034 | 0.046 | 0.073 | 0.098 | 0.16 | 0.20 |
6 µF | 0.064 | 0.063 | 0.061 | 0.051 | 0.048 | 0.046 | 0.034 | 0.046 | 0.073 | 0.10 | 0.17 | 0.21 |
8 µF | 0.064 | 0.063 | 0.061 | 0.051 | 0.048 | 0.046 | 0.034 | 0.046 | 0.074 | 0.10 | 0.17 | 0.20 |
10 µF | 0.064 | 0.063 | 0.061 | 0.051 | 0.048 | 0.046 | 0.034 | 0.046 | 0.073 | 0.098 | 0.16 | 0.20 |
20 µF | 0.10 | 0.10 | 0.10 | 0.096 | 0.11 | 0.12 | 0.072 | 0.24 | 0.67 | 0.99 | 1.7 | 2.2 |
30 µF | 0.10 | 0.10 | 0.10 | 0.096 | 0.11 | 0.12 | 0.073 | 0.24 | 0.67 | 0.99 | 1.8 | 2.2 |
60 µF | 0.10 | 0.10 | 0.10 | 0.096 | 0.11 | 0.12 | 0.076 | 0.25 | 0.68 | 1.0 | 1.8 | 2.3 |
80 µF | 0.10 | 0.10 | 0.10 | 0.097 | 0.11 | 0.12 | 0.074 | 0.24 | 0.67 | N/A | N/A | N/A |
100 µF | 0.10 | 0.10 | 0.10 | 0.096 | 0.11 | 0.12 | 0.072 | 0.24 | 0.66 | N/A | N/A | N/A |
Annex J
Uncertainty in the Measurement of DC Current Expressed as % of Value
Current Range (A) | % of Full Scale | |||||||||
---|---|---|---|---|---|---|---|---|---|---|
10 % | 20 % | 30 % | 40 % | 50 % | 60 % | 70 % | 80 % | 90 % | 100 % | |
10 pA to 100 pA | 0.13 | 0.095 | 0.091 | 0.092 | 0.089 | 0.088 | 0.094 | 0.094 | 0.093 | 0.093 |
0.1 nA to 1 nA | 0.060 | 0.061 | 0.060 | 0.060 | 0.060 | 0.060 | 0.060 | 0.060 | 0.060 | 0.060 |
1 nA to 10 nA | 0.033 | 0.031 | 0.031 | 0.031 | 0.031 | 0.031 | 0.031 | 0.031 | 0.031 | 0.031 |
10 nA to 100 nA | 0.032 | 0.031 | 0.031 | 0.031 | 0.031 | 0.031 | 0.031 | 0.031 | 0.031 | 0.031 |
0.1 µA to 1 µA | 0.028 | 0.024 | 0.023 | 0.023 | 0.023 | 0.023 | 0.022 | 0.022 | 0.022 | 0.022 |
1 µA to 10 µA | 0.024 | 0.020 | 0.020 | 0.019 | 0.019 | 0.019 | 0.019 | 0.019 | 0.019 | 0.019 |
10 µA to 100 µA | 0.023 | 0.019 | 0.019 | 0.019 | 0.018 | 0.018 | 0.018 | 0.018 | 0.018 | 0.018 |
Annex K
Uncertainty in the Measurement of DC Current Expressed as % of Value
Current Range (A) | % of Full Scale | |||||||||
---|---|---|---|---|---|---|---|---|---|---|
10 % | 20 % | 30 % | 40 % | 50 % | 60 % | 70 % | 80 % | 90 % | 100 % | |
10 pA to 100 pA | 0.18 | 0.13 | 0.12 | 0.12 | 0.12 | 0.12 | 0.12 | 0.12 | 0.12 | 0.12 |
0.1 nA to 1 nA | 0.088 | 0.093 | 0.093 | 0.092 | 0.092 | 0.092 | 0.092 | 0.092 | 0.092 | 0.092 |
1 nA to 10 nA | 0.045 | 0.045 | 0.044 | 0.044 | 0.048 | 0.047 | 0.047 | 0.047 | 0.047 | 0.047 |
10 nA to 100 nA | 0.045 | 0.045 | 0.045 | 0.044 | 0.044 | 0.044 | 0.048 | 0.048 | 0.048 | 0.048 |
0.1 µA to 1 µA | 0.031 | 0.028 | 0.028 | 0.027 | 0.027 | 0.028 | 0.028 | 0.028 | 0.028 | 0.027 |
1 µA to 10 µA | 0.026 | 0.023 | 0.023 | 0.023 | 0.023 | 0.023 | 0.023 | 0.023 | 0.023 | 0.022 |
10 µA to 100 µA | 0.025 | 0.023 | 0.023 | 0.022 | 0.022 | 0.022 | 0.022 | 0.022 | 0.022 | 0.022 |
Note: Uncertainties may be linearly interpolated between points.
Annex L
Calibration Measurement Capability in the Calibration of Digital Multimeters and AC Voltage Measuring Devices, expressed as ± {(% of reading) + residual}
Voltage, AC | Frequency | |||||
---|---|---|---|---|---|---|
10 Hz to 2 kHz |
2 kHz to 10 kHz |
10 kHz to 30 kHz |
30 kHz to 100 kHz |
100 kHz to 300 kHz |
300 kHz to 500 kHz |
|
1 mV to 10 mV | 0.025 % + 1.1 μV | 0.033 % + 1.1 μV | 0.034 % + 1.1 μV | 0.3 % + 1.1 μV | 1 % + 4 μV | 2 % + 4 μV |
10 mV to 100 mV | 0.0068 % + 0.5 μV | 0.011 % + 0.5 μV | 0.021 % + 1 μV | 0.051 % + 5 μV | 0.2 % + 30 μV | 1 % + 100 μV |
0.1 V to 1 V | 0.0064 % + 5 μV | 0.011 % + 5 μV | 0.021 % + 10 μV | 0.051 % + 50 μV | 0.2 % + 300 μV | 1 % + 1 mV |
1 V to 3.3 V | 0.0064 % + 50 μV | 0.011 % + 50 μV | 0.021 % + 100 μV | 0.051 % + 500 μV | 0.2 % + 3 mV | 1 % + 10 mV |
3.3 V to 10 V | 0.0064 % + 50 μV | 0.011 % + 50 μV | 0.021 % + 100 μV | 0.051 % + 500 μV | n/a | n/a |
10 V to 33 V | 0.007 % + 500 μV | 0.009 % + 500 μV | 0.021 % + 1 mV | 0.051 % + 5 mV | n/a | n/a |
Voltage, AC | Frequency | |||
---|---|---|---|---|
45 Hz to 2 kHz |
2 kHz to 10 kHz |
10 kHz to 30 kHz |
30 kHz to 100 kHz |
|
33 V to 100 V | 0.007 % +500 μV | 0.009 % + 500 μV | 0.021 % + 1 mV | 0.051 % + 5 mV |
100 V to 330 V | 0.009 % +25 mV | 0.009 % + 25 mV | 0.021 % + 25 mV | 0.051 % + 100 mV |
330 V to 1020 V | 0.009 % +25 mV | 0.009 % + 25 mV | n/a | n/a |