Example

Channel 1 is to be calibrated with four-wire connection at two points with 100 Ω and 350 Ω. The vendor offset for the 2-wire calibration is -2607 (taken from index 0x800F:03).

The following measured values are recorded:

100 Ω through precision resistor

X1 = 25600 (1/256 Ω)

171125, read in index 0x800E:01

Y1 = 171125

350 Ω through precision resistor

X2 = 89600 (1/256 Ω)

592224, read in index 0x800E:01

Y2 = 592224

With the equations (1) - (3):

Example 1:

the resulting values for gf, GU and OU are:

Example 2:

The indices accept only integer values. The following entries are to be made in the CoE:
Index 0x8000:17 = -12
Index 0x8000:18 = 9960

Subsequently the vendor calibration is to be deactivated (0x8000:0B) and the user calibration activated (0x8000:0A).