Calculation of process data

The process data are calculated in up to seven steps between reading of the ADC and the process data output:

Name

Calculation formula

not active

Offset correction

Calculation of process data 1:

Calculation of process data 2:

Filter for averaging over 8 values

Calculation of process data 3:

Calculation of process data 4:

60 Hz mode adaptation

Calculation of process data 5:

Calculation of process data 6:

Calibration active

Calculation of process data 7:

Calculation of process data 8:

Calculation of process data 9:

Calculation of process data 10:

AC system offset

Calculation of process data 11: 
for
Calculation of process data 12:

Calculation of process data 13:
(condition not met)

Scaling

Calculation of process data 14:

-

Table 1: Formulas for calculation of process data

The scaling includes the powers of ten selected in the range.
All gain factors should therefore correspond to 1/8 in order to obtain a total factor of 1. The value 8192 (0x2000) results in a total factor of 1.

Legend for table 1

Name

Meaning

CoE Index

Name

Meaning

CoE Index

XADC

Output value of the A/D converter

0x800E:01

 

 

 

YZ

Measured value after ADC offset correction

 

BZ

Current ADC Zero value

0x800E:02

BZCal

ADC Zero at the time of calibration

0x800F:20

YF

Measured value after averaging

 

 

 

 

Y60

Measured value after adaptation of the 60 Hz integration time

 

BF

60 Hz offset

0x800F:1D

AF

60 Hz gain

0x800F:1E

YH

Measured value after manufacturer calibration

 

BK

Manufacturer offset

0x800F (odd subindices)

AK

Manufacturer gain

0x800F (even subindices)

YA

Measured value after user calibration

 

BA

User offset

0x8002 (odd subindices)

AA

User gain

0x8002 (even subindices)

Y

Measured value after AC system offset

 

XSO

AC system offset

0x800F:1F

YScale

Measured value after scaling

 

FScal

End value in 1 bit per 1µV / 1µA

 

Table 2: Legend for table 1