4. CHAT Reliability ICCs

Statistics run on February 10, 2011.

10 PSG studies were re-scored by two scorers (916 and 931) to assess inter-scorer reliability. Each scorer had originally scored 5 of the studies, allowing for intra-scorer reliability assessments.

Variables of interest include % of time in sleep stages, arousal index, and AHI.

Inter-scorer assessment (916 vs. 931 on re-scoring of 10 studies):

Variable	916 mean	931 mean	Mean diff	ICC
timest1p	7.35	6.28	1.07	0.821 (0.433 – 0.952)
timest2p	45.95	43.92	2.03	0.872 (0.570 – 0.967)
times34p	28.87	32.35	3.48	0.749 (0.267 – 0.931)
timeremp	17.82	17.50	0.32	0.898 (0.643 – 0.974)
ai	11.67	11.63	0.04	0.944 (0.793 – 0.986)
omai0p	3.23	3.08	0.15	0.996 (0.983 – 0.999)
omahi3	12.76	14.39	1.63	0.985 (0.942 – 0.996)

Intra-scorer assessment (916 original vs. 916 re-scoring of 5 studies):

Variable	Orig	Re-score	Mean diff	ICC
timest1p	10.19	8.26	1.93	0.832 (0.064 – 0.981)
timest2p	43.46	44.70	1.24	0.946 (0.579 – 0.994)
times34p	30.02	28.90	1.12	0.715 (-0.230 – 0.966)
timeremp	16.36	18.14	1.78	0.844 (0.103 – 0.983)
ai	13.40	14.56	1.16	0.951 (0.613 – 0.995)
omai0p	4.97	4.42	0.55	0.968 (0.733 – 0.997)
omahi3	14.17	14.38	0.21	0.991 (0.914 – 0.999)

Intra-scorer assessment (931 original vs. 931 re-scoring of 5 studies):

Variable	Orig	Re-score	Mean diff	ICC
timest1p	5.26	5.52	0.26	0.968 (0.731 – 0.997)
timest2p	46.24	45.62	0.62	0.719 (-0.221 – 0.967)
times34p	30.94	30.78	0.16	0.618 (-0.388 – 0.952)
timeremp	17.58	18.10	0.52	0.943 (0.562 – 0.994)
ai	7.40	8.54	1.14	0.739 (-0.180 – 0.969)
omai0p	3.21	2.00	1.21	0.752 (-0.152 – 0.971)
omahi3	12.60	12.51	0.09	0.950 (0.606 – 0.995)

National Sleep Research Resource

Childhood Adenotonsillectomy Trial

https://doi.org/10.25822/d68d-8g03