Origianl articlesMeasuring health status using the Health Utilities Index: Agreement between raters and between modalities of administration
Introduction
In medicine, the effects of prevention and therapy are conventionally measured in terms of mortality and morbidity. In chronic diseases, however, mortality and morbidity show little variance and the patient's priorities may lie elsewhere. In evaluation studies in chronic conditions, health status and health-related quality of life are therefore important additional measures of outcome. For these measures, it is claimed that patients themselves are the preferred respondents. This claim rests on two assumptions: first, that the crucial concept to be measured is the patient's own perception of health, and second, that the patient is the best observer and reporter of this perception 1, 2. Self-reports may, however, be difficult or impossible to obtain, for instance in the severely ill or cognitively impaired. It may then be necessary to invite a spouse, a doctor or a nurse to report on the patient's behalf. The validity of using these so-called proxies as respondents in health surveys has been the subject of several studies, most of which show only partial agreement between proxy report and self-report. In measuring children's health status, parents are commonly used as proxy respondents. This strategy is clearly needed with very young children, who cannot act as respondents. Even in school children and adolescents, the use of parents as valid proxy informants has been advocated 3, 4, despite the fact that at this age children are generally capable of communicating their perception of health. Existing evidence suggests that, as in adult patients, agreement between proxy report and self-report depends on the observability of the domain 5, 6, 7. It has also been found that proxies consistently report less dysfunction in psychological domains than do children themselves 8, 9, 10.
A second important issue in assessing health status is the way the information is obtained. Options include mailed questionnaire, face-to-face interview or telephone interview. It has been argued that the anonymity of a mailed questionnaire invites respondents to be more candid [11], but empirical studies addressing this issue have thus far shown conflicting results 12, 13, 14, 15, 16.
If studies differ with respect to source of information and modality of administration, the resulting sets of data relating to health status cannot be directly compared. In the present study, we analyzed interrater and intermodality agreement on the Health Utilities Index Mark 3 (HUI3) [17]. This was done in the context of an international multicenter study investigating outcomes of very low birth weight or small for gestational age infants. As the participating centers did not apply identical modalities of administration, or use identical sources of information, this analysis is required to interpret intercountry differences in health results, should they exist. The aim of this analysis was: (1) to determine intermodality agreement comparing mailed questionnaires with telephone interviews and with face-to-face interviews from parents and children, respectively; and (2) to determine interrater agreement between parents and children, taking modality into account.
Section snippets
Sample
In 1983, 94% (n = 1338) of all Dutch infants born alive before 32 completed weeks of gestation or with a birth weight of <1500 g were enrolled in a prospective follow-up study named POPS [18]. Not all Dutch hospitals participated in the POPS study. The nonparticipating hospitals agreed to send some information on infants who met the inclusion criteria. Infant mortality was 2% higher in these hospitals, none of which were university hospitals. Nevertheless, the POPS cohort comprises a remarkably
Results
Characteristics of the samples are described in Table 1. The table 1 shows that no statistically significant differences occurred between the samples with regard to background characteristics except for age at follow-up. The mail-only sample was approached 1 month earlier than the samples that were interviewed. In the total cohort eligible for follow-up (n = 908), 202 children (22%) were normal, 447 (49%) had an impairment, 121 (13%) had a disability, 72 (8%) had a moderate handicap and 66 (7%)
Discussion
The aim of this study was to evaluate interrater and intermodality agreement in measuring health status in adolescents by means of HUI3. The results showed that, as expected, both kinds of agreement were generally good in physical attributes, which may be readily observed—such as vision, hearing, ambulation and dexterity—and poor in the psychological attributes of cognition, emotion and pain. Similar findings have been reported before, also with respect to other health status measures 4, 11, 19
Acknowledgements
This study was supported by Grant HS-08385 from the Agency for Health Care Policy and Research, Rockville, MD.
References (32)
- et al.
Refusal and information bias associated with postal questionnaires and face-to-face interviews in very elderly subjects
J Clin Epidemiol
(1996) - et al.
Correspondence between adolescent report and parent report of psychiatric diagnostic data
J Am Acad Child Adolesc Psychiatry
(1997) - et al.
Does it matter whom and how you ask? Inter- and intra-rater agreement in the Ontario Health Survey
J Clin Epidemiol
(1997) - et al.
Interviewer versus self-administered questionnaires in developing a disease-specific, health related quality of life instrument for asthma
J Clin Epidemiol
(1993) - et al.
Reliability and validity of a comprehensive health status measure in a heterogeneous population of children admitted to intensive care
J Clin Epidemiol
(1996) - et al.
Mother–child agreement on the self-report of anxiety in abused children
J Anxiety Disord
(1997) - et al.
Comparison of patient and proxy EORTC QLQ-C30 ratings in assessing the quality of life of cancer patients
J Clin Epidemiol
(1998) - et al.
Daughter and mother report on individual symptoms on the children's depression inventory
J Adolesc Health
(1997) Quality of lifeWhat is it? How should it be measured?
Oncology
(1988)- et al.
Kindla questionnaire for the measurement of health-related quality of life in children
Gesundheidspsychol
(1994)
Young children's health related quality of lifedevelopment of the TACQOL
Qual Life Res
Measuring health-related quality of life in a child population
Eur J Public Health
Influence of proxy respondents and mode of administration on health status assessment following central nervous sytem tumours in childhood
Qual Life Res
Wherein lies the truth? Assessment of agreement between parent proxy and child respondents
Int J Epidemiol
Pain control in children. Parents underestimate children's pain
BMJ
Agreement between self reports and proxy reports of quality of life in epilepsy patients
Qual Life Res
Cited by (53)
Quality of life and neurological disability in children and young people with ataxia telangiectasia
2022, European Journal of Paediatric NeurologyCitation Excerpt :Proxy-report measures for child QoL (typically completed by the child's parent) have been developed but the objectivity of parent proxy reports can be influenced by internal and external factors. These include their personal experience of their child's condition and the modality of administration, with reporting bias an important consideration when interpreting such discrepancies [12,13]. This study aimed to 1) compare child and parent ratings of QoL in A-T and examine any discrepancies between the two ratings, 2) monitor changes in QoL of children with A-T over time, 3) compare the QoL in A-T with healthy controls, and 4) explore which neurological factors influence QoL in children with A-T from both the child and parent perspective.
Optimal decision of dynamic wealth allocation with life insurance for mitigating health risk under market incompleteness
2022, European Journal of Operational ResearchMind the (inter-rater) gap. An investigation of self-reported versus proxy-reported assessments in the derivation of childhood utility values for economic evaluation: A systematic review
2019, Social Science and MedicineCitation Excerpt :In terms of quality of reporting, all studies included in this systematic review scored between 11 and 13 points out of the maximum score of 15, indicating good reporting quality according to our quality appraisal criteria (Appendix 1). For the studies reporting utilities with a health condition, inconsistency in the direction of discrepancy in inter-rater gap between child-proxy dyads was evident, with proxy underestimation (Barr et al., 1999; Baumann et al., 2016; Brunner et al., 2004; Bull et al., 2014; Chevreul et al., 2016; Morrow et al., 2012; Penn et al., 2011; Saigal et al., 1999; Sung et al., 2004; Verrips et al., 2001), overestimation (Belfort et al., 2011; Chadha et al., 2010; Czyzewski et al., 1994; Fu et al., 2006; Glaser et al., 1999; Iskrov et al., 2015; Lee et al., 2011; Robertson et al., 2017; Vermeulen et al., 2017a; Wolke et al., 2013) or comparable results (Bull et al., 2014; Cheng et al., 2011). Health condition-specific appraisals are detailed below.
Self and parent perspectives on health-related quality of life of adolescents born very preterm
2013, Journal of PediatricsTelephone interviews in research with children
2011, Journal of Pediatric Health Care