Origianl articles
Measuring health status using the Health Utilities Index: Agreement between raters and between modalities of administration

https://doi.org/10.1016/S0895-4356(00)00317-6Get rights and content

Abstract

The aim of this study was to evaluate interrater and intermodality agreement in assessing health status using the Health Utilities Index. A random sample from a Dutch cohort of 14-year-old Very Low Birth Weight children and their parents were invited to participate in a face-to-face (n = 150) or telephone (n = 150) interview. All 300 participants were also sent a questionnaire by mail. Response rate was 68%. Interrater and intermodality agreement were high for the physical HUI3 attributes and poor for the psychological attributes. Children and parents reported more dysfunction in the psychological attributes when interviewed than when completing the mailed questionnaire. High agreement on the physical attributes may have resulted from the fact that hardly any dysfunction was reported in these attributes, and poor agreement in the psychological attributes may have been a result of the fact that in these attributes much more dysfunction was reported. In measuring children's health status using the HUI3, the results and their interpretation vary with the source of information and the modality of administration. For maximum comparability between studies, written self-report questionnaires seem the preferred option.

Introduction

In medicine, the effects of prevention and therapy are conventionally measured in terms of mortality and morbidity. In chronic diseases, however, mortality and morbidity show little variance and the patient's priorities may lie elsewhere. In evaluation studies in chronic conditions, health status and health-related quality of life are therefore important additional measures of outcome. For these measures, it is claimed that patients themselves are the preferred respondents. This claim rests on two assumptions: first, that the crucial concept to be measured is the patient's own perception of health, and second, that the patient is the best observer and reporter of this perception 1, 2. Self-reports may, however, be difficult or impossible to obtain, for instance in the severely ill or cognitively impaired. It may then be necessary to invite a spouse, a doctor or a nurse to report on the patient's behalf. The validity of using these so-called proxies as respondents in health surveys has been the subject of several studies, most of which show only partial agreement between proxy report and self-report. In measuring children's health status, parents are commonly used as proxy respondents. This strategy is clearly needed with very young children, who cannot act as respondents. Even in school children and adolescents, the use of parents as valid proxy informants has been advocated 3, 4, despite the fact that at this age children are generally capable of communicating their perception of health. Existing evidence suggests that, as in adult patients, agreement between proxy report and self-report depends on the observability of the domain 5, 6, 7. It has also been found that proxies consistently report less dysfunction in psychological domains than do children themselves 8, 9, 10.

A second important issue in assessing health status is the way the information is obtained. Options include mailed questionnaire, face-to-face interview or telephone interview. It has been argued that the anonymity of a mailed questionnaire invites respondents to be more candid [11], but empirical studies addressing this issue have thus far shown conflicting results 12, 13, 14, 15, 16.

If studies differ with respect to source of information and modality of administration, the resulting sets of data relating to health status cannot be directly compared. In the present study, we analyzed interrater and intermodality agreement on the Health Utilities Index Mark 3 (HUI3) [17]. This was done in the context of an international multicenter study investigating outcomes of very low birth weight or small for gestational age infants. As the participating centers did not apply identical modalities of administration, or use identical sources of information, this analysis is required to interpret intercountry differences in health results, should they exist. The aim of this analysis was: (1) to determine intermodality agreement comparing mailed questionnaires with telephone interviews and with face-to-face interviews from parents and children, respectively; and (2) to determine interrater agreement between parents and children, taking modality into account.

Section snippets

Sample

In 1983, 94% (n = 1338) of all Dutch infants born alive before 32 completed weeks of gestation or with a birth weight of <1500 g were enrolled in a prospective follow-up study named POPS [18]. Not all Dutch hospitals participated in the POPS study. The nonparticipating hospitals agreed to send some information on infants who met the inclusion criteria. Infant mortality was 2% higher in these hospitals, none of which were university hospitals. Nevertheless, the POPS cohort comprises a remarkably

Results

Characteristics of the samples are described in Table 1. The table 1 shows that no statistically significant differences occurred between the samples with regard to background characteristics except for age at follow-up. The mail-only sample was approached 1 month earlier than the samples that were interviewed. In the total cohort eligible for follow-up (n = 908), 202 children (22%) were normal, 447 (49%) had an impairment, 121 (13%) had a disability, 72 (8%) had a moderate handicap and 66 (7%)

Discussion

The aim of this study was to evaluate interrater and intermodality agreement in measuring health status in adolescents by means of HUI3. The results showed that, as expected, both kinds of agreement were generally good in physical attributes, which may be readily observed—such as vision, hearing, ambulation and dexterity—and poor in the psychological attributes of cognition, emotion and pain. Similar findings have been reported before, also with respect to other health status measures 4, 11, 19

Acknowledgements

This study was supported by Grant HS-08385 from the Agency for Health Care Policy and Research, Rockville, MD.

References (32)

  • A.G.C Vogels et al.

    Young children's health related quality of lifedevelopment of the TACQOL

    Qual Life Res

    (1998)
  • G.H.W Verrips et al.

    Measuring health-related quality of life in a child population

    Eur J Public Health

    (1999)
  • A.W Glaser et al.

    Influence of proxy respondents and mode of administration on health status assessment following central nervous sytem tumours in childhood

    Qual Life Res

    (1997)
  • D Whiteman et al.

    Wherein lies the truth? Assessment of agreement between parent proxy and child respondents

    Int J Epidemiol

    (1997)
  • M.H Bellman et al.

    Pain control in children. Parents underestimate children's pain

    BMJ

    (1993)
  • R.D Hays et al.

    Agreement between self reports and proxy reports of quality of life in epilepsy patients

    Qual Life Res

    (1995)
  • Cited by (53)

    • Quality of life and neurological disability in children and young people with ataxia telangiectasia

      2022, European Journal of Paediatric Neurology
      Citation Excerpt :

      Proxy-report measures for child QoL (typically completed by the child's parent) have been developed but the objectivity of parent proxy reports can be influenced by internal and external factors. These include their personal experience of their child's condition and the modality of administration, with reporting bias an important consideration when interpreting such discrepancies [12,13]. This study aimed to 1) compare child and parent ratings of QoL in A-T and examine any discrepancies between the two ratings, 2) monitor changes in QoL of children with A-T over time, 3) compare the QoL in A-T with healthy controls, and 4) explore which neurological factors influence QoL in children with A-T from both the child and parent perspective.

    • Mind the (inter-rater) gap. An investigation of self-reported versus proxy-reported assessments in the derivation of childhood utility values for economic evaluation: A systematic review

      2019, Social Science and Medicine
      Citation Excerpt :

      In terms of quality of reporting, all studies included in this systematic review scored between 11 and 13 points out of the maximum score of 15, indicating good reporting quality according to our quality appraisal criteria (Appendix 1). For the studies reporting utilities with a health condition, inconsistency in the direction of discrepancy in inter-rater gap between child-proxy dyads was evident, with proxy underestimation (Barr et al., 1999; Baumann et al., 2016; Brunner et al., 2004; Bull et al., 2014; Chevreul et al., 2016; Morrow et al., 2012; Penn et al., 2011; Saigal et al., 1999; Sung et al., 2004; Verrips et al., 2001), overestimation (Belfort et al., 2011; Chadha et al., 2010; Czyzewski et al., 1994; Fu et al., 2006; Glaser et al., 1999; Iskrov et al., 2015; Lee et al., 2011; Robertson et al., 2017; Vermeulen et al., 2017a; Wolke et al., 2013) or comparable results (Bull et al., 2014; Cheng et al., 2011). Health condition-specific appraisals are detailed below.

    • Telephone interviews in research with children

      2011, Journal of Pediatric Health Care
    View all citing articles on Scopus
    View full text