Article Text
PDF
Abstract
Objective Despite growing interest in children and young people’s (CYP) perspectives on healthcare, they continue to be excluded from many patient experience surveys. This study investigated the feasibility of, and additional information gained by, measuring CYP experiences of a recent hospital admission.
Design Cross-sectional analysis of national survey data.
Setting Inpatients aged 8–15 years in eligible National Health Service hospitals, July–September 2014.
Participants 6204 parents/carers completed the parent section of the survey. The CYP section of the survey was completed by CYP themselves (n=3592), parents (n=849) or jointly (n=1763).
Main outcome measures Pain relief, involvement, quality of staff communication, perceived safety, ward environment, overall experience.
Analyses Single-measures intraclass correlations (ICCs) were used to assess the concordance between CYP and parent responses about the same inpatient episode. Multilevel logistic regression models, adjusted for individual characteristics, were used to compare the odds of positive responses when the CYP section of the survey was completed by parents, by CYP themselves or jointly.
Results The CYP section of the survey was completed independently by 57.8% of CYP. Agreement between CYP and parent responses was reasonably good for pain relief (ICC=0.61 (95% CI 0.58 to 0.63)) and overall experience (ICC=0.70 (95% CI 0.68 to 0.72)), but much lower for questions comparing professionals’ communication with CYP and with their parents (ICC range=0.28 (95% CI 0.24 to 0.32) to 0.51 (95% CI 0.47 to 0.54)). In the regression models, CYP were significantly less likely than parents to report feeling safe (adjusted OR (AOR)=0.54 (95% CI 0.38 to 0.76)), involvement in decisions (AOR=0.66 (95% CI 0.46 to 0.94)) or adequate privacy (AOR=0.68 (95% CI 0.52 to 0.89)).
Conclusions Including CYP (8–15 years) in patient experience surveys is feasible and enhances what is known from parents’ responses.
- children
- young people
- patient perspective
- inpatient experience
- measurement
This is an Open Access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/
Statistics from Altmetric.com
What is already known on this subject?
Data from patient experience surveys can help to empower patients, improve the quality and patient-centredness of care and make an important contribution to improving health outcomes.
Typically, children and young people below 16–18 years are either not included in patient experience surveys or their parents are asked to respond on their behalf.
What this study adds?
Including children and young people in patient experience surveys is feasible and enhances what is known from parents’ responses.
Background
Patients’ perspectives are essential to understanding the quality of healthcare services and delivering patient-centred care.1 2 Patient-centredness is recognised as a key pillar of health quality in its own right, and as an important determinant of health outcomes.3 4 Central to developing and monitoring such care has been an increase in the use of patient experience surveys, which are now administered routinely in many healthcare settings.4
Historically, most patient experience surveys have been restricted to adults.5 6 When children and young people’s (CYP) care is included in patient experience surveys, parents or caregivers (henceforth referred to as parents) are usually asked to respond on their behalf.5 7 Two reported reason for not asking CYP themselves have been concerns about gaining parental consent and lack of evidence about the feasibility of asking them to complete surveys.8 While it is clear that young children are unlikely to be able to provide detailed experience information, there is increasing evidence that young people may be willing to respond to age-appropriate surveys from the age of 8 onwards and that their healthcare priorities evolve and progressively diverge from those of their parents from the age of 12 onwards.9–11 However, it is not known whether, and from what age, it would be feasible to include CYP themselves in routine, large-scale programmes to measure patient experience. Lastly, it is not known whether asking CYP themselves would yield significant additional information about their experiences, over and above the information that can be obtained from parents answering on their behalf.
Data from the English Children and Young People’s Inpatient and Day Case Survey 201412 allow for investigation of these questions using a large, nationally representative sample of CYP who were recently discharged from hospital. This survey was administered in 137 acute and specialist NHS Hospital Trusts in England admitting paediatric patients. For CYP aged 8–15 years, child-friendly surveys were administered, which contained two sections: a CYP section for the child/young person to complete (with input from their parents where necessary), and a section for their parents.
The first aim of this study was to investigate the proportion and characteristics of CYP who completed the CYP section independently. The second aim was to study the agreement between reports by CYP and their parents on the same inpatient episode. Third, we investigated whether there were systematic differences in responses to the CYP section when it was completed by CYP, parents or jointly.
Methods
Data
Data from the Children and Young People’s Inpatient and Day Case Survey 2014 were analysed for patients aged 8–15 years (response rate=27%). Questionnaires were posted to consecutively discharged patients (overnight stays and day case admissions) between July and September 2014. Surveys comprised two sections: a section for their parent (n=6204) and a CYP section that could be completed by CYP themselves (n=3592), parents (n=849) or jointly (n=1763). Survey report and sampling procedures have been published previously.13 Further details on methodology are presented in the online supplementary appendix (Methods section).
Supplementary file 1
Variables and analyses
This study comprised three sets of analyses, corresponding to the three study aims.
Descriptive analysis of the sociodemographic and clinical characteristics of CYP in each category of respondent: by themselves, by their parents or jointly.
Analysis of CYP-parent dyads to compare the responses of CYP and their parents on the same inpatient admission, for CYP who responded by themselves.
Comparison of parent, CYP and joint responses to the CYP section (both unadjusted and adjusted for sociodemographic and clinical characteristics).
The details of each set of analyses are described in turn below.
Descriptive analysis of CYP respondents
The proportion of CYP surveys completed by the CYP, parent and jointly were calculated—both overall and disaggregated by patient characteristics (age group (8–11 vs 12–15 years), sex, ethnicity, elective vs emergency admission, number of admissions within the past year (1–3 vs ≥4) and presence of any long-standing illness or condition (see online supplementary appendix for wording of the questions and responses). Next, parental and joint responses were combined to create a dichotomised outcome of any parental involvement versus independent CYP response. Χ2 tests were used to assess the significance of differences in the rates of independent CYP responses between each sociodemographic and clinical group.
Analysis of CYP-parent dyads
Data from CYP-parent dyads were used to compare responses about the same inpatient admission from the two sections of the survey. Dyads were only included if the CYP completed his/her section independently.
For three questions (presence of pain, pain relief, overall experience), direct comparisons were possible between CYP self-reported experience and parent’s perceptions of his/her child’s experience. For an additional seven questions, CYP perceptions of how staff communicated with and involved them (as the child/patient) were compared with parental views of how staff communicated with and involved them (as the parent). The wording of the questions and dichotomised responses in the CYP and parent sections of the survey are presented in online supplementary appendix table A1 and table A2.
First, the single-measures intraclass correlation (ICC) was calculated, to assess the level of agreement between CYP and parent responses. These analyses made use of all response options. Next, using the dichotomised responses shown in table 1, the proportions of CYP and parents reporting a positive experience of care on each measure were calculated. Then, the degree of disagreement between dichotomised CYP and parent responses was calculated, using
The proportion of surveys where the CYP and parental responses differ and
The proportion where the CYP response was less positive than their parent’s response.
Respondents to the children and young people’s (CYP) section of the survey, by selected individual characteristics. Children and Young People’s Inpatient Survey, England, 2014
Note that for the overall experience of care question, analyses of the dichotomised (or ‘top-box’) responses (0–8/10 vs 9–10/10) are presented in table 2; analyses of the exact scores were also performed and are presented separately. ICC values were assigned the following categories:<0.40=poor; 0.40–0.59=fair; 0.60–0.74=good; 0.75–1.00=excellent agreement.14
Agreement between reports of the same inpatient admission by children and young people (CYP) and their parent/carer. Children and Young People’s Inpatient Survey, England, 2014.
Analysis of differences between parent, CYP and joint responses to the CYP section
Data from the CYP section of the survey were used to compare responses according to who answered the survey: parent, CYP and joint responses. Thirteen dichotomised patient experience measures from the CYP section of the survey were analysed, which related to the hospital environment, staff attitudes and communication and overall care rating. The wording of all questions is presented in online supplementary appendix table A2. Unadjusted and adjusted logistic regression models were conducted; multilevel, adjusted models included all patient variables listed above (as fixed main effects at patient level) and admitting Hospital Trust (as a random effect at Trust level). Descriptive analyses were performed using SPSS V.23 and regression models created using MLwiN V.2.36.
Results
Descriptive analysis of CYP respondents
The majority (3592/6204=57.9%) of patients aged 8–15 years completed the CYP section of the survey themselves. Parents responded in 849 (13.7%) cases; the remaining 1763 (28.4%) were completed jointly by CYP and their parents.
Table 1 presents the response categories by selected individual variables. Surveys were more likely to be completed by CYP themselves (rather than by parents or jointly) when they were females versus males (62.6% vs 53.6%, P<0.001), older children (63.1% among 12–15 years vs 52.1% among 8–11 years, P<0.001), those with no long-standing condition (62.7% vs 50.4%, P<0.001), those with 1–3 versus four or more hospital admissions within the past 6 months (58.9% vs 52.6%, P=0.013) and those reporting white ethnicity (60.4%) versus black (46.8%, P<0.001), Asian (42.8%, P<0.001) or mixed/other/not known (50.0%, P<0.001). CYP were also more likely to respond themselves if they were admitted as an inpatient rather than a day case (60.3% vs 56.4%, P=0.002). Response rates did not differ significantly by ward type or elective versus emergency admission; regarding ward type, this may reflect the small number of patients admitted to adolescent or adult wards.
Analysis of CYP-parent dyads
Table 2 presents the proportion of positive responses and the agreement between responses by the CYP-parent dyads. Despite good overall agreement between CYP and parent responses regarding the presence of pain (ICC=0.73 (95% CI 0.71 to 0.75)), in 163 dyads (4.7%) CYP reported having had pain but their parents reported no pain, while the converse was true in 250 dyads (7.2%). Where both CYP and parents reported the CYP having had pain, the ICC value for good attention to pain control was 0.61 (95% CI 0.58 to 0.63), with CYP reporting poorer experience for pain management than their parents in 8.4% of cases. For overall experience, ICC was 0.70 (95% CI 0.68 to 0.72). Analysing dichotomised responses (as shown in the table), CYP were more positive than their parents regarding overall experience in 10.0% of cases, and less positive in 13.5%. Analysis of the exact scores (0–10) showed agreement in only 49.2% of dyads (see supplementary appendix table C and table D for further details).
Involvement in decisions about care was reported by 55.1% of CYP, by 66.6% of parents and by both in only 43.1% of dyads. There were considerable differences between CYP and their parents (ICC 0.34 (95% CI 0.29 to 0.39)), with disagreement in 42.7% of cases, and CYP reporting lower involvement than their parents in 28.3%. Similarly, low levels of agreement were seen between CYP and parental responses for the six indicators of communication (ICC range 0.28–0.51; non-concordance in 13.7%–34.4% of cases, with CYP reporting poorer experience of staff communication than their parents in 6.2%–22.6% of dyads).
Analysis of differences between parent, CYP and joint responses to the CYP section
The proportions of positive responses to each question by CYP, parents and jointly are shown in online supplementary appendix table B. In table 3, data from the CYP section show the ORs of positive responses for CYP and joint responses, compared with parental responses; the adjusted ORs (AOR) for selected questions are also shown in figure 1.
Adjusted ORs of good experience, children and young people (CYP) vs parent responses. Selected indicators from CYP Inpatient Survey, England, 2014.
ORs of positive reported patient experience in surveys completed by children and young people (CYP) themselves or jointly, compared with surveys completed by parents/carers. Children and Young People’s Inpatient Survey, England, 2014
CYP were significantly more likely than their parents to report pain (AOR 1.21 (95% CI 1.01 to 1.56), P=0.04). CYP were less likely to report that staff did all they could to help ease the pain (AOR 0.64 (95% CI 0.45 to 0.91), P=0.01); they felt safe on the ward (AOR 0.54 (95% CI 0.38 to 0.76), P<0.001); they were involved in decisions about their care (AOR 0.66 (95% CI 0.46 to 0.94), P=0.02) or they were given enough privacy (AOR 0.68 (95% CI 0.52 to 0.89), P=0.005). The likelihood of a good overall care rating (9-10/10) was also lower for CYP AOR=0.69 (95% CI 0.56 to 0.86), P=0.001). Conversely, there were significantly higher odds of positive responses about hospital food when the survey was completed by CYP themselves, rather than by their parents (AOR 1.48 (95% CI 1.15 to 1.90), P=0.002). There were no significant differences between CYP and parental responses in the odds of responding positively to the other questions, and no significant differences between parent and joint responses.
Discussion
Although many have argued against collecting patient experience data from CYP because they would fail to complete surveys or give answers that matched their parent’s responses, this study shows that CYP will indeed respond and provide information that enhances what is known from their parents. Direct comparisons of the experiences of CYP and their parents during the same inpatient admission showed that parents’ responses often do not capture important aspects of CYP’s experience relating to pain, involvement and communication. Overall care ratings by CYP and parents differed in about one-quarter (24%) of families (using dichotomised or ‘top-box’ scores) and over half (51%) of families when comparing the exact rating. Comparing surveys completed by CYP and parents, and adjusting for patient characteristics, CYP responses were less positive than parents’ responses regarding safety, pain relief, involvement in decisions, privacy and overall care rating.
These analyses used questions that had undergone a rigorous process of piloting and cognitive testing with their relevant age groups and the survey sample has previously been shown to be broadly representative of the NHS inpatient population in this age group.12 13 The overall response rate of 27% was similar to other paediatric surveys that are only addressed to parents,7 but the risk of differential non-response limits our ability to generalise the first set of findings to all NHS patients in this age group.
The analyses investigating whether CYP and parent responses differ are also subject to limitations. It is possible that minor wording differences and/or differences in interpretation may have influenced the degree of agreement between CYP and parent responses. It was also not possible to compare parent and CYP responses directly for the majority of questions. Lastly, while our regression models were able to adjust for a number of important potential confounders, we cannot exclude unseen confounding by factors not included in our models. In particular, no data were available to indicate how many patients were not able to respond independently due to cognitive impairment, or due to additional physical or communication needs.
Research and policy context
WHO has recommended as a key research priority developing better ways of understanding and monitoring the views of young people.14 To our knowledge, this is the first national study to report detailed characteristics of CYP who complete a patient experience survey. Although previous literature is sparse, we report a larger number of CYP responding independently than the previous English survey in 2004, when a minority (38%) of CYP aged 12–15 years and very few below the age of 12 years completed the survey themselves.15 This may reflect the extensive work that has been done to develop a questionnaire that is designed specifically for CYP. There may also be an increasing level of willingness among CYP to express their views and a greater expectation that their views will be listened to.16 17
Although responses from CYP have long been used in the diagnosis and management of some paediatric conditions,18 we are not aware of other national-level studies that investigate the additional benefit of CYP reporting their patient experience (rather than relying on parent responses). It confirms and extends the findings of smaller, single-centre studies, which have shown that parent and CYP responses to patient experience surveys often differ, with a tendency for CYP to be less positive about the quality of care they have received.19 20 Lastly, our findings extend previous research with parents, which showed that the quality of communication with CYP and with parents are distinct aspects of paediatric care and should be evaluated separately.7
Conclusion
The Royal College of Paediatrics and Child Health has stated that ‘no-one is better qualified to comment on the care provided by a paediatric centre than the CYP receiving that care’.21 Yet, in practice, CYP are rarely given the opportunity to express their views or report their experience of healthcare. Our findings demonstrate that it is feasible to collect the views of CYP (8–15 years) and that doing so yields important additional information, beyond what is possible from parent surveys alone.
A key research question for the future is whether monitoring and improving CYP experience of healthcare could promote more patient-centred care for this age group, which may in turn promote healthier behaviour, including adherence to treatment regimens, and improve long-term health outcomes. There is also a need for research into whether administering the questionnaire electronically, and/or using shorter versions of questionnaires could improve response rates and provide more timely information with which to improve services.
Footnotes
Contributors DSH, SS, JP, AT, RMV conceived and designed the study. SS performed all analyses. All authors critically reviewed the manuscript. SS and DSH are the guarantors. DSH affirms that the manuscript is an honest, accurate and transparent account of the study being reported; that no important aspects of the study have been omitted and that any discrepancies from the study as planned (and, if relevant, registered) have been explained. All authors, external and internal, had full access to all of the data (including statistical reports and tables) in the study and can take responsibility for the integrity of the data and the accuracy of the data analysis.
Competing interests SS, AT and BH are employed by Picker Institute Europe, which provides survey coordination services for the NHS patient surveys under contract to the Care Quality Commission. DSH is supported by the Health Foundation.
Ethics approval These were secondary analyses of anonymised data and were approved by the Care Quality Commission. The survey implementation itself was given a favourable ethical opinion by NRES Committees—North of Scotland ref 14/NS/0006.
Provenance and peer review Not commissioned; externally peer reviewed.