People with limiting long-term conditions report poorer experiences and more problems with hospital care

Abstract

Background

Long-term conditions have a significant impact on individuals, their families, and the health service. As people with these conditions represent a high proportion of hospital admissions, investigating their experiences of inpatient care has become an important area of investigation. We conducted a secondary analysis of the NHS adult inpatient survey for England to compare the hospital experiences of three groups of patients: those without long-term conditions, those with a single long-term condition, and those with multiple long-term conditions. We were particularly interested in the extent to which these patients received self-management support from hospital staff, so we developed a brief summary tool drawn from salient questions in the survey to aid the comparison.

Methods

Analysis of data from the 2011 national adult inpatient survey (n = 65,134) to compare the experiences of three groups of patients: those with no limiting long-term conditions (No-LLTC), those with one limiting long-term condition (S-LLTC), and those with two or more limiting long-term conditions (M-LLTC). The main outcome measure was patients’ self-reports of their experience of inpatient care, including staff-patient interactions, information provision, involvement in decisions and support for self-care and overall ratings of care. A short form scale, the Oxford Patient Involvement and Experience scale (OxPIE) was developed from the adult inpatient survey and used to compare the groups using logistic regression.

Results

There were significant differences between the No-LLTC group in comparison to both the S-LLTC and M-LLTC groups. Patients with limiting long-term conditions reported significantly worse hospital experiences than those without, as measured by OxPIE: S-LLTC odds ratio = 1.23, 95% CI 1.03-1.48; M-LLTC odds ratio = 1.64, 95% CI 1.19 – 2.26. Responses to a single global rating question were more positive but not strongly correlated with OxPIE.

Conclusions

Patients with LLTCs were more critical of their inpatient care than those with no LLTCs. Those with more than one long-term condition reported worse experiences than those with a single limiting condition. Simple rating questions may not be sufficiently sensitive to reflect important aspects of patients’ experience.

Background

Chronic diseases, physical, psychological, sensory or cognitive disabilities (long-term conditions (LTCs)) have a significant impact on individuals and their families and on health and social care services., LTCs are very common, especially among older people. An analysis of patient data from Scotland found that, in 2007, 42% of the population had at least one chronic condition and 23% had two or more [1]. The proportion with at least one LTC rose to 50% at age 50 and 80% at age 65. Similar proportions of people with multiple LTCs have been found in studies of US and Canadian populations [2, 3]. People with LTCs account for a disproportionate share of hospital attendances, with LTCs accounting for 70% of hospital inpatient bed days in England in 2009 [4]. Those with long-term conditions that limit their activities (LLTCs) are the most intensive users of the most expensive services. There is evidence that strategies to engage, support and empower people with LTCs have an important role in improving health outcomes [5, 6]. Surveys show that people with LTCs want to be involved in decisions about their care and they want access to information to help them make those decisions [4]. They also want their role in self-care to be acknowledged by staff and to be given effective support to help them self-manage their condition [7]. Most patients with LTCs in England report having some sort of care planning discussion with their GP, but only a small proportion experience proactive, systematic support in primary care [8, 9]. This type of support is equally important during hospital episodes, since adequate preparation for returning home after discharge can be crucial to promote recovery and independent living. We have been unable to find any studies focusing on self-management support for hospital inpatients with LTCs. We therefore conducted a secondary analysis of data from the NHS national inpatient survey to examine the extent to which patients with and without LTCs receive self-management support during hospital stays.

Most published studies of patients’ experience have focused on the relationship between specific conditions (e.g. diabetes, cardiovascular disease) or multiple conditions (two or more LTCs), and health-related quality of life, medical services use or health care utilisation costs [10–12]. Most of these studies narrowly define LTCs as the presence or absence of a LTC, rather than whether or not the LTC(s) have an impact on peoples’ daily activities. The few studies which have investigated this issue in more depth underline the importance of incorporating self-reported burden associated with the LTC(s) to establish a more accurate understanding of peoples’ experiences and healthcare needs [13–15]. Since some LTCs (for example hypertension) may not affect the type of support people require in hospital, we chose to limit our analysis to those survey respondents who indicated that they had one or more LTCs that limited their activities.

The study had two main aims:

• 1. To develop an instrument, using psychometric methods, that would enable us to summarise patients’ reports of their experience, focusing in particular on the extent to which hospital staff informed and engaged them and provided them with self-management support;

• 2. To compare the hospital experiences of three groups of patients: those without limiting long-term conditions (No-LLTC), those with a single limiting long-term condition (S-LLTC), and those with multiple limiting long-term conditions (M-LLTC).

The national patient survey programme for England, currently run by the Care Quality Commission (CQC), has conducted inpatient surveys each year since 2004 [16]. This postal survey is sent to samples of 850 adult patients consecutively discharged from each hospital trust in the country during a specified period. The questionnaire, which asks respondents a number of questions about their most recent hospital stay, includes items on interactions with hospital staff, involvement in treatment and discharge decisions, information provision and support for carers. It also asks about the presence or absence of LTCs and whether these conditions limit their activities in any way. Although the results of the survey are reported publicly each year, detailed analyses of the experience of inpatients with and without LLTCs have not previously been published.

Methods

Data sources

We used data from the national inpatient survey that was conducted in 2011. For the purpose of this analysis we were interested in people who had a long term condition that limited their activities, excluding those with problems such as hypertension that might not have an obvious effect on what they are able to do. Two items in the inpatient questionnaire asked patients to indicate if they had a long-term condition (longstanding illness or physical condition, such as cancer, HIV, diabetes, chronic heart disease or epilepsy, hearing or vision problem, deafness or severe hearing impairment, blindness or partially sighted, mental health condition or learning disability) and, if so, whether this condition caused them difficulties in various aspects of their daily life (everyday activities, work, education or training, access to buildings, streets or vehicles, people’s attitudes to them, communicating, mixing with others or socializing, or any other activity). Respondents answering yes to both these questions were deemed to have a limiting long term condition (LLTC). We categorised respondents into one of three groups: no limiting long term condition (i.e. no condition that limited their activities, No-LLTC), a single limiting long term condition (S-LLTC), and multiple (two or more) limiting long term conditions (M-LLTC).

Scale development

We transformed all thirty-one items in the questionnaire that specifically concerned patients’ experience of interpersonal care, including staff-patient interactions, information provision, involvement in decisions and support for self-care, into dichotomous variables. Other questions about waiting times, food and the environment were omitted from the analysis. We coded each of the items as a dichotomous ‘problem score’, indicating the presence or absence of a problem. A problem is defined as an aspect of healthcare that could, in the eyes of the patient, be improved upon to enhance their experience of care (Figure 1).

Figure 1

Examples of questions showing derivation of problem scores. Note: Black boxes indicate responses coded as a ‘problem’.

We used these items to develop a short summary measure that we named the Oxford Patient Involvement and Experience (OxPIE) scale. The criteria used to develop OxPIE were based on previously published methods for developing psychometrically reliable scales of inpatient experiences [17, 18]. These criteria include:

• 1. items included in the short-form should be applicable to as many respondents as possible (i.e. very low proportion of missing responses to items)

• 2. the short-form created from the 31 pertinent items in the Picker adult inpatient questionnaire should ideally correlate with the longer ‘parent’ measure at 0.9 or above [19]

• 3. the level of internal consistency for the short-form (KR-20 for dichotomous variables) should be above 0.7 [20]

• 4. item total correlations, corrected for overlap, should exceed 0.3 for items in the short-form measure [21].

Analysis

We carried out a bivariate analysis of categorical variables using the chi-squared test. Item analysis for the scale was based on an examination of the data for floor and ceiling effects, correlations between items, item discrimination and ordering of response categories. Internal consistency was evaluated with item-to-item and item-total correlations using the Kuder-Richardson (KR20) method [22]. We constructed a multivariable logistic regression model to examine associations between the OxPIE scale and key patient variables (LLTC status, age group, gender, length of stay, ethnicity, pain experienced during hospitalisation, having an operation or procedure during hospitalisation and route of admission). As older age is closely associated with LLTC status, interaction terms for age group and LLTC status were also included in the model. A backward-selection procedure, with a P value of less than 0.1 used for retention in the model, was used to identify important patient factors at the 0.05 level of statistical significance. All statistical analyses were performed using STATA (Version 10.1; StataCorp).

Picker Institute Europe has ethical approval to conduct the annual national Inpatient Survey from the National Research Ethics Service (NRES: 01/8/090) and NIGB Ethics and Confidentiality Committee (ECC) approval (under Section 251 approval from the Secretary of State) to process patient identifiable information derived from the Inpatient Survey (ECC 6-02 (FT1)/2012). This study used secondary analysis of publically available information (provided by Picker with the consent of CQC in the UK). At no time was any personal identifiable information made available to any of the researchers involved in this study.

Results

Respondents’ characteristics

The 2011 inpatient survey was mailed to 136,446 adult patients (aged 16 years and over) recently discharged from 161 acute and specialist NHS trusts in England. A total of 70,863 questionnaires were returned completed, a response rate of 51.9%. Of these, 65,134 respondents (91.9%) provided sufficient information about LLTC(s) to be included in the analysis. More women (53.2%) returned the questionnaire than men. Most respondents (92.0%) described their ethnicity as ‘white-British’, and nearly two-thirds (65.2%) were aged over 61 (Table 1). Overall, 55.8% of respondents reported no LLTCs, 29.0% had one and 15.2% had two or more. Approximately 32% of the No-LLTC group reported one or more LTCs but indicated that these did not limit their daily activities.

Table 1 Characteristics of respondents

Patients in the M-LLTC group were more likely to have experienced an emergency admission than those in the other two groups: 71.1% of M-LLTC patients were admitted as emergencies as compared to 61.0% of the S-LLTC group and 54.0% of the No-LLTC group (p < 0.001). The majority of those in the No-LLTC group (69.6%) underwent operations or procedures, as compared to only half (50.0%) of those in the S-LLTC group and less than half (47.1%) of those in the M-LLTC group.

OxPIE scale development

Twenty of the original 31 questions in the 2011 inpatient survey were omitted from the scale. These items were removed due to not being applicable to a large proportion of respondents (i.e. items not relevant to all respondents), or because their removal resulted in an increase in the reliability of the instrument. The item analysis for the OxPIE scale is shown in Table 2. The internal consistency of the OxPIE scale was good (KR-20 = 0.85) and the correlation between the eleven-item scale and the 31 item ‘parent’ measure was very high (r = 0.947; p < 0.001). Item-total correlations for each item in the scale were above the recommended level, indicating very good discrimination for each of the items.

Table 2 Items included in OxPIE scale including item-total correlation and percentage of missing values

Descriptive statistics for the OxPIE scale results for each of the three LLTC groups are shown in Table 3. Given the considerable skewness of the distribution of responses, the OxPIE scale was dichotomised using the median-split method [23, 24]. The KR-20 for each of the LLTC groups was very similar to the KR-20 for the entire sample; No-LLTC = 0.83, S-LLTC = 0.85 and M-LLTC = 0.86.

Table 3 Descriptive statistics for OxPIE scale

OxPIE items

Detailed results for each of the OxPIE items are shown in Table 4. Across all age-groups, patients in the S-LLTC and M-LLTC groups consistently reported more problems with their experience of care than did those in the No-LLTC group. Patients in the M-LLTC group were more likely to report problems than those in the S-LLTC group for almost all of the items, and those in the younger age-groups reported more problems than those who were older.

Table 4 Problems with staff-patient interactions, information provision, involvement in decisions and self-care support by age and condition for items included in OxPIE

Overall rating of care

In contrast to their responses to the detailed questions about their experiences, respondents gave much more positive answers to a global rating question: ‘Overall, how would you rate the care you received?’ (Table 5). Even so, both the M-LLTC (12.7%) and S-LLTC (9.5%) groups were more likely to say their care was only ‘fair’ or ‘poor’ (p = 0.001) than the No-LTC group (6.0%). As for the other items, the highest proportion of unfavourable ratings was seen among younger people in the M-LLTC group, a fifth of whom indicated problems with some aspects of their hospital experiences. Responses to this question were not highly correlated with the OxPIE scores (Pearson’s correlation coefficient of 0.463).

Table 5 Overall rating of hospital care by age and condition

Multivariate logistic regression

A multivariate logistic regression analysis was performed to determine the extent to which these results might be accounted for by differences in the composition of the three LLTC groups (Table 6).

Table 6 Results of the logistic regression analysis between key patient characteristics and the dichotomised OxPIE scale

In the total sample, women had worse OxPIE scores than men (OR = 1.33; 95% CI: 1.29 to 1.38); people in minority ethnic groups had worse scores than those who classified themselves as White British (OR = 1.35; 95% CI: 1.26 to 1.45); those who experienced pain during hospitalisation had worse scores than those who did not (OR = 1.61; 95% CI: 1.55 to 1.67); and those who stayed in hospital more than four days had worse scores than those with shorter lengths of stay (OR = 1.26; 95% CI: 1.21 to 1.31). In contrast, patients admitted for an operation or procedure had better OxPIE scores than those who did not (OR = 0.84; 95% CI: 0.80 to 0.87); those undergoing planned admissions had better scores than those admitted as emergencies (OR = 0.60; 95% CI: 0.57 to 0.62), and older people had better scores than those in the youngest age-group (16–29 years of age).

Both groups with limiting LTCs were significantly more likely to report worse experiences after accounting for these other factors: S-LLTC group (OR = 1.23; 95% CI: 1.03 to 1.48) and M-LLTC group (OR = 1.64; 95% CI: 1.19 to 2.26). Importantly, LLTC status was shown to mitigate the positive effect of age in respect of OxPIE scores. Whereas the main effect for all age categories was significantly associated with more positive scores on the OxPIE, this trend was reversed for the interaction effects of age group and LLTC status. Indeed, almost all of the odds ratios for LLTC status and age group were above 1, although only three (S-LLTC × Age 60–74 OR = 1.34; 95% CI 1.10 to 1.62, S-LLTC × Age 75–89 OR = 1.49; 95% CI 1.22 to 1.82, and M-LLTC × Age 75–89 OR = 1.49; 95% CI 1.07 to 2.08) were significantly associated with worse OxPIE scores. The significant interactions with poorer ratings of care for two S-LLTC age groups (60–74 and 75–90) and one M-LLTC age group (60–74), indicated that LLTC status had more influence on patients’ experiences than age group alone; LLTC status essentially reversing the positive effect of age on experience of care.

Discussion

We believe this may be the first study to compare the experiences of people with and without LLTCs in a large dataset. The results indicate cause for concern because they suggest that people with LLTCs report worse hospital experiences than those without, but a number of caveats must be borne in mind when interpreting these findings. First, a response rate of 51.9% means the sample of respondents may be biased in some way. It is known that certain population groups are less likely to respond to postal surveys, including males, younger adults, the very old, people in poorer health, and those in socio-economically deprived groups [25]. Second, we relied on patients’ self-reports to determine the presence or absence of limiting LTCs. These are unlikely to be inaccurate but we had no means of verifying this. And third, although the analyses show a very strong relationship between the presence of limiting LTCs and individual likelihood of reporting problems in hospital experiences, we cannot necessarily infer from these cross-sectional survey data that the presence of LLTCs is a causal factor in people receiving poorer standards of care. It is possible that people with LLTCs have higher expectations of care, or that their assessments of care are influenced by differential treatment outcomes, or that people who are sicker adopt a more jaundiced view of their experiences. Finally, there is a potential ambiguity in the distinction between the S-LLTC and M-LLTC groups. Questions in the survey do not ask respondents to attribute limited activities to particular conditions: thus the M-LLTC group might be more precisely defined as including people who report more than one long-term condition, of which at least one limits their daily activities. The clear differences in results for the two S-LLTC and M-LLTC groups implies that this ambiguity is minor and that the distinction is meaningful.

Some of the patterns we noted have been seen in other similar surveys. For example, a recent inpatient survey in Scotland found that patients with poorer health status and those admitted as emergencies were less likely to report a positive experience of hospital care [26]. It has often been found that younger people are more critical of their care than those in older age groups, and there is also an observed tendency for patients from minority ethnic groups to report worse experiences than those from the majority group [27]. Recent research has suggested that these differences are not accounted for by differences in prior expectations of care [28].

A cross-sectional survey such as this can point to potential problems, but lacks explanatory power. We cannot know from these results why patients with LTCs experience worse care, or if they really do. Qualitative studies may offer some insight into what is going on. For example, a Swedish study that used focus groups to explore doctors’ attitudes to caring for elderly hospitalised patients suggested that the complexity of their conditions and the extra time required for effective communication gave rise to feelings of professional inadequacy and frustration, which may have affected the quality of their interactions with these patients [29]. A US study found that patients with multiple conditions gave marginally more critical reports on their interactions with doctors than did patients without LTCs, but the differences were not great [30]. Longer hospital stays, poor communication between staff working in different specialty departments, and inflexible hospital routines may lead to greater fragmentation and discontinuities in care for these patients [31].

It is worth noting that patients’ responses to a global rating question were more positive than their answers to the other questions examined here, and the correlation between responses to this rating question and the more detailed questions included in OxPIE was weak. This suggests that a single rating question may not adequately capture many important aspects of patients’ experience of hospital care. This question has since been removed from the survey and replaced in 2012 with a new ‘overall’ item with more Likert-style response options that may perform better. Nevertheless, it will be essential for healthcare staff and policy-makers to take account of the multifaceted nature of patients’ experience if they are to derive a better understanding of how to improve the delivery of the service. Simple rating or satisfaction questions may not adequately capture the totality of people’s experiences, in particular the relational, as opposed to transactional, factors that are so important to most patients.

Conclusions

The fact that people with LTCs reported less satisfactory communications with staff, less involvement in decisions about their care, and less self-care support requires further investigation. Since the data came from a cross-sectional survey, we cannot know whether these findings are a true reflection of worse care for people with LTCs or a tendency for these people to be more critical as a consequence of their condition. External factors may have affected their assessments. Some of these patients may have been admitted to hospital as a result of ineffective management in primary and community care or inadequate social care support. Others may have experienced accidents, falls or acute medical problems that necessitated a distressing emergency admission. Nevertheless, the OxPIE scale revealed significant differences in reported experience that are of concern. It is worrying that patients with multiple conditions were even less likely than those with single conditions to report positive experiences. These findings add support to the view that many people with LTCs might be better off if they were cared for in their own homes [32, 33]. They also point to the need to look for ways to optimize hospital care for this patient group, since admissions are sometimes unavoidable.

People with LTCs are heavier users of health and social care services, so providing proper support to help them return to independent living should be a priority, both for their individual well-being and also for improving the efficient allocation of resources. It is particularly important that hospital staff do all they can to help these patients and their carers to self-manage their conditions, yet our study suggests that this type of supportive care is not universally available in NHS hospitals.

Authors’ information

PH is a senior research officer at the HSRU involved in the development and evaluation of psychometric scales and statistical analysis of datasets. CJ is the Director of the HSRU and involved in a number of projects including QORU-related research. AC is a health policy analyst and researcher specialising in patient and public involvement in healthcare. CG is Director of Survey Research at the Picker Institute Europe. AS is a Research Associate at the Picker Institute Europe. Both CG and AS are involved in the evaluation of the NHS Adult Inpatient Survey.