Objective Evaluating effectiveness and cost-effectiveness of ‘Families for Health V2′ (FFH) compared with usual care (UC).
Design Multicentre randomised controlled trial (RCT) (investigators blinded, families unblinded) and economic evaluation. Stratified randomisation by family; target of 120 families.
Setting Three National Health Service Primary Care Trusts in West Midlands, England.
Participants Overweight or obese (≥91st or ≥98th centile body mass index (BMI)) children aged 6–11 years and their parents/carers, recruited March 2012–February 2014.
Interventions FFH; a 10-week community-based family programme addressing parenting, lifestyle change and social and emotional development. UC; usual support for childhood obesity at each site.
Main outcome measures Primary outcomes were 12-months change in children's BMI z-score and incremental cost per quality-adjusted life-year gained (QALY). Secondary outcomes included changes in children's physical activity, fruit and vegetable consumption and quality of life, parents' BMI and mental well-being, family eating/activity, parent-child relationships and parenting style.
Results 115 families (128 children) were randomised to FFH (n=56) or UC (n=59). There was no significant difference in BMI z-score 12-months change (0.114, 95% CI −0.001 to 0.229, p=0.053; p=0.026 in favour of UC with missing value multiple imputation). One secondary outcome, change in children's waist z-score, was significantly different between groups in favour of UC (0.15, 95% CI 0.00 to 0.29). Economic evaluation showed that mean costs were significantly higher for FFH than UC (£998 vs £548, p<0.001). Mean incremental cost-effectiveness of FFH was estimated at £552 175 per QALY.
Conclusions FFH was neither effective nor cost-effective for the management of obesity compared with UC.
Trial registration number ISRCTN45032201.
- Evidence Based Medicine
This is an Open Access article distributed in accordance with the terms of the Creative Commons Attribution (CC BY 4.0) license, which permits others to distribute, remix, adapt and build upon this work, for commercial use, provided the original work is properly cited. See: http://creativecommons.org/licenses/by/4.0/
Statistics from Altmetric.com
What is already known on this topic?
Childhood obesity represents a major public health burden, with a third of children aged 10–11 years in England being either overweight or obese. Effective treatment interventions are needed.
The Families for Health programme was a promising intervention for the management of childhood obesity in a pilot, focusing on parenting skills, social and emotional development as well as lifestyle.
What this study adds?
There was no significant difference in change in BMI z-score at 12-months with Families for Health compared to usual care.
Families for Health was significantly more costly than usual care.
The Families for Health programme is neither effective nor cost-effective for the treatment of obesity in children aged 6 to 11.
Childhood obesity represents a major public health burden. Although trends may now be reversing in England,1 prevalence remains high. In 2014–2015, 33.2% of children in year 6 (10–11 years) were either overweight or obese.2 Childhood overweight and obesity have been linked to immediate and long-term physiological and psychological health risks,3 ,4 including type 2 diabetes, hypertension and coronary heart disease in adulthood.5
A review of 64 randomised controlled trials (RCTs) of interventions for childhood obesity concluded that family-based interventions combining dietary, physical activity and behavioural components produce significant improvement.6 In children under 12 years, involving parents was useful. Family-based interventions for childhood obesity are being offered, but they rarely cover parenting skills.
‘Families for Health’ (FFH) is a manualised group-based family intervention for overweight or obese children aged 6–11 years. The programme places more emphasis on parenting skills, relationship skills and emotional and social development than other UK interventions. A pre-post pilot of 27 children showed mean reductions in body mass index (BMI) z-scores sustained at 9 months (−0.21, 95% CI −0.35 to −0.07, p=0.007) and 2 years (−0.23, 95% CI −0.42 to 0.03, p=0.027),7 ,8 encouraging further evaluation. This study examines the effectiveness and cost-effectiveness of FFH.
In a multicentre RCT in overweight or obese children aged 6–11 years, with parallel economic and process evaluations, families were randomised to FFH (target 60 families) or usual care (UC) (target 60 families) (ISRCTN45032201). Randomisation, via a central telephone registration and randomisation service of Warwick Clinical Trials Unit, was stratified by locality using biased coin (p=2/3) minimisation to ensure approximately equal-sized arms. Families could not be blinded to treatment allocation, but every effort was made to ensure that allocation remained unknown to researchers.
This trial took place between March 2012 and March 2015 in three defined areas within the West Midlands, UK, reflecting the varied demographics within the region. Sites A and C were relatively more deprived, whereas site B was less deprived (IMD 2015 rank out of 326 Local Authority Districts, where one is the most deprived: site A 55, site B 249, site C 14).9 Sites A and C also had greater ethnic diversity (% white ethnicity: site A 73.8%, site B 92.6%, site C 67.9%).10
Eligible families had an overweight (≥91st centile for BMI) or obese (≥98th centile for BMI) child aged 6–11 years, based on the UK 1990 definition11; and at least one parent or guardian willing to take part. Families were excluded if parent or child had insufficient command of English; the child had recognised medical cause of obesity or was unable to participate due to severe learning difficulties and/or behavioural problems. We aimed to recruit 40 families from each of three sites, using active and passive recruitment methods.12 Active recruitment methods were via letters to families with an eligible child identified by the National Child Measurement Programme and by referrals from healthcare professionals, including dietitians and general practitioners (GPs). Passive recruitment methods were via the local media (newspapers and radio); flyers and posters at schools, GP surgeries and other community venues and attending public events.
The intervention: families for health
The FFH intervention (V1) was developed by Candida Hunt and the University of Warwick team (SS-B, WR). Following evaluation in the pilot,7 ,8 the programme underwent minor modifications and it is FFH V2 that was delivered in this RCT. The changes in V2, implemented based on parents' feedback, were the reduction in length from 12 to 10 weeks, the addition of two follow-up sessions, enhanced information on healthy eating and the distribution of pedometers. The FFH V2 manualised programme comprises 10 weekly 2½-hour sessions, with children and parents from 8 to 12 families attending parallel groups. The programme combines information on parenting skills, social and emotional development as well as healthy eating including portion size and physical activity. The plan was to run six FFH courses (two in each site). Parenting components, based on the Nurturing Programme from Family Links,13 aimed to increase parental capacity to implement and maintain lifestyle changes. Further details of the FFH intervention are available.14
Four facilitators, as pairs in the children's and parents' groups, ran each programme following a 4-day Family Links training course. Facilitators were selected for their personal attributes, including previous relevant experience. Professional backgrounds included community nursing, teaching, youth work, leisure services and nutritionists. We aimed to assign families to groups within 3 months of randomisation, and invited both parents and all overweight and non-overweight siblings in the target age range. Each group ran on a Saturday in a leisure/community centre. Additional sessions were planned for 1 month and 3 months post-intervention.
Usual care control group
Families assigned to UC were offered ‘One Body One Life’,15 a group-based family intervention in site A, Change4Life advisors offering one-to-one support in site B and either (1) a two-step programme, MEND16 and Choose It, with taster sessions for physical activity, healthy eating, or (2) Weight Watchers for young people aged 10+ years or (3) referral to the school nurse for children aged 6–9 years in site C. Further details of the UC interventions are available.14
We collected outcome measures at home visits at baseline, 3 months (or end of FFH programme) and 12 months post-randomisation.
At baseline parents completed a brief demographic questionnaire. Families' socioeconomic status (SES) was recorded using the National Statistics Socioeconomic Classification based on parental employment.17
The primary outcome was change in children's BMI z-score from baseline to 12 months. Weight was measured using the Tanita body composition analyser (BC-420S MA), which also provided an indirect measure of percentage body fat.18 Height was measured by a Leicester stadiometer. BMI (kg/m2) and waist circumference (with a Seca 200 tape) were converted into SD (z) scores from the UK reference curves.11 ,19 ,20 Parent's height, weight, BMI and percentage body fat were recorded.
Children were asked to wear an accelerometer (Actigraph GT3X, Penascola, Florida, USA) for 7 consecutive days at baseline and 12-month follow-up. Data were analysed using Actilife 6 Data Analysis Software, using Evenson's activity count cut-points for physical activity intensities.21 We defined a complete day of data as ≥8 hours, after excluding any periods of ≥60 consecutive minutes of zero counts (non-wear time). Records were included in the analysis if at least 3 complete days of data were available at baseline and 12 months. Mean daily time in moderate and vigorous physical activity, sedentary time, accelerometer counts per minute and daily step count were calculated.
Children completed a 24-hour recall using the ‘Day in the Life Questionnaire’, which is validated for fruit and vegetable consumption.22 Eating and activity behaviour in the family was assessed using an Anglicised version of the Family Eating and Activity Habits Questionnaire (FEAHQ).23
Children's health-related quality of life was measured using the Pediatric Quality-of-Life Inventory (PedsQL) V.4.0 (UK) for ages 8–12 years.24 Children completed the 23-item self-report version and parents completed the parent-proxy version. Parental mental well-being was measured using the 14-item Warwick-Edinburgh Mental Well-Being Scale.25
The quality of parent-child relationships was measured using the parent-completed 15-item version of the Child-Parent Relationship Scale (CPRS).26 Parenting style was scored as authoritative, authoritarian or permissive parenting using the 32-item Parenting Styles and Dimensions Questionnaire.27
Sample size calculation
Informed by the pilot,7 we based power calculations on a BMI z-score residual SD of 0.22, a SD of random family effects of 0.14, an intervention group intracluster correlation of 0.1, a two-sided significance of 5% and an estimate of 60% of participating families having one overweight/obese child and 40% having two. Allowing for clustering by family and for group effects in the intervention arm, 6 groups of 10 families (60 families) in the intervention arm and 60 families in the control arm provided power of 94% to detect an intervention effect of 0.2 in BMI z-score. If 30% of families dropped out, the study would retain power of 88%.
For child outcome measures, linear mixed models with a random family effect were fitted to account for clustering. After approval from the Trial Steering Committee, we did not account for delivery group clustering in the FFH arm as analyses showed no evidence of clustering. Separate models were fitted for differences between baseline and 3-month follow-up (end of FFH programme) and baseline and 12-month follow-up. Models were adjusted for baseline values of outcomes, gender and family-level ‘locality’ as fixed effects as specified in the Statistical Analysis Plan. Primary analyses were conducted on trial participants with complete relevant data. A preplanned secondary analysis was also conducted with missing values imputed using multiple imputation with fully conditional specification regression.28
We summarised outcomes by trial allocation and follow-up period using means, SDs and CIs for continuous variables and absolute numbers, percentages and CIs for categorical variables. Generally, one parent per family provided data, and parent outcomes were compared using t-tests and χ2 tests.
All analyses were performed on an intention-to-treat basis, except where clearly stated, and conducted using SAS V.9.4 TSL1M2.
We conducted a within-trial economic evaluation from a UK National Health Service (NHS) and personal social services perspective.29 A comprehensive strategy was adopted to estimate incremental costs associated with the programme. Resource use questions completed by parents at each time-point provided profiles of hospital and community health and social services received by each child and broader service utilisation including educational support, family expenditures and parental lost productivity attributable to the child's health status. Unit costs (£, 2013–2014 prices) were collected from national sources in accordance with guidelines and attached to resource use.29 Health utilities generated from EuroQol Five Dimensions Questionnaire Youth Version (EQ-5D-Y) responses,30 ,31 obtained from parents and children at each time point, were used to estimate quality-adjusted life year (QALY) profiles for each child, calculated as area under the baseline-adjusted utility curve, assuming linear interpolation between utility measurements. We report cost-effectiveness results as incremental cost-effectiveness ratios (ICERs), calculated as the difference in mean costs divided by the difference in mean outcomes (QALYs or change in BMI z-score between baseline and 12 months) between the trial comparators. The non-parametric bootstrap method was used to construct cost-effectiveness acceptability curves at alternative cost-effectiveness thresholds relevant to decision-makers. Secondary analyses adopted a wider societal perspective for economic costs. Sensitivity analyses were undertaken to assess the impact of uncertainty surrounding aspects of the economic evaluation, while subgroup analyses were conducted for the main cost-effectiveness results to explore the effects of trial population heterogeneity. Further details are reported in web appendix 1.
supplementary web appendix
We examined reach of the intervention, fidelity of delivery, dose delivered and received,32 and perceived impact of the intervention through observation, collection of trial process data, focus groups with facilitators and interviews and evaluation forms with participants (see details of the data collection in table 1).
The National Research Ethics Service Committee West Midlands—Coventry and Warwickshire REC gave ethical approval (reference 11/WM/0290) and participating trusts gave NHS Research and Development approval. A Trial Steering Committee and Data Monitoring and Ethics Committee oversaw the trial. Parents and children gave written informed consent.
Further details of the study design, interventions and outcome measures are available.14
We recruited 115 families (with 128 children in total included in the study), with 56 (63 children) allocated to FFH and 59 (65 children) to UC (figure 1). Of the 194 families assessed for eligibility, 79 were excluded (reasons in figure 1). Recruitment took 24 rather than 12 months. Six families withdrew from the trial, four at 3 months and two at 12 months. Reasons for withdrawal were illness, bereavement, child starting secondary school and wanting to manage weight on their own, child disliking study measurements, family feeling the study wasted their time and no reason. Twenty-four families were lost to follow-up for unknown reasons. There was 80% retention of families at 3 months and 72% retention at 12 months, with greater loss to follow-up in the UC arm (figure 1).
Intervention delivery and attendance
To recruit sufficient families, seven rather than six FFH programmes were delivered. Three FFH programmes ran for 10 weeks as planned and four for 9 weeks (reasons for session cancellations: bad weather (2); shortage of facilitators (1); poor attendance (1)). Minor adaptations were made by facilitators during delivery. Difficulties in delivery related to small group size and broad age range. Of the 56 families randomised to FFH, 21 (37.5%) waited over 3 months to join a group, mostly due to getting a viable number of families together to run the group at a specific site.
Families allocated to FFH were more likely to have attended at least one session than those allocated to UC (42/56, 75.0% vs 24/59, 40.7%; p<0.001) (figure 1). In the FFH arm, 62.5% (35/56) of families completed at least five sessions. FFH was well received by attendees with over 90% of parental ratings of the weekly sessions ‘good’ or ‘great’. Topics receiving the most positive comments were food labelling, coping with stress and building self-esteem.
With the exception of SES, where the FFH group had higher overall status than the UC group, baseline characteristics were similar (table 2). Eleven families had two or more children participating in the trial. Children from ethnic minority families, single parent families and families where parents were unemployed were a higher proportion of the children recruited than would have been expected from 2011 census data for the localities.
Table 3 gives the mean values and sample sizes for both trial arms at each time point.
BMI z-score and other anthropometric measures
At 3-month follow-up, within-group analysis showed that the mean BMI z-score was not statistically different from baseline for UC (−0.042, 95% CI −0.089 to 0.004) or FFH (−0.019, 95% CI −0.093 to 0.054), with no difference between trial arms (p=0.593).
There was also no difference between trial arms in mean change in BMI z-score from baseline to 12 months, using unadjusted and adjusted analyses (adjusted: 0.114, 95% CI −0.001 to 0.229, p=0.053) (table 4 and figure 2). Within-group analysis showed that BMI z-score was significantly reduced in the UC arm at 12 months (−0.118, 95% CI −0.203 to −0.034, p=0.007), with no change in the FFH arm (−0.005, 95% CI −0.085 to 0.078, p=0.907). The multiple imputation analysis yielded a very similar estimated treatment difference with a significantly greater reduction in BMI z-score in the UC arm than in the FFH arm (0.113, p=0.026). There was also a significantly greater reduction in BMI z-score in the UC arm (0.134, 95% CI 0.008 to 0.259, p=0.037) in an unplanned secondary analysis adjusting for ethnicity and SES in addition to baseline outcome, gender and locality. Results for the change in children's waist z-score were significantly different between groups in favour of UC, although the change in per cent body fat was not significantly different (table 4). Parent's BMI and per cent body fat showed no significant change (table 4).
Per-protocol analysis on families that participated in five or more sessions of FFH (‘programme completers’) showed that the mean reduction in BMI z-score was greater in the non-completers (−0.103, 95% CI −0.234 to 0.029) than the completers (0.065, 95% CI −0.040 to 0.169) at 12-month follow-up, although this difference was not statistically different (p=0.059).
We collected 71 pairs (baseline and 12 months) of accelerometer data and 46 records met the inclusion criteria (27 in the FFH arm, 19 in the UC arm). There were no significant differences between groups (table 4).
There was no difference between groups in child-reported fruit and vegetable consumption (table 5). There were no between-group differences at follow-up for the four subscales of the FEAHQ, although there was a significant improvement in activity level in the UC group from baseline, at both 3 months (−5.640, 95% CI −9.985 to −1.295) and 12 months (−6.813, 95% CI −11.176 to −2.450).
There was no significant difference in change from baseline in children's health-related quality of life (assessed by PedsQL and EQ-5D-Y) or in parental mental well-being (table 5). Most parents scored highest on authoritative (desirable) parenting style at baseline and changes in parenting did not differ between groups (tables 3 and 5). The CPRS also showed no difference between (or within) groups (table 5).
Mean (SE) total NHS and personal social service costs over the follow-up period were estimated at £998 (£72) for the FFH group compared with £548 (£73) for the UC group: the cost difference was £450 (bootstrap 95% CI £249, £650; p<0.001). Among children with complete costs and QALY data over the trial follow-up period, FFH was associated with a mean incremental cost of £512 and mean incremental QALYs gained of 0.0009, generating an ICER of £552 175 per QALY gained, far exceeding accepted cost-effectiveness thresholds for an additional QALY.29 The cost-effectiveness acceptability curve in figure 3 indicates that, regardless of the value of the cost-effectiveness threshold, the probability that the FFH programme is cost-effective does not exceed 40%. If decision-makers are willing to pay £20 000 for an additional QALY, the probability that the FFH programme is cost-effective is approximately 28%. The economic evaluation remained robust to the choice of study perspective, expression of cost-effectiveness and sensitivity and subgroup analyses exploring the impacts of uncertainty and heterogeneity (see web appendix 1).
Process evaluation: evidence of change
From coded parent interview responses at 12 months, to a question about what they had changed in their daily lives as a result of their intervention, we were able to categorise the 47 families who participated in this interview into the following: those who had made no change, those who had made change but this was not sustained, those who made at least one change in either food or exercise (no families) food or exercise (no families reported making only changes in parenting) and those who had made multiple changes (see table 6). There was no clear distinction between the FFH and UC groups in terms of count of families and types of changes they reported.
FFH is designed to increase parenting skills, support family lifestyle change and help children manage their weight. This trial found no difference between trial arms in the change in BMI z-score at 12 months and within-group analysis hinted at the possibility that children in the UC group did better than those allocated to FFH. This was despite higher attendance at FFH than UC, and the FFH programme being rated highly by parents. There was no clear distinction between groups in the changes reported at 12 months by parents from interview data.
FFH was significantly more costly than UC to deliver, mainly because it required separate groups for parents and children, which UC did not. The results of the economic analysis indicate that FFH is unlikely to be cost-effective.
The FFH pilot results7 ,8 were not replicated in this trial, and consideration of the reasons is warranted. Other trials of children's lifestyle interventions have also failed to replicate pilot successes (eg, Kipping et al33 and Croker et al34). The difficulties encountered during delivery were not more than would be expected if delivering such an intervention routinely. It may be that scaling up the intervention attenuated its effects. In the pilot study, the intervention was delivered by a small team of four experienced facilitators at one site, and so there may have been some reduction in facilitator skills in the RCT when run at scale across three sites by 17 facilitators mostly new to delivering the programme. Additionally, when evaluating the programme in the context of an RCT, a proportion of families had to wait for a viable group to form because one-half of the families were allocated to the control arm, whereas this did not happen in the pre-post pilot. Alternatively, the pilot study may have been a chance false-positive result.
The parenting components of FFH were based on the Family Links Nurturing Programme (FLNP).13 A trial of FLNP was completed during the FFH trial,35 finding no evidence of effectiveness as a universal programme. Other parenting interventions for obesity show mixed results. In an RCT of Lifestyle Triple P (Positive Parenting Programme) with children aged 4–11 years in Australia, BMI z-score reduced by −0.11 at the end of the 12-week programme and −0.19 at 1-year follow-up, in contrast to a reduction of −0.01 for the waiting list control.36 However, a Dutch study with children aged 4–8 years showed no significant differences in children's BMI z-score between Lifestyle Triple P and the control at 4 and 12 months.37 The value of a parenting component to family-based childhood obesity interventions may depend on the baseline parenting styles in trial families. In our study trial, families had good baseline parenting skills, so there was less room for improvement. Families in the trial were also more from ethnic communities, single parents and where parents were unemployed, compared with census data for the localities, which potentially could have impacted on effectiveness and generalisability of the findings to other geographical areas.
The limitations of the study need to be explored to provide lessons learnt for future research, and specifically for RCTs of complex interventions. The pre-post pilot maybe was an inadequate study design to inform the decision to proceed to a full-scale trial. Instead, a pilot RCT would have highlighted potential difficulties with recruitment and with running the intervention in a trial setting, and would have required further thought about the control arm. The decision to compare FFH with ‘UC’ across three sites within the West Midlands meant that the control arm had very varied interventions, which had been developed and improved to suit the needs of their local communities during the time taken to obtain funding and set up the trial. In effect, we did not have a ‘no treatment’ control group. The length of time it took to recruit 115 families (five less than the target) to the trial was grossly underestimated. Only a third of trials recruit the target number within the time specified and around a third have extensions,38 and so this issue is not unique to our study. Campbell et al38 identified that three factors were observed in trials that recruited successfully: having a dedicated trial manager, being a cancer or drug trial and having interventions that were only available within the trial. In the current study, we did have a trial administrator, but the UC interventions were available outside of the trial setting, and of course this is a lifestyle intervention. Future research needs to factor in more realistic recruitment targets, and incorporate further strategies to improve recruitment.
We conclude that FFH is neither effective nor cost-effective for the management of obesity. This trial does not support local or national implementation of FFH.
This project was funded by the National Institute for Health Research (NIHR) Health Technology Assessment (HTA) programme (project number 09/127/41) and will be published in full by the HTA. Visit the HTA programme website for further project information. WR is part funded by the NIHR Collaborations for Leadership in Applied Health Research and Care West Midlands (CLAHRC-WM initiative). We would like to thank the following people and organisations who have supported the trial: Bernadette Lee, Kate Reddington, John Dewsbury, Helen King, Fran Poole, Dr Adrian Phillips and Gloria Rye from the public health teams at the three sites who enabled this trial to take place. Dr Melvyn Hillsdon (University of Exeter), The Chair of the Trial Steering Committee and the other external members, Professor Russ Jago (University of Bristol), Professor Mike Campbell (University of Sheffield) and Catherine Millard as our public representative. Professor Peymane Adab (University of Birmingham), The Chair of the Data Monitoring and Ethics Committee and the other external members, Dr Sandra Hollinghurst (University of Bristol) and Ed Juszczak (University of Oxford). Katie Williams from the NIHR Clinical Research Network: West Midlands and the Human Resources Department at Warwick Medical School who supported the Research Passport and National Health Service (NHS) Honorary Contracts process. West Midlands South Comprehensive Local Research Network (CLRN) and West Midlands North CLRN, School Nurse Services, Childhood Obesity Clinics and General Practices across the three sites for their help with recruitment. The R&D Departments at the NHS Trusts for giving their approval to the study, and issuing honorary contracts. The Clinical Trials Unit at Warwick Medical School for their randomisation and database services. Dr Rebecca Lang, who was a Research Fellow for the first 9 months of the project. Most importantly, the dedicated facilitators of the Families for Health programme, and the families who took part in the trial. V2 of the ‘Families for Health’ programme draws on the materials developed for the ‘Families for Health’ Programme V1 (2007) by Candida Hunt and the University of Warwick on funding provided by the Department of Health in England.
Contributors WR had overall responsibility for the study as the Chief Investigator. SS-B, SP, NS, MT, FG and DS were co-applicants on the grant application and were involved in its implementation. JF, AK, EH and WR were responsible for the recruitment to the trial, and EH was responsible for assigning participants to their allocated intervention. JF, AK and WR carried out the fieldwork with families and facilitators. JF, AK, FG, MT and WR analysed the qualitative data; TH and NS analysed the quantitative data and KK, SWK and SP carried out the economic analysis. All authors have been actively involved in the authorship of the paper and approved the final manuscript.
Funding Health Technology Assessment Programme (09/127/41).
Disclaimer The views and opinions expressed herein are those of the authors and do not necessarily reflect those of the Health Technology Assessment programme, National Institute for Health Research, National Health Service or the Department of Health.
Competing interests None declared.
Ethics approval Committee West Midlands—Coventry and Warwickshire REC (reference 11/WM/0290).
Provenance and peer review Not commissioned; externally peer reviewed.
If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.