Statement of principal findings
No intervention effect for the primary outcome BMIz or overweight or obesity was observed for intervention communities compared to control communities over the four years of the trial. While we observed a statistically significant (4%) reduction in the prevalence of overweight and obesity in intervention communities in the first two years (2015 to 2017), this was followed by a large increase in the final two-year period against a backdrop of no change in control communities. We positive interventions effects were observed among girls for water consumption while among boys, positive effects were observed for takeaway food and packaged snack consumption. Positive intervention effects were reported for physical, psychosocial and global HRQoL scores driven by reductions in all HRQoL outcomes among control communities relative to stable levels among intervention children.
Comparison with other studies
High quality community-based obesity prevention studies are limited, a recent review[43] of contemporary studies (2013–2017) identified only seven studies that presented a quality design with a minimum follow-up duration of 12 months and measured anthropometric outcomes. Of these studies, one was a RCT with two years follow up and the remainder were quasi-experimental.[43] The RCT[44] targeted children aged 5–8 years recruited via recreation centres in San Diego USA. Unlike our study, no intervention effects on BMIz or behaviours were identified after two years, although significant intervention effects for reduction in BMIz were observed for girls.
A systematic review[7] of community-based interventions identified eight trials between 1990 and 2011 with seven of the eight having a positive impact on weight status. Their meta-analysis aligns with the first two years of WHOSTOPS trial where BMIz was reduced by 0.12 among girls and 0.04 among boys. For WHOSTOPS these improvements were reversed in the following two years whereas control communities’ BMIz remained unchanged. The longest intervention period reported in the Wolfenden review was three years.[45] Tarro et al., observed lower BMIz and obesity prevalence among intervention children (5 to 7 years old at baseline) compared to control children 2-years post-intervention from their healthy lifestyle education program.[46] Economos et al., observed a significant reduction in BMIz 1-year post-intervention for Shape up Somerville, a reduction that persisted after 20 months before dissipating as intervention intensity dropped.[47]
The initial reductions followed by increase in prevalence and BMIz in WHOSTOPS may be related to intervention length. A systematic review[48] of 26 prevention studies in the same age group as WHOSTOPS found interventions of 12 months or less most effective in preventing obesity. They conclude duration was critical for intervention outcomes and mean BMI reduction or interventions of 12 months or less was almost twice higher than those lasting > 1 year. Our results are consistent with this observation and suggest that initial positive changes in BMIz and obesity prevalence are difficult to sustain.
The drop and subsequent increase in intervention communities remains a question for further investigation but our initial explanations are as follows; Firstly, at the two-year time point the research team reduced their implementation support to step one communities to begin recruiting step two communities. Whilst this was planned, the impact of bushfires and other natural disasters, resulted in the control communities delaying uptake of intervention for a further two years, and the resources allocated to supporting the first set of intervention communities was reduced by a factor of at least half of what was planned for the second two-year period. Secondly, the data collection methods meant that monitoring data were available and presented back to communities in close to real time. One, possible, unintended consequence of the early signs of positive change in the intervention communities may have led to some complacency, or shifting of priorities, as the initial reduction suggested ‘the job was done’ and reductions in obesity were being observed. Thirdly, it is possible that as actions accumulated over time they overwhelmed implementation capacity. It is generally agreed that multicomponent interventions targeting both physical activity and nutrition are most likely to be effective[49 50] and in this trial, building on experience in community intervention, we set out to build capacity within communities to apply techniques from systems science to the design and implementation of interventions. This clearly was successful over the first two years but, as actions continued to be rolled out, a peak in capacity and or engagement may have been reached. Improvements in behaviours in the intervention communities between 2015 and 2017 [e.g. fruit guideline (all), SSB (girls)] that diminished thereafter and the absence of change in targeted behaviours are consistent with this explanation. Finally, changes in the control communities suggest that, in the absence of intervention, regional Victorian environments were becoming more obesogenic for children [e.g. increased takeaway (all), reduced water (all) increased SSB (boys), increased packaged snacks (boys)] and negatively impacting HRQOL. These broad secular changes may have impacted on the intervention communities’ ability to maintain healthy environments for children and lower obesity prevalence.
The Chirpy Dragon study, is a cluster RCT[51] of primary school based obesity prevention efforts similar to WHOSTOPS. Chirpy Dragon targeted physical activity and dietary behaviours using the UK Medical Research Council Complex intervention framework[52]. The trial was of a similar size to WHOSTOPS (1,641 children) and resulted in actions across home, family and school,. A mean difference in BMIz between intervention an control was observed (-0.13) and positive intervention effects were observed for fruit and vegetables, SSBs, snacking, screen time behaviour and physical activity. We do not know if these changes persisted however as the trial was conducted over a 12-month period.
The intervention design are comparable to capacity building trials evaluated using quasi-experimental designs such as Economos[47] and Malakellis et al.[54] Both these trials delivered multi component interventions in multiple settings and reported significantly lower BMIz scores.
Strengths and weaknesses of the study
Our study represents the longest follow-up (four years) of any contemporary community-based intervention. Until now, the longest was three years with one to two years being most common.[49] The trial utilised a cluster randomized design and electronic tablets for data collection saving time compared to paper-based surveys[55]. Local, high quality data was recognised by community partners as to a key aspect of the community engagement and ongoing intervention adaptation.[53] Student participation rates were higher than 80% using an opt-out approach which compares favourably to other active (opt-in) school-based data collection where participation rates ranged between 30–60%[56]. Participation bias has been observed in regard to differing student response rates and resulting estimates of BMIz and overweight/obesity prevalence.[57]
Weaknesses
Communities were considered to be ‘active’ once they had completed the third phase of the five phase intervention design process. This gave a clear ‘start point’ adapted to community readiness but meant there was no single ‘start date’ for each community meaning the intervention period varied. This variation in intervention period likely impacted our primary outcome. One community had completed all phases as described in the WHOSTOPS intervention description section by 2017, while the other four communities had completed the second phase, where leaders come together to build a systems model. Four of the five had completed all phases by 2019 and the remainder were preparing to begin phase three, engaging the broader community. Intention-to-treat analysis is likely to overlook the nuance of early or late adoption.
This trial was designed to engage community leaders in understanding the systemic drivers of childhood obesity and to identify and commit to making changes that were feasible, realistic and, therefore, more likely to be sustained. Thus interventions differ by community and vary depending on community resources, priorities and capacity to engage. This responds directly to the Lancet Commission on Obesity[16] call for a step change in engaging communities in prevention.[58] Levels of community action varied and showed some promise; one community recorded 400 intervention actions[59] involving by > 20 community leaders and > 150 community members.
WHOSTOPS has intentionally focussed on fidelity of process[60] while the package of interventions were adaptable to the needs, abilities and resources available to the community. In practice this means intervention dose was impacted by changes in context, priorities baseline and community capacity.
Our study did not achieve the proposed sample size of 1500 in each trial arm at each wave,[24] so our analyses are underpowered for detection of BMIz change of an estimated − 0.13. The observed changes that were shown to be significant and the intervention effects in secondary outcomes are therefore highly relevant as to detect a significant change in a percentage variable (e.g. % PA guide) require large changes.
Meaning of the study: possible mechanisms and implications for clinicians or policymakers
WHOSTOPS reduced obesity prevalence over two-years, and over four-years helped a majority of children keep their takeaway food intake low, and sustained health-related quality of life in a context where this was declining. Results varied with gender and age group indicating that single behaviour, single setting interventions are unlikely to generate the level of change required to improve child health or prevent obesity across the spectrum of childhood. Rather, interventions need to adapt to children’s needs considering age, gender and the capacity or limitations of the surrounding systems. These were not ‘greenfield’ communities (with no previous or existing prevention efforts) and any interpretation of overall study effect needs to consider that a range of efforts were already in place to address childhood obesity.
While the first two years of this intervention reduced obesity prevalence, the initial effect appears to have been reversed in the subsequent two years. The reasons for this are to likely relate to context, capacity and timing and possibly the length of the WHOSTOPS trial. It appears one to two years is a meaningful intervention period after which the efficacy of prevention efforts may wane.
Childhood obesity is demonstrably preventable and community-based interventions are effective, feasible, and acceptable to government, industry and the public[8]. These interventions should plan to mitigate unforeseen social and economic shocks that may distract community efforts. The adaptive design of this trial meant the actions were able to be adapted to existing capacity, resources and priorities. The trial itself may have suffered as community priorities shifted. For WHOSTOPS bushfire brought this issue into stark relief though any community effort at significant scale is bound to be beset by unexpected challenges. Long term (e.g. >1 year) trials need regular short term revisions to narrowly focused change efforts. New adaptive trial methodologies provide one direction.[61]
A second interpretation of these results may be the need to ring fence resources to the obesity prevention regardless of other priorities. The better sustained community efforts in WHOSTOPS were supported by larger auspice organisation and regional leadership over longer periods of time. Similarly the Kiel Obesity Prevention Study found obesity prevention was more likely to be sustained when embedded in existing social education systems.[46]