Eligibility Criteria
Participants included within the scope of the Breech-COS include those with
- Breech presentation confirmed from 37 weeks in all pregnancies, who expect to deliver a foetus in breech presentation; and
- No absolute contraindication to vaginal birth, requiring delivery by caesarean section.
Health interventions included within the scope of this COS include
- planned modes of delivery (e.g. vaginal birth versus caesarean section, selection protocols);
- methods of delivery (e.g. management protocols, maternal birth position); and
- models of care delivery (e.g. breech team care, midwife/physician/obstetrician as lead carer).
Effectiveness studies comparing methods of turning a foetus to a head-down position in the uterus, such as external cephalic version, are outside the scope of this COS, except in cases where their impact on vaginal breech birth is being studied.
Existing Knowledge of Outcomes
The COMET and CROWN databases were searched in April 2020 for other published and unpublished COS development projects relevant to this research, under disease category ‘Pregnancy and Childbirth’ and disease name ‘Breech Presentation.’ Only one study was registered in this category; this concerned the practice of acupuncture and moxibustion to promote cephalic version8 and was thus outside the scope of the Breech-COS.
The following maternity care COS studies are likely to be relevant to the Breech-COS:
- Evaluating Maternity Care: A Core Set of Outcome Measures9
- The Composite Adverse Obstetrics Outcomes Study (CAOOS), due to be completed in May 2020;10
- Salutogenic Intrapartum Core Outcomes (SIPCO), systematic review11 and protocol12 published, due to be completed in September 2020
In addition, two systematic reviews have or intend to report on consistency, variation and quality of outcomes among COS in maternal and newborn care.
- Duffy et al (2017), Core outcome sets in women's and newborn health13
- Slavin et al (on-going), Quality of core outcome sets in maternal and newborn health14
When a relevant reporting standard (outcome, definition or measurement) has been agreed through previous COS development, this will be identified to panellists in the Delphi study for their consideration for inclusion in the Breech-COS. Relevant items recommended in previous maternity care COS projects, but not included in previous breech studies, will be proposed for inclusion as appropriate. This is to promote consistency with international standards as much as possible, while enabling justified variation where it achieves consensus among experts in this field.
Study Design: Overview
The design of the study is based on the criteria outlined in the COMET Handbook.6 The Breech-COS will be developed through a three-phase Delphi consensus-building process involving international stakeholders, as shown in Table1. Detailed methodology for each phase is provided below.
- Completion of a systematic review to identify effectiveness and safety outcomes currently reported in effectiveness studies of breech birth at term. An online meeting with the study’s PPI group will be conducted to discuss the importance and relevance of outcomes identified in the systematic review; and to ascertain important outcome measures that were not identified through reviewing the literature
- A four-round Delphi survey, including:
- Prioritisation of outcomes and generation of a consensus outcomes list in the first two rounds; and
- Generation of a consensus on the way these outcomes are labelled and defined, and the methods and timing of measurement, in a further two rounds.
- Ratification of the Breech-COS, including definitions and measurements, in a consensus meeting of international experts and stakeholders.
Study Registration
The study has been registered with the COMET initiative (www.comet-initiative.org; # 1749) and has been submitted to the Core Outcomes in Women’s and Newborn Health (CROWN) Initiative. The systematic review will be conducted in accordance with guidance set out by the PRISMA Statement for reporting systematic reviews.
Phase 1: Systematic Literature Review
The purpose of phase one is to ensure that an initial list of items for the Breech-COS is grounded in the literature, representing the views of previous researchers.12 A literature review will be conducted to identify outcomes, definitions and measurements previously reported in effectiveness studies of breech births at term. The results of phase one will be a preliminary list of items to be included in a Breech-COS.
Types of Studies, Participants and Interventions
RCTs, non-randomised effectiveness studies and systematic reviews of both (with or without meta-analysis) will be included. Studies not describing breech birth outcomes, conference proceedings/abstracts without complete trial description or studies for which full text is not available in English. Study participants will include all childbearing people >37 weeks pregnant with a foetus in breech presentation. Interventions will include:
- planned modes of delivery (e.g. planned vaginal breech birth versus planned caesarean section, antenatal candidate selection protocols);
- methods or management plans for vaginal breech delivery (e.g. upright versus supine delivery, expediated versus conservative approached, comparisons of assisted delivery protocols);
- and models of care delivery (e.g. comparisons of care delivered by different experience levels or professions, use of breech teams).
Other interventions intended to modify the outcomes associated with term breech birth may be identified in the review, and these will be included.
Search Strategy for Identification of Studies and Study Eligibility
Full terms of a comprehensive, electronic search strategy are detailed in Section 16. MEDLINE, EMBASE and the Cochrane Central Register of Controlled Trials (CENTRAL) databases will be searched. The reference lists of eligible studies and reviews will be checked for additional effectiveness studies not identified from the electronic database search. Using Covidence systematic review software, two out of four review authors (Shawn Walker, Alexandra Halliday, Anke Reitter, Tisha Dasgupta) will independently screen the abstracts returned from the search strategy and any studies not meeting inclusion criteria will be excluded. Where necessary to resolve a disagreement, the third member of the research team will be consulted.
Eligibility criteria will include:
- Settings: high- and low-income settings
- Language: all
- Date: 2000 to present
- Study design: systematic reviews, randomised trials, comparative observational studies
This review is designed to identify the choice and consistency of outcomes reported in comparative studies concerning vaginal breech birth. The year 2000 was chosen because this was the year of publication of the single large randomised trial of term breech birth.15 Two other small trials completed before 2000 are included in the Cochrane Review last updated in 2015.2 Our scoping search revealed that no further trials have been completed. Limiting our search of other literature to the last 20 years enables us to survey a wide range of outcomes considered important in smaller comparative observational studies within a reasonable timeframe.
Assessment of methodological quality
As the primary objective of this review concerns choice and consistency of outcomes, the overall methodological quality of the included studies from systematic reviews will not be evaluated. Instead, the methodological quality of the reported outcomes in included studies will be assessed using four questions:6,16
- Is the primary outcome clearly stated?
- Is the primary outcome clearly defined so that another researcher would be able to reproduce its measurement (e.g. measurement tools, measurement timing)?
- Are secondary outcomes clearly stated?
- Are secondary outcomes clearly defined?
Data management, extraction, analysis and presentation
Records will be managed using Covidence systematic review software.17 Independent data extraction will be performed for each article by two review authors using a Microsoft Excel spreadsheet-based extraction form for the following: author and title details, year and journal of publication, study type, setting, key eligibility criteria, study population size, description of intervention, proposed outcomes, primary and secondary effectiveness and safety outcome(s) reported, outcome definition(s), outcome measurement tool(s) and timing(s). Disagreement will be resolved through discussion, involving the third reviewer if helpful. Original study authors will be contacted if there is unclear/unavailable data.
Interventions will be reported based on the Effective Practice and Organisation of Care (EPOC) framework.18 Reported outcomes will be based on the outcome framework by the Core Outcome Measures in Effectiveness Trials (COMET) and according to the hierarchy as used in the studies (primary, secondary and other). These outcomes will then be condensed into a list for consideration in the Delphi survey.
Patient and Public Involvement on Identified Outcome Measures
As identified by the systematic literature review, most-frequently reported outcome measures will be brought to the study’s PPI group in an online meeting led by members of the team [SW and TD]. The purpose of this stage is to determine (1) how patients and public with experience of breech birth value the outcomes identified in published literature: their importance and relevance; (2) to isolate any outcome measures that are deemed important by the PPI group but were not identified by the systematic review. The findings of the discussion will be collated and used to inform the design of the Delphi survey.
Phase 2: Delphi Survey on Breech-COS
The purpose of phase two is to ensure the Breech-COS represents international, multi-stakeholder perspectives on the most important outcomes of care for breech births at term. This will: 1) ensure it is useful for a range of settings and purposes; and 2) increase the likelihood of its use and impact on the quality of future meta-analyses.
Phase two will involve a Delphi survey, administered using JISC Online Surveys. In the Delphi method, consensus is developed anonymously and collaboratively through a series of surveys. Delphi methods have been widely used to develop consensus about COSs and standards of practice19,20 in maternity care. The online Delphi swill enable the involvement of a wide range of international stakeholders, however limited by internet access and ability to speak English.
Participants will be asked to rate the importance of the outcomes identified in phase one for inclusion in a Breech-COS and suggest changes if indicated. After each round, the group responses are provided to panellists who can then reconsider their position in light of other viewpoints. Results will be stratified by participant type (e.g. professionals, service users). The anonymity of the Delphi method avoids the opinions of prominent personalities from dominating the consensus and also facilitates wide international participation. All online survey forms will be tested prior to distribution to ensure clarity. This Delphi will consist of two stages, each including two rounds of online surveys, response and feedback. These are further described below.
The results of Phase Two will be a ranked list of the most important outcomes to include in the Breech-COS, including how they should be defined and measured, and identification of any items requiring further discussion.
Selection of Panel Members
The panel in phase two will include a minimum target 12 of 50 participants. We aim to recruit a diverse respondent pool, with involvement from each major stakeholder group. These include obstetricians, midwives, neonatologists, researchers, service users, representatives from support groups, service managers, healthcare commissioners, health economists and statisticians. Selected participants will reflect a broad range of clinical experiences and geographical expertise, with representation from high-, middle- and lower-income countries.
Clinicians who have published research concerning management of breech presentation at term since 2000 will be purposively invited to participate. They will be identified by way of the systematic review being conducted in the first stage. An invitation email will be sent to all identified panel members using a survey (https://kings.onlinesurveys.ac.uk/breech-cos-pilot), which has been piloted within the research team. Authors of clinical effectiveness studies, other forms of comparative effectiveness research, systematic reviews and national guidelines will be preferentially invited to participate, and all of those purposely invited will be asked to nominate colleagues or service users whom they feel should also be invited. Similar recruitment strategies have been used in previous COS development.6,21
Service users will be eligible for inclusion in the Delphi survey if they have or their partner have experienced a breech pregnancy at term within the past 5 years, and they have a fluent understanding of written English. Representatives from service user advocacy groups will be eligible if they have experience of supporting women and others who have planned breech deliveries. Members of a UK-based PPI group who have already contributed to this project at the funding application stage will be invited to participate. International participation will be sought through established collaborative partnerships with service user groups in North America, Europe and the Antipodes. All service users will have the opportunity to receive training to enable them to understand the purpose of the research and participate fully.
All potential participants will be emailed an invitation letter outlining the aims and details of the study and the rationale and importance of completing the entire Delphi process. Respondents who agree to take part will be assigned a unique identification number. For each round of the process, participants will have 3 weeks to complete the survey with generic e-mail reminders sent at the one and 2-week marks. All data will be stored against the unique identifier only; participants will be blinded to the other respondents in the study. Only two members of the research team (SW and TD) will have access to the complete list of Delphi survey panellists. For each round of the Delphi survey, response and attrition rates will be calculated.
Delphi round one
In the first round, participants will be asked to identify the stakeholder group and geographic area to which they belong, and complete questions about their professional background and experience with clinical research relevant to the management of breech presentation at term. They will then be presented with a complete list of effectiveness and safety outcomes generated from the literature review. Outcome order will be randomly assigned to mitigate the influence of display order on scoring. Participants will be asked to rank each outcome on a scale from 1 to 9, based on the Grading of Recommendations Assessment, Development and Evaluation work group definitions.22 Scores of 1-3 indicate an outcome is not that important for inclusion, scores of 4-6 indicate an outcome is important but not critical for inclusion and scores of 7-9 indicate an outcome felt critical for inclusion in the COS. An option to select ‘Unsure of significance’ will also be available. Participants will be asked to focus on ranking the most important outcomes for inclusion highly and excluding outcomes felt to be of lesser importance; regardless of score, all outcomes will be carried to the second round. Finally, through free-text entry, participants will have the option to clarify compelling arguments for and against inclusion of outcomes and to identify additional outcomes not included in the first-round questionnaire. Where the results of the SR indicated disparity in definitions or measurement, participants will also be invited to recommend how items should be labelled and defined, and the methods and timing of measurement.
Responses from round one will be analysed and collated into a feedback report. Descriptive statistics will be used to summarise the number of participants scoring each outcome and the distribution of scores. Ranking will be determined by the median rating of each outcome. Responses to open-ended questions will be reviewed by the authorship team to evaluate for insights that should be shared with the panel in Round 2. Additional suggestions will be reviewed for outcomes not captured or misrepresented in the first-round questionnaire. If participant numbers are large enough to enable meaningful subgroup analysis, scores will be stratified by stakeholder group to evaluate for differences from other panellist responses. Panellists who do not complete the first-round survey will not be invited to participate in round two.
Delphi round two
In round two, each participant will be provided with the number of respondents and distribution of scores for each outcome from the first round, stratified by stakeholder group. They will then be shown their own score from round one and asked to rescore each outcome, and any additional outcomes arising from round 1, with consideration based on insights from the group. Each outcome will be rescored on a scale from 1 to 9 as previously described. Changes in score from round-to-round will be documented.
Responses from round two will be analysed with descriptive statistics. Outcomes that > 70% of panellists scored 7-9 and < 15% scored 1-3 will be decided a priori to have met consensus for inclusion. Conversely, outcomes > 70% of panellists scored 1-3, and < 15% scored 7-9 will be decided to have met consensus for exclusion. Rank order will be determined using the mean score of all responses. Outcomes not meeting these definitions will be classified as lack of consensus. While these definitions are subjective, they have been recommended by previous COS authors and avoid post hoc definitions of consensus that may bias the results.6,16
Delphi rounds three and four
If necessary, rounds three and four of the Delphi survey will replicate the methods of the first two rounds in order to achieve a consensus on the way the items in the Breech-COS are labelled and defined, and the methods and timing of measurement.6
Phase 3: Consensus Meeting to Ratify Results
The purpose of phase three is to enable real-time debate of the results obtained from phase two and agree the final Breech-COS and secondary outcomes. A consensus meeting with key stakeholders will be held in central London after completion of the Delphi process. On-line meeting software will be used to enable participants less able to travel to participate. The meeting will be chaired by Professor Andrew Shennan with the objective of finalising the outcomes for inclusion in the COS. Approximately 30 participants will be purposively sampled from panellists completing all four rounds of the Delphi study, with the intention of ensuring each stakeholder group and broad geographic and economic areas are represented. The results from each round of the Delphi survey will be reviewed and participants will ratify the outcomes that meet consensus criteria for inclusion and exclusion. Participants will then discuss the outcomes which did not meet the criteria for agreement. Based on the discussion, participants will then anonymously vote for each outcome for inclusion and exclusion in the finalised COS using a format similar to that of the Delphi survey. All participants in the final consensus meeting will be acknowledged in the publication of results.
Dissemination
Results of this Breech-COS project will be reported according to the COS-STAR criteria23 and submitted for publication in a leading obstetric or medical journal. They may also be disseminated at appropriate conferences. The expectation is that the Breech-COS will always be collected in all clinical trials, audits of practice and other forms of research that involve breech birth at term. This will facilitate comparing, contrasting and combining studies with the ultimate goal of improved maternal and neonatal outcomes.
Study Status
The systematic review stage of this study was started in June 2020. Data extraction and analysis has been completed. Preparation for submission to a peer-reviewed journal is ongoing. A meeting with the study’s PPI group was conducted on December 10, 2020. Stakeholder recruitment and round 1 the Delphi process will start in 2021, with expected completion by June 2022, including the consensus meeting. Following this, the ratified Breech COS will be reported via publication in an academic journal. This timeline is subject to some flexibility to account for the needs of front-line clinician participants to prioritise clinical care during the COVID-19 pandemic, and uncertainties arising from this.
This is the first version of the protocol dated 23/11/2020.