- Eligibility Criteria
This systematic review will be developed according to published guidelines(18) and reported according to the Preferred Reporting Items for Systematic Review and Meta-analysis (PRISMA).(19) (Appendix 1)
Eligibility of papers for inclusion in the review will be assessed inclusion and exclusion criteria applied to each of the following domains: study designs, types of participants, types of interventions and comparison conditions, and the outcome measures assessed. Inclusion and exclusion criteria within each of these domains are described in turn below.
In accordance with the objective of providing an overview of the current evidence for oral microbiome response to different types of powered and manual toothbrushes, the following designs will be included – parallel-arm randomized controlled trials (RCTs), cluster randomized controlled trials, cross-over randomized controlled trials; non-randomized controlled trials; case-series and cross-sectional studies. In-vitro studies, observational studies, literature reviews and editorials will be excluded.
The studies of adults and adolescents who are professionally instructed to use toothbrushes as a part of their daily routine will be included. Healthy volunteers, hospitalized patients, pregnant patients, orthodontic patients, periodontitis patients and patients on maintenance therapy will be included in this review. Frail and disabled patients who are unable to perform their personal hygiene instructions independently will be excluded.
The intervention of interest is powered toothbrushing. All generations of powered toothbrushes will be included in this review – side to side action, counter oscillation, rotation oscillation, circular, ultrasonic and sonic toothbrushes. Powered toothbrushes that have more than one action, referred to as “multi-dimensional toothbrushes” will be included.(2) Studies using powered toothbrushes without specifying the mode of its action or generation will be included. Trials instituting combined interventions like brushing combined with the use of antibiotic mouth rinse or toothpaste will be included, with estimating the effect of these additional interventions as a confounding variable. Studies with a follow-up period less than 28 days will be excluded.
Given the broad perspective of the intervention of interest, all types of manual toothbrushes will be relevant for inclusion as control groups. Therapeutic and traditional alternatives of toothbrushes like toothette and miswak will be excluded. As previous reviews comparing powered and manual toothbrushes considered the analysis of filament arrangement, orientation, size, shape and flexibility, brush head size and shape along with presence or absence and characteristics of a timer difficult to define across time and brush types, these factors will not be assessed in this current review.(2)
- Types of Outcome Measures
The primary outcome measures employed to evaluate the effectiveness of powered versus manual toothbrushes in terms of the oral microbiome will be included. Microbiological samples harvested from the following sites will be included:
- a. sub-gingival plaque
- b. supra-gingival plaque
- c. oral rinse (salivary)
- d. oral mucosa (buccal or labial)
- e. tongue (dorsal or lateral)
All studies using molecular methods for identifying and quantifying oral microbiota species will be included.
The secondary outcome measures employed to evaluate the effectiveness of powered versus manual toothbrushes in terms of clinical parameters will be included.
The following periodontal indices used for evaluating oral health will be included:
- a. Plaque Index (Quigley Hein Turesky, Silness and Loe, Visible Plaque Index Ainamo Bay, Ortho Modification of Silness and Loe, Navy Plaque Index mod Rustogi, and O’Leary Index)
- b. Gingival Index (Loe Silness, Lobene Gingival Index, Bleeding on Probing, Papillary Bleeding Index, and Bleeding on Marginal Probing)
- c. Periodontal Index (Rusell’s Periodontal Index, Community Periodontal Index of Treatment Needs)
- Information Sources
An initial limited search of MEDLINE and EMBASE will be undertaken followed by the analysis of the text words contained in the title and abstract, and of the index terms used to describe the article.
A second search using all identified keywords and index terms will then be undertaken across all included databases.
Thirdly, the reference list of all identified reports and articles will be searched for additional studies.
Studies published in all possible languages, if they have a title and an abstract in English will be considered for inclusion in this review. Studies published without any time restriction will also be considered for inclusion in this review.
The databases to be searched include:
Ovid MEDLINE(R), EMBASE, Cochrane Library, Web of Science, Scopus, ProQuest Central, ProQuest Dissertations & Theses Global, Bibliographia medica Cechoslovaca, Dentistry & Oral Sciences Source.
The search for unpublished studies will include:
Open Grey, Current Controlled Trials (ISRCTN registry), MedNar, ClinicalTrials.gov., International Clinical Trials Registry Platform of the World Health Organisation.
- Search Strategy
Consistent with the methods detailed in Cochrane Guidelines for systematic reviews the search strategy will be conducted as follows:(18)
- Abstract, title, keywords of the identified database will be searched.
- Both randomized and non-randomized clinical trials will be sought. No study design, date, or language limits will be imposed on the search.
- Reference lists of identified publications will be manually searched to identify any additional publications.
- These searches will be re-run just before final analyses and further studies retrieved for inclusion.
- An example of the search strategy for MEDLINE is attached to this protocol. (Table 1)
- Study Records
Literature search results will be uploaded to reference management software (Endnote X8) and duplicate citations will be removed electronically.
Once duplicate entries are removed, RIAD A and CHUCHMOVA V will develop and test screening questions and forms for level 1 and 2 assessments based on the inclusion and exclusion criteria. Both reviewers will classify the entries independently according to the eligibility criteria. Disagreements will be resolved by discussion between the two reviewers or (when unable to be resolved) third author KLUGAR M adjudication. Reasons for excluding studies from Screening Level 2 will be recorded.
- Screening Level 1:
Titles and/or abstracts of retrieved entries will be checked against general inclusion/exclusion criteria of studies designs (in-vitro studies, observational studies, non-comparative studies, literature reviews, editorials and case reports), types of participants (frail and dependent patients), types of interventions (follow-up period less than 28 days), and comparison conditions (therapeutic and traditional toothbrushes alternatives).
Each entry will be classified as one of the following options; a) eligible-for-inclusion, b) eligible-for-exclusion, c) unclear.
- Screening Level 2:
The full text of eligible-for-inclusion and unclear entries will be retrieved for extensive review. If necessary, reviewers will seek additional information from study authors to resolve any concerns about eligibility.
The Cochrane template of RCTs Data Extraction Forms (EF) will be used.(20) In order to optimize the parameters of EF, piloting of data extraction will be performed by two reviewers independently on five pilot articles which will be randomly chosen from the full list of included entries.
- Data Items
In addition to the standard parameters of Cochrane EF, the following variables will be recorded:
- Powered toothbrush mode of action
- Powered toothbrush brand/model
- Adjunct oral hygiene practices/methods
- Advised period of brushing
- If professional advice/training was delivered to patients
- If patients underwent conventional periodontal therapy before or during the study
- Manual toothbrush brand/model
- Adjunct oral hygiene practices/methods
- Advised period of brushing
- If professional advice/training was delivered to patients
- If patients underwent conventional periodontal therapy before or during the study
- Antibiotic prophylaxis
- Smoking or other risk behaviours
When multiple reports of the same study are identified like related journal articles and conference proceedings which are then published, data from each report will be extracted separately and then combined across multiple EFs.
- Outcomes and Prioritization
- The primary outcomes will be changes in oral microbiome after using powered and manual toothbrushes. These may be measured as a total count of microbial species at different time points or as a percentage of change of microbial counts in relation to powered or manual toothbrushing.
- The secondary outcomes will be changes in clinical parameters after using powered and manual toothbrushes. These may be measured as a mean of measured parameters at different time points or as a percentage of change of measurements in relation to powered or manual toothbrushing.
- The estimate of effect which will be used is the mean difference (MD) and corresponding 95% confidence intervals (CI). Whenever possible, the different clinical indices of secondary outcomes that measure the same concept will be incorporated, as long they have a high correlation between each other. If it is not possible to combine the results from different indices, the effects will be expressed as standardized values, which have no units, before combining. The standardized mean difference (SMD) will be therefore calculated along with the appropriate 95% CI and will be used as the effect measure for each meta-analysis where results will be available for more than one index.
- Other secondary outcomes may include cost-effectiveness, safety, and reliability of powered versus manual toothbrushing. This will be decided according to the availability of evidence.
- Risk of Bias in Individual Studies
The critical appraisal of individual studies will be guided by an experienced methodologist, KLUGAR M. To facilitate this process, the revised version of Risk of Bias Assessment Tool (RoB 2) will be used.(21)
This tool uses signalling questions in order to critically appraise the following methodological domains:
- Domain 1: Risk of bias arising from the randomization process
- Domain 2: Risk of bias due to deviations from the intended interventions
- Domain 3: Risk of bias due to missing outcome data
- Domain 4: Risk of bias in the measurement of the outcome
- Domain 5: Risk of bias in the selection of the reported result
The overall risk of bias After receiving proper training and calibration of their skills, RIAD A and CHUCHMOVA V will assess each included study according to each risk of bias domain independently. Disagreements will be resolved through discussion between the two reviewers or, when unable to be resolved, KLUGAR M will be consulted. All studies regardless of their risk of bias will be included in final data synthesis. Influence of bias on the results will be explored by sensitivity analysis.
- Data Synthesis
- Narrative synthesis using “summary of findings” (SOF) tables will explore the findings within and between each included study as they pertain to the powered toothbrushing impact on the oral microbiome, the correlation between microbial and clinical outcomes and lab protocols used.
- Data from cross-over trials will be included with that of similar parallel-group trials, using the techniques described by Elbourne and colleagues.(22) This will be done using the generic inverse variance method within RevMan.(18)
- For heterogeneity assessment, an inspection of a graphical display of the estimated treatment effects from the trials along with their 95% CI and by Cochrane’s test for heterogeneity will be undertaken before each meta-analysis as described in the Cochrane Handbook for Systematic Reviews of Interventions.(18)
The heterogeneity will also be quantified using the I2 statistic, using guidance for interpretation from the Cochrane Handbook for Systematic Reviews of Interventions:(18)
0% to 40%: might not be important;
30% to 60%: may represent moderate heterogeneity;
50% to 90%: may represent substantial heterogeneity;
75% to 100%: considerable heterogeneity.
- An overall assessment of the robustness of the evidence will be ascertained using weightings from the quality appraisals; the strength of evidence for each main outcome variable will be synthesized and presented as key recommendations for policy and practice and to inform future inquiry.
- Meta-Bias(es)
To evaluate reporting bias, the revised version of Risk of Bias Assessment Tool (RoB 2) will be thoroughly used.
An important part of this tool mechanism is to document all the available source that is used to complete the assessment including – journal article(s), trial protocol, statistical analysis plan (SAP), non-commercial trial registry record (e.g. ClinicalTrials.gov record), company-owned trial registry record (e.g. GSK Clinical Study Register record), grey literature (e.g. unpublished thesis), conference abstract(s) about the trial, regulatory document (e.g. Clinical Study Report, Drug Approval Package), research ethics application, grant database summary (e.g. NIH RePORTER or Research Councils UK Gateway to Research). The second and fifth domains of RoB 2 will enable us to detect if there’s any selective reporting bias, especially in case of deviation from the protocol.
- Confidence in Cumulative Evidence
The certainty of the evidence for all outcomes will be evaluated using the Grading of Recommendations Assessment, Development and Evaluation (GRADE) working group methodology. SOF table for this review outcomes will be created using GRADEpro GDT sw.
#
|
search
|
results
|
1
|
toothbrush*.af
|
8704
|
2
|
"tooth brush*".af
|
1548
|
3
|
1 OR 2
|
9364
|
4
|
powered.af
|
14727
|
5
|
power.af
|
242275
|
6
|
electric.af
|
255435
|
7
|
sonic.af
|
7568
|
8
|
ultrasonic.af
|
47093
|
9
|
"ultra sonic".af
|
80
|
10
|
rotation.af
|
82561
|
11
|
rotating.af
|
15232
|
12
|
oscillating.af
|
6046
|
13
|
oscillation.af
|
15878
|
14
|
4 OR 5 OR 6 OR 7 OR 8 OR 9 OR 10 OR 11 OR 12 OR 13
|
15878
|
15
|
microbiota.af
|
35808
|
16
|
microbiome.af
|
23552
|
17
|
microbial.af
|
382595
|
18
|
microbiological.af
|
58750
|
19
|
microflora.af
|
13876
|
20
|
flora.af
|
31400
|
21
|
microorganism?.af
|
88184
|
22
|
micro-organism?.af
|
9290
|
23
|
bacteria.af
|
438739
|
24
|
bacterium.af
|
64201
|
25
|
bacterial.af
|
1102786
|
26
|
microbe?.af
|
44395
|
27
|
15 OR 16 OR 17 18 OR 19 OR 20 OR 21 OR 22 OR 23 OR 24 OR 25 OR 26
|
1525896
|
28
|
3 AND 14 AND 27
|
103
|
Search was conducted on 14th November. 2019 at 13:00 am (CET) in All fields.
|
Table 1
Ovid MEDLINE(R) search strategy