We will undertake a systematic review of existing observational evidence and will perform meta-analyses where sufficient data are available. The study has been pre-registered with AsPredicted (No. 39505) and registered to the International Prospective Register of Systematic Reviews (PROSPERO CRD42020165345). This protocol follows the Preferred Reporting Items for Systematic Review and Meta-Analyses for Protocols (PRISMA-P) 2015 guidelines (see Additional file 1)[48].
Eligibility criteria
The inclusion/exclusion criteria have been defined according to the Population of interest, Exposure, Comparator, and Outcome (PECO) statements as described below:
Our population of interest will be children and youth aged less than 25 years old. We will include studies carried out in clinical and community samples of individuals aged less than 25 years or whose mean age is under 25 and exclude those that do not specify participants’ mean age or age range.
The term “parent” will refer to the biological or adoptive parent(s), guardian(s) or caregiver(s).
In accordance with the rationale described earlier and with previous meta-analyses examining relationship of parenting on child outcomes, parenting factors will be classified according to the three broad categories of positive parenting, negative parenting and parent-child relationship [49–51].
Studies will be eligible for inclusion if they assess parenting before the age of 18, or at a mean age lower than 18. We set this age limit knowing that, in most countries and states, reaching 18 years corresponds to legal emancipation of children and is marked by more autonomy, life decisions and often changes in living arrangement that have a main impact on how parents and children perceive the role of parenting and the parent-child relationship [52].
In this review, we will focus on the following two outcomes as defined by the CDC: i) suicidal ideation, which refers to thinking about, considering, or planning suicide, and ii) suicide attempt, which refers to a non-fatal, self-directed, potentially injurious behavior with intent to die as a result of the behavior [5].
We will not to consider data relating to non-suicidal self-injury (NSSI) and non-suicidal self-harm in the present study. Although they are highly comorbid with suicidal behaviours in children and adolescents, these are phenomenologically different [53] and could be influenced by distinct protective and risk factors [54].
Some studies have examined the relationship of parenting with self-injury and self-harm, which refer to any self-injurious behaviour, including suicide attempt but also NSSI and non-suicidal self-harm.
In order to identify all relevant data pertaining to suicide attempt, our search strategy is meant to capture these studies by including relevant keywords such as “self-injury”, “self-harm” or “self-mutilation”. However, reviewers will carefully assess the definition of each outcome considered (including in sub-analyses), and will only retain those reporting data on suicide attempt. The studies that examine self-harm as a single entity will be excluded, assuming that they do include non-suicidal behaviours.
Only observational studies with retrospective, cross-sectional or longitudinal designs will be eligible for inclusion. Case-control studies will be excluded because they are more prone to recall and selection bias [55]. To examine the bidirectional association of parenting and NFSB, we will include longitudinal studies that examine either the effect of parenting on subsequent suicidal behavior or the effect of suicidal behavior on subsequent parenting factors. The findings of case reports, case series, therapy/treatment based intervention studies, discussion articles, exclusively qualitative studies, reviews or meta-analyses will be excluded. However, the reference lists of literature reviews and meta-analyses will be reviewed to capture possible additional relevant citations.
Studies published (or “in-process”) in a peer-reviewed journal as well as dissertations will be included. The inclusion of dissertations will allow us to consider results published outside of traditional commercial publishing and thus to reduce the risk of publication bias [56]. However, we will not include conference posters and presentations for two reasons. First, they may not contain adequate information about the study design, methods, biases and results, limiting critical appraisal of corresponding studies. Second, the association of parenting and NFSB has already been examined in a large number of studies published as articles and dissertations and, in that case, the inclusion of conference abstracts in meta-analyses has been shown to result in only small differences in the effect estimates [57].
Our research team includes members who are proficient in English and in French, making us able to review research works published in these two languages.
Search strategy
A primary search strategy was developed in APA PsycInfo by a health sciences librarian and, after review and validation by co-authors, the final search strategy was run in APA PsycInfo on November 6th, 2019 (Additional file 2). On the same day, it was translated and applied in Medline, CINAHL, Embase, Scopus and the Cochrane Library databases and was also run in Medline Epub Ahead of Print, In-Process & Other Non-Indexed Citations, to capture the most recent literature. Database-specific subject headings and keywords in natural language were used to capture “parenting dimensions” and “suicidality” concepts, and combined using Boolean logic and operators including proximity searching. These results were then limited to articles where “child” and “adolescent” terms and their synonyms appear in selected fields, and to observational study types. No year limits or language limits were applied.
Data screening
Two independent reviewers will follow a two-step selection process using Covidence® Software, according to the eligibility criteria described previously. A first decision will be made based on titles and abstracts. Then, the selected articles will be considered for full-text assessment to determine if they definitely qualify for inclusion. Any disagreement will be discussed by the two reviewers and any remaining discrepancy will be resolved by a third reviewer.
Data extraction
Data will be extracted separately by the two reviewers using a standardized data extraction form and a coding process implemented in the Research Electronic Data Capture System (REDCap®). The following information will be systematically extracted from the included studies:
- General study characteristics: first author, year of publication, journal and type of publication (peer-reviewed article or dissertation);
- Study setting: country where the study was performed, setting in which it took place (mental health care setting, other clinical care setting, or population-based);
- Study design: type of study (e.g. cross-sectional, longitudinal), time period for data collection;
- Sample characteristics: sample size, age of participants (range and/or mean ± standard deviation) or corresponding school grades, gender distribution and main ethnicity (defined as the ethnicity shared by more than 60% of participants, otherwise ethnicity will be defined as “balanced”);
- Measurement of parenting: type of parenting, measurement time frame, type of informant (child, parent, other), relationship of caregiver with the child (biological parents only or not), method for assessment (questionnaire, interview or observation);
- Assessment of NFSB: type of outcome (suicidal ideation or attempts), assessment time frame, informant (child, parent, other), method for assessment (questionnaire, interview, observation);
- Effect estimates: Non adjusted and/or adjusted effects estimates (along with their standard deviation or 95% confidence intervals) relating to the association of each parenting factor with one or both of our outcomes will be extracted and converted it to odds-ratios (OR) for dichotomous outcomes, and standardized mean differences (Cohen’s d) for continuous outcomes, using conventional conversions.
Any disagreements between the two extraction processes will be resolved by consensus discussion with a third reviewer. In case of unclear or incomplete data, original authors will be contacted.
Risk of bias
The two reviewers will independently assess the methodological quality of studies using the Quality Assessment Tool for Observational Cohort and Cross-Sectional Studies developed by US National Heart, Lung and Blood Institute (NHLBI) [58]. This validated tool includes 14 items for evaluating potential bias induced by study methods or implementation, including patient selection, attrition, confounding, sample size justification and arguments for causation. Reviewers will select "yes," "no," or "cannot determine" in response to each item. Some questions of the tool have been slightly adapted to better capture strengths and weaknesses of existing studies in the scope of our topic. Reviewers will also rate the overall study quality as “good”, “fair” or “poor” based on their rating for each item and their own critical appraisal of the risk of bias, as recommended by the guidance document developed by the NHLBI methodology team. If reviewers rate the overall quality of the study as poor, they will state the reasons for decision. In case of disagreements, consensus will be sought through discussion between raters and, if necessary, with the third reviewer.
Data synthesis
Evidence regarding the association of parenting factors with our two outcomes (suicidal ideation and suicide attempt) will be reported according to the Preferred Reporting Items for Systematic review and Meta-Analysis (PRISMA) criteria [48] and satisfy the Meta-analysis Of Observational Studies in Epidemiology (MOOSE) Checklist for Meta-analyses of Observational Studies [59].
Meta-analyses will be performed using a random effect model when a minimum of three studies with usable data is available. We will calculate effect sizes as odds ratios (OR) or standardized mean difference (Cohen’s d), with standard errors, and convert information reported in a different metric (i.e., mean-difference or correlation) using conventional conversions.
A narrative summary of the evidence will be provided by outcome, including results from studies that would not be possible to consider in meta-analysis. Results will be presented using forest plots and in a “Summary of Findings table”. The Grading of Recommendations Assessment, Development, and Evaluation (GRADE) approach will be used to rate the certainty of the evidence [60].
Studies often report on multiple effect sizes obtained from the same sample or in the same epidemiological study, for instance when examining the associations of different parenting factors with NFSB or when considering the measures reported by different informants (mother/father or youth). In that case we can assume that the corresponding effects sizes are dependent [60], and it is inappropriate to perform a standard meta-analysis because the assumption of conditional independence of effect sizes is violated [61]. A strategy could be to consider only one effect size per study and to perform separate meta-analyses for each type of exposure [62]. However, this implies that some associations are more valid or of greater priority and results in a loss of information. Moreover, it becomes impossible to examine moderation effects between several exposures of interest (in our case, between parenting factors). The use of three-level models has thus been recommended to model dependent effects sizes without losing available information, especially in studies examining the role of different parenting factors that could influence each other [51]. Our three-level meta-analyses will allow us to consider: 1) the effect size level; 2) the sample level; 3) the study level.
Heterogeneity will be assessed by visual inspection of forest plots, Cochrane’s Q and Higgins’ test (I2). The I2 values, corresponding to the observed heterogeneity that would not be expected by chance, will be classified as low (< 30%), moderate (30%–50%), and severe (> 50%) [63].
In case of significant heterogeneity, moderator analyses will be conducted considering study sample characteristics (age and sex of participants, main ethnicity), countries’ economy indicators: gross national income per capita and income inequalities measures (Gini index), and methodological aspects including study design, informants and informant consistency (considering whether parenting and suicidal behaviors are reported by the same informant or not).
Publication bias will be evaluated through visual inspection of funnel plots and by using Egger’s test. The “trim and fill” method will be applied to correct for publication bias [64].
Subgroup and sensitivity analyses
If possible, sub-group analyses will be conducted according to different study settings (mental health care setting, other clinical setting or population-based).
To examine whether the inclusion of studies with the highest risk of bias might affect our results, and in in accordance with The Cochrane Handbook, sensitivity analyses will be performed by restricting the primary analysis to studies at low risk of bias, after exclusion of those whose quality was rated as “poor” on the Quality Assessment Tool for Observational Cohort and Cross-Sectional Studies. We will identify effect-size outliers, defined as effect sizes falling more than 2.2 standard deviations away from the pooled result, as well as small sample size outliers (n<100) [65]. These outliers will be considered in a leave-one-out sensitivity analysis, which consists in performing separate meta-analyses on each subset of the studies obtained by iteratively leaving out one outlier [66].
Analyses will be performed using Comprehensive Meta-Analysis and R.