4.1 Study design and participants
We conducted behavioral economic experiments on two data collection time-points (baseline and follow-up) in six schools in NI and six in BOG. For the 12 schools, we delivered two different smoking prevention interventions (ASSIST and Dead Cool). Schools were randomly assigned to receive the ASSIST intervention (three in NI and three in BOG) or the Dead Cool intervention (three in NI and three in BOG). A total of 1444 students participated in the study, including n=796 who received the ASSIST intervention (n=423 in NI; n=373 in BOG), and n=648 who received the Dead Cool intervention (n=295 in NI; n=353 in BOG). All students in a whole school year group (target age 12-15 years) were invited to participate (Year 9 in NI and Year 7 in BOG). In total, 91.7% of those eligible participated in the study (94.3% in NI and 87.9% in BOG). The research protocol of this study was approved by the Queen’s University Belfast, School of Medicine, Dentistry and Biomedical Sciences ethics committee (reference number 18.43; v3 Sept 2018), and by the Ethics committee of the Universidad de Los Andes, Bogotá (937 - July 30, 2018). Written informed consent to participate in this study was provided by the participant's legal guardian/next of kin. All research was performed in accordance with relevant guidelines/regulations of Northern Ireland and Colombia.
In the ASSIST intervention, all students nominated up to 15 classmates across the 3 questions whom they view as influential (who do you respect / who are good leaders / who do you look up to in your year at your school?). The top 18% of nominated students were invited to a two-day training course where they were trained to be peer supporters and were asked to intervene informally in everyday conversations to encourage their peers to not smoke 25. For the Dead Cool intervention, teachers were trained to deliver eight weekly lesson plans in their class groups. The lessons examined the influences on smoking behavior from friends, family members, and the media 26. Since both interventions were developed in the UK, extensive cultural adaptation was undertaken to implement the interventions in BOG 53.
Data were collected before and after the delivery of the interventions using two instruments (more detailed information can be obtained in the published protocol paper 24). First, a self-administered survey was used to collect data including sociodemographic information, self-efficacy, self-report social norms, and pro-sociality. The survey also included a social network questionnaire asking participants about peer relationships in the same year group, including closest school friends, peers with whom they would talk about something that was upsetting you, peers with whom they spend time outside of school, and influential peers 24. For this analysis, the closest school friends’ relationship was used (“Please name up to ten of your closest friends in your school year”).
Second, as an experimentally derived measure of social norms, the incentivized experiments questionnaire (based on Game Theory) was used to collect a measure of general norms sensitivity, injunctive norms of altruism, injunctive norms about smoking behavior, descriptive norms about smoking behavior, and willingness to pay to support anti-smoking norms [13], 24, 42.
Qualtrics software was used to collect all data (Qualtrics, Provo, Utah, USA Version Jan. 2019). All the instruments were translated and back-translated by bilingual speakers/translators. The study was approved by the School of Medicine, Dentistry, and Biomedical Sciences Ethics Committee at Queen's University Belfast on September 21 of 2018 (ref: 18:43) and from the Research Ethics Committee at Universidad de los Andes on July 30 of 2018 (ref 937/2018).
4.2 Students attributes
Sociodemographic variables
We included the following demographic variables: age, sex, home composition, and ethnic status. Details of the categories for each variable can be found in the SI Appendix.
Psychosocial characteristics
We obtained self-report outcomes, including self-efficacy, pro-sociality, and personality traits, from the students in the baseline self-administered survey. Self-efficacy was assessed on a single scale. Pro-sociality was assessed with three variables: Need to Belong Scale, Fear of Negative Evaluation Scale, and Pro-Social Behavior Scale. The personality traits were assessed with the five subscales of the 'Big Five' personality questionnaire: Openness, Extraversion, Agreeableness, Conscientiousness, and Emotional Stability. Further details about the survey and outcomes can be found in the MECHANISMS study protocol 24.
Intervention
For each student, a categorical variable indicating the intervention in which they participated (ASSIST or Dead Cool) was assigned, and a binary variable representing if the student was selected as a peer supporter in the ASSIST intervention was assigned.
Social norms measures
Both injunctive and descriptive smoking social norms were measured with a self-report survey and an incentivized experiment (SI Appendix, section 1.2) with a total of 25 variables 24 (SI Appendix, section 1.1). The self-report survey collected information about family injunctive norms, peer injunctive norms, family descriptive norms, and peer descriptive norms 54. Self-report injunctive norms were measured with a seven-point Liker scale, assessing individuals' beliefs about whether important others (e.g. parents, family, and friends) would approve of their smoking. The self-report descriptive norm was collected using a six-point Liker scale that assesses the adolescents' perceived smoking behavior of important others (e.g. parents, family, and friends).
The incentivized experiment used coordination games to elicit injunctive and descriptive social norms for smoking and vaping behaviors. In this experiment, participants were provided with financial incentives to match their answers to other participants' in their school year group 27. The incentivized descriptive norms items measured beliefs about the proportion of the school year group who would be accepting of a close friend smoking or vaping. The incentivized injunctive norms assessed beliefs about how most others in the school year group would rate the social appropriateness of eight smoking-related scenarios.
4.3 Statistical Analysis
Uncovering the latent groups related to social norms
To reduce the dimensionality of the social norms variables, we conducted two confirmatory factor analysis (CFA) models, one to obtain a latent injunctive social norm variable, and the other to obtain a latent descriptive social norm variable (SI Appendix, section 1.2). The input variables for both CFAs were the self-report survey indicators and the incentivized experiment indicators standardized by the maximum value and changing the directionality of the metric to align them 16.
First, we conducted an initial exploration of how students could be clustered with a CFSC. Second, to understand how the latent groups changed over time, we conducted an LTA. The LTA uncovers the patterns that characterize the clusters of students according to their descriptive and injunctive social norms and estimates how the students transition across the groups over time. The CFSC is a solution to the multi-feature selection problem in clustering. We addressed the special characteristics of each sample in distinguishing a cluster rather than focusing on selecting a subset of samples. To do this, we quantitatively measured the clustering relevance of each sample to a cluster, which we refer to as component-based feature saliency. To achieve this, we assumed that the probability distribution of the samples can be modeled as a Gaussian mixture model (GMM). To estimate the feature saliency we used mixture models, and to optimize the clustering results we used Bayesian parameter estimation with Markov Chain Monte Carlo (MCMC) sampling for those cases where no analytical solution was possible 28. Furthermore, the LTA is a longitudinal extension of Latent Class Analysis (LCA), a multivariate approach that allows the uncovering of hidden grouping variables. This methodology has been extensively studied due to its importance in identifying latent status membership probabilities, and transition probabilities to capture transitions between latent classes over time 55 (SI Appendix).
Students from both settings with no missing data on the descriptive and injunctive norms items were included (n=1018). When the LTA modeling exhibits substantive separation in the group membership probabilities of each student, covariates do not have to be included in the estimation of the latent groups. The estimation of the latent groups and the LTA was performed using the MPlus program 56. To estimate the association of the covariates (sociodemographic and psychosocial traits) with the latent groups at baseline, a multinomial logistic regression was performed using the latent groups from the LTA as the dependent variable and covariates as group predictors57. The estimations were performed using the 'nnet' package in R 58.
Assessing the change in network structure over time
Next, we evaluated if there were structural changes over time in the network of friends, undertaking a temporal analysis. For this, we calculated the Jaccard index Ji 59 that measures the amount of change in the ties of the network over time using the following equation.
Where A(1,1) represents the number of ties that existed before and after the intervention, A(0,1) represents the number of ties that did not exist before the intervention but existed after the intervention, and A(1,0) represents the number of ties that existed before the intervention, but ceased to exist after the intervention. According to the literature, to conclude that there were significant structural changes in the network over time, values between 0.3 and 0.6 should be obtained 59.
Assessing the relationship between the network structure and the social norms group
To determine the presence of homophily or influence processes, we examined the association between the relationship changes in the structure of the friendship network with the changes in friends’ social norms. Homophily refers to the linkage of students by attributes in common. Influences refer to imitating behaviors of students with which the student is connected. For this, we conducted STERGMs and descriptive analysis.
A STERGM allows us to conclude if there is a greater likelihood of preserving or dissolving ties than that which can be attributed to chance 31,60. For each network, a STERGM was conducted, including reciprocity and transitivity as network structural variables and the students’ social norms groups as individual attributes. STERGM simulations were conducted using the 'stergm' package in R 31 (SI Appendix).
The descriptive analysis allowed us identifying if when a student changed their social norms toward or against smoking (or if they stayed in the same group over time) this corresponded to similar changes in the social norms of their friends. Also, we analyzed the friendship threshold according to the proportion of friends (out-degree, i.e. nominations made) that have social norms favorable towards smoking. The analysis was conducted using only the students with complete social norms data at baseline and follow-up.