Study setting and population
The island of Barú has a population of 6,000 inhabitants and is composed by three communities: Barú, Ararca and Santa Ana. Santa Ana’s population being approximately 3,200 inhabitants (Cartagena Cómo Vamos, 2020). More than 80% of the population self-identifies as Afro-descendent (Carreño Jimenez, 2017). As noted earlier, while Santa Ana is administratively dependent on the city of Cartagena, this district is geographically isolated and therefore the capacity for intervention by the state has been limited (ANSPE, 2014).
Study design
This is a descriptive study and is a first-generation formative pilot study to evaluate the initial feasibility and utility of using this type of technology-enabled “by the people” citizen science method among this underserved and understudied population.
This study was developed using the Our Voice method developed at Stanford University (Figure 1), which consists of the following phases: 1) recruitment of participants; 2) technology-enabled data collection during walks within the school property; 3) facilitated participatory mapping workshops and discussion among citizen scientists to build consensus around those issues of highest priority that could be feasible to address; 4) a participatory community meeting with relevant school stakeholders; and 5) assessment of change.
1) Sample – Recruitment of participants
In this first-generation study, a total of 11 participants (8 female and 3 male) were randomly selected in a raffle among students of the science club that is composed by students of the different high school degrees. Previous Our Voice studies reported that this number is typically sufficient to attain group consensus on the major barriers and enablers in a specific locale (A. C. King et al., 2021).All the selected adolescents and their parents or caregivers gave their written consent to participate in the study. This study was reviewed and approved by the Institutional Review Board of the Universidad de los Andes in Bogotá (Minutes 945 of 2018).
2) Data collection
Stanford Discovery Tool
The Stanford Discovery Tool is a mobile application-based environment assessment tool that residents use to collect information about features of their local environments that impact health and well-being (Buman et al., 2013). Deployed successfully by individuals ages 9 to over 95 years old across more than 20 countries, including Colombia (A. C. King et al., 2021)(A. King et al., 2020), this tool allows citizen scientists to record geotagged photos, comments, and ratings that are then uploaded to a secure server where collective data reports can be generated. As part of the Discovery Tool app, participants completed a brief survey that included a standard question concerning rating their overall health relative to others of a similar age and sex on a 5-point scale from poor to excellent (A. C. King et al., 2016), and several frequently used questions about perceptions of cohesion and empowerment in the community using Likert scales from the standard Our Voice protocol (A. C. King et al., 2016).
Walks within the school
The data collection walks were carried out across three days. Prior to data collection, the citizen scientists were provided with a cell phone that had the Discovery Tool installed, and instructions were given on how to use it. Following completion of the participation agreement and informed consent form, each citizen scientist opened the application, read a welcome message and safety suggestions, and took an individual walk in their school site with the goal of answering the following question: “What things facilitate or hinder your well-being and that of your community at the Santa Ana Educational Institution?” Throughout the walk, the citizen scientists took photos of the elements of their built environment of relevance to this research question. For each element, they selected in the app whether it was considered a facilitator of their well-being (happy face emoticon), a barrier to their well-being (sad face emoticon), or both. They then used the app’s audio-recording feature and/or text comments to describe why they took the picture. Trained research staff remained in proximity to the citizen scientists on the walks in case they had technical difficulties, but did not interfere with data collection. At the end of the walk, each participant completed a short survey consisting of 8 questions regarding demographic data, perceptions of health, perception of the level of support among school site members, levels of individual and group empowerment in decisions that affect the community, and level of knowledge about relevant actors/stakeholders (e.g., important hotels in the area, the community board) in the larger community
Facilitated mapping workshops and solution-building among citizen scientists
School Community Meeting 1: participatory mapping workshop and building consensus on perceived facilitators and barriers to well-being
Once the walks were finished, study investigators processed the Discovery Tool data to create collective reports for participant review. At a facilitated meeting, each participant was given a folder containing printed copies of their geotagged photographs accompanied by verbatim transcripts of their text and/or audio comments as well as map locations and positive or negative ratings. The discussion among citizen scientists was facilitated by the research team and in the context of a school mapmaking activity in which adolescents constructed their own map of the school.
During this community mapping activity, participants discussed their findings, found common ground, and set priorities to improve well-being in their school environment. To facilitate this process, citizen scientists were divided into two groups and jointly drew school maps where they identified natural, political, and social elements related to well-being. Afterwards they were asked to add another layer to the map, consisting of the photos taken with the Discovery Tool. Then, the two groups presented the maps to each other and worked together to identify and prioritize the main barriers and facilitators of well-being in the school. Near the end of the workshop, the citizen scientists proposed possible solutions for each of the main barriers identified. Using this information, they were then provided with mentorship by the study staff to prepare a presentation using slides, so that they could present their findings at a subsequent meeting with the relevant decision-makers of the school.
This method invites citizen scientists to become active participants in sharing their experiences and developing a shared vision of their school, thus facilitating feelings of empowerment (Lydon, 2003). During the workshop the participants were encouraged to make distinctions related to their built and local environment from different points of view. They were encouraged to be observers within their system when they carried out the walks, and then observers from outside their system when they built their map of the school. This is important because, according to second order cybernetics, the system’s distinctions let the observer to define the meaning of what is observed and analyze it (Vanderstraeten, 2001; Von Foerster, 1984).
3) Community meeting with relevant school stakeholders
School Community Meeting 2: advocating and reaching agreement about changes in the school community
Following the first Community Meeting, the research team organized a school community meeting with the relevant stakeholders of the school. The meeting was attended by the directors of the school, the teachers, the architect in charge of future improvements to the school's infrastructure, the Amor por Barú Foundation Team (i.e., the executive director of this non-governmental organization [NGO]), two coordinators that provided logistic support to the Our Voice process, and a landscape contractor), and the Universidad de Los Andes research team. In this meeting, citizen scientists presented their findings and proposals for potential solutions, which were discussed with the stakeholders to reach agreements on relevant actions to take. After this Community Meeting the research team prepared a report summarizing and documenting the findings and agreements that resulted from the project.
4) Assessment of change
Ripple effects and outcomes of Our Voice in Barú
Six months following the second community meeting, the research team developed a report for the school directors describing the results of the Our Voice process. The report consisted of a review of the different stages of the process, a listing of the barriers and facilitators identified, the ideas generated by the citizen scientists about how to improve the general well-being of the school community, and the commitments that were agreed upon between decision-makers and citizen scientists at the second community meeting. Also, a descriptive statistical analysis was conducted and presented with the quantitative data that the survey yielded. The anonymous, de-identified Discovery Tool data collected during the walks were stored on a secure server at Stanford University, accessible to study investigators via a password-protected web interface.
The action plan was subsequently tracked and the activities and their results were monitored both by the Amor por Barú Foundation and the school by e-mails. A year later, though school activities were suspended due to the COVID-19 pandemic, researchers conducted a semi-structured virtual interview with the principal of the school and the staff at the Amor por Barú Foundation sed us via e-mail a report. The research team inquired about the effects that the project had on the school community and the actions carried out for each of the points that were agreed upon in the community meeting.
Qualitative data integration and analysis
All information obtained through the Discovery Tool was transcribed and downloaded with the prior authorization of citizen scientists and their parents/caregivers through informed consent forms. Each of the workshops and community meetings was documented through field notes of the research team that were later transcribed and organized by the research team. The results from the different stages were then structured into a table, and the research team classified them into topics. The information obtained through the virtual semi-structured interview with the principal of the school was recorded and later transcribed. Lastly, to analyze the effects that the project had on the school community, the results of the interview with the principal and the report of Amor por Barú Foundation were compared with the points agreed upon in the community meeting.