Participants were recruited from those who signed up for the Great British Intelligence Test (21) in response to emails sent in December 2020 and June 2021 and January 2022. We analysed data from 20,922 individuals in December 2020, from 12,796 individuals in June 2021 and from 14,090 individuals in January 2022 using the Cognitron online assessment platform (22–24). 2,797 people completed all three timepoints. Demographics of participants at all timepoints are presented in Supplementary Materials.
-
Characterising behaviours and trust: an analysis of fixed response questionnaire data
We assessed the distribution of responses to three types of pre-formulated questions. The first type probed whether or not respondents were distrustful of the government’s approach and the media’s response to the pandemic, vaccines, and the mainstream narrative of the origins of COVID-19 (Figure 1A-E). The second type probed whether respondents had complied with suggested measures to reduce the transmission of COVID-19 (Figure 1F-I). The third type probed respondents’ primary sources of information regarding the pandemic (Figure 1J).
1.1 The distribution of trust and compliance and information sources
As expected, although the majority of the population endorsed trust in the government, media, vaccines, and the standard narrative for the origins of COVID-19 (Figure 1A-E) there were substantial minorities who endorsed distrust and a lack of compliance. For example, in December 2020, 22.7% of respondents reported assuming that there were ulterior motives behind the government’s response to the pandemic (Figure 1A), 17% that the media was covering up information (Figure 1B), 19.6% did not consider COVID-19 to be a natural phenomenon, (Figure 1C) and 9.7% felt that the government imposed restrictions were not justified (Figure 1E). Over the course of one year these responses showed small but statistically significant changes. Most notably, more people assumed the government had ulterior motives behind their response to the pandemic (29.9%) and that the COVID-19 pandemic had unnatural origins (27.9%). At the same time, fewer people (13.4%) considered that more needed to be done regarding restrictions on social behaviour in January 2022 compared to December 2020 (29.3%).
A similar pattern of results was evident for the compliance questions, with the majority endorsing compliance with safety measures but substantial minorities reporting non compliance (Figure 1F-I). For example, in December 2020, 37.1% of people surveyed stated that they did not avoid leaving the house due to COVID-19 (Figure 1G), 15.5% of respondents did not want to be tracked with the NHS Track and Trace app, and 9.4% did not trust what the government would do with that data (Figure 1I). Only 6.6% of people stated that they would not get vaccinated when a vaccine became available (Figure 1D). Although 0.6% of respondents reported not following social distancing guidelines at all, 37.8% reported not doing so all of the time (Figure 1H). Similarly, although 0.4% of responders reported not wearing a mask (Figure 1F) 13.5% only did so because they had to, a percentage that increased to 18.6% in June. Reflecting changes in guidance, the most striking change from December 2020 to January 2022 was that people no longer avoided leaving their house due to COVID-19, from 18.9% to 49.9% in June 2021 and 49.2% in January 2022 (Figure 1G).
In December 2020 the most common reported source of news about the pandemic was via TV (26.5%), and the Internet (21.9%), with social media accounting for 7.3% of responders' primary source of information surrounding the pandemic (Figure 1J). In May 2020, the proportions changed such that marginally more respondents took their information about COVID-19 from governmental communications and less from other sources.
1.2 Predicting lack of compliance on the basis of trust
Next, we investigated whether individual respondent’s compliance with COVID-19 safety measures could be predicted from trust in government and media advice about COVID-19-related issues. The answers given to the five compliance questions (wearing a mask, taking the vaccine, following social distancing guidelines, avoiding leaving the house and using the NHS app) were converted into continuous numeric scales and aggregated as a composite compliance score (see Methods). A multiple linear regression model was fitted with the composite compliance score which was adjusted to demographics measures (age, residence, ethnicity, education, occupation) as the dependent variable and yes/no responses to each trust question as predictors. R2 for the model was 0.13. Table 1 shows the results of this analysis and identifies which aspects of trust predicted lack of compliance (Table 1). Affirming any of the following four statements predicted a lack of compliance with the suggested measures for containing the pandemic: that restrictions are unjustified, that the government has ulterior motives, that the media is hiding things, and skepticism that COVID-19 has natural origins. Considering that restrictions are poorly justified had the largest regression coefficient. Therefore, if someone considers that restrictions are poorly motivated then they are less likely to follow them, with other aspects of distrust having small additive effects to this.
Lack of trust
|
Regression Coefficient
|
p-value
|
Meaning
|
Intercept
|
-0.12
|
***
|
Those who trust are more likely to comply
|
More restrictions are needed
|
-0.30
|
***
|
Affirmative respondents more likely to comply
|
Restrictions are not justified
|
1.51
|
***
|
Affirmative respondent less likely to comply
|
The government has ulterior motives
|
0.10
|
***
|
Affirmative respondent less likely to comply
|
The media is hiding things
|
0.17
|
***
|
Affirmative respondent less likely to comply
|
COVID-19 has unnatural origins
|
0.07
|
**
|
Affirmative respondent less likely to comply
|
Table 1. Predictors of non-compliance with suggested measures to reduce transmission of COVID-19. Effect size (Cohen’s d) is calculated by dividing the beta coefficients calculated in the linear regression by the square root of the N times the standard errors. Significance is denoted as *, **, and *** for p<0.05, p<0.01, and p<0.001, respectively.
1.3 Predicting trust and non-compliance based on sociodemographic factors, substance use, preexistent neurological or psychiatric conditions, wellbeing, time spent online and information sources
We examined whether sociodemographic variables, levels of substance use, neuropsychiatric status, news sources and time spent online were predictive of whether respondents were distrustful and/or non-compliant with COVID-19 safety measures. Binomial and multinomial logistic regression models were trained to predict the categorical responses for each of the minority answers for questions in Figure 1 (see methods).
Factor
|
A.
|
B.
|
C.
|
D.
|
E.
|
F.
|
G.
|
H.
|
I.
|
Age
|
***
|
***
|
***
|
***
|
***
|
***
|
***
|
***
|
***
|
Sex
|
***
|
***
|
***
|
0.088
|
**
|
***
|
***
|
***
|
***
|
Residence
|
0.761
|
***
|
**
|
0.178
|
**
|
**
|
0.806
|
**
|
***
|
Ethnicity
|
0.97
|
*
|
**
|
0.158
|
***
|
*
|
***
|
*
|
***
|
Education
|
***
|
***
|
**
|
***
|
***
|
**
|
***
|
**
|
*
|
Occupation
|
0.383
|
0.19
|
0.058
|
0.062
|
***
|
***
|
*
|
***
|
***
|
Neuropsychiatric status
|
0.236
|
***
|
*
|
**
|
0.137
|
***
|
0.296
|
***
|
**
|
Drug use
|
*
|
**
|
***
|
***
|
*
|
***
|
***
|
***
|
***
|
News source
|
***
|
***
|
***
|
***
|
***
|
***
|
***
|
***
|
***
|
Wellbeing
|
0.864
|
***
|
***
|
***
|
**
|
**
|
***
|
***
|
***
|
Time online
|
*
|
***
|
*
|
**
|
0.288
|
***
|
0.249
|
***
|
***
|
Table2. Sociodemographic factors predict trust and non-compliance. Questions B,G, H and I were fitted as multinomial logistic regression models, and questions B-F were multinomial logistic regression models. A - Does not wear a mask at all times, B - Lockdown restrictions are not justified, C - There are ulterior motives behind the government’s response to COVID-19, D - The media is hiding things from the public, E - Would not take the vaccine, F - Does not socially distance, G - COVID-19 is not a naturally occuring phenomena, H - Does not avoid leaving the house due to COVID-19, I - Does not use the NHS app. Significance is denoted as *, **, and *** for p<0.05, p<0.01, and p<0.001, respectively.
The factors added to the model were, in this order, age decade, sex, residence, ethnicity, education, occupation, psychiatric or neurological conditions, drug use frequency prior to the pandemic, primary news sources about the pandemic, wellbeing score determined from the GAD-7 (25) and PHQ (26) anxiety and depression scales, and number of hours spent online per day. The impact of each of the factors on driving either trust-related or compliance-related questions is illustrated in Table 2. The significance of each factor was calculated from the log likelihood ratio of the model containing all factors and the model without that specific factor.
At the factor level, age, education, frequency of drug use and news sources all showed significant prediction of distrust and compliance across all questionnaire items. Notable factors predicting distrust and noncompliance were also sex for all questions apart from the media hiding things, and wellbeing level for all questions apart from following the social distancing guidelines. Neuropsychiatric status was a predictor of all but trust in vaccination, following the social distancing guidelines and distrusting that COVID-19 is a natural phenomenon. Ethnicity also played a role in driving trust about lockdown restrictions, the government response to COVID-19, vaccination, the origins of COVID-19, leaving the house and using the NHS app.
At predictor level, compliance and distrust varied significantly with sociodemographics. The most salient sociodemographic and lifestyle predictors are illustrated in Figure 2 and the full spectrum of predictors including odds ratios and significance values are appended in the Supplementary Materials. Odds ratios were calculated from the regression coefficients resulting from all complete binomial and multinomial logistic regression models. Younger people (18-30 years old) had twice the odds of older people (51-60 years) to not follow social distancing guidelines. People with low education levels showed high odds of distrusting the government, media and mainstream COVID-19 narrative, as well as to not follow the social distancing guidelines compared to people with university degrees.
Frequent drug users were more likely to not wear masks and not follow the guidelines compared to people who never used drugs, but also to distrust the government and mainstream media. People with low wellbeing were around 1.5 times more likely than people with high wellbeing to distrust the government including what they would do with their data from the NHS app, distrust the media, only following guidelines for masks because they have to, have given up on following them or never followed them to begin with.
- Common beliefs underlying distrust: a topic-modelling analysis of free text responses
Topic modelling was applied to free-text responses to provide further insights into the most common beliefs people held that motivated distrust in government and media. Specifically, respondents were presented with a free text box if they answered specific questions indicating distrust. They were asked to provide reasons for responding that (1) restrictions were either unjustified or more needed to be done, (2) the government had ulterior motives, (3) the media was hiding things, (4) they would refuse the vaccine, and (5) they thought the origins of COVID-19 were unnatural. LDA models were trained on the resulting free-text data from these questions to capture in a data-driven manner the responders’ most common beliefs as commonly occuring latent documents or ‘topics’.
After removing infrequent words, non-words, lematising and tokenising, the optimal number of topics for each question given the corpus of responses was chosen based on the number of topics from 1 to 30 where Cv coherence was highest. Then, LDA was used to infer this number of latent topics from the corpus (see Methods and Supplementary materials).
2.1 Distribution of beliefs across timepoints
We illustrate the dominant topics derived from the answers to the free text questions in Figure 3, as well as whether there was a change in topic distribution from December 2020 to January 2022. Chi-squared tests illustrated that changes in the prevalence of beliefs was significant for every question assessed. People who indicated that they felt more restrictions were needed, tended to justify this distrust on the basis of topics such as the need to protect the NHS, infections rising, lockdowns being needed, and that rules had to be stronger and clearer. They also believed that the government needed to be more proactive and the reason for amplifying restrictions was because many people did not follow the guidelines. The highest % change between December 2020 and January 2022 is for the topic related to infections, transmission, hospitalisation and death rates, rising concerns which sky-rocketed from 10.1% in December 2020 to 27.1% in January 2022.
Conversely, people who endorsed restrictions being unjustified stated that this was due to their impact on the youth, the fact that they were not focused specifically on the vulnerable, the contradictory nature of the policies, and most prevalently because of the impact they had on the economy. The changes in the prevalence of belief topics was substantial. The most striking one was related to the government inconsistencies about the restrictions which saw an increase from 13.9% in December 2020 to 27.1% in January 2022.
The sub-population who distrusted the government prevalently believed that they had ulterior motives because they made inconsistent decisions with regards to COVID-19 policies, thereby prioritising the gain of popularity with the public or businesses rather than population health. This topic saw an increase from 18.8% to 25.7% from December 2020 to June 2021, followed by a decrease to 18.9% in January 2022. The remaining topics featured the government’s lack of transparency, prioritising economy over health, using COVID-19 to distract from other issues such as Brexit, and using the pandemic for personal gain. The most prevalent belief in January 2022 was that the government has been dishonest with the public and ignored advice of experts (24.5%).
People who distrusted the media believed that they shared only partial information or sides of the stories, focused on the negative and shocking stories, did not encourage discourse critical of the government, and were unreliable. A substantial proportion among the distrustful (20.5% in December 2020, 20.6% in June 2021, 19.9% in January 2022) believed that the media not only did not present an impartial view but also were influenced by politics, the global economy, and investors, making this the most popular topic.
Only a small proportion of people in our sample indicated that they would refuse the COVID-19 vaccination. However, those who did so either quoted personal health circumstances that made them exempt, were unsure about vaccines in general, did not see the benefits compared to the risks, or worried vaccines were being rolled out too quickly and might have long term side effects that had not yet been assessed. The latter topic showed an increase from 36.7% in December 2020 to 53.5% in January 2022.
Lastly, people had a range of views concerning the origins of COVID-19. Respondents believed it was either a bioweapon developed in China which was accidentally released, a virus leaked from a lab, a zoonosis resulted from our interference with the biosphere or from food markets, that it resulted from improper treatment of animals, or were unsure about its origins at all. The most prevalent belief in January 2022 was that the virus is the result of improper treatment of animals and interference with their habitats (35.5%), and the least prevalent, that it was created by humans and deliberately/accidentally released from a lab (8.6%).
2.2 Specific beliefs covary with sociodemographic factors
Topic probabilities for the entire cohort surveyed varied substantially with sociodemographic factors (Figure 4). Chi-squared tests confirmed that the distribution of best-fitting topics varied significantly with sociodemographic factors. Further chi-squared tests and Pearson’s correlations (for incremental factors) were conducted to determine if each individual topic varied in prevalence across sociodemographic categories (See Supplementary Materials).
Younger people (18 to 30 years old) believed that more had to be done to protect the frontline workers, the lockdown should have been more prompt and restrictions should have been stricter; they were also the group most likely to distrust the government and media in all major reasoning themes. In comparison, older people (above 60 years old) had the highest probability for distrusting the COVID-19 narrative. Specifically they believed that COVID-19 is either a product of humans mistreating animals or man-made, where opinions diverge into either intentionally as a bioweapon or accidentally released.
People who identify as ‘Other’ (rather than male or female) were more likely to believe more needs to be done, but also to be more distrustful of the government, media, and believe that COVID-19 is a zoonosis resulting from human interference with the biosphere or be unsure about the virus origins.
Minority ethnic groups were more likely to have divergent beliefs in all domains studied, apart from believing that restrictions are unjustified.
Respondents educated at PhD level were distrustful of the government because they believe that the economy has been prioritised over public health. In comparison, people with lower education levels had higher probability of believing that more needed to be done because the government’s response should have been more proactive and many people do not follow the guidelines. They also had higher probabilities to generally distrust the media. The effect of low education levels, however, was most apparent in regards to distrusting the mainstream COVID-19 narrative.
Having a psychiatric or neurological condition was linked to having a higher probability to distrust the authorities in all cases, but lower probability to believe that COVID-19 originated from the wet markets, was a man-made bioweapon or that restrictions were illogical. Overall, people suffering with low wellbeing, frequent drug users, and those who spent most of their day online had higher probabilities for all topics in all cases.