The Lockdown Impact Scale for Students (LISS)

doi:10.21203/rs.3.rs-811200/v1

Download PDF

Research Article

The Lockdown Impact Scale for Students (LISS)

https://doi.org/10.21203/rs.3.rs-811200/v1

This work is licensed under a CC BY 4.0 License

Journal Publication

published 03 Nov, 2023

Read the published version in BMC Medical Education →

You are reading this latest preprint version

Background: The Covid-19 pandemic has resulted in many student populations learning online in lockdown. While the mental health consequences of lockdown are increasingly understood, the core features of ‘cabin fever’ are poorly described.

Methods: We conducted a questionnaire survey of 649 undergraduate medicine and health sciences students. Item content was developed based on current literature and input from student representatives.

Results: Mokken scaling identified seven questions that together formed a strongly unidimensional scale which comprised two domains : social isolation/cabin fever and demotivation / demoralisation. Scale scores were significantly associated with depression, self-rated mental health, impaired study efficacy and doomscrolling.

Conclusions: The adverse effects of lockdown on student wellbeing appear to be driven to an important extent by an experience of isolation and demotivation that correspond to narrative descriptions of cabin fever. In the foreseeable event of future pandemics, these experiences are a promising target for health promotion in students studying in lockdown.

Educational Philosophy and Theory

Internal Medicine

Wellbeing

cabin fever

lockdown

Covid-19

students

depression

social isolation

demotivation

With an average of two viral diseases a year jumping the species barrier to humans [1] in tandem with the destruction of the last of the natural environment [2], the Covid-19 pandemic must be seen as a vital learning opportunity to develop mechanisms for preventing, mitigating and managing the further pandemics that will occur in the coming years.[3] One important element of this preparation must be developing an understanding of the specific effects of pandemics on mental health.

The current pandemic has had a wide-reaching effect on societies, with major changes to patterns of work, education, travel and socialising. From the outset, it was recognised that the pandemic would have a significant negative impact on mental health. [4–7] Early research produced two themes of immediate significance. The first documented the adverse effects of the pandemic on wellbeing, leading to the description of a syndrome increasingly referred to as Covid stress syndrome – a traumatic syndrome with symptoms of intrusive worrying thoughts, hypervigilance (including doomscrolling) and avoidance. These findings led to the development of the Covid stress syndrome scale. [8, 9]

The second theme was the assessment of risk perception. Risk perception is a major driver of health related behaviours [10, 11] and is therefore important in controlling the spread of infectious diseases. The development of specific scales to measure risk perception around Covid [12, 13] has been important in helping to understand evolving public health behaviours and to inform public health interventions. In a rapidly-evolving research field it is difficult to summarise the current state of research, however there have been several valuable overviews of the literature by Zavlis [14] and Cortez [15].

The institution of lockdown regimes across the world led to concern about the effects of isolation on mental health. [16–20] In education, the switch to online learning has led to a reduction in social contact and interaction, a diminished sense of engagement in a learning community, increasing loneliness and the emergence of the phenomenon of cabin fever. [21] Although cabin fever is not yet a well-defined entity, it describes the adverse effects of being confined to a small space with or without others. Anecdotally, it is characterised by anxiety, unusual tiredness or sleepiness, irritability, moodiness, boredom, depression, or feeling of helplessness. It is akin to, but distinct from the concept of entrapment. [22]

To date there has been one proposed scale measuring cabin fever by Cong and Rabbani [23] which was developed on the basis of descriptive accounts. However, to date there have been no data-driven attempts to identify the characteristics of cabin fever and the social isolation associated with lockdown.

In common with other schools and universities, the RCSI University of Medicine and Health Sciences adapted its learning delivery to online platforms in response to national lockdown requirements. Aware of the significant effect on student mental health reported in the numerous publications in the first months of the Covid-19 pandemic, we conducted a survey of our students as part of our ongoing student support programme.

The survey was a scoping survey, designed to provide information across a broad spectrum of areas of concern. For this reason, instead of using multiple validated scales to assess each domain – which would have created an unwieldy survey that was unlikely to engage student engagement – we instead tapped each area using one or two sentinel questions.

In this paper we report on the derivation of a short scale to measure the impact of social isolation on students, based on responses to the survey.

The questionnaire items were derived from an extensive survey of the rapidly-accumulating literature on the effects of the pandemic on wellbeing. In the first iteration, we derived items related to two broad domains. The first was fear of Covid, characterised principally by symptoms seen in response to trauma : hypervigilance, avoidance, and intrusive thoughts, images and worries around the trauma [9, 24, 25]. The second domain of concern was risk perception around Covid-19 [12]. We were naturally concerned that students who feared losing out academically if they became ill might conceal symptoms or fail to report contact with a symptomatic individual. Consultation with students resulted in the identification of two further important areas : social isolation and its effects, and positive experiences of meaning and purpose. Finally, a round of item prioritisation and selection reduced the questionnaire to 19 closed questions and a twentieth item that asked for other positive or negative experiences that we had not covered.

The relevant questions from the questionnaire is included as appendix 1, and the relevant data available in the supplementary materials. The global mental health item was the standard WHO item. [26] The depression item was adapted from the Beck Depression Inventory [27], maintaining the response options of the original scale but prefacing them with the question "Are you feeling sad?". The effect on academic perceived academic efficacy was measured by asking "How has Covid affected your studies in the past month?"

The survey invitation was circulated to all RCSI undergraduates, and followed by two reminders. The final response rate of 649 questionnaires represents approximately 25% of the undergraduate population.

Data were analysed with Stata release 16.1, R [28] and JASP. Stata was used for data preparation, cleaning and checking, and for regression modelling. The R package "mokken" [29] was used to conduct a Mokken scaling analysis on the scale properties. JASP [30] was used to calculate Cronbach's alpha and its Bayesian 95% credible intervals. JASP and R were used to examine the network structure of the items, the latter using the MPsychoR [31] and qgraph [32] packages. The item network was constructed using multidimensional scaling of dissimilarities, and goodness of fit of the two-dimensional representation of the items was checked using Sheppard plots and Kruskal's stress index, which is zero when the items can be represented perfectly on two dimensions, and increases with increasing lack of fit. While there are no universally-agreed thresholds for stress, a value of ≤0·15 is taken as reflecting adequate dimensional representation – that is, that the distances between the nodes of the network are interpretable as relative distances between the variables.

The survey was conducted through the RCSI Quality Improvement Office which acted as a gatekeeper to ensure that data were anonymised at source before being passed to the researchers. Ethical approval was obtained from the RCSI Research Ethics Committee (Record ID: 212548897).

Scale construction and visualisation

Mokken scaling identified seven questions that together formed a strongly unidimensional scale, with a Loevinger’s H coefficient of 0·41 (SE 0·02) and an alpha of 0·77 (95% Credible interval 0·74 to 0·80). Checks for goodness of scaling revealed no significant violations of monotonicity or invariant item ordering. The relevant questions and their response options are shown in Appendix 1.

Figure 1 shows the results of the network analysis of the item structure. We used multidimensional scaling of item dissimilarities to map the items onto a two-dimensional representation. We examined ordinal, spline and interval models of dimensionality. The diagram shows the spline model, which had a stress of 0·11 compared with 0·08 for the ordinal model, but lower than the 0·13 for the interval model. Examination of Shepard plots also revealed a consistent misfit for the interval model at intermediate item dissimilarities. The scaling in figure 1 is interpretable as the strength of the relationship between items. The items formed two groups, one reflecting a sense of social isolation – loneliness, lack of social support, cabin fever, a reduced sense of belonging to the learning community. The other reflected the loss of a sense of energy and purpose that we have termed demotivation. It comprised finding it hard to make a start on the day, doubting that you were doing the right thing and a lack of sense that you were growing and developing as a person.

Associations with scale scores

Figure 2 shows mean scores on the Lockdown Impact Scale and demographic variables. Male students had a 56% probability of having a lower score than female students (Wilcoxon Mann-Whitney test, P=0·027). Students in their first year had a 60% probability of having a lower scale score than students in subsequent years (Wilcoxon Mann-Whitney test, P < 0·001). Compared with students who were living in the family home, students who lived alone had higher scale scores (Ordinal logistic regression Continuation OR 2·2, 95% CI 1·3 to 3·9) and this remained unchanged when adjusted for Irish nationality. Students in the other two residential categories – in shared accommodation or in student accommodation – did not differ in their scale scores from students who lived at home.

Figure 3 shows the relationship between Lockdown Impact Scale scores and variables of interest. Using ordinal logistic regression, there was a strong relationship between Lockdown Impact Scale for Students scores and both self-rated mental health (continuation OR for a 1-quartile increase in score 4·2, 95% Credible Interval 3·6 to 5·0) and depression (COR 4·4, 95% CrI 3·6 to 5·3). The association with traumatic behaviours showed that higher scale scores predicted both hypervigilance (doomscrolling) (relative risk ratio 1·4, 95% CrI 1·1 to 1·7) and avoidance of news (RRR 1·4, 95% CrI 1·1 to 1·6).

These associations remained substantially unchanged and statistically significant when region of origin, sex and course type were adjusted for (data not shown).

There has been considerable interest in the effects of the Covid-19 pandemic on mental health, with the proliferation of constructs and scales to measure these. These have been reviewed by Zavlis [14] and by Cortez [15]. These constructs fall into two broad groups: stress/distress, which includes anxiety, worry, fear and traumatic stress; and risk perception and health behaviours. There have been fewer attempts to examine the mechanisms whereby the pandemic brings about these effects. One logical place to begin is by examining the effects of isolation consequent on lockdown.

The effects of isolation are normally difficult to study in the general population because it is not the general population that typically experiences isolation. However, in an era that is increasingly characterised by epidemics and pandemics requiring populations to self-isolate, understanding these effects becomes increasingly important to prevent and mitigate them.

The short scale presented here adds a potentially useful conceptual framework and measurement instrument to those available for examining the effects of social isolation on student mental health and morale, and adds to our understanding of the phenomenon of cabin fever. We freely admit that when we drew up the questionnaire the items that comprise the scale were selected to tap two domains that we considered distinct: social isolation and morale. However, as can be seen from the network analysis, these two domains have strong intersections, and the questionnaire items formed a unidimensional scale with a H coefficient of 0·41. This suggests that there is a superordinate construct that combines social isolation and demotivation.

This combination of isolation and demotivation corresponds well with the narrative accounts of the experience of cabin fever. These descriptions encompass both the sense of isolation and loss of the psychologically sustaining effects of social interaction, together with a sense of futility, demotivation, purposelessness [33–35]. It is useful to compare the items derived from the data-based approach used here with the items selected based on a literature review by Cong and Rabbani [23]. The twelve items in their scale loaded on two factors, one of anxiety, depression, hopelessness and anhedonia; the other reflecting changes in sleep and appetite. One item, decreased motivation, loaded with the sleep and appetite variables but had a substantial cross-loading with the first factor. The significant overlap between the scale items and the symptoms of depressive disorder makes it arguable as to whether the scale measures a specific construct of cabin fever.

The items in the LISS on the other hand form a single dimension with minimal conceptual overlap with either the constructs of depression (depressed mood and/or anhedonia) or anxiety (intrusive worry, panic, avoidance). As such it may more specifically represent the specific experience of lockdown.

LISS scores were associated with depression and poorer self-rated mental health. They were also associated with two manifestations of traumatic response: hypervigilance (doomscrolling) and avoidance. This suggests that response to isolation plays a significant role in wellbeing. However, we would not claim a clear direction of causation – indeed, it is probably unhelpful to model mental health variables as “outcomes”. Reciprocal reinforcing relationships can be expected to exist between all of the variables that we have presented. However, the greatest prospect for prevention and mitigation lies with the variables that represent the extent and quality of social interaction and social support. It is notable, but unsurprising, that scale scores were similar whether students were living in the family home, in student accommodation or in shared accommodation, with higher scores in those who lived alone.

Epidemics and pandemics are a predictable feature of the Anthropocene.[1, 36] We have been fortunate that the current pandemic has been comparatively benign compared with even recent events such as the early 19th century cholera pandemic or the influenza pandemic of the early twentieth. We must use the present learning opportunity not only to put in place preventive measures and plan co-ordinated response strategies, but also to learn how to maintain wellbeing and social cohesion in the context of lockdown and other public restrictions to daily life. Lockdown is a distinctive form of social isolation, where the individual may be literally alone, or in permanent enforced proximity to a small group of individuals¹. It has brought dramatic changes to the delivery of learning and to the student experience. As educators, we need to understand the consequences of these changes for student wellbeing. While we do know an increasing amount about the effects of lockdown on wellbeing, the concept remains poorly defined and understood. We propose that the results presented here at least act as the basis for a more theory-driven approach.

¹One is tempted to remember Sartre’s play Huis Clos, in which the three protagonists discover that hell is not flames and torment, but being trapped in a drawing room forever with one another.

Ethics approval and consent to participate

Ethical approval was obtained from the RCSI Research Ethics Committee (Record ID: 212548897). Informed consent was explicitly obtained from all participants and all methods were performed in accordance with the relevant guidelines and regulations.

Consent for publication

Not applicable

Availability of data and materials

A Stata dataset containing the variables reported in this paper is obtainable upon reasonable request from the corresponding author.

Competing interests

The authors declare that they have no competing interests

Funding

The study received no specific funding.

Authors' contributions

RC : Overall responsibility for design, analysis and final manuscript

KF : Input into analysis, interpretation and final manuscript

Acknowledgements

The authors gratefully acknowledge the help of the RCSI students’ union and the individual students who helped to formulate the questionnaire. We are grateful to the RCSI Quality Assurance Office who administered the survey, acted as gatekeeper and ensured that the data were anonymised at source.

Woolhouse M, Scott F, Hudson Z, Howey R, Chase-Topping M. Human viruses: discovery and emergence. Philosophical Transactions Royal Soc B Biological Sci. 2012;367(1604):2864-71.
Dobson AP, Pimm SL, Hannah L, Kaufman L, Ahumada JA, Ando AW, et al. Ecology and economics for pandemic prevention. Science. 2020;369(6502):379-81.
Osterholm MT. Preparing for the next pandemic. N Engl J Med. 2005;352(18):1839-42.
Holmes EA, O'Connor RC, Perry VH, Tracey I, Wessely S, Arseneault L, et al. Multidisciplinary research priorities for the COVID-19 pandemic: a call for action for mental health science. Lancet Psychiatry. 2020.
Brooks SK, Webster RK, Smith LE, Woodland L, Wessely S, Greenberg N, et al. The psychological impact of quarantine and how to reduce it: rapid review of the evidence. Lancet. 2020;395(10227):912-20.
Armitage R, Nellums LB. COVID-19 and the consequences of isolating the elderly. Lancet Public Heal. 2020.
Grubic N, Badovinac S, Johri AM. Student mental health in the midst of the COVID-19 pandemic: A call for further research and immediate solutions. Int J Soc Psychiatr. 2020;66(5):517-8.
Taylor S, Landry C, Paluszek M, Fergus TA, McKay D, Asmundson GJG. Development and Initial Validation of the COVID Stress Scales. J Anxiety Disord. 2020;72:102232.
Taylor S, Landry CA, Paluszek MM, Fergus TA, McKay D, Asmundson GJG. COVID stress syndrome: Concept, structure, and correlates. Depression and Anxiety. 2020;37(8):706-14.
Gaube S, Lermer E, Fischer P. Perceived Safety, A Multidisciplinary Perspective. In: Susanne Gaube ELPF, editor. Perceived Safety Risk Engineering. Risk Engineering: Springer; 2019. p. 101-18.
Brewer NT, Chapman GB, Gibbons FX, Gerrard M, McCaul KD, Weinstein ND. Meta-Analysis of the Relationship Between Risk Perception and Health Behavior: The Example of Vaccination. Health Psychology. 2007;26(2):136-45.
Yıldırım M, Güler A. Factor analysis of the COVID-19 Perceived Risk Scale: A preliminary study. Death Stud. 2020:1-8.
Jaspal R, Fino E. The COVID-19 Own Risk Appraisal Scale (CORAS): Development and validation in two samples from the United Kingdom. Journal of Health Psychology. 2021.
Zavlis O, Butter S, Bennett K, Hartman TK, Hyland P, Mason L, et al. How does the COVID-19 pandemic impact on population mental health? A network analysis of COVID influences on depression, anxiety and traumatic stress in the UK population. Psychol Med. 2021:1-9.
Cortez PA, Joseph SJ, Das N, Bhandari SS, Shoib S. Tools to measure psychological impact of COVID-19 pandemic: What do we have in the platter? Asian J Psychiatry. 2020;53:102371.
P S. Closure of Universities Due to Coronavirus Disease 2019 (COVID-19): Impact on Education and Mental Health of Students and Academic Staff. Cureus. 2020;12(4):e7541.
Odriozola-González P, Planchuelo-Gómez Á, Irurtia MJ, Luis-García Rd. Psychological effects of the COVID-19 outbreak and lockdown among students and workers of a Spanish university. Psychiatry Research. 2020;290:113108.
Ihm L, Zhang H, Vijfeijken Av, Waugh MG. Impacts of the Covid‐19 pandemic on the health of university students. Int J Heal Plan Management. 2021;36(3):618-27.
Copeland WE, McGinnis E, Ba Y, Adams Z, Nardone H, Devadanam V, et al. Impact of COVID-19 Pandemic on College Student Mental Health and Wellness. J Am Acad Child Adolesc Psychiatry. 2021;60(1):134–41.
Zis P, Artemiadis A, Bargiotas P, Nteveros A, Hadjigeorgiou GM. Medical Studies during the COVID-19 Pandemic: The Impact of Digital Learning on Medical Students’ Burnout and Mental Health. International Journal of Environmental Research and Public Health. 2021;18(1):349.
Aristovnik A, Keržič D, Ravšelj D, Tomaževič N, Umek L. Impacts of the COVID-19 Pandemic on Life of Higher Education Students: A Global Perspective. Sustainability-basel. 2020;12(20):8438.
Cramer RJ, Rasmussen S, Tucker RP. An examination of the Entrapment Scale: Factor structure, correlates, and implications for suicide prevention. Psychiatry Res. 2019;282:112550.
Cong CW, Rabbani M. Development of Cabin Fever Scale in Malaysia. J Cognitive Sci Hum Dev. 2021;7(1):115-22.
Asmundson GJG, Taylor S. Coronaphobia revisted: A state-of-the-art on pandemic-related fear, anxiety, and stress. J Anxiety Disord. 2020;76:102326.
Nikčević AV, Spada MM. The COVID-19 anxiety syndrome scale: Development and psychometric properties. Psychiatry Research. 2020;292:113322.
Ahmad F, Jhajj AK, Stewart DE, Burghardt M, Bierman AS. Single item measures of self-rated mental health: a scoping review. BMC Health Serv Res. 2014;14:398.
Beck AT, Steer RA. Internal consistencies of the original and revised Beck Depression Inventory. J Clin Psychol. 1984;40(6):1365-7.
R Core Team T. R: A Language and Environment for Statistical Computing. Vienna, Austria2018.
Ark vd, Andries L. Mokken Scale Analysis in R. J Stat Softw. 2007;20(11).
JASP Team T. JASP (Version 0.14.1) [Computer Software]. 2020.
Mair P. MPsychoR: Modern Psychometrics with R. 2020.
Epskamp S, Cramer AOJ, Waldorp LJ, Schmittmann VD, Borsboom D. {qgraph}: Network Visualizations of Relationships in Psychometric Data. J Stat Softw. 2012;48(4):1-18.
Rosenblatt PC, Anderson RM, Johnson PA. The Meaning of “Cabin Fever”. The Journal of Social Psychology. 1984;123(1):43-53.
Crawford P. Editorial Perspective: Cabin fever – the impact of lockdown on children and young people. Child Adol Ment H-uk. 2021;26(2):167-8.
Brooks SK, Webster RK, Smith LE, Woodland L, Wessely S, Greenberg N, et al. The psychological impact of quarantine and how to reduce it: rapid review of the evidence. Lancet. 2020;395(10227):912-20.
Osterholm MT, Olshaker M. Chronicle of a pandemic foretold. Foreign Aff. 2020;99:10-24.

Supplementary Materials are not available with this version.

No competing interests reported.

Appendix1scaleitems.docx

Download PDF

Journal Publication

published 03 Nov, 2023

Read the published version in BMC Medical Education →

Editorial decision: Major revision
04 Jan, 2022
Reviews received at journal
28 Dec, 2021
Reviewers agreed at journal
01 Dec, 2021
Reviews received at journal
01 Dec, 2021
Reviewers agreed at journal
29 Nov, 2021
Reviewers invited by journal
23 Nov, 2021
Editor assigned by journal
23 Nov, 2021
Editor invited by journal
01 Nov, 2021
Submission checks completed at journal
01 Nov, 2021
First submitted to journal
13 Aug, 2021

You are reading this latest preprint version

The Lockdown Impact Scale for Students (LISS)

Status:

Journal Publication

Version 1

Abstract

Figures

Introduction

Methods

Results

Discussion

Conclusion

Declarations

Ethics approval and consent to participate

Consent for publication

Availability of data and materials

Competing interests

Funding

Authors' contributions

Acknowledgements

References

Supplementary Materials

Additional Declarations

Supplementary Files

Status:

Journal Publication

Version 1