The study used cross-sectional design and utilized data collected from a large-scale survey for Ukrainian university students (Bachelor’s, Master’s and PhD programs), from different regions of Ukraine conducted at the end of 2023. Data was obtained through online questionnaire using licensed Qualtrics software. The link to the questionnaire was disseminated among departments of education and science, university rectors and the leaders of student government, which then were shared with their students who were encouraged to answer this survey. Data collection was conducted during September – November, 2023. In total, 2,364 students from different regions, excluding the territories temporarily occupied by Russia, completed the questionnaire.
Students were 18 plus years old. All participants were informed that they could revoke their participation at any time, and acquired data would be anonymous and confidential. Regardless of the answers, participants were given guidance on resources they can seek for mental health support. The study was approved by the Ethics Committee of the Institute of Psychiatry of Taras Shevchenko National University of Kyiv (No.1, 17.07.2023), and each of the survey participants signed an informed consent.
The survey included demographic variables, instruments to assess the symptoms of mental problems/disorders, as well as Work Productivity and Activity Impairment: Special Health Problems (WPAI: SHP) section [20], adapted for the purpose of the study. Since students had the option to avoid answering certain questions, the number of students who answered the questions of the WPAI:SHP section was 1,398, i.e. 59.1% of the survey respondents (2,364 students).
Mental health problems were assessed by commonly accepted instruments (PC-PTSD-5 for post-traumatic stress disorder [21], PHQ-9 to access depression severity [22], GAD-7 for screening and measuring the severity of generalized anxiety disorder [23], CRAFFT for substance use screening [24], ISI for insomnia problems [25].
In our study, we used version 2.0 of the WPAI: SHP questionnaire, which was developed by Reilly M., Zbrozek A. and Dukes E. [20]. The specific feature of this questionnaire is that it allows assessing the impact of any specific health problems on work productivity and activity impairment, in contrast to the original version, which was designed to study the impact of general health problems.
For the purposes of our study, in the WPAI: SHP questionnaire, we replaced the phrase “work productivity” with “academic performance”, “currently employed” with “currently studying at a university”, “from work” with ”from study”, “specific health problems” with “mental health problems”. Additionally, based on experts opinion, we have increased the timeframe from “during the last 7 days” to “during the last 14 days”, as symptoms of some mental disorders usually take a longer time to manifest.
Work Productivity and Activity Impairment: Special Health Problems (WPAI: SHP) questionnaire section included the following six questions: Q1. Are you currently studying at a university? Q2. During the past 14 days, how many hours did you miss from study because of mental health problems? Q3. During the past 14 days, how many hours did you miss from study because of any other reason, such as vacation, holidays, time off to participate in this study? Q4. During the past 14 days, how many hours did you actually study? Q5. During the past 14 days, how much did your mental health problems affect your productivity while you were studying? (use a number between 1 and 10. If your mental health problems have affected your study only a little, choose a low number and vice versa). Q6. During the past 14 days, how much did your mental health problems affect your ability to do your regular daily activities, other than study? (use a number between 1 and 10. If your mental health problems have affected your study only a little, choose a low number and vice versa).
The respondents' answers to Q5 of the WPAI: SHP section were used to determine the value of the API (Academic Performance Impairment) variable, which could vary from 0 (no negative impact of mental health problems on academic performance) to 10 (maximum negative impact of mental health problems on academic performance). This variable allows us to quantify the negative impact of students' mental conditions on their academic performance in the wartime, as well as to determine the contribution of different types of mental disorders to the academic performance impairment during the war using regression analysis.
In the same way, the respondents' answers to questions Q2-Q4 were used to construct the HM variable − number of hours that university students missed from study because of mental health problems as a percentage of the total number of hours that university students could spend on studying during the past 14 days. To obtain the value of the HM variable, we divided the respondents' answer to Q2 by the sum of answers to questions Q2-Q4.
The analysis of the impact of mental health problems on the student’s academic performance was performed in the following steps: 1) combining data on mental health problems into different level of severity groups; 2) testing the reliability of the questionnaire; 3) assessment of the impact of demographic factors and different level of severity of mental health problems separately as independent variables on the API through regression analysis and interpretation of the results.
The data collected was summarized in Microsoft Excel 2019, and then analyzed using the Eviews 12 software. The reliability of the questionnaire was tested using the JASP 0.17.3 software.The impacts of mental health problems/disorders and separate demographic factors on the API were assesed using the linear least squares method in combination with the method of consistent estimation of the McKinnon and White covariance matrix. This approach allowed to take into account the heteroscedasticity of disturbances, as well as to avoid bias and incorrectness of standard estimates of the covariance matrix, which, due to its wide range of applications, holds a key place among the methods of mathematical statistics [26]. This method has been successfully applied in mental health research and allows to assess the patterns observed against the background of random fluctuations of the dependent variable and to use the identified patterns for further forecasts [27].
The scores obtained through respective mesures were used to divide the respondents into groups according to the severity of the symptoms of mental health problems.
Table 1
Definition of the groups of respondents depending on the severity of symptoms of different mental health problems
Mental health problem | Name of the variable | Severity groups |
Group I | Group II | Group III |
Anxiety | A | No or minimal symptoms: GAD-7 scores from 0 to 4. A = 0 | Mild or moderate symptoms: GAD-7 scores from 5 to 14. A = 1 | Severe symptoms: GAD-7 scores from 15 to 21. A = 2 |
Depression | D | No or minimal symptoms: PHQ-9 scores from 0 to 4. D = 0 | Mild or moderate symptoms: PHQ-9 scores from 5 to 14. D = 1 | Moderately severe or severe symptoms: PHQ-9 scores from 15 to 27. D = 2 |
PTSD | P | No symptoms: PC-PTSD-5 scores from 0 to 2. P = 0 | PTSD symptoms: PC-PTSD-5 scores from 3 to 5. P = 1 | N/A |
Sleep disorder | SD | No symptoms: ISI scores from 0 to 7. SD = 0 | Mild (sub-threshold) symptoms: ISI scores from 8 to 14. SD = 1 | Moderate or severe symptoms: ISI scores from 15 to 28. SD = 2 |
Substance use | SU | N/A | Low or moderate risk of substance use: CRAFFT score from 0 to 1. SU = 0 | High risk of substance use: CRAFFT score from 2 to 6. SU = 1 |
To quantify the contribution of different mental health problems to API, we used linear regression, because the available data set was quantitative and met the conditions of normal distribution. The linear regression included independent variables that showed a significant correlation with API as a dependent variable. The independent variables were Age of respondents (AGE), Gender of respondents (GEN; 0 – female, 1 – male), Year of study of respondents (YEAR), Number of hours that university students missed from study because of mental health problems as a percentage of the total number of hours that university students could spend on studying during the past 14 days (HM), severity of anxiety disorder symptoms (A; 0 – minimal/none, 1 – mild/moderate, 2 - severe), severity of depression symptoms (D; 0 – minimal/none, 1 – mild/moderate, 2 - moderately severe/severe), severity of PTSD symptoms (P; 0 – none, 1 – present), severity of sleep disorder symptoms (SD; 0 – none, 1 – mild, 2 – moderate/severe), severity of substance use disorder symptoms (SU; 0 – low/moderate risk, 1 – high risk). To estimate the model parameters by the least square’s method, a sample of answers from 1398 respondents was used.