Introduction

The global spread of COVID-19 and the various measures taken in response, such as lockdown restrictions or physical distancing policies, have raised concerns about its impact on mental health. Since the beginning of the pandemic, the number of studies dealing with the psychological consequences is growing rapidly.

With respect to the general population, some studies have found a negative impact on mental health outcomes. For example, in a cross-sectional study carried out in Italy during the first three weeks after the begin of lockdown restrictions, it was found that the duration of lockdown restrictions as well as the quality of domestic living situations had a negative impact on the well-being of residents. Social contacts, both online and offline, were found to mitigate this effect [1]. The results of a cross-sectional study conducted in China further showed that those individuals who were unable to pursue any professional activity were more likely to experience psychological distress four weeks after the begin of lockdown restrictions [2]. Another study from the UK found significant increases in mental health problems in April 2020 compared to 2017–2019 [3]. Finally, findings from a study conducted in Spain indicated a detrimental effect of the pandemic during its first weeks [4].

In contrast, other studies found a predominant resilience in the general population. A study from New Zealand, for example, compared the well-being of propensity score matched samples from population surveys before and after a nationwide lockdown. It was found that individuals surveyed after the lockdown reported only slightly increased specific psychological distress but were also observed to possess a high degree of resilience [5]. Likewise, data from a panel in Germany showed unchanged levels of well-being in April 2020 compared to previous surveys completed between 2016 and 2019 [6]. Similar results suggesting resilience were found in a survey examining the mental and social health in the older German population [7], as well as a sample of the general population in Dresden before and four weeks after lockdown restrictions [8].

A recent systematic review revealed that knowledge regarding the impact of COVID-19 on patients with pre-existing psychiatric disorders remains scarce [9]. Here too, the findings of the few existing studies are mixed. Results of a study from China showed that, compared to psychiatric patients, control subjects experienced less psychological stress during the early weeks of the pandemic while lockdown restrictions were in place. However, the authors of this cross-sectional study were unable to prove that these findings were a direct result of the pandemic and/or lockdown restrictions [10]. According to the results of another cross-sectional study involving several countries, more than half of the participants who reported a previous mental disorder also stated that their condition had worsened due to the COVID-19 pandemic [11]. In contrast, in our own study conducted in Germany, we found no detrimental effects on the psychological well-being of mentally ill participants four weeks after the implementation of lockdown restrictions, compared to their base levels recorded in surveys before the lockdown [8]. These results were consistent with the observations made by Martinelli and Ruggeri [12] in Italy.

In part, these conflicting findings may be attributed to the fact that studies differed in respect to numerous factors, such as the study design, the instruments used, or the way subjects were recruited. However, another explanation could also be the numerous factors that differed between the countries at the time the studies were conducted, i.e. the extent to which the population was affected by the pandemic including the number of infections or related deaths, the severity of the measures taken by the government or the capacity of the health care system. For example, in a multinational study conducted at a relatively early stage of the pandemic, participants who were dissatisfied with the measures of their government reported higher worries and fears that were in turn related to experiencing more distress [13]. Similarly, trust in governmental actions to tackle COVID-19 was negatively associated with psychological distress as well as generalised anxiety and depression symptoms in a large German sample [14]. A nationwide study in China further found that the self-reported level of distress was highest in the region including Hubei which was most severely affected by the spread of COVID-19 compared to other regions. Other factors affecting the level of distress included the local efficiency of the public health care system and the availability of medical resources [15].

The above-mentioned factors differ not only across countries but may also change over time. We therefore conducted a second follow-up survey to our initial study to investigate the course of the effects on various clinical and social psychiatric variables in participants with and without acute or chronic mental disorders. The aim of the present study was to assess the same variables within the same individuals before the beginning of the pandemic as well as during and after strict lockdown restrictions to describe the effects of COVID-19 for each group individually.

Materials and methods

Materials

The primary instrument used in this study was the Measure of Participation and Social Inclusion for Use in People with a Chronic Mental Disorder (F-INK) [16]. The questionnaire has a modular structure and allows for the recording of socio-demographic and clinical variables. Through the “participation module”, the questionnaire is able to measure the behaviour-related extent of social participation, operationalised as the frequency with which 32 individual activities (e.g. watching television, meeting friends) were carried out. Answers are coded 4 = almost every day, 3 = multiple days per week, 2 = approx. once per week, 1 = approx. once or twice per month and 0 = never in the last four weeks, which can then be compounded into a total score. The “inclusion module” uses self-assessment on a 4-point Likert scale to record feelings of belonging (0 = not at all; 1 = little; 2 = moderately; 3 = very much) as it is experienced in different social contexts (e.g. in the home living environment or with immediate family members). These self-assessment scores can also be summarised to a total value.

Despite its name, the Index for the Assessment of Health Impairments (IMET) [17] assesses the extent of perceived impairments in social participation (e.g. everyday activities like family/household obligations, recreational and leisure activities) during the assessment period using an 11-point scale (0 = no impairment; 10 = no activity possible anymore). Assessment is completed regardless of whether the impairments are due to personal reasons or as a direct consequence of lockdown restrictions.

The Brief Symptom Inventory (BSI-18) [18] is a self-assessment tool which measures depression, anxiety and somatisation, with six items each. A 5-point Likert scale (0 = not at all; 4 = extremely) is used to assess the extent of participants’ subjective stress experiences. In contrast to the other instruments, these items refer to the seven days prior to the survey.

In addition to the aforementioned questionnaires, participants were asked at follow-up to answer specific questions regarding their subjective concerns, as well as the subjective possibilities of events in relation to the coronavirus pandemic (e.g. likelihood of contracting coronavirus). These questions were taken from the “COVID-19 Snapshot Monitoring (COSMO)” survey [19].

Participants

As part of an ongoing research study aiming to apply the F-INK to comprehensive statistical test studies, participants had been recruited since August 2019. Participants were assigned to one of three groups: Group 1 consisted of individuals with a chronic mental disorder. To be assigned to this group, participants must not have been acutely ill in the four weeks prior to the initial survey. These participants were accessed via institutions providing assisted living facilities. Group 2 consisted of individuals who were receiving acute psychiatric or psychotherapeutic treatment at the time of the initial survey. These participants were recruited from consecutive acute admissions to the Department of Psychiatry and Psychotherapy at the TU Dresden. The initial survey was conducted within three days of admission. Group 3 consisted of members of the general public, who at the time of the initial survey presented with neither acute nor chronic mental disorders. These participants were recruited from the Dresden general population with the aim of being as representative as possible in a complex recruitment process using cluster and stratification processes. For all three groups, inclusion criteria were an age between 18 and 65 years, as well as the ability to provide an informed declaration of consent.

A total of n = 174 individuals that had previously been interviewed between August 2019 and early March 2020 as part of the initial study were invited to participate in the first follow-up survey on April 17, 2020. Participants were instructed to provide answers based on the four weeks following the start of strict lockdown restrictions (March 23, 2020–April 20, 2020), unless stated differently in a specific item or questionnaire. Responses received between April 22, 2020 and May 13, 2020 were included in the evaluations. A total of n = 132 participants completed the initial and the first follow-up survey, with response rates being 72.0% for Group 1, 65.2% for Group 2 and 91.4% for Group 3.

Three months later (July 17, 2020), the n = 132 respondents were invited to take part in a second follow-up survey. Again, participants were instructed to relate their answers to the last four weeks (June 22, 2020–July 19, 2020), unless stated differently in a specific item or questionnaire. A total of n = 106 participants completed the second follow-up and thus all three surveys, with response rates being 75.0% for Group 1, 69.8% for Group 2 and 92.5% for Group 3. Systematic comparisons of the basic socio-demographic characteristics between the drop-outs and the completers of all three surveys revealed significant differences in Group 2 only: here, the drop-outs were significantly younger (M = 35.8, SD = 12.4) than the completers (M = 43.4, SD = 11.9) [t(64) = -2.53, p = 0.014]. The average response period between the initial and the first (and second) follow-up survey was 18.3 (30.8) weeks and ranged from 4 to 36 (17–48) weeks, whereby the three groups did not differ in mean periods.

COVID-19 cases and pandemic decrees in the study region

In the period to which the study participants should refer their answers at the first follow-up survey, the number of identified COVID-19 cases in Dresden rose from 153 on March 23, 2020 to 523 on April 20, 2020, corresponding to 370 new infections in four weeks [20]. With the aim of curbing the spread of SARS-CoV-2 infections, several lockdown restrictions were put in place in Dresden from March 22, 2020. Leaving one’s own home was only permitted for valid reasons, such as professional employment or for “obtaining necessary household supplies”. It was advised that contact with persons outside of one’s personal household should be kept “to the bare minimum”, while gatherings and celebrations with multiple individuals were prohibited. Sport and exercise in the fresh air were permitted “alone or with members of the same household” [21]. These lockdown restrictions were eased on April 17, 2020 and were replaced by social distancing policies, including an outright ban on group gatherings. Individuals were permitted to leave their households at free will, but only “in the accompaniment of partner(s) or family members of the same household” [22].

In the four weeks prior to the second follow-up survey, the number of identified cases in Dresden increased only slightly from 624 on June 22, 2020, to 631 on July 19, 2020, corresponding to 7 new infections [20]. During this period, most restrictions that applied during the first follow-up had already been largely relaxed. Private gatherings were allowed with members of another household or up to ten other people when in public, but without number limits when at home. With a few exceptions, there was an extensive opening of service providers and other enterprises, institutions, sports facilities, food services, hotels, businesses and shops, as well as public transports and certain events (under observation of hygiene rules). Nevertheless, people were generally encouraged to limit unnecessary physical contact, to keep at least 1.5 m away from others whenever possible, and to follow hygiene recommendations. Wearing a mouth and nose covering was only mandatory when using public transport or visiting shops [23].

Statistical analyses

Sampling characteristics were reported descriptively. Due to the large differences between the groups defined by the inclusion criteria, only within-group variations were of interest. Therefore, paired samples t tests and repeated measures ANOVAs with post hoc pairwise comparisons were conducted for each group separately to compare the results from the initial and both follow-up surveys. In case the assumption of sphericity was violated, a Huynh–Feldt correction was applied. An alpha level of 0.05 was used to assess for statistical significance, while the Bonferroni–Holm correction was used to adjust the α-error, which is less conservative than the Bonferroni correction. These adjustments were made for each of the analyses of the questionnaires. Due to the small number of participants per group, we additionally reported the f values in Tables 3, 4, and the Supplementary Tables as a measure of the experimental effect. We used only complete cases with data on all three survey dates for our analyses, as the different response rates between the groups suggested that drop-outs over the course of the study were not random. The analyses were conducted using IBM SPSS Statistics 27.

Results

Participant demographics

Table 1 shows the socio-demographic and clinical characteristics of the study participants. As expected, participants with a chronic mental disorder (Group 1) differed from participants in Groups 2 and 3 in several aspects. Study participants in Group 3 (i.e. those with neither chronic nor acute mental disorders at the time of the initial survey) were predominantly female and were seemingly more affected by the COVID-19 restrictions in their professional lives, compared to participants in Groups 1 and 2.

Table 1 Study participants

COVID-19 specific questions

At the time of the second follow-up survey, 16 participants (5 from Group 1, 1 from Group 2 and 10 from Group 3) stated knowing people in their immediate social environment who were or had been infected with the SARS-CoV-2. Only one participant from Group 1 reported that she had been infected herself. Across all three groups, the self-estimated probability of getting infected with the SARS-CoV-2, as well as the evaluation of one’s own susceptibility to an infection and the expected severity of its consequences remained medium (Table 2). Most participants indicated that they followed the official measures and recommendations “rather strictly” or “very strictly”, with no significant differences in mean values between the two follow-up surveys (Table 2) or between groups, neither in the first (F(2, 103) = 1.21, p = 0.302) nor in the second follow-up survey (F(2, 103) = 1.40, p = 0.252).

Table 2 Impact, probability and handling of measures and recommendations. The Bonferroni–Holm method was applied to obtain the adjusted p values

Perceived impairments in social participation (IMET)

Participants with a chronic mental disorder (Group 1) did not report any significant additional impairments in social participation in comparison to the initial survey, neither during the lockdown restrictions prior to the first follow-up survey, nor during the physical distancing policy prior to second follow-up survey (Table 3). Participants who were receiving acute psychiatric or psychotherapeutic treatment at the time of the initial survey (Group 2) experienced significantly less impairment in three out of nine areas during the lockdown restrictions and in additional five areas during the physical distancing policy, compared to the initial survey (Table 3). In contrast, participants in Group 3 indicated that they felt significantly more impaired in five out of nine areas during the lockdown restrictions, compared to the initial survey. While three of the more impaired areas returned to normal during the physical distancing policy, the remaining two areas improved but were still significantly impaired in comparison to the initial survey (Table 3).

Table 3 Perceived impairments in social participation (IMET). In case the sphericity assumption was violated, a Huynh–Feldt correction was applied. The Bonferroni–Holm method was applied to obtain the adjusted p values. Per row, means followed by a different letter significantly differ at 5% level according to post hoc tests

Participation and inclusion (F-INK)

Across the three surveys, the overall level of participation, as measured by the “participation module” of the F-INK, did not change significantly in Groups 1 or 2 (Table 4). Across all survey dates, participants of Group 1 carried out 31 out of 32 solo activities with unchanged frequency. In Group 2, this was the case for 30 out of 32 activities. Participants in Group 1 attended less parties in the four weeks prior to the first and second follow-up surveys, while participants in Group 2 visited bars or restaurants and concerts, cinemas, etc. with reduced frequency (Supplementary Tables 4.1.1 and 4.1.2). In strong contrast, participants in Group 3 reported significant changes in their overall level of participation across the three surveys. A post hoc pairwise comparison showed significant differences between the initial and the first follow-up survey, as well as between the first and the second follow-up surveys (Table 4). Out of the 32 solo activities recorded, 15 were carried out with notably less frequency during the lockdown restrictions compared to the initial survey. The frequency of 13 of those 15 activities returned to normal in the four weeks prior to the second follow-up survey, however, participants in Group 3 were still going for more walks and visiting concerts, cinemas, etc. less frequently (Supplementary Table 4.1.3).

Table 4 Participation, inclusion (F-INK) and mental health problems (BSI-18). In case the sphericity assumption was violated, a Huynh–Feldt correction was applied. The Bonferroni–Holm method was applied to obtain the adjusted p values. Per row, means followed by a different letter significantly differ at 5% level according to post hoc tests

Across all three groups and survey dates, feelings of inclusion, measured by the “inclusion module” of the F-INK, remained at a constant level (Table 4).

Mental health (BSI-18)

As shown in Table 4, participants in Groups 1 and 3 reported unchanged mental health states in the week before the first follow-up survey and in the week before the second follow-up survey. In contrast, participants who were receiving acute psychiatric or psychotherapeutic treatment at the time of the initial survey (Group 2) indicated significantly improved scores on the subscales “depression” and “anxiety” of the BSI-18 as well as the Global Severity Index in the week before the first follow-up survey. These effects persisted through to the week before the second follow-up survey (Table 4). Detailed data showing the individual items of the BSI-18 can be found in Supplementary Tables 4.2.1 to 4.2.3.

Discussion

In the present study, a variety of clinical and social psychiatric variables were investigated before, during and after COVID-19-related lockdown restrictions in three different groups: participants with a chronic mental disorder, participants who were receiving acute psychiatric or psychotherapeutic treatment at the beginning of the study, and participants from the general public who presented with neither acute nor chronic mental disorders. To our knowledge, this is the first time these variables have been so thoroughly investigated in relation to the COVID-19 pandemic.

The limitations of the present study include the relatively small number of participants in each of the three groups, the variable time periods between the pre- and post-surveys, as well as the regional specificity of the study. The results should therefore be interpreted with some care. Despite the small sample, it should be emphasised that non-significant results in the sum scores represented small or at most medium effects. However, a few large effects showed to be non-significant at the level of the single-item analyses, presumably due to the adjustment of the α-error. In addition, all our interpretations are based on mean values. As a result, there may of course have been stronger or weaker impairments in individual cases. Beyond this, only self-assessments and no external assessments were utilised to obtain data for the study. Lastly, generalisability of our findings is limited due to the sampling strategies and the baseline socio-demographic differences between the groups which may have contributed to the divergent effects of the pandemic.

However, the unique strength of the present study is that participants from multiple specific groups were examined longitudinally in an initial as well as two follow-up surveys. Using the data of the initial survey before the outbreak of the pandemic as a reference, we were able to measure the actual changes that have occurred over the course of time, i.e. when the lockdown restrictions and later the physical distancing policies were in force. Our results can be summarised as follows.

Participants with a chronic mental disorder showed no perceived impairment in their social participation as a result of the lockdown restrictions or the subsequent physical distancing policy associated with the COVID-19 pandemic. However, the impairments in the surveyed areas of everyday life were already at a relatively high level at the time of the initial survey for this group. This was further reflected in the minimal changes across the three surveys concerning the frequencies with which certain activities were carried out. These were, as could be expected [24, 25], already at a comparatively low level at the time of the initial survey, possibly indicating a floor effect. With regard to their mental health states, this group of participants showed high stability over time, indicating a high resilience to the official restrictions and measures as well as the pandemic itself.

Participants who were receiving acute psychiatric or psychotherapeutic treatment at the time of the initial survey reported significantly less impairments in several of the surveyed areas of everyday life during the lockdown restrictions and subsequent physical distancing restrictions, as compared to the time of the initial survey. The strong impairments at the time of the initial survey due to the acute mental disorder thus improved despite the adverse conditions resulting from the COVID-19 pandemic. This was to be expected given the participants’ likely recovery from their mental health condition during this time. While the frequencies with which certain activities were carried out changed only minimally in this group of participants, their mental health states improved significantly from the initial survey to the first follow-up survey and remained stable until the second follow-up survey. Overall, this suggests that resilience to the lockdown restrictions and the subsequent physical distancing policy as well as the pandemic as itself can also be assumed for this group.

Participants who presented with neither acute nor chronic mental disorders at the beginning of the study experienced extensive impairments in their social participation due to the lockdown restrictions. However, some of those areas of everyday life were only temporarily impaired and returned to normal levels by the time of the second follow-up survey when the restrictions had been largely lifted. The same applied to the extensive changes in behaviour of the participants associated with the lockdown restrictions. While a large proportion of activities were carried out less frequently during this time, most of them returned to pre-lockdown levels in the four weeks before to the second follow-up survey. Despite these temporary impairments and behavioural changes, the participants in this group did not report any negative effects on their mental health states, which again speaks for a resilience to the COVID-19 pandemic and the associated restrictions.

By completing a second follow-up survey, we have extended the findings of our previous study [8] and thus provided further evidence for a predominant resilience to the COVID-19 pandemic as well as the subsequent lockdown restrictions and physical distancing policy among the examined population groups. Although the lockdown restrictions may have led to more or less severe impairments in social participation and behavioural changes in our sample, these appeared to be tied to the strength of the official measures and, therefore, were only temporary. The feeling of inclusion, or more precisely the feeling of being structurally involved in and subjectively belonging to society, remained stable across all three groups and throughout the observation period. Interestingly, the restrictions also had no noticeable effect on the mental health states of the participants, whether or not they previously had a mental disorder.

Our results of resilience are therefore in concordance with other studies from Germany [6, 7] and New Zealand [5], but in discordance with findings from the UK [3], Italy [1], China [2] and Spain [4]. One reason for this could be that the population of Germany, and especially Dresden, has so far been less affected by the pandemic than other countries, e.g. in terms of the number of cases or the severity and duration of the restrictions. In addition, there have been no signs of an imminent overburdening of the German health care system and the confidence in the German government and key institutions in connection with the current pandemic seems to have remained at a medium-to-high level [26]. However, more studies are needed to further examine these assumptions. We, therefore, advocate that in future studies, a more detailed description of the pandemic situation in the respective study region should be provided. Information on the number of cases and local regulations at the time of the survey would help to improve the comparability of study results on this topic.

Finally, it should be highlighted that our results are in line with the observations of Martinelli and Ruggeri [12], who found an unexpectedly high degree of resilience during the pandemic lockdown in severely mentally ill users of supported accommodation services. Our study further shows, however, that social participation opportunities for individuals with chronic mental disorders are strongly limited, regardless of lockdown restrictions or physical distancing policies. Further efforts to improve social participation and inclusion opportunities are urgently needed to rectify this.