Next Article in Journal
“Complete the Drawing!”: The Relationship between Imagination and Executive Functions in Children
Previous Article in Journal
Inclusion of Ultra-Orthodox Students in Higher Education: A Case Study about Women Seminary in the Engineering College of Jerusalem
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

The Role of General and Study-Related Intraindividual Factors on Academic Learning Outcomes under COVID-19: A Cross-Sectional and Longitudinal Analysis

1
Department of General Psychology, University of Padua, 35122 Padua, Italy
2
Unità Operativa Complessa (UOC) Hospital Psychology, University-Hospital of Padua, 35128 Padua, Italy
*
Author to whom correspondence should be addressed.
Educ. Sci. 2022, 12(2), 101; https://doi.org/10.3390/educsci12020101
Submission received: 25 November 2021 / Revised: 10 January 2022 / Accepted: 27 January 2022 / Published: 1 February 2022
(This article belongs to the Topic Advances in Online and Distance Learning)

Abstract

:
Little is known about the intraindividual dispositional factors related to cognitive, behavioral, and emotional academic learning outcomes under COVID-19. This study investigated (i) the associations of intraindividual factors, some related to studying (motivation to learn, self-regulated learning, and study resilience), others more general (soft skills, intolerance of uncertainty) with three situational academic learning outcomes (general distress, online self-regulated learning, study-related emotions), and (ii) the effect of time, intraindividual factors, online self-regulated learning, and study-related emotions on distress and achievement over the following three exam sessions. A total of 331 university students took part in the study during the first Italian nationwide lockdown (T1; March–May 2020). Of those, 121 also completed at least one follow-up (T2: August 2020; T3: September 2020; T4: February 2021). At T1, study-related dispositions and soft skills were positively associated with online self-regulated learning and study-related emotions, while study-related dispositions were also negatively associated with general distress. Intolerance of uncertainty was associated positively with general distress and negatively with study-related emotions. Longitudinal effects of T2 and T3 for intolerance of uncertainty and study-related emotions were observed for distress, while those for T4 were study-related dispositions for achievement. Nurturing intraindividual factors can help students cope with a prolonged stressful situation such as a pandemic.

1. Introduction

According to the integrated self-regulated learning model (iSRL, [1,2]), academic learning encompasses cognitive, behavioral, and emotional outcomes, examples of which can be academic achievement, capacity to adopt adequate study behaviors, and the ability to regulate one’s emotions, respectively. Under this view, these three sets of outcomes are conceptualized in this model as the “what” of successful academic learning. The “how” of academic learning is represented by the learners’ “intraindividual system”, which includes all the internal factors helping students to actively regulate their learning, in interaction with the influence of more external systems (e.g., family, institutions). Such intraindividual factors range from study-related factors, such as self-regulated learning, and motivation to succeed, to more general characteristics such as personal skills and genetics [2]. It is postulated that students who succeed in the cognitive, behavioral, and emotional academic learning outcomes are those able to flexibly use these intraindividual general and study-related personal dispositions. Figure 1 displays an overview of the model.
The COVID-19 pandemic seems to have profoundly affected all three facets of academic learning, in terms of the study strategies adopted to manage online lectures, and the study-related and general positive and negative emotions experienced during the lockdowns [3,4,5,6,7,8,9,10,11,12,13]. Compared to non-pandemic distance learning situations, online learning under COVID-19 was characterized by high levels of stress and uncertainty across different students’ life areas. That is why it is important to consider general emotional responses (not only study-related ones) to have a more complete picture of academic learning during this time. Moreover, COVID-19 represents a case study to better understand the role of major stressors in both distance and traditional learning; however, few studies have investigated the COVID-19 cognitive, behavioral, and emotional effects at the same time [3,6,14], and even fewer have examined the study-related or general intraindividual factors potentially associated with these outcomes over time [11]. This makes it hard to identify the individuals at greater risk of struggling academically during these challenging times, and to therefore support them adequately. Additionally, considering the long lasting effects of the COVID-19 pandemic there is the possibility to extend such knowledge to similar stressful events [15], and such knowledge can be of crucial relevance for advancing our theoretical knowledge while applying it in educational contexts (e.g., through personalized trainings).
Therefore, the present study focused on the cross-sectional and longitudinal associations of the intraindividual factors identified by Ben-Eliyahu [2] with four relevant academic learning outcomes: a behavioral outcome, i.e., online self-regulated learning strategies (adopted specifically to study online during the first Italian nationwide lockdown, i.e., March–May 2020—T1); two emotional outcomes, that are study-related emotions (experienced specifically when studying during T1), and psychological distress (general emotional suffering, usually characterized by symptoms of depression and anxiety, experienced during T1 and following the subsequent Summer, Fall, and Winter exam sessions—T2–T4); and a cognitive outcome, i.e., achievement following the lockdown (grades obtained for T2–T4). Assessing the relative role of a variety of dispositional intraindividual variables can provide evidence supporting recent theoretical frameworks such as the integrated self-regulated learning model [1,2] and can inform researchers and institutions on which one may be prioritized as a target for intervention, to support students who experience difficulties and/or would like to enhance their academic learning, helping them to perform better, adopt better study behaviors, or to better regulate their emotions while studying and in their daily life.
After introducing the intraindividual factors considered, we review the literature on the academic learning outcomes mostly affected during the COVID-19 pandemic.

1.1. General Intraindividual Factors and Academic Learning Outcomes

The personal skills included in the intraindividual system of academic learning [2] have been also referred to in the literature as character strengths [16], noncognitive skills [17], or soft skills [18]. Although having been recognized as crucial for 21st century students to approach complex challenges and changing environmental conditions [19], these acquirable personal qualities have been studied mainly in relation to cognitive academic learning outcomes such as academic achievement [20,21,22,23], and much less with reference to learning behaviors or emotions. This lack of knowledge hampers their applicability to the education context, making it harder to devise strategies and intervention programs to nurture students through multi-componential trainings [24].
According to the WEF framework [19], these soft skills include perseverance (also known as grit, or a passion for long-term goals), which has emerged as being negatively associated with mental disorders in non-pandemic situations [25] and positively with subjective wellbeing during the pandemic [4]. Another character quality listed in the WEF model concerns interacting effectively with others, as shown by emotional intelligence. In this study, emotional intelligence is conceptualized as a trait [26], i.e., a disposition to accurately perceive, express and regulate emotions. It seems to be directly associated with both cognitive and behavioral learning outcomes (see Keefer et al. [27] for an overview) and positive affect [28], as well as with positive emotional outcomes during the COVID-19 pandemic [29]. Epistemic curiosity, i.e., a drive to know, is reportedly related positively with effective learning [30,31,32], and negatively with anxiety and depression [33,34] in non-pandemic contexts, while also being related to better mental health under COVID-19 [35]. Creativity is defined in this setting as a disposition to think of new and effective ways to do things [16]. Its relationship with affect is controversial [36], and a recent meta-analysis reported a small negative association with depressed mood in university students [37]. Critical thinking, or the tendency to analyze learning material critically, has been inversely associated with negative achievement emotions [38], and with mental health disorders, in adolescents at least [39]. As for the pandemic, neither creativity nor critical thinking emerged as significantly related to mental health in the Italian general population [40].
Together with soft skills, personality features have been associated with emotional outcomes in university students [41]. One such feature to consider, given the sense of precariousness triggered by the COVID-19 pandemic, is an intolerance of uncertainty, or the tendency to react negatively to uncertain situations and events. This trait is strongly associated with several psychological disorders [42,43], and has also been found related to achievement emotions in university students [44] and mental wellbeing under COVID-19 [45].
Summing up, previous literature has provided some significant evidence of the association of the soft skills included in the WEF [19] model with cognitive academic learning outcomes (i.e., achievement) in non-pandemic contexts, with some indication of their importance under COVID-19 as well. Much less is known about their relationships with behavioral and emotional outcomes. There is also a lack of knowledge on their effect in distance learning contexts, as well as on their relative role when compared to factors that are specific to the learning context.

1.2. Study-Related Intraindividual Factors and Academic Learning Outcomes

As well as noncognitive and personality traits, several study-related intraindividual factors have been related to university students’ academic achievement [22,46] and, more rarely, to their emotions. Study-related intraindividual factors can be defined as fairly stable tendencies in approaching one’s studies, such as self-regulated learning, motivational beliefs, and study-related resilience.
Self-regulated learning (SRL, [47]) describes the extent to which students are actively involved in the learning process, in terms of their ability to analyze a learning task, set themselves goals, plan how to achieve them by adopting specific learning strategies, monitor their progress, stay motivated, assess their own performance, reflect metacognitively on their successes or failures, and consequently adjust their studying behavior [48]. Self-regulated learning has been found directly associated with positive academic emotions [46], and inversely with general distress [49].
Similarly, mastery learning goals (aimed at acquiring competence, as opposed to performance goals), a growth mindset (the conviction that intelligence is malleable, and can therefore be incremented), and academic self-efficacy (confidence in one’s ability to succeed in a given academic context) are motivational dispositions that have been found positively associated with positive academic emotions [46,50] and negatively with distress [51]. Moreover, academic self-efficacy was showed to be negatively related to state and trait anxiety [14], and to various aspects of emotional, social, and psychological wellbeing [52].
Finally, resilience—in the present context—can be defined as the tendency to stay motivated and willing to succeed despite repeated difficulties or failures experienced while studying [53]. General resilience is known to be inversely related to psychological distress [54], and study-related resilience has likewise been found inversely related to anxiety and directly related to self-regulated learning [53].
All in all, study-related factors are known to sustain academic learning in non-pandemic traditional and distance contexts, while less is known on their role during the COVID-19 pandemic. Their contribution to more general emotional outcomes (e.g., mental health, general distress) instead has been neglected in the literature and should deserve a closer examination.

1.3. Emotional Outcomes under the COVID-19 Pandemic

Research on the affective response to the COVID-19 pandemic has identified university students as being at greater risk of poor mental health outcomes (e.g., anxiety, depression, stress) than older adults [55,56]. To be more specific, a large epidemiological study (n = 44,447, [57]) conducted during the first outbreak of the virus in China initially identified relatively low rates of anxiety (7.7%) and depression (12.2%) in university students. This was followed, however, by a number of studies [6,7,8,12,13] reporting a much higher prevalence (around 25%) of self-reported distress, depression, anxiety, and stress among university students experiencing lockdown—though only slightly higher than estimated in non-pandemic situations [58].
According to a large global survey [3] on 30,383 students in 62 countries, boredom, anxiety, and frustration were the negative affective states most often described during the pandemic, while hope and joy were the most common positive ones experienced. It was suggested that positive emotions were especially affected by the pandemic, with students reporting lower levels of positive affective states than in previous studies [12].
Longitudinal studies showed that symptoms worsened from before to during lockdown, especially for anxiety and depression [11,59,60], and they tended to become more severe over the course of the first pandemic wave (February-May 2020; [11,61,62]). Subsequent studies [63,64] reported a similar worsening of mental health symptoms over longer time-periods (October 2019-July 2020 and October 2019-October 2020, respectively).
Overall, the results suggest that students may be having difficulties with emotionally adjusting to pandemic-related academic and life demands.
Less is known about which intraindividual factors affect emotional outcomes over time, with some evidence that male gender [63], active behavior [64], and novelty-seeking [35] may be longitudinally associated to better mental health. Therefore, there is an urgent need to understand which intraindividual features may be playing a role in helping students emotionally cope with this prolonged stressful situation of distance learning and external uncertainty.

1.4. Cognitive and Behavioral Learning Outcomes under the COVID-19 Pandemic

As for learning behavior, studying alone at home seems to demand greater self-discipline and self-initiative than traditional classroom learning [65,66]. Students learning online seem to display a greater use of SRL strategies than those in blended environments [65], possibly due to the greater autonomy required in the former case [66], and the need to make better use of strategies to learn effectively.
With respect to cognitive learning outcomes such as achievement, the influence of the COVID-19 pandemic is controversial. Aristovnik et al. [3] found that around 40% of students reported an increase in their workload when lectures were only available online. Students found it harder to stay focused during online lectures and felt their study performance had declined. Intriguingly, studies comparing students’ performance before and after the COVID-19 lockdown found either no difference [67] or a significant improvement in test scores compared with previous years, regardless of the exam formats and teaching methods involved [68,69]. Possible student-related reasons for these somewhat unexpected results include better time management and self-regulated learning strategies; and a stronger degree of worry and/or motivation to succeed in the face of unstable and uncertain external conditions. In other words, it may be that other factors, such as self-regulation and emotions (rather than study performance), have had an important part to play in students’ academic achievements during the pandemic.

1.5. The Present Study

Given the persistence of the pandemic, with lessons continuing to be delivered online, it is worth examining the intraindividual dispositions related to behavioral (e.g., strategies for coping with online teaching), emotional (e.g., study-related emotions and general psychological distress), and cognitive (e.g., achievement) learning outcomes both cross-sectionally and longitudinally, so as to clearly identify which intraindividual features should be nurtured to sustain students in such stressful times. To our knowledge, no studies have investigated the different academic learning outcomes together under the COVID-19 lockdown, nor their relationship with the general or study-related intraindividual factors during the peak of the pandemic and beyond. Moreover, we decided to adopt a general, recent model of academic learning [2] and test its ability to adapt to such a specific case, namely, that of an abrupt major stressful event affecting most students around the world. By doing this, we could provide evidence in support of the model and draw similarities between the pandemic context and other distance and non-pandemic future situations.
The main goal of the present study was then i) to examine the effects of intraindividual factors on three situational academic learning outcomes (i.e., psychological distress, online self-regulated learning strategies, and study-related emotions) that can shed light on students’ responses during the COVID-19 lockdown (T1); and ii) to assess how time, dispositional variables and situational variables during T1 impacted further situational outcomes, i.e., psychological distress and academic achievement.
Based on previous literature related to non-pandemic and pandemic contexts, for the data collected in T1 we expected psychological distress to be associated positively with intolerance of uncertainty [43,45], and negatively with both general [4,5,25,28,33,34,37] and study-related intraindividual factors [49,51,52,53,54]. As suggested by previous findings regarding the current pandemic situation, we also expected higher levels of distress in female students compared to males [13,70].
For the online self-regulated learning strategies, we hypothesized a positive association with both general [27,30,31,32], and study-related intraindividual factors [46,53,65].
For study-related emotions, we expected a positive relationship with soft skills [38], and study-related intraindividual factors [46] and a negative association with intolerance of uncertainty [44].
Preliminarily, we also examined the levels of psychological distress experienced by students under nationwide lockdown (T1) to see whether they were higher than those usually reported in non-pandemic conditions [6,7,8,13,56].
Then, in the second part of the study, we examined how psychological distress changed in the following three time-periods (T2, T3, and T4) with the hypothesis that the distress levels would follow a V-shaped trend, i.e., they would be higher at T1 and T4, compared to T2 and T3, also due to restrictions being lessened [61,63].
As for grades, negligible differences were anticipated across time-points [67,68,69].
With respect to the effect of intraindividual factors over time, we expected similar effects on distress for the reasons mentioned above, together with a significant association of soft skills [20,21,22,23] and study-related intraindividual dispositions [22,46] on grades. Finally, we expected significant positive effects of both online self-regulated learning and study-related emotions on achievement [46].

2. Materials and Methods

2.1. Participants

The participants were university students living in Italy. Inclusion criteria were being older than 18 years old, being enrolled in an Italian university and living in Italy during the lockdown. The final sample (we included data from respondents completing at least 50% of the questionnaires (N = 331). 292 (88%) completed all measures) consisted of 331 university students (91 males) aged 19–34 years (M = 22.48, SD = 2.33). Table 1 summarizes the sample’s characteristics.
Of the 331 participants, 107 (22 males; Mage = 21.95, SDage = 2.02) took part in at least one follow-up of the study and were considered in the following analyses. More specifically, 96 students (15 males; Mage = 22.01, SDage = 2.12) participated in the first follow-up (T2), 87 (14 males; Mage = 21.81, SDage = 1.74) in the second follow-up (T3) and 61 (13 males; Mage = 21.60, SDage = 1.52) in the last follow-up (T4). In total, 30 participants (4 males; Mage = 21.6, SDage = 1.61) completed all the follow-ups.
To ensure sample size adequacy, we conducted retrospective power analysis using the pwrSEM Shiny app [71] and the package simr [72] to examine the power for the cross-sectional and longitudinal portions of the study, respectively. The parameters were estimated to be small-to-medium, based on the previous literature presented in the Introduction. Power was then calculated via simulations with 5000 iterations.
Results of the power analysis showed that with 331 participants (sample size at T1), power ranged between 0.89 and 1.00 for the effects of the three intraindividual factors (i.e., soft skills, study-related factors, and intolerance of uncertainty) over the three situational learning outcomes (i.e., general distress, online self-regulated learning, and study-related emotions).
As for the longitudinal portion, power associated to our sample size (N = 107) was above 0.80 for all the considered effects (i.e., time, study-related factors, intolerance of uncertainty, online self-regulated learning, and study-related emotions) for both DASS-21 and achievement, except for the effects of intolerance of uncertainty and study-related emotions on achievement, which had lower associated power (0.70 and 0.73, respectively).

2.2. Materials

All measures displayed satisfactory reliability in both the Italian validation study and our sample (see Table S2). Responses were generally given on 4-to-7-point Likert scales (see Table S2 for the range of each scale).

2.2.1. Intraindividual Factors

I/D Epistemic Curiosity Scale—I-type subscale (EC; [73]; translated in Italian by Litman et al. [74]). This includes five items measuring Type I (Interest) epistemic curiosity, i.e., the pleasure associated with uncovering new information (five items, e.g., “I enjoy exploring new ideas”). The original subscale displayed good reliability indices (α = 0.82; [73]), and it did so in the present study also (α = 0.79).
Values in Action Inventory of Strengths-120—Creativity (VIA-IS; [16]; Italian validation by Feraco et al. [75]). This involves four items and assesses an individual’s tendency to think of new and productive ways to conceptualize and do things (e.g., “Being able to come up with new and different ideas is one of my strong points”). The scale displayed a good reliability in the Italian validation study (α = 0.88; [75]), and in the present sample also (α =0.90)
Motivated Strategies for Learning Questionnaire—Critical thinking (MSLQ; [76]; Italian validation by Moretti et al. [77]). This involves four items investigating the tendency to question learning material (e.g., “When a theory, interpretation, or conclusion is presented in class or in the readings, I try to decide if there is good supporting evidence”). The Italian version of the questionnaire has satisfactory properties (0.67 < α < 0.92; [77]); in our sample, the scale showed a good internal consistency (α = 0.79).
Short Grit Scale—Perseverance of effort subscale (SGS; [78]; validated in Italian by Sulla et al. [79]). This involves four items assessing perseverance of effort (e.g., “Setbacks don’t discourage me”), i.e., a personal disposition to persist in one’s efforts despite difficulties. The subscale displayed an acceptable internal consistency in the Italian version (α = 0.61; [79]), and in the present study as well (α = 0.70).
Trait Emotional Intelligence Questionnaire-Short Form (TEIQue-SF; [80]; Italian version by Di Fabio and Palazzeschi [81]). This involves 30 items on global trait emotional intelligence, covering four factors: emotionality, referring to emotion perception, emotion expression and empathy (8 items, e.g., “Expressing my emotions with words is not a problem for me”); self-control, reflecting low impulsiveness, stress management and emotion regulation (6 items, e.g., “On the whole, I’m able to deal with stress”); sociability, relating to assertiveness and social competence (6 items, e.g., “I can deal effectively with people”); and wellbeing, pertaining to self-esteem, happiness and optimism (6 items, e.g., “On the whole, I’m pleased with my life”). The remaining four items concern adaptability and motivation and are used only to calculate the overall score. The scores for half of the items need to be reversed. The Italian version showed a good internal consistency (0.80 < α < 0.82; [81]), and this was also true of the present study (0.70 < α < 0.88).
Self-regulated Learning Questionnaire—short form (SLQ; adapted from [53]). This contains 20 items assessing five facets of self-regulated learning strategies (four items each): organization (e.g., “In the early afternoon I plan all the things I have to do”), elaboration (e.g., “When studying, I try to present the contents in my own words”), self-evaluation (e.g., “After a written exam, I know whether it went well or not”), preparing for exams (e.g., “I try to anticipate what kind of exam awaits me”), and metacognition (e.g., “When an exam goes wrong, I try to understand the reasons why I failed”). Seven items need to be reversed. Only the overall score was used in the following analyses because it proved more reliable than the single subscales in both the original version (α = 0.76; [53]) and the present sample (α = 0.78).
Learning Goals Questionnaire (LGQ; [53]). This includes four items on learning goals. For each item there are two options for respondents to choose from, one regarding performance (e.g., “In a study situation, you prefer…to face tasks you already know”), the other mastery (e.g., “In a study situation, you prefer…to face new tasks, that you have never encountered before”). Zero points are awarded for the option representing performance goals, and one point for responses reflecting mastery goals. The scale displayed a good reliability both in the original version (α = 0.78; [53]), and in the present study (α = 0.88).
Academic Self-efficacy Questionnaire (ASQ; [53]). This includes five items on academic self-efficacy (e.g., “How do you rate your study skills?”). The scale proved reliable in the original version (α = 0.80; [53]), and in the present study (α =0.80).
Theories of Intelligence Questionnaire (TIQ; [53]). This consists of eight items that measure growth mindset, i.e., beliefs about whether a person’s intelligence is malleable (e.g., “You can learn new things, but you can’t change your intelligence”). The internal consistency is reportedly good (α = 0.88; [53]), as it was in the present study (α = 0.92).
Anxiety and Resilience Questionnaire (ARQ; [53]). This involves 14 items examining study-related anxiety (7 items, e.g., “The very thought of taking an exam makes me panic”), and study-related resilience (7 items, e.g., “I can overcome the disappointment over an academic failure”). An overall score was calculated, reversing the anxiety items, to measure the extent to which students felt resilient in their studying, while being able to manage anxiety. The original version has satisfactory psychometric properties (α = 0.86 for the Anxiety subscale, α = 0.76 for Resilience; [53]), which were replicated in the present study (α = 0.89 and α = 0.72, respectively).
Intolerance of Uncertainty Questionnaire—Revised (IUS-R; [82]; Italian version by Bottesi et al. [42]). This contains 12 items on the tendency to interpret uncertain situations as threatening and unpleasant (e.g., “Unforeseen events upset me greatly”). The questionnaire showed a good internal consistency, both in the Italian validation study (α = 0.90; [42]) and in the present case (α = 0.86).

2.2.2. Situational Academic Learning Outcomes

Depression, Anxiety, and Stress Scales-21 (DASS-21; [83]; validated in Italian by Bottesi et al. [84]). This involves 21 items measuring three sets of symptoms experienced over the past week (7 items each): depression, in terms of dysphoria, low self-esteem and lack of initiative (e.g., “I could not feel any positive emotion”); anxiety, in terms of somatic symptoms and fear responses (e.g., “I felt I was having a panic attack”); and stress, in terms of tension, high general arousal, irritability and impatience (e.g., “I felt stressed”). A total general distress score was calculated as it proved highly reliable in both the validation study [84] and the current sample across all four time-points (T1: α = 0.90 when considering the whole sample, α = 0.92 for participants who completed at least one follow-up; T2: α = 0.95; T1: α = 0.93; T1: α = 0.95). Furthermore, multigroup confirmatory factor analysis supported scalar measurement invariance across time-points (Chisq. Difference = 75.89, Df difference = 60, p = 0.08).
Online Self-regulated Learning Questionnaire (OSLQ; adapted from [66,85]). This involves 21 items investigating self-regulated learning strategies in the context of distance learning, such as goal setting, strategic planning, help seeking and self-evaluation (e.g., “I set goals to help me manage studying time for my online courses”). Both the original instruments from which the items were adapted showed good psychometric properties (α = 0.93 in [85]; α = 0.92 in [66]), that were replicated in our sample (α = 0.88).
Emotions Questionnaire (EQ; [86]). This involves 10 positive and 10 negative emotions experienced while studying. A total score was obtained in terms of positive emotions by reversing the scores for the items concerning negative emotions. The internal consistency was good in the original version (α = 0.90 for negative emotions, α = 0.87 for positive emotions, [86]), and in the present sample also (α = 0.88 and α = 0.86, respectively).

2.3. Procedure

All participants took part in the study voluntarily and gave their consent by means of the online form before taking part. No compensation was given for their participation. The study was approved by the Ethical Committee of the University of Padua (n. 3531).
The first data collection (T1) was conducted from 15 April (one month after lockdown was officially declared) to 29 May 2020. A nationwide lockdown was declared in Italy starting on 9 March 2020. All non-essential movement was forbidden (except for work or health reasons), and all schools and universities were closed. Gatherings in public places were suspended, and so were sporting events. Only vital commercial businesses (supermarkets, pharmacies, and related shops) remained open, and public transport services were significantly reduced.
Three more data collections (T2-T4) were conducted, in which participants who left their email address (N = 352) were contacted again through Qualtrics to answer questions on the exam sessions (e.g., grades obtained) and complete the DASS-21. Reminders were also sent after one week to participants to encourage the completion of the three follow-ups. The second data collection took place after the Summer exam session (T2; 4 August 2020–30 August 2020) during a period of less strict restrictions to movement. The third data collection was conducted after the Fall exam session (T3; 29 September 2020–15 October 2020), with similar relaxed restrictions in place. The last data collection followed the Winter exam session (T4; 28 February 2021–5 March 2021), after Christmas holidays, during which the whole country was declared a “red zone”, with strict lockdown-like restrictions in place.
All the questionnaires involved in the present study were implemented in Qualtrics and took a mean 35 min to complete at T1 and five minutes for each follow-up (T2-T4). A brief introduction to the study was sent to personal contacts and posted on social media, using a snowball recruitment process. If participants provided their informed consent, they first provided socio-demographic information, then completed the questionnaires in randomized order and lastly answered questions relating to their studies (e.g., average grades).

2.4. Data Analysis

RStudio [87] was used to run all the analyses.
First, we examined the levels of general distress displayed in the sample population compared with the normative sample described by Bottesi et al. [84], calculating mean z-scores for all time-points.
Then, following previous studies [19,46,88,89] supporting the theoretical similarity between soft skills (i.e., curiosity, creativity, critical thinking, emotional intelligence and perseverance) and study-related intraindividual factors (i.e., self-regulated learning, motivational beliefs, and study resilience), two confirmatory factor analyses (CFAs) were fitted using the package lavaan [90] to inspect the structure of these two latent variables. The variables were considered as ordinal, and the diagonally weighted least squares (DWLS) estimator was used. If the two latent variables proved structurally reliable, they were converted into observed variables for use in the subsequent analyses. This procedure enables the number of variables to consider to be reduced and provides more reliable results when the size of a sample does not allow for many parameters to be estimated [88,91].
To ascertain the influence of the intraindividual factors (soft skills, study-related dispositions, and intolerance of uncertainty) on the situational outcome measures at T1, three multiple linear regressions models were fitted using lavaan [90], considering soft skills, study-related dispositions, and intolerance of uncertainty as predictors of the three dependent variables (distress, online self-regulated learning, and study-related emotions). Gender was included as a covariate for distress [7,8,12,13].
Finally, the longitudinal associations were considered. To this end, linear mixed models were run using lmerTest [92], considering DASS-21 and grades as dependent variables, participants’ code as random effect, and time, dispositional (study-related dispositions, soft skills, and intolerance of uncertainty) and situational (online self-regulated learning strategies and study-related emotions) variables as fixed effects. Data from students who completed at least one follow-up measurement were considered to increase sample size at each time point, as previously performed by other studies with multiple waves [93].

3. Results

Table S1 (Supplementary Material ) contains the descriptive statistics (mean, standard deviation, and range) for each variable, their internal consistency, and correlations.

3.1. Distress Levels across Time-Points

The mean z-scores were computed to compare the present sample with the normative one [84] in terms of general distress levels across time-points. The mean z-scores were 1.11 (SD = 1.47) at T1, 0.52 (SD = 1.57) at T2, 0.40 (SD = 1.31) at T3, and 0.95 (SD = 1.62) at T4.

3.2. Factor Composition with Dispositional Measures

Two CFAs were fitted to test the structure of the latent variables hypothesized (Table S2).
The CFA for “soft skills” included seven observed variables: epistemic curiosity (EC), creativity (VIA-IS), critical thinking (MSLQ), emotionality, self-control, sociability, wellbeing (TEIQue subscales), and perseverance (SGS). All the factor loadings were significant at the 0.001 level and the average factor loading was 0.53. The fit indices showed a good fit of the data with the structure hypothesized (CFI = 0.98, NNFI = 0.97, RMSEA = 0.08, SRMR = 0.05).
The second CFA, testing “study-related intraindividual factors”, included five observed variables: academic self-efficacy (ASQ), learning goals (LGQ), theories of intelligence (TIQ), self-regulated learning (SLQ) and study resilience (ARQ). All the factor loadings were significant at the 0.001 level, and the mean factor loading was 0.059. The fit indices were good (CFI = 0.99, NNFI = 0.98, RMSEA = 0.08, SRMR = 0.04).

3.3. Associations between Dispositional Intraindividual Factors (Soft Skills, Study-Related Dispositions, and Intolerance of Uncertainty) and Situational Outcome Measures at T1

Table S3 shows the correlations between the variables considered in the regression models.
Three regression models were fitted using soft skills, study-related factors, and IUS-R as predictors (representing intraindividual factors) and the DASS-21 total score, OSLQ total scores and EQ as dependent variables (representing situational academic learning outcomes). Moreover, gender was added as covariate for the DASS-21.
The results indicated a good fit for the model as a whole (CFI = 1.00; NNFI = 0.98; RMSEA = −0.05; SRMR = 0.02).
The results for DASS-21 showed a significant direct effect for IUS-R (β = 0.39), and an inverse effect for study-related dispositions (β = −.20); male gender was significant also (β = −0.10, p = 0.03), while soft skills were only marginally significant (β = −0.12, p = 0.06). The model explained 36.7% of the variance.
For OSLQ, the model showed that study-related dispositions (β = 0.37) and soft skills (β = 0.22) had a significant positive effect, while the effect of intolerance of uncertainty was not significant. The model explained 26.3% of the variance.
For EQ, study-related dispositions (β = 0.55), IUS-R (β = −0.15) and soft skills (β = 0.12) all emerged as significant predictors. The model explained 51.8% of the variance. Table 2 shows the results of the regression models, without the effects of the covariate.

3.4. Associations of Dispositional and Situational Outcome with Distress and Achievement over Time

The correlations of soft skills, study-related dispositions, and intolerance of uncertainty with distress and grades across time-points are available in the Supplementary materials (see Table S3).
The results of the mixed effects model for the DASS-21 overall scores revealed significant inverse effects of T2 (β = −0.36), T3 (β = −0.45), IUS-R (β = −0.45), and EQ (β = −0.42).
As for grades, the results showed significant direct effects of T4 (β = 0.11) and study-related dispositions (β = 0.50). Table 3 displays the results of both mixed effects models.

4. Discussion

As the COVID-19 pandemic persists, and similarly stressful situations may arise, there is an urgent need to identify the factors that can support relevant academic learning outcomes such as effective learning behavior, positive emotions, or the achievements of university students having to cope with the switch to online lectures and a curtailment of their social lives.
Building on the integrated self-regulated learning model [1,2], the present study newly examined the associations of general and study-related intraindividual factors with relevant behavioral, emotional, and cognitive outcomes under the COVID-19 pandemic. By investigating a wide range of intraindividual factors, the study also provides evidence of the relative role of general and study-related factors, illuminating which ones could be particularly relevant to address through intervention.

4.1. Distress Levels

Preliminarily, our results indicated that the levels of general distress reported by university students across the time-points (as measured with the DASS-21) were only slightly higher than those found in a normative sample [84]. It should be noted that the normative sample adopted consisted of adults from the general population, however, and not only students, possibly making this comparison less informative. A qualitative comparison with other studies using the DASS-21 during lockdown [70] revealed similar rates of reported symptoms, higher than those found early in the pandemic [94]. Our findings are also consistent with those obtained using other tools to assess mental health [7,13]. In short, the distress levels identified in our sample were similar to those recorded by other studies conducted during the first pandemic wave and slightly higher than in non-pandemic situations.
In line with our expectations, distress levels displayed a V-shaped trend, i.e., were descriptively higher at T1 and T4 and lower at T2 and T3. This preliminary result extends previous longitudinal findings [11,61,63,64] that focused on pre-post pandemic changes or on the first pandemic wave and suggests that the distress levels mirror the pandemic situation, possibly increasing and decreasing according to the trend in restrictions and threat perceptions, i.e., appraisals of COVID-19 as more or less dangerous.

4.2. General and Study-Related Intraindividual Factors

To approach the main research question, i.e., the role of the intraindividual factors proposed by Ben-Eliyahu [2] on pandemic-related situational academic learning outcomes (i.e., general distress, online self-regulated learning and study-related emotions experienced during T1), the intraindividual factors were examined as second-order factors.
Confirmatory factor analyses supported the structure of the two latent variables hypothesized, i.e., soft skills (representing the disposition towards the acquisition and creative use of knowledge, emotional regulation, and perseverance), and study-related dispositions (including a tendency to approach studying effectively and functionally, in terms of self-regulated learning, motivation to learn, and resilience in the face of difficulties).
The results for the soft skills provide empirical support to the WEF [19] model, indicating that they represent more general non-cognitive dispositions, as seen previously [88,89].
The results for the study-related variables showed that these dispositions can be pooled into a single factor reflecting a consistent set of intraindividual features in a student (such as the ability to self-regulate their learning, functional motivational beliefs, and resilience in the face of study-related failures). Of note, other studies have only considered these study-related intraindividual factors separately, assessing their specific influence on achievement (e.g., distinguishing between self-regulated learning and motivational beliefs, [46]). The present study newly suggests the possibility to consider them as composite factors, sharing a common function. Such commonality was better understood through the regression analyses.

4.3. Intraindividual Factors and Academic Learning Outcomes at T1

Having ascertained the factor composition of personal dispositions, multiple regressions within a single SEM model identified the relationships between the intraindividual factors and academic learning outcomes, as well as the effect of gender.
Concerning general distress, intolerance of uncertainty was the intraindividual factor most tightly related to higher levels of general distress during the first pandemic wave (T1). This result is consistent with our hypotheses and with previous meta-analytical findings [43] supporting its association with depression, anxiety, and stress in the context of a pandemic as well, as was already found for the general population [45].
General distress was also negatively related to study-related dispositions. This finding is in line with reports regarding some of the study-related intraindividual factors considered [49,52,54].
To our knowledge, no previous studies have examined several self-regulated learning dispositions together, neither in a pandemic nor in other settings. The present results thus provide new evidence of the association between university students’ mental health and different study-related intraindividual factors during a pandemic and could be extended to similar stressful distance learning contexts.
Gender also emerged as being related to general distress, with males experiencing less distress during the pandemic than females. This means that female gender might be a risk factor for general distress under lockdown, as suggested in other studies [13,56].
The association with soft skills was only marginally significant and deserves further investigation, possibly indicating that their conjoint effect on distress might be indirect, through the mediation of other variables, as suggested by previous studies [88] and as also postulated by Ben-Eliyahu [2]. In other words, it may also be that soft skills are better understood as being able to generally stimulate students’ self-regulated learning, motivation, and resilience, which in turn closely affect academic learning outcomes by assisting students to feel able to address specific challenges that arise in the learning context (e.g., dealing with academic failures, adapting to different academic requests, etc.).
There was a direct association of positive study-related emotions with study-related dispositions and soft skills, and an inverse association with intolerance of uncertainty. These results are similar to findings in some previous reports [44,46] and newly suggest that several personal dispositions, either study-related or more generally, may jointly explain students’ emotions experienced when studying under stressful circumstances (like those that students faced during the first lockdown).
Although distress describes a general negative emotional state, while study-related emotions refer to positive and negative emotions experienced while studying, the two constructs were similarly related to the intraindividual factors considered. This would suggest that these two outcomes might be influenced by the same personal dispositions in this population, and that fostering the latter could affect both general and study-related emotionality.
Our results also evidenced that online self-regulated learning was predicted mainly by study-related dispositions and, to a lesser degree, by soft skills. Generally endorsing effective study strategies, as measured by self-regulated learning in classroom learning environments, might favor the adoption of better strategies when switching to online learning, in which these strategies need to be even more effective to achieve good results [65]. Students who reported a growth mindset, mastery of learning goals and confidence in their ability to succeed were also more likely to report using effective SRL strategies for their online studies, corroborating the importance of motivational beliefs in distance learning as well. As for study-related resilience, we speculate that this may stem from more positive secondary appraisals [95] of an adverse situation, like the COVID-19 lockdown, as something challenging but controllable to some degree through personal effort and commitment.
Overall, being able to approach one’s studies effectively, and, to a lesser degree, being generally curious, critically-minded, creative, emotionally aware and persevering, appeared to relate to lower levels of general distress, more positive emotions when studying, and higher levels of online self-regulated learning strategies during the first lockdown prompted by the pandemic. A tolerance of uncertainty seemed to be associated with less distress and more positive study-related emotions.

4.4. Intraindividual Factors and Academic Learning Outcomes over Time

A longitudinal analysis (at T2, T3 and T4) allowed for contextualizing the role of predictors, better detecting the role of the situational and the dispositional variables.
It emerged that time significantly affected students’ distress: students appeared less distressed following both the Summer and Fall exam sessions. Interestingly, the Winter session did not affect distress levels, and may indicate that students were experiencing distress at degrees similar to the first nationwide lockdown (T1).
Intolerance of uncertainty was confirmed as the personal disposition more strongly associated with distress, in line with our cross-sectional results. Interestingly, study-related emotions also showed an effect on distress, possibly illuminating the associations of soft skills and study-related intraindividual factors with distress. It may be the case that these factors favor more positive emotions when studying (as shown by our cross-sectional results) and this in turn protects against experiencing general distress.
As for achievement, it appeared that grades slightly improved after the Winter 2021 exam session. This result may be explained by the positive effect of study-related dispositions, that may have helped students to study more efficiently and eventually perform better, as suggested by other studies considering the impact of the pandemic on students’ performance [67,68,69]. In other words, study-related intraindividual factors may partially explain why the students’ performances did not significantly change, and even slightly improved, following the pandemic and abrupt switch to online learning, despite students feeling their performance was indeed decreased [3].

4.5. Limitations and Future Directions

The present results need to be considered with caution considering some limitations.
Since both intraindividual factors and academic learning measures were collected during lockdown, it may be that the respondents’ intraindividual factors had already changed to some degree due to the arrival of the pandemic, and did not reflect their general dispositions. The relationships identified in the present study are nevertheless in line with the previous literature, suggesting that these personal features hold for both in a pandemic and in other situations.
No causal inferences can be drawn regarding the direction of the relations due to the cross-sectional nature of the first part of the study. Despite the significant longitudinal correlations between personal dispositions, distress and achievement, the sample size was too small for some of the effects (e.g., intolerance of uncertainty and study-related emotions’ associations with achievement) and future studies could provide more generalizable results. Moreover, the possibility of self-selection bias invites us to interpret the results, especially of the longitudinal portion of the study, with extreme caution. It may be that only students with specific intraindividual features decided to complete the follow-ups, thus leaving open the possibility that our findings are not generalizable to the entire student population experiencing the pandemic. Similarly, the lack of random sampling prevents us from generalizing the present results to the entire student population. Future studies employing such sampling methodology should be carried out to confirm and further develop the present findings. Nevertheless, our findings on the relationships between the intraindividual features and the learning outcomes considered appear to be in line with previous evidence in non-pandemic [22,86,88] and pandemic contexts using convenience sampling [3,4,5,7,35] as well as with studies using more rigorous sampling techniques [13,96]. Although this is not enough to ensure self-selection bias did not occur, it also may indicate that our results could be extended to other student samples. On the same note, our sample was mainly composed of female students, so our results regarding the distress levels may be biased—although they are consistent with those reported in studies with a more balanced proportion of female and male participants [62].
We were also unable to assess the effects of place of residence and type of accommodation during lockdown because most respondents were from Northern Italy (the area hardest hit by COVID-19 at the time) and were staying home with their families.

5. Conclusions

To conclude, despite the aforementioned limitations, this study provided support for the integrated self-regulated learning model [1,2] by identifying several intraindividual factors that appeared to sustain students’ emotional, behavioral, and cognitive outcomes in the new learning and life circumstances imposed by the COVID-19 pandemic.
It emerged that study-related intraindividual factors appear more involved in supporting situational outcomes, as well as distress and achievement across time. A tolerance of uncertainty appeared to be uniquely negatively associated with distress, both cross-sectionally and longitudinally, and positively with study-related emotions.
Fostering these individual dispositions—through training, for instance—may help university students to better approach their studies and benefit them in terms of their mental health in such difficult times as the present. More specifically, researchers and practitioners could develop interventions promoting the knowledge (through psychoeducation) and practice (through assignment and experiential activities) of these general and study-related intraindividual factors, presenting them as related factors that jointly contribute to several positive academic outcomes, capitalizing on the commonality of these variables.
All in all, our results suggest that several general (e.g., soft skills) and study-related (e.g., self-regulated learning, academic self-efficacy) intraindividual factors may contribute to students’ academic success under particularly stressful conditions, as well as when learning online.

Supplementary Materials

The following are available online at https://www.mdpi.com/article/10.3390/educsci12020101/s1, Table S1: Descriptive statistics, Table S2: Confirmatory factor analysis factor loadings, Tables S3-S4: Correlations.

Author Contributions

Conceptualization: N.C., M.G. and C.M.; methodology, N.C. and C.M.; software, N.C.; validation, N.C., M.G. and C.M.; formal analysis, N.C.; investigation, N.C.; resources, N.C.; data curation, N.C.; writing—original draft preparation, N.C.; writing—review and editing, M.G. and C.M.; visualization, N.C.; supervision, M.G. and C.M.; project administration, N.C.; funding acquisition, C.M. All authors have read and agreed to the published version of the manuscript.

Funding

Not applicable.

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki, and approved by the Ethics Committee of the University of Padua (protocol code 3531, 04/04/20).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The data that support the findings of this study are openly available in “figshare” at http://doi.org/10.6084/m9.figshare.14206790.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Ben-Eliyahu, A.; Bernacki, M.L. Addressing complexities in self-regulated learning: A focus on contextual factors, contingencies, and dynamic relations. Metacognition Learn. 2015, 10, 1–13. [Google Scholar] [CrossRef] [Green Version]
  2. Ben-Eliyahu, A. Academic emotional learning: A critical component of self-regulated learning in the emotional learning cycle. Educ. Psychol. 2019, 54, 84–105. [Google Scholar] [CrossRef]
  3. Aristovnik, A.; Keržič, D.; Ravšelj, D.; Tomaževič, N.; Umek, L. Impacts of the COVID-19 pandemic on life of higher education students: A global perspective. Sustainability 2020, 12, 8438. [Google Scholar] [CrossRef]
  4. Bono, G.; Reil, K.; Hescox, J. Stress and wellbeing in urban college students in the U.S. during the COVID-19 pandemic: Can grit and gratitude help? Int. J. Wellbeing 2020, 10, 39–57. [Google Scholar] [CrossRef]
  5. Datu, J.A.D.; Fincham, F.D. The relational and mental health payoffs of staying gritty during the COVID-19 pandemic: A cross-cultural study in the Philippines and the United States. J. Soc. Pers. Relatsh. 2021, 1–22. [Google Scholar] [CrossRef]
  6. Cao, W.; Fang, Z.; Hou, G.; Han, M.; Xu, X.; Dong, J.; Zheng, J. The psychological impact of the COVID-19 epidemic on college students in China. Psychiatry Res. 2020, 287, 112934. [Google Scholar] [CrossRef] [PubMed]
  7. Chi, X.; Becker, B.; Yu, Q.; Willeit, P.; Jiao, C.; Huang, L.; Hossain, M.M.; Grabovac, I.; Yeung, A.; Lin, J.; et al. Prevalence and psychosocial correlates of mental health outcomes among Chinese college students during the coronavirus disease (COVID-19) pandemic. Front. Psychiatry 2020, 11, 803. [Google Scholar] [CrossRef]
  8. Fu, W.; Yan, S.; Zong, Q.; Anderson-Luxford, D.; Song, X.; Lv, Z.; Lv, C. Mental health of college students during the COVID-19 epidemic in China. J. Affect. Disord. 2021, 280, 7–10. [Google Scholar] [CrossRef]
  9. Holzer, J.; Lüftenegger, M.; Korlat, S.; Pelikan, E.; Salmela-Aro, K.; Spiel, C.; Schober, B. Higher education in times of COVID-19: University students’ basic need satisfaction, self-regulated learning, and well-being. AERA Open 2021, 7, 1–13. [Google Scholar] [CrossRef]
  10. Hong, J.-C.; Lee, Y.-F.; Ye, J.-H. Procrastination predicts online self-regulated learning and online learning Ineffectiveness during the coronavirus lockdown. Personal. Individ. Differ. 2021, 174, 110673. [Google Scholar] [CrossRef] [PubMed]
  11. Li, Y.; Zhao, J.; Ma, Z.; McReynolds, L.S.; Lin, D.; Chen, Z.; Wang, T.; Wang, D.; Zhang, Y.; Zhang, J.; et al. Mental health among college students during the COVID-19 pandemic in China: A 2-wave longitudinal survey. J. Affect. Disord. 2021, 281, 597–604. [Google Scholar] [CrossRef] [PubMed]
  12. Wang, Y.; Jing, X.; Han, W.; Jing, Y.; Xu, L. Positive and negative affect of university and college students during COVID-19 outbreak: A network-based survey. Int. J. Public Health 2020, 65, 1437–1443. [Google Scholar] [CrossRef]
  13. Wathelet, M.; Duhem, S.; Vaiva, G.; Baubet, T.; Habran, E.; Veerapa, E.; Debien, C.; Molenda, S.; Horn, M.; Grandgenèvre, P.; et al. Factors associated with mental health disorders among university students in France confined during the COVID-19 pandemic. JAMA Netw. Open 2020, 3, e2025591. [Google Scholar] [CrossRef] [PubMed]
  14. Alemany-Arrebola, I.; Rojas-Ruiz, G.; Granda-Vera, J.; Mingorance-Estrada, Á.C. Influence of COVID-19 on the perception of academic self-efficacy, state anxiety, and trait anxiety in college students. Front. Psychol. 2020, 11, 570017. [Google Scholar] [CrossRef] [PubMed]
  15. Casali, N.; Feraco, T.; Meneghetti, C. Character strengths sustain mental health and post-traumatic growth during the COVID-19 pandemic. A longitudinal analysis. Psychol. Health 2021, 1–17. [Google Scholar] [CrossRef]
  16. Peterson, C.; Seligman, M.E.P. Character Strengths and Virtues: A Handbook and Classification; American Psychological Association: Washington, DC, USA, 2004. [Google Scholar]
  17. Khine, M.S.; Areepattamannil, S. Non-Cognitive Skills and Factors in Educational Attainment; Springer: Cham, Switzerland, 2016. [Google Scholar]
  18. Heckman, J.; Kautz, T. Hard Evidence on Soft Skills; National Bureau of Economic Research: Cambridge, MA, USA, 2012; p. w18121. [Google Scholar]
  19. World Economic Forum. New Vision for Education: Unlocking the Potential of Technology; British Columbia Teachers’ Federation: Vancouver, BC, Canada, 2015. [Google Scholar]
  20. Gajda, A.; Karwowski, M.; Beghetto, R.A. Creativity and academic achievement: A meta-analysis. J. Educ. Psychol. 2017, 109, 269–299. [Google Scholar] [CrossRef]
  21. Lam, K.K.L.; Zhou, M. Examining the relationship between grit and academic achievement within K-12 and higher education: A systematic review. Psychol. Sch. 2019, 56, 1654–1686. [Google Scholar] [CrossRef]
  22. Richardson, M.; Abraham, C.; Bond, R. Psychological correlates of university students’ academic performance: A systematic review and meta-analysis. Psychol. Bull. 2012, 138, 353–387. [Google Scholar] [CrossRef] [Green Version]
  23. Von Stumm, S.; Ackerman, P.L. Investment and intellect: A review and meta-analysis. Psychol. Bull. 2013, 139, 841–869. [Google Scholar] [CrossRef] [Green Version]
  24. Niemiec, R.M.; Pearce, R. The practice of character strengths: Unifying definitions, principles, and exploration of what’s soaring, emerging, and ripe with potential in science and in practice. Front. Psychol. 2021, 11, 590220. [Google Scholar] [CrossRef] [PubMed]
  25. Credé, M.; Tynan, M.C.; Harms, P.D. Much ado about grit: A meta-analytic synthesis of the grit literature. J. Personal. Soc. Psychol. 2017, 113, 492–511. [Google Scholar] [CrossRef] [PubMed]
  26. Petrides, K.V.; Furnham, A. Trait emotional intelligence: Psychometric investigation with reference to established trait taxonomies. Eur. J. Personal. 2001, 15, 425–448. [Google Scholar] [CrossRef]
  27. Keefer, K.V.; Parker, J.D.A.; Saklofske, D.H. Emotional Intelligence in Education; Springer: Cham, Switzerland, 2018. [Google Scholar]
  28. Martins, A.; Ramalho, N.; Morin, E. A comprehensive meta-analysis of the relationship between emotional intelligence and health. Personal. Individ. Differ. 2010, 49, 554–564. [Google Scholar] [CrossRef]
  29. Moroń, M.; Biolik-Moroń, M. Trait emotional intelligence and emotional experiences during the COVID-19 pandemic outbreak in Poland: A daily diary study. Personal. Individ. Differ. 2021, 168, 110348. [Google Scholar] [CrossRef] [PubMed]
  30. Efklides, A. Affect, epistemic emotions, metacognition, and self-regulated learning. Teach. Coll. Rec. 2017, 119, 1–22. [Google Scholar] [CrossRef]
  31. Lauriola, M.; Litman, J.A.; Mussel, P.; De Santis, R.; Crowson, H.M.; Hoffman, R.R. Epistemic curiosity and self-regulation. Personal. Individ. Differ. 2015, 83, 202–207. [Google Scholar] [CrossRef]
  32. Richter, T.; Schmid, S. Epistemological beliefs and epistemic strategies in self-regulated learning. Metacognition Learn. 2010, 5, 47–65. [Google Scholar] [CrossRef]
  33. Kashdan, T.B. Social anxiety spectrum and diminished positive experiences: Theoretical synthesis and meta-analysis. Clin. Psychol. Rev. 2007, 27, 348–365. [Google Scholar] [CrossRef]
  34. Spielberger, C.D.; Reheiser, E.C. Assessment of emotions: Anxiety, anger, depression, and curiosity. Appl. Psychol. Health Well-Being 2009, 1, 271–302. [Google Scholar] [CrossRef]
  35. Li, W.W.; Yu, H.; Miller, D.J.; Yang, F.; Rouen, C. Novelty seeking and mental health in Chinese university students before, during, and after the COVID-19 pandemic lockdown: A longitudinal study. Front. Psychol. 2020, 11, 600739. [Google Scholar] [CrossRef] [PubMed]
  36. Kaufman, J.C. Creativity and Mental Illness; Cambridge University Press: New York, NY, USA, 2014. [Google Scholar]
  37. Baas, M.; Nijstad, B.A.; Boot, N.C.; De Dreu, C.K.W. Mad genius revisited: Vulnerability to psychopathology, biobehavioral approach-avoidance, and creativity. Psychol. Bull. 2016, 142, 668–692. [Google Scholar] [CrossRef] [PubMed]
  38. Villavicencio, F.T. Critical thinking, negative academic emotions, and achievement: A mediational analysis. Asia Pac. Educ. Res. 2011, 20, 118–126. [Google Scholar]
  39. Su, M.R.; Shum, K.K. The moderating effect of mindfulness on the mediated relation between critical thinking and psychological distress via cognitive distortions among adolescents. Front. Psychol. 2019, 10, 1455. [Google Scholar] [CrossRef]
  40. Casali, N.; Feraco, T.; Ghisi, M.; Meneghetti, C. “Andrà Tutto Bene”: Associations between character strengths, psychological distress and self-efficacy during COVID-19 lockdown. J. Happiness Stud. 2021, 22, 2255–2274. [Google Scholar] [CrossRef]
  41. Tosevski, D.L.; Milovancevic, M.P.; Gajic, S.D. Personality and psychopathology of university students. Curr. Opin. Psychiatry 2010, 23, 48–52. [Google Scholar] [CrossRef]
  42. Bottesi, G.; Noventa, S.; Freeston, M.H.; Ghisi, M. Seeking certainty about intolerance of uncertainty: Addressing old and new issues through the intolerance of uncertainty scale-revised. PLoS ONE 2019, 14, e0211929. [Google Scholar] [CrossRef] [Green Version]
  43. Gentes, E.L.; Ruscio, A.M. A Meta-analysis of the relation of intolerance of uncertainty to symptoms of generalized anxiety disorder, major depressive disorder, and obsessive–compulsive disorder. Clin. Psychol. Rev. 2011, 31, 923–933. [Google Scholar] [CrossRef]
  44. Tang, W.K. Resilience and self-compassion related with achievement emotions, test anxiety, intolerance of uncertainty, and academic achievement. Psychol. Stud. 2019, 64, 92–102. [Google Scholar] [CrossRef]
  45. Satici, B.; Saricali, M.; Satici, S.A.; Griffiths, M.D. Intolerance of uncertainty and mental wellbeing: Serial mediation by rumination and fear of COVID-19. Int. J. Ment. Health Addict. 2020, 1, 1–12. [Google Scholar] [CrossRef]
  46. Mega, C.; Ronconi, L.; De Beni, R. What makes a good student? How emotions, self-regulated learning, and motivation contribute to academic achievement. J. Educ. Psychol. 2014, 106, 121–131. [Google Scholar] [CrossRef] [Green Version]
  47. Zimmerman, B.J. Attaining self-regulation. In Handbook of Self-Regulation; Elsevier: Amsterdam, The Netherlands, 2000; pp. 13–39. ISBN 9780121098902. [Google Scholar]
  48. Panadero, E. A Review of self-regulated learning: Six models and four directions for research. Front. Psychol. 2017, 8, 422. [Google Scholar] [CrossRef] [PubMed]
  49. Durand-Bush, N.; McNeill, K.; Harding, M.; Dobransky, J. Investigating stress, psychological well-being, mental health functioning, and self-regulation capacity among university undergraduate students: Is this population optimally functioning? Can. J. Couns. Psychother. 2015, 49, 253–274. [Google Scholar]
  50. Huang, C. Achievement goals and achievement emotions: A meta-analysis. Educ. Psychol. Rev. 2011, 23, 359–388. [Google Scholar] [CrossRef]
  51. Burnette, J.L.; Knouse, L.E.; Vavra, D.T.; O’Boyle, E.; Brooks, M.A. Growth mindsets and psychological distress: A meta-analysis. Clin. Psychol. Rev. 2020, 77, 101816. [Google Scholar] [CrossRef] [PubMed]
  52. Capone, V.; Caso, D.; Donizzetti, A.R.; Procentese, F. University student mental well-being during COVID-19 outbreak: What are the relationships between information seeking, perceived risk and personal resources related to the academic context? Sustainability 2020, 12, 7039. [Google Scholar] [CrossRef]
  53. De Beni, R.; Zamperlin, C.; Meneghetti, C.; Cornoldi, C.; Fabris, M.; Tona, G.D.M.; Moè, A. Test AMOS-Abilitá e Motivazione Allo Studio: Prove Di Valutazione e Orientamento per La Scuola Secondaria Di Secondo Grado e L’università: Nuova Edizione; Edizioni Centro Studi Erickson: Trento, Italy, 2014. [Google Scholar]
  54. Pidgeon, A.M.; Rowe, N.F.; Stapleton, P.; Magyar, H.B.; Lo, B.C.Y. Examining characteristics of resilience among university students: An international study. Open J. Soc. Sci. 2014, 2, 14–22. [Google Scholar] [CrossRef] [Green Version]
  55. Huang, Y.; Zhao, N. Generalized anxiety disorder, depressive symptoms and sleep quality during COVID-19 outbreak in China: A web-based cross-sectional survey. Psychiatry Res. 2020, 288, 112954. [Google Scholar] [CrossRef]
  56. Wang, C.; Pan, R.; Wan, X.; Tan, Y.; Xu, L.; Ho, C.S.; Ho, R.C. Immediate psychological responses and associated factors during the initial stage of the 2019 coronavirus disease (COVID-19) epidemic among the general population in China. Int. J. Environ. Res. Public Health 2020, 17, 1729. [Google Scholar] [CrossRef] [Green Version]
  57. Wang, Z.-H.; Yang, H.-L.; Yang, Y.-Q.; Liu, D.; Li, Z.-H.; Zhang, X.-R.; Zhang, Y.-J.; Shen, D.; Chen, P.-L.; Song, W.-Q.; et al. Prevalence of anxiety and depression symptom, and the demands for psychological knowledge and interventions in college students during COVID-19 epidemic: A large cross-sectional study. J. Affect. Disord. 2020, 275, 188–193. [Google Scholar] [CrossRef]
  58. Auerbach, R.P.; Mortier, P.; Bruffaerts, R.; Alonso, J.; Benjet, C.; Cuijpers, P.; Demyttenaere, K.; Ebert, D.D.; Green, J.G.; Hasking, P.; et al. WHO world mental health surveys international college student project: Prevalence and distribution of mental disorders. J. Abnorm. Psychol. 2018, 127, 623–638. [Google Scholar] [CrossRef]
  59. Elmer, T.; Mepham, K.; Stadtfeld, C. Students under lockdown: Comparisons of students’ social networks and mental health before and during the COVID-19 crisis in Switzerland. PLoS ONE 2020, 15, e0236337. [Google Scholar] [CrossRef] [PubMed]
  60. Meda, N.; Pardini, S.; Slongo, I.; Bodini, L.; Zordan, M.A.; Rigobello, P.; Visioli, F.; Novara, C. Students’ mental health problems before, during, and after COVID-19 lockdown in Italy. J. Psychiatr. Res. 2021, 134, 69–77. [Google Scholar] [CrossRef] [PubMed]
  61. Savage, M.J.; James, R.; Magistro, D.; Donaldson, J.; Healy, L.C.; Nevill, M.; Hennis, P.J. Mental health and movement behaviour during the COVID-19 pandemic in UK university students: Prospective cohort study. Ment. Health Phys. Act. 2020, 19, 100357. [Google Scholar] [CrossRef]
  62. Zhang, Y.; Zhang, H.; Ma, X.; Di, Q. Mental health problems during the COVID-19 pandemics and the mitigation effects of exercise: A longitudinal study of college students in China. Int. J. Environ. Res. Public Health 2020, 17, 3722. [Google Scholar] [CrossRef]
  63. Fruehwirth, J.C.; Biswas, S.; Perreira, K.M. The COVID-19 pandemic and mental health of first-year college students: Examining the effect of COVID-19 stressors using longitudinal data. PLoS ONE 2021, 16, e0247999. [Google Scholar] [CrossRef]
  64. Savage, M.J.; Hennis, P.J.; Magistro, D.; Donaldson, J.; Healy, L.C.; James, R.M. Nine months into the COVID-19 pandemic: A longitudinal study showing mental health and movement behaviours are impaired in UK students. Int. J. Environ. Res. Public Health 2021, 18, 2930. [Google Scholar] [CrossRef] [PubMed]
  65. Broadbent, J. Comparing online and blended learner’s self-regulated learning strategies and academic performance. Internet High. Educ. 2017, 33, 24–32. [Google Scholar] [CrossRef]
  66. Kizilcec, R.F.; Pérez-Sanagustín, M.; Maldonado, J.J. Self-regulated learning strategies predict learner behavior and goal attainment in massive open online courses. Comput. Educ. 2017, 104, 18–33. [Google Scholar] [CrossRef] [Green Version]
  67. Bawa, P. Learning in the age of SARS-COV-2: A quantitative study of learners’ performance in the age of emergency remote teaching. Comput. Educ. Open 2020, 1, 100016. [Google Scholar] [CrossRef]
  68. Gonzalez, T.; de la Rubia, M.A.; Hincz, K.P.; Comas-Lopez, M.; Subirats, L.; Fort, S.; Sacha, G.M. Influence of COVID-19 confinement on students’ performance in higher education. PLoS ONE 2020, 15, e0239490. [Google Scholar] [CrossRef] [PubMed]
  69. Iglesias-Pradas, S.; Hernández-García, Á.; Chaparro-Peláez, J.; Prieto, J.L. Emergency remote teaching and students’ academic performance in higher education during the COVID-19 pandemic: A case study. Comput. Hum. Behav. 2021, 119, 106713. [Google Scholar] [CrossRef] [PubMed]
  70. Odriozola-González, P.; Planchuelo-Gómez, Á.; Irurtia, M.J.; de Luis-García, R. Psychological effects of the COVID-19 outbreak and lockdown among students and workers of a Spanish university. Psychiatry Res. 2020, 290, 113108. [Google Scholar] [CrossRef] [PubMed]
  71. Wang, Y.A.; Rhemtulla, M. Power analysis for parameter estimation in structural equation modeling: A discussion and tutorial. Adv. Methods Pract. Psychol. Sci. 2021, 4, 1–17. [Google Scholar] [CrossRef]
  72. Green, P.; MacLeod, C.J. SIMR: An R package for power analysis of generalized linear mixed models by simulation. Methods Ecol. Evol. 2016, 7, 493–498. [Google Scholar] [CrossRef]
  73. Litman, J.A. Interest and deprivation factors of epistemic curiosity. Personal. Individ. Differ. 2008, 44, 1585–1595. [Google Scholar] [CrossRef]
  74. Litman, J.A.; Lauriola, M.; De Santis, R. Individual Differences in Epistemic Curosity in Italy; Institute for Human and Machine Cognition: Pensacola, FL, USA, 2014. [Google Scholar]
  75. Feraco, T.; Casali, N.; Meneghetti, C. Do strengths converge into virtues? An item-, virtue-, and scale-level analysis of the Italian values in action inventory of strengths-120. J. Personal. Assess. 2021, 1–13. [Google Scholar] [CrossRef]
  76. Pintrich, P.R.; Smith, D.A.F.; Garcia, T.; McKeachie, W.J. A Manual for the Use of the Motivated Strategies for Learning Questionnaire (MSLQ); National Center for Research to Improve Postsecondary Teaching and Learning: Ann Arbor, MI, USA, 1991. [Google Scholar]
  77. Moretti, G.; Giuliani, A.; Morini, A. Accrescere la consapevolezza degli studenti come soggetti in formazione: Utilizzo, e validazione del motivated strategies for learning questionnaire in Italia. Giornale Italiano Ricercar Educativa 2018, 1, 115–131. [Google Scholar]
  78. Duckworth, A.L.; Quinn, P.D. Development and validation of the short grit scale (Grit–S). J. Personal. Assess. 2009, 91, 166–174. [Google Scholar] [CrossRef]
  79. Sulla, F.; Renati, R.; Bonfiglio, S.; Rollo, D. Italian students and the Grit-S: A self-report questionnaire for measuring perseverance and passion for long-term goals. In Proceedings of the 2018 IEEE International Symposium on Medical Measurements and Applications (MeMeA), Rome, Italy, 11–13 June 2018; pp. 1–5. [Google Scholar]
  80. Cooper, A.; Petrides, K.V. A psychometric analysis of the trait emotional intelligence questionnaire—Short form (TEIQue–SF) using item response theory. J. Personal. Assess. 2010, 92, 449–457. [Google Scholar] [CrossRef]
  81. Di Fabio, A.; Palazzeschi, L. Proprietà psicometriche del trait emotional intelligence questionnaire short form (TEIQue-SF) nel contesto Italiano. Counseling Giornale Italiano Ricerca Applicazioni 2011, 4, 327–336. [Google Scholar]
  82. Carleton, R.N.; Norton, M.A.P.J.; Asmundson, G.J.G. Fearing the unknown: A short version of the intolerance of uncertainty scale. J. Anxiety Disord. 2007, 21, 105–117. [Google Scholar] [CrossRef] [PubMed]
  83. Lovibond, P.F.; Lovibond, S.H. The structure of negative emotional states: Comparison of the depression anxiety stress scales (DASS) with the beck depression and anxiety inventories. Behav. Res. Ther. 1995, 33, 335–343. [Google Scholar] [CrossRef]
  84. Bottesi, G.; Ghisi, M.; Altoè, G.; Conforti, E.; Melli, G.; Sica, C. The Italian version of the depression anxiety stress scales-21: Factor structure and psychometric properties on community and clinical samples. Compr. Psychiatry 2015, 60, 170–181. [Google Scholar] [CrossRef] [PubMed]
  85. Barnard, L.; Lan, W.Y.; To, Y.M.; Paton, V.O.; Lai, S.-L. Measuring self-regulation in online and blended learning environments. Internet High. Educ. 2009, 12, 1–6. [Google Scholar] [CrossRef]
  86. Mega, C.; Moè, A.; Pazzaglia, F.; Rizzato, R.; de Beni, R. Emozioni nello studio e successo accademico. Presentazione di uno strumento. Giornale Italiano Psicologia 2007, 34, 451–464. [Google Scholar] [CrossRef]
  87. RStudio Team. RStudio: Integrated Development for R; R Studio: Boston, MA, USA, 2020. [Google Scholar]
  88. Feraco, T.; Resnati, D.; Fregonese, D.; Spoto, A.; Meneghetti, C. Soft skills and extracurricular activities sustain motivation and self-regulated learning at school. J. Exp. Educ. 2021, 1–20. [Google Scholar] [CrossRef]
  89. Zuo, J.; Zhao, X.; Nguyen, Q.B.M.; Ma, T.; Gao, S. Soft skills of construction project management professionals and project success factors: A structural equation model. ECAM 2018, 25, 425–442. [Google Scholar] [CrossRef]
  90. Rosseel, Y. Lavaan: An R package for structural equation modeling. J. Stat. Soft. 2012, 48, 1–36. [Google Scholar] [CrossRef] [Green Version]
  91. Köller, O.; Meyer, J.; Saß, S.; Baumert, J. New analyses of an old topic. Effects of intelligence and motivation on academic achievement. J. Educ. Res. Online 2019, 11, 166–189. [Google Scholar]
  92. Kuznetsova, A.; Brockhoff, P.B.; Christensen, R.H.B. LmerTest package: Tests in linear mixed effects models. J. Stat. Soft. 2017, 82, 1–26. [Google Scholar] [CrossRef] [Green Version]
  93. Pierce, M.; Hope, H.; Ford, T.; Hatch, S.; Hotopf, M.; John, A.; Kontopantelis, E.; Webb, R.; Wessely, S.; McManus, S.; et al. Mental health before and during the COVID-19 pandemic: A longitudinal probability sample survey of the UK population. Lancet Psychiatry 2020, 7, 883–892. [Google Scholar] [CrossRef]
  94. Yu, Y.; Yu, Y.; Li, B. Effects of mindfulness and meaning in life on psychological distress in Chinese university students during the COVID-19 epidemic: A chained mediation model. Asian J. Psychiatry 2020, 53, 102211. [Google Scholar] [CrossRef] [PubMed]
  95. Lazarus, R.S.; Folkman, S. Stress, Appraisal, and Coping; Springer: Cham, Switzerland, 1984. [Google Scholar]
  96. Bakhtiarvand, F.; Ahmadian, S.; Delrooz, K.; Farahani, H.A. The moderating effect of achievement motivation on relationship of learning approaches and academic achievement. Procedia Soc. Behav. Sci. 2011, 28, 486–488. [Google Scholar] [CrossRef] [Green Version]
Figure 1. The integrated self-regulated learning model.
Figure 1. The integrated self-regulated learning model.
Education 12 00101 g001
Table 1. Socio-demographic features of the sample.
Table 1. Socio-demographic features of the sample.
Socio-Demographic VariablesN (%)
Gender
Females240 (72.51%)
Males91 (27.49%)
Residence
Northern Italy295 (89.12%)
Central Italy9 (2.72%)
Southern Italy27 (8.16%)
Living situation
At home with the family286 (86.40%)
Flat with/without housemates38 (11.48%)
University residence hall7 (2.12%)
Mean year of course (SD)2.59 (1.5)
Completion of exams on time
Yes241 (85.53%)
No51 (17.47%)
Cycle of studies
Bachelor’s184 (55.59%)
Master’s97 (29.31%)
Single cycle50 (15.12%)
Area of study
Hard sciences57 (17.22%)
Health and life sciences105 (31.72%)
Humanities80 (24.17%)
Social sciences89 (26.89%)
Grades a (SD)26.6 (2.16)
Regular physical activity
Yes246 (74.32%)
No85 (25.68%)
Note. a In the Italian university system, the minimum grade is 18, the maximum 30.
Table 2. Results of the multiple regression models at T1.
Table 2. Results of the multiple regression models at T1.
PredictorsGeneral DistressOnline SRLStudy Emotions
βCIβCIβCI
Study-related aspects−0.20 **[−0.32; −0.08]0.37 ***[0.24; 0.51]0.54 ***[0.44; 0.65]
Soft skills−0.12[−0.25; 0.01]0.23 **[0.09; 0.36]0.12 *[0.01; 0.23]
Intolerance of uncertainty0.37 ***[0.29; 0.50]0.09[−0.03; 0.20]−0.15 *[−0.24; –0.06]
R2 explained36.7%26.3%51.8%
Note. SRL = self-regulated learning. β = standardized beta coefficient; CI = 95% confidence intervals. * = p < 0.05; ** = p < 0.01; *** = p < 0.001.
Table 3. Results of the two linear mixed models.
Table 3. Results of the two linear mixed models.
PredictorsGeneral DistressGrades
βCIβCI
T2−0.36 ***[−0.56; −0.16]0.07[−0.01; 0.14]
T3−0.45 ***[−0.66; −0.25]0.05[−0.03; 0.13]
T4–0.04[−0.27; 0.20]0.11 *[0.02; 0.19]
Study-related dispositions T10.03[−0.18; 0.23]0.50***[0.23; 0.77]
Soft skills T1−0.01[−0.19; 0.17]−0.19[−0.43: 0.04]
Intolerance of uncertainty T10.22 **[0.07; 0.37]0.16[−0.03; 0.35]
Online SRL T1−0.01[−0.17; 0.14]0.04[−0.16; 0.24]
Study-related emotions T1−0.42 ***[−0.61; −0.22]0.14[−0.11; 0.40]
Marginal R232.6%22.9%
95.1%
Conditional R260.4%
Note. The effect of T1 is not displayed as it serves as a reference point. T = time (treated as a categorial variable); SRL = self-regulated learning. * = p < 0.05; ** = p < 0.01; *** = p < 0.001.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Casali, N.; Ghisi, M.; Meneghetti, C. The Role of General and Study-Related Intraindividual Factors on Academic Learning Outcomes under COVID-19: A Cross-Sectional and Longitudinal Analysis. Educ. Sci. 2022, 12, 101. https://doi.org/10.3390/educsci12020101

AMA Style

Casali N, Ghisi M, Meneghetti C. The Role of General and Study-Related Intraindividual Factors on Academic Learning Outcomes under COVID-19: A Cross-Sectional and Longitudinal Analysis. Education Sciences. 2022; 12(2):101. https://doi.org/10.3390/educsci12020101

Chicago/Turabian Style

Casali, Nicole, Marta Ghisi, and Chiara Meneghetti. 2022. "The Role of General and Study-Related Intraindividual Factors on Academic Learning Outcomes under COVID-19: A Cross-Sectional and Longitudinal Analysis" Education Sciences 12, no. 2: 101. https://doi.org/10.3390/educsci12020101

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop