Next Article in Journal
Operational Implications and Risk Assessment of COVID-19 in Dental Practices
Next Article in Special Issue
In Vitro Recapitulation of Neuropsychiatric Disorders with Pluripotent Stem Cells-Derived Brain Organoids
Previous Article in Journal
Decreased Emotional Dysregulation Following Multi-Modal Motion-Assisted Memory Desensitization and Reconsolidation Therapy (3MDR): Identifying Possible Driving Factors in Remediation of Treatment-Resistant PTSD
Previous Article in Special Issue
Descriptive and Quasi-Experimental Studies about Moral Emotions, Online Empathy, Anger Management, and Their Relations with Key Competencies in Primary Education
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Factor Structure and Psychometric Properties for the PTSD Checklist of Chinese Adolescents in the Closed Period after the COVID-19 Outbreak

School of Psychology, Guizhou Normal University, Guiyang 550025, China
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2021, 18(22), 12245; https://doi.org/10.3390/ijerph182212245
Submission received: 19 October 2021 / Revised: 12 November 2021 / Accepted: 16 November 2021 / Published: 22 November 2021
(This article belongs to the Special Issue Promoting Health for Adolescents)

Abstract

:
After COVID-19 appeared in China in December 2019, the mental health of adolescents, as a vulnerable group in public health emergencies, was negatively affected by the epidemic and the unprecedented prevention and control measures. The purpose of this study was to investigate the factor structure and psychometric properties of the Posttraumatic Stress Disorder (PTSD) Checklist (PCL) among Chinese adolescents. A total of 915 participants completed the PTSD. Confirmatory factor analyses (CFAs) and multi-group CFAs were used to test the factor structure and psychometric properties of PTSD. The CFA results showed that five-factor PCL was the optimal fitting model with satisfactory reliability and validity; moreover, it was suggested that the properties of PCL were invariant across gender, PTSD and asymptomatic groups, early and late adolescents, as well as over time. In summary, PCL is applicable among Chinese adolescents and can be used for effective measurement of PTSD caused by epidemics and to conduct cross-group studies.

1. Introduction

Coronavirus disease (COVID-19) emerged in Wuhan, China, in December 2019 and grew into a pandemic by March 2020 [1,2,3]. As of 9 November 2021, there have been 126,782 COVID-19 patients and 5697 deaths related in China. Of these, 159 patients with COVID-19 and 2 deaths were in the Guizhou Province. At the time of the worst outbreak of the COVID-19, China played a metaphorical game of chess; all people were isolated at home and protested together. Early research [4,5] and recent findings [6,7] suggested that infectious disease epidemics and pandemics may be traumatic experiences for some people that may lead to post-traumatic stress disorder (PTSD) [3] and chronic psychological symptoms. Since the early days of the pandemic, public health experts have noted that the prevalence of PTSD is likely to increase in the general population [8]. Early data indicated an increase in the prevalence of PTSD and traumatic symptoms in the general population since the COVID-19 epidemic began [9,10,11]. The mental health of adolescents, as vulnerable groups in public health emergencies, was negatively affected by the COVID-19 outbreak and the unprecedented measures implemented to curb its spread [12,13]. Adolescents were at a high risk of multiple mental health problems and experienced post-traumatic stress disorder (PTSD) [14,15].
PTSD is a persistent and severe mental disorder that occurs after individuals are exposed to an unusually threatening and catastrophic event [16]. Among people who experience a traumatic injury, PTSD is one of the strongest factors associated with post-traumatic life quality and recovery, especially when compared to physically traumatized individuals without PTSD [17]. The PTSD Checklist (PCL) is one of instruments used to measurement the level of PTSD, comprising 17 items based on the fourth Diagnostic and Statistical Manual of Mental Disorder (DSM-IV) or 20 items based on Diagnostic and Statistical Manual of Mental Disorders, 5th Edition (DSM-V). Although previous studies have pointed out that the models based on DSM-V have certain evidence to support them, the symptom structure of these models is relatively dispersed, which may make the diagnosis of PTSD more extensive [16,18]. Therefore, it is of great significance to further investigate the structure of PTSD based on DSM-IV [16,19]. More importantly, the classification of symptom structures for PTSD in DSM-V is mainly influenced by the four-dimensional model of emotional numbness by King et al. (1998) and the four-dimensional model of mental distress by Simms et al. (2002) [20]. It can be seen that further investigation of the structural model of DSM-IV can provide reference for improving of the structure of PTSD symptoms in DSM-5.
For confirmation, studies have explored the factor structure of PTSD among Chinese adolescents [16,21]. However, the factor structure identified in these studies is not necessarily applicable to the assessment of trauma symptoms in adolescents under the COVID-19 context. Similar to Severe Acute Respiratory Syndromes (SARS), COVID-19 is another shocking epidemic event, but the latter has spread more widely, leading to more hospitalizations and deaths worldwide. In addition, COVID-19 continues to spread rapidly around the world, affecting more people every day in various ways (e.g., economic losses, unemployment, difficulties in obtaining important materials, increased social isolation, uncertainties about the future); therefore, the impact of the COVID-19 pandemic on mental health will be more extensive and possibly more far-reaching than the SARS epidemic [7,22]. For these reasons, if the measurements used in a context other than the one for which it they were developed, then they are likely to perform differently. It is critical to evaluate the performance of these tools in various application environments where they are used [17,23,24]. Therefore, this research aimed to explore the structure of PTSD symptoms based on DSM-IV under the COVID-19 outbreak.
Additionally, during the COVID-19 outbreak, home isolation has emerged as one of the main forms of protection; however, the prevalence of PTSD is particularly high in self-isolated populations [11,25] and previous studies have shown that increasing social support helps to reduce PTSD [3,26]. Compared with resilient responders, patients with PTSD have significantly higher levels of dysfunction within 2 years after injury [27]. This effect was demonstrated to be significant for 6 years after the injury, with residual dysfunction even after symptom relief [17,27]. In addition to the external factors mentioned above, gender difference is also one of the demographic factors that scholars pay the most attention to. Numerous studies have shown that there is a lower incidence of PTSD in males than females [3,7,22,28,29,30,31]. It is true that previous studies have obtained many intentional conclusions, but it is not clear whether the explanation of these conclusions is valid. Therefore, it is necessary to test the invariance of PCL for assessing PTSD. Additionally, according to the age classification of the World Health Organization [32], adolescents are 10–19 years old: early adolescents are 10–14 years old and late adolescents are 15–19 years old. On the basis of previous research theories, the current study also divided the participants into groups to explore the measurement invariance of PCL in early and late adolescents and to provide a strong basis for the comparative study of PTSD in early and late adolescents.

The Current Study

The aims of the current study were to examine the factor structure and psychometric properties of the PTSD in mainland Chinese adolescents. First, we discuss the optimal factor structure of PCL through confirmatory factor analyses (CFAs). In this process, the models we tested include: The single-factor model (M1) [33]; the two-factor model (M2) [34]; the three-factor model (M3) [35]; the four-factor emotional numbing PTSD model (M4a) [36]; the four-factor dysphoria PTSD model (M4b) [37]; at the same time, we also tested the second-order factor structure of the emotional numbing PTSD model (M5a) and the dysphoria PTSD model (M5b), that is, adding a second-order factor to the M4a,b models; and the dysphoric arousal model (M6) [38]. As shown in previous studies, we assumed that the five-factor model was the optimal model.
Furthermore, the reliability of the optimal factor structure based on CFAs was also examined, including the internal consistency coefficient (Cronbach’s α) of potential factors [39], the scalability of dimensions (Loevinger’s H) [40], and consistency between items and dimensions (Hj-min) [40]. In addition, the convergent and discriminant validities of five-factor PCL were determined through the examination of a correlation matrix; the elements of this matrix were the correlation coefficients between items and rest scores [40].
Finally, we tested the measurement invariance (MI) of PCL. MI is a statistical property that determined whether the items used in a questionnaire had the same meaning for different groups of participants. If MI cannot be established, the mean difference in observed values between groups cannot be directly explained [41]. This makes it difficult to draw conclusions about traditionally observed mean differences in various aspects, including cross-sectional study (e.g., sex) and longitudinal study (mainly referring to different time groups) [42,43]. Based on the existing theoretical basis, we explored the MI of PCL across gender, symptomatic and asymptomatic groups, early and late adolescents; additionally, the longitudinal measurement invariance was also tested.

2. Methods

2.1. Participants

In September 2020, cluster sampling was used and the participants in current study were from 6 schools in Guizhou, China. A total of 915 adolescents participated in the study. Their ages ranged from 11 to 18 years (age was not reported for 3 of the participants, who were coded as missing) and the mean age was 14.19 years (SD = 1.29); 476 (52%) participants were boys and 439 (48%) were girls. Three months later, students from 2 of the 6 schools were tested for the second time, and 300 valid questionnaires were collected. An independent sample t-test showed that there was no significant difference in the total score of PCL at the first time point (T1) between the participants and dropouts at the second time point (T2) (t = −0.03, p = 0.97), indicating that the sample loss at T2 was random.

2.2. Instruments

Posttraumatic Stress Disorder (PTSD) Checklist (PCL). The PCL was developed based on DSM-IV with 17 items [44]. As it has previously been translated by domestic scholars [45,46], it was not translated in present study. For each item, participants were asked to indicate how much they had been disturbed by each symptom in the past month on a 5-point Likert scale ranging from 1 (“never”) to 5 (“extremely”). The PCL total score (the total score for the 17 items) ranged from 17 to 85. A higher score indicates a higher level of PTSD, and a score of 38 or higher is considered likely to indicate PTSD [47,48]. The internal consistency coefficient of the scale was 0.92.

2.3. Procedure

We obtained consent from the participants’ guardian and school leaders before the study began; indeed, after we told principals the purpose of our study, strictly abided by the principle of confidentiality, and helped the school screen the students’ mental health problems, we were unanimously recognized by principals. Subsequently, the teachers of each class informed the parents of the survey through the home–school cooperative Wechat group. The participants were required to sign an informed consent form before they completed the paper-and-pencil questionnaire in the classroom and the researcher collected the questionnaires uniformly, which took about 15–20 min. After the questionnaires were collected, EpiData 3.1 (The EpiData Association, Denmark, Europe) was used to build the database, and two researchers entered the data independently. The current study was conducted in line with the Helsinki Declaration of Ethical Principles and was approved by the Committee of the School of Psychology of Guizhou Normal University.

2.4. Analytical Plan

First, descriptive statistics of the whole scale were performed by STATA/SE 13.1 (StataCorp LLC, College Station, TX, USA) [49]. Second, a series of CFAs were conducted through MPLUS 8.3 (The National Institute on Alcohol Abuse and Alcoholism, National Institutes of Health, Los Angeles, CA, USA) [50] to test and compare the PTSD model mentioned above. The skewness and kurtosis values of some items were out of the acceptable range (skewness ± 3.00, kurtosis ± 8.00), indicating that the sample distribution was non-normal [51]; therefore, the mean adjusted maximum likelihood estimator (MLM) estimation method was used for data processing in this study [52].
In this study, the following indicators were used to evaluate the model fitting: root mean square error of approximation (RSMEA); standardized root mean square residual (SRMR); the Tucker–Lewis index (TLI); comparative fit index (CFI); Akaike information criterion (AIC), and Bayesian information criterion (BIC). Generally speaking, for CFI and TLI, values greater than 0.90 and 0.95 are considered to reflect acceptable and optimal fit to the data, respectively. For RMSEA, values less than 0.08 and 0.06 were regarded as reasonable and best fitting indices for the data, respectively [53] An SRMR value of less than 0.08 indicates a good fit of the model [54]. For non-nested models, the BIC difference is compared to judge the model’s advantages and disadvantages. If the difference of BIC between two non-nested models is greater than 10, it indicates that there is a large difference between the two models. At this time, the model with a smaller BIC value should be selected as the optimal model [55].
In accordance with previous guidelines, the αs were interpreted as follows: α < 0.60 (unacceptable), α = 0.60–0.65 (undesirable), α = 0.65–0.70 (minimally acceptable), α = 0.70–0.80 (respectable), α = 0.80–0.90 (excellent), and α > 0.90 (excessive consistency) [56]. Moreover, the Loevinger’s H coefficient of the subscales of >0.30 suggests satisfactory scalability, and an Hj-min of >0.30 indicates that items might be consistent with the subscale [40]. Meanwhile, Perrot et al. (2018) point out that elements on the diagonal greater than 0.40 suggest there is convergent validity, while off-diagonal values greater than the values on the diagonal demonstrate a lack of divergent validity.
Subsequently, the entire sample was used to examine the MI across gender, the MI across symptomatic and asymptomatic groups, early adolescents and late adolescents, as well as the longitudinal MI. The diagnostic cutoff point of 38 points was used as the cutoff point for those with and without symptoms of PTSD. In this study, 761 (83.20%) participants scored less than 38, and 154 (16.80%) participants scored greater than or equal to 38. Additionally, we analyzed the frequency of age and found that there were too few participants of several ages to be representative, so we considered removing them (12 participants were excluded). Then, the remaining 903 participants were divided into two groups: early adolescence (N = 436) and late adolescence (N = 467). MI was established through a multi-group CFA (MGCFA) common stage framework [57], including: (a) configural invariance (e.g., no parameters are set to be equal across groups), (b) weak invariance (e.g., factor loadings are allowed to be equal across groups), (c) scalar invariance (e.g., the factor loadings and intercepts are allowed to be equal across groups), and (d) strict invariance (e.g., the factor loadings, intercepts, and unique factor variances are allowed to be equal across groups) [57]. A more rigorous model test was performed only if the previous measurement model was satisfied. Specifically, before the MI test, we carried out a single test (e.g., male and female groups; participants with PTSD symptoms and those without PTSD symptoms; early adolescents and late adolescents, as well as those who were measured twice). For nested models, the equivalent model was considered acceptable when ∆CFI ≤ 0.01 and ∆TLI ≤ 0.01 [41].

3. Results

3.1. Descriptive Statistics

Before exploring the factor structure, the descriptive statistical analysis of the total sample was prepared, as presented in Table 1. As can be seen, there was a reasonable amount of dispersion in the study variables. The mean PTSD mean score was 27.44 and the SD was 11.24. The reexperiencing (R) subscale had a mean of 7.90 with a SD of 3.84; Avoidance (A) had a mean value of 3.06 and a SD of 1.76. Numbing (N) had a mean of 7.47 with a SD of 3.34. Dysphoric arousal (DA) evidenced a mean of 5.14 with a SD of 2.71. The anxious arousal (AA) in PTSD had a mean of 3.86 and an SD of 2.30.

3.2. Factor Structure of the PTSD

As indicated in Table 2, the 17-item model fit indices for the single-factor model (M1), the two-factor model (M2), the three-factor model (M3) were poor; the model fitting indices (CFIs and TLIs) were not up to standard. All the other models (M4a, M4b, M5a, M5b, M6) reached the fitting standard; the fitting indices of M6 were better than that of other models (MLM χ2 = 375.76, df = 109, CFI = 0.97, TLI = 0.96, RMSEA = 0.05, SRMR = 0.03, AIC = 34,680.28, BIC = 34,974.24), with the smallest values of AIC and BIC, and the ratio of ΔBIC of the non-nested models was greater than 10. The factor loading of the five-factor Dysphoric Arousal model detail in Figure 1, and follow-up studies were based on this model.
At the same time, we also examined the reliability and validity of the latent factor structure. Cronbach’s alpha was greater than 0.70, and Loevinger’s H and Hj-min were greater than 0.30. Additionally, the correlations between an item and the rest score of its dimension was greater than 0.40, and the correlation between the item and the dimension that was not part of itself was smaller than that of the dimension to which it belonged (see Table 3).

3.3. Measurement Invariance

MI across gender of the five-factor PCL was examined in the total sample. First, model fits were examined for male and female participants respectively, and all model fitting indices were adequate. For all invariance testing, the model fitting indices were satisfactory (e.g., CFI, TLI > 0.90, and RMSEA, SRMR < 0.08, ΔCFI and ΔTLI < 0.01). Overall, results suggested that the PCL scores were invariant across gender of adolescents (see Table 4).
MI across participants with PTSD symptoms and those without PTSD symptoms of the five-factor PCL was examined. First, model fits were examined separately for with or without PTSD symptoms reports, and satisfactory model fitting results were obtained. For the three invariance models, the fit indices were adequate (e.g., CFI, TLI > 0.90, and RMSEA, SRMR < 0.08, ΔCFI and ΔTLI < 0.01). All in all, results suggested that the PCL scores were invariant across with or without PTSD symptoms of adolescents (see Table 4).
MI across early adolescents and late adolescents of the five-factor PCL was examined. Firstly, model fits were examined separately for early adolescents and late adolescents, satisfactory model fitting results are obtained. For all the invariance models, the fit indices were adequate (e.g., CFI, TLI > 0.90, and RMSEA, SRMR < 0.08, ΔCFI and ΔTLI < 0.01). In a word, findings demonstrated that the PCL scores were invariant across early adolescents and late adolescents of adolescents (see Table 4).
MI across different time group of the five-factor PCL was examined with data from repeated measurements. Indeed, model fits were examined respectively for the participants participated in this study for the T1 and who participated in this study for the T2, and the results indicated that the model fitting was satisfactory (e.g., CFI, TLI > 0.90, and RMSEA, SRMR < 0.08, ΔCFI and ΔTLI < 0.01). In conclusion, the results revealed that the PCL scores were invariant across time for adolescents, as detailed in Table 4.

4. Discussion

This is the first study to examine the factor structure and psychometric properties of the PCL in a sample of adolescents from mainland China under the COVID-19 outbreak. Through CFAs, we found that the five-factor model of PCL was the best fit. The reliability and validity of this factor model were proved to be satisfactory. Most importantly, the MI results indicated that the optimal five-factor PCL had strict invariance across gender and early and late adolescents and strong invariance across the with or without PTSD symptom group and longitudinal MI of adolescents.
As expected, the five-factor model had the optimal fit. First, in terms of model fitting, the three models M1–3 failed to meet the fitting standards. Although the four models M4a–M5b reached satisfactory fitting standards (CFI, TLI > 0.90, RMSEA, SRMR < 0.80), the AIC and BIC values of these models were not the smallest. Relatively speaking, the five-factor model was an optimal fit to the data (CFI, TLI > 0.95, RMSEA < 0.6, SRMR < 0.80) [53], which is consistent with the results of previous studies [16,38,58]. Second, from a theoretical point of view, the five-factor theory is also more convincing. In the emotional numbness model [36], D1–D3 symptoms are placed in the hyperarousal factor, which is different from the dysphoria model [37] where D1–D3 symptoms were placed in the dysphoria factor. However, it can be argued that D1–D3 symptoms are conceptually distinct in hyperarousal and anxiety disorders. Importantly, the five-factor model has the advantage of combining the mixed findings that typically occur in modern PTSD CFA research, with some finding support for the emotional numbness model and others finding support for the dysphoria model [38].
The Cronbach alpha for the PTSD was high both on the total scale and its subscale, all of them greater than 0.70; there was good-to-excellent reliability [56], which supported the results of previous studies [38]. Loevinger’s H coefficients for the five subscales were >0.30, which demonstrated good scalability. Meanwhile, the Hj-min coefficients were greater than 0.30, indicating that there was good consistency between the items and the dimensions. Additionally, the elements in the correlation matrix suggested that there was good convergent and discriminant validity [40].
Since few previous studies have directly and comprehensively tested the measurement invariance of PCL [59], further research on this topic was needed to determine the feasibility of our findings in different groups, such as gender, with or without PTSD symptom, early and late adolescents, as well as over time. The analysis of measurement invariance also provided some useful insights into the measurement characteristics of PTSD. Strict invariance of PTSD across gender, early and late adolescents were observed for all five sub-scales; the fitting indices of CFI and TLI were more than 0.90, RMSEA and SRMR were less than 0.08 for all models, and the comparison results of all nested models showed that ΔCFI and ΔTLI were less than 0.01, indicating that the scores of these five sub-scales could be interpreted in the same way for both male and female, early and late adolescents, and the difference in test performance among different groups was due to the difference of potential variables, not the difference caused by artificial factors [60]. Similarly, we also found that PCL had strong invariance between PTSD symptoms and asymptomatic individuals, as well as at different time points. It can be seen that group variables did not affect the effectiveness of the questionnaire in measuring individuals’ PTSD. The above measurement invariance conclusions showed that in practice and research, we can compare the differences between the symptomatic and asymptomatic groups, and the specific changes in PTSD symptoms of the same individual over time. In conclusion, the current findings showed that PCL was suitable for Chinese adolescents, provided a solid theoretical basis guidance for empirical research and practice, and should convince researchers and educators to use this tool to measure and explain PTSD.

5. Conclusions

COVID-19 has caused great harm to people’s physical and mental health, and of those affected have PTSD. The current research results indicated that PCL can be used effectively to evaluate the PTSD caused by COVID-19 in Chinese adolescents. Specifically, PCL has a satisfactory factor structure, and the five-factor dysphoric arousal model is stable, with satisfactory reliability and validity. In addition, the five-factor model achieved strict invariance between gender, early and late adolescents, and strong invariance between PTSD groups and asymptomatic groups, as well as longitudinal invariance. The PCL has good psychometric properties in Chinese adolescents under the COVID-19 outbreak.

Author Contributions

W.C., conceptualization, data curation, validation and supervision. R.G., investigation, formal analysis, writing-original draft preparation and editing. T.Y., investigation. All authors have read and agreed to the published version of the manuscript.

Funding

This study was funded by Natural Science Research Funding Project of Department of Education Guizhou Province (Grant No. Qian Ke He KY Zi[2021]299), Guizhou Education Reform and Development Research Major Project (ZD202009), Guizhou is the Phased Achievement of Philosophy and Social Science Planning Project (21GZZD45) and Research Project of Humanities and Social Sciences in Colleges and Universities of Guizhou Provincial Department of Education(2022ZD006).

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

This paper provides the data in this study.

Acknowledgments

We would like to thank anonymous commentators for their useful suggestions and feedback.

Conflicts of Interest

The authors states that there is no conflict of interest.

References

  1. Chang, M.C.; Lee, W.; Hur, J.; Park, D. Chest Computed Tomography Findings in Asymptomatic Patients with COVID-19. Respiration 2020, 99, 748–754. [Google Scholar] [CrossRef]
  2. Chang, M.; Baek, J.; Park, D. Lessons from South Korea Regarding the Early Stage of the COVID-19 Outbreak. Healthcare 2020, 8, 229. [Google Scholar] [CrossRef] [PubMed]
  3. Chang, M.; Park, D. Incidence of Post-Traumatic Stress Disorder After Coronavirus Disease. Healthcare 2020, 8, 373. [Google Scholar] [CrossRef] [PubMed]
  4. Hong, X.; Currier, G.W.; Zhao, X.; Jiang, Y.; Zhou, W.; Wei, J. Posttraumatic stress disorder in convalescent severe acute respiratory syndrome patients: A 4-year follow-up study. Gen. Hosp. Psychiatry 2009, 31, 546–554. [Google Scholar] [CrossRef] [PubMed]
  5. Mak, I.W.C.; Chu, C.M.; Pan, P.C.; Yiu, M.G.C.; Ho, S.C.; Chan, V.L. Risk factors for chronic post-traumatic stress disorder (PTSD) in SARS survivors. Gen. Hosp. Psychiatry 2010, 32, 590–598. [Google Scholar] [CrossRef]
  6. Liu, N.; Zhang, F.; Wei, C.; Jia, Y.; Shang, Z.; Sun, L.; Wu, L.; Sun, Z.; Zhou, Y.; Wang, Y.; et al. Prevalence and predictors of PTSS during COVID-19 outbreak in China hardest-hit areas: Gender differences matter. Psychiatry Res. 2020, 287, 112921. [Google Scholar] [CrossRef]
  7. Boyraz, G.; Legros, D.N. Coronavirus Disease (COVID-19) and Traumatic Stress: Probable Risk Factors and Correlates of Posttraumatic Stress Disorder. J. Loss Trauma 2020, 25, 503–522. [Google Scholar] [CrossRef]
  8. Horesh, D.; Brown, A.D. Traumatic stress in the age of COVID-19: A call to close critical gaps and adapt to new realities. Psychol. Trauma Theory Res. Pract. Policy 2020, 12, 331–335. [Google Scholar] [CrossRef]
  9. Bo, H.-X.; Li, W.; Yang, Y.; Wang, Y.; Zhang, Q.; Cheung, T.; Wu, X.; Xiang, Y.-T. Posttraumatic stress symptoms and attitude toward crisis mental health services among clinically stable patients with COVID-19 in China. Psychol. Med. 2020, 51, 1052–1053. [Google Scholar] [CrossRef] [Green Version]
  10. Karatzias, T.; Shevlin, M.; Murphy, J.; Mcbride, O.; Ben-Ezra, M.; Bentall, R.P.; Vallières, F.; Hyland, P. Posttraumatic SO-VID-19 Pandemic in Ireland: A Population-Based Study. J. Trauma Stress 2020, 33, 365–370. [Google Scholar] [CrossRef]
  11. Haderlein, T.P.; Wong, M.S.; Yuan, A.; Llorente, M.D.; Washington, D.L. Association of PTSD with COVID-19 testing and infection in the Veterans Health Administration. J. Psychiatr. Res. 2020, 143, 504–507. [Google Scholar] [CrossRef]
  12. Guessoum, S.B.; Lachal, J.; Radjack, R.; Carretier, E.; Minassian, S.; Benoit, L.; Moro, M.R. Adolescent psychiatric disorders during the COVID-19 pandemic and lockdown—ScienceDirect. Psychiat Res. 2020, 291, 113264. [Google Scholar] [CrossRef] [PubMed]
  13. Liu, J.J.; Bao, Y.; Huang, X.; Shi, J.; Lu, L. Mental health considerations for children quarantined because of COVID-19. Lancet Child Adolesc. Health 2020, 4, 347–349. [Google Scholar] [CrossRef] [Green Version]
  14. Vindegaard, N.; Benros, M.E. COVID-19 pandemic and mental health consequences: Systematic review of the current evidence. Brain Behav. Immun. 2020, 89, 531–542. [Google Scholar] [CrossRef] [PubMed]
  15. Li, Y.; Duan, W.; Chen, Z. Latent Profiles of the Comorbidity of Post-traumatic Stress Disorder and Generalized Anxiety Disorder among Children and Adolescents who are Potentially Infected with COVID-19. Child Youth Serv. Rev. 2020, 116, 105235. [Google Scholar] [CrossRef]
  16. Zhou, X.; Wu, X.C.; An, Y.Y.; Lin, C.D. Assessing the Latent Structure of PTSD among Chinese Adolescent after Earthquake. Psychol. Dev. Educ. 2017, 33, 206–215. [Google Scholar] [CrossRef]
  17. Geier, T.J.; Hunt, J.C.; Hanson, J.L.; Heyrman, K.; Deroon-Cassini, T.A. Validation of Abbreviated Four- and Eight-Item Versions of the PTSD Checklist for DSM-5 in a Traumatically Injured Sample: Abbreviated PCL-5 Validation in Traumatic Injury. J. Trauma Stress 2020, 33, 218–226. [Google Scholar] [CrossRef]
  18. Pietrzak, R.H.; Tsai, J.; Armour, C.; Mota, N.; Harpaz-Rotem, I.; Southwick, S.M. Functional significance of a novel 7-factor model of DSM-5 PTSD symptoms: Results from the National Health and Resilience in Veterans Study. J. Affect. Disord. 2015, 174, 522–526. [Google Scholar] [CrossRef]
  19. Boasso, A.M.; Steenkamp, M.M.; Fox, A.B.; Nash, W.P.; Larson, J.L.; Litz, B.T. The structure of PTSD in active-duty marines across the deployment cycle. Psychol. Trauma Theory Res. Pract. Policy 2016, 8, 127–134. [Google Scholar] [CrossRef]
  20. Armour, C.; Műllerová, J.; Elhai, J.D. A systematic literature review of PTSD’s latent structure in the Diagnostic and Statistical Manual of Mental Disorders: DSM-IV to DSM-5. Clin. Psychol. Rev. 2016, 44, 60–74. [Google Scholar] [CrossRef]
  21. Zhou, X.; Wu, X.; Zhen, R. Assessing the latent structure of DSM-5 PTSD among Chinese adolescents after the Ya’an earthquake. Psychiatry Res. 2017, 254, 33–39. [Google Scholar] [CrossRef]
  22. Yue, J.; Zang, X.; Le, Y.; An, Y. Anxiety, depression and PTSD among children and their parent during 2019 novel corona-virus disease (COVID-19) outbreak in China. Curr. Psychol. 2020, 14, 1–8. [Google Scholar]
  23. Brennan, C.; Worrall-Davies, A.; Mcmillan, D.; Gilbody, S.; House, A. The Hospital Anxiety and Depression Scale: A di-agnostic meta-analysis of case-finding ability. J. Psychosom. Res. 2010, 69, 371–378. [Google Scholar] [CrossRef] [PubMed]
  24. Hinz, A.; Brähler, E. Normative values for the hospital anxiety and depression scale (HADS) in the general German population. J. Psychosom. Res. 2011, 71, 74–78. [Google Scholar] [CrossRef] [PubMed]
  25. Wu, L.; Guo, X.; Shang, Z.; Sun, Z.; Jia, Y.; Sun, L.; Liu, W. China experience from COVID-19: Mental health in mandatory quarantine zones urgently requires intervention. Psychol. Trauma Theory Res. Pract. Policy 2020, 12, S3–S5. [Google Scholar] [CrossRef] [PubMed]
  26. Mowbray, H. In Beijing, coronavirus 2019-nCoV has created a siege mentality. BMJ 2020, 368, m516. [Google Scholar] [CrossRef] [Green Version]
  27. Bryant, R.A.; Nickerson, A.; Creamer, M.; O’Donnell, M.; Forbes, D.; Galatzer-Levy, I.; McFarlane, A.C.; Silove, D. Trajectory of post-traumatic stress following traumatic injury: 6-year follow-up. Br. J. Psychiatry 2015, 206, 417–423. [Google Scholar] [CrossRef] [Green Version]
  28. Gelaye, B.; Zheng, Y.; Medina-Mora, M.E.; Rondon, M.B.; Sánchez, S.E.; Williams, M.A. Validity of the posttraumatic stress disorders (PTSD) checklist in pregnant women. BMC Psychiatry 2017, 17, 1–10. [Google Scholar] [CrossRef]
  29. Qiu, J.; Shen, B.; Zhao, M.; Wang, Z.; Xie, B.; Xu, Y. A nationwide survey of psychological distress among Chinese people in the COVID-19 epidemic: Implications and policy recommendations. Gen. Psychiatry 2020, 33, e100213. [Google Scholar] [CrossRef] [Green Version]
  30. Hamam, A.A.; Milo, S.; Mor, I.; Shaked, E.; Eliav, A.S.; Lahav, Y. Peritraumatic reactions during the COVID-19 pandemic—The contribution of posttraumatic growth attributed to prior trauma. J. Psychiatr. Res. 2021, 132, 23–31. [Google Scholar] [CrossRef]
  31. Alshehri, F.S.; Alatawi, Y.; Alghamdi, B.S.; Alhifany, A.A.; Alharbi, A. Prevalence of post-traumatic stress disorder during the COVID-19 pandemic in Saudi Arabia. Saudi Pharm. J. 2020, 28, 1666–1673. [Google Scholar] [CrossRef] [PubMed]
  32. World Health Organization. Global Accelerated Action for the Health of Adolescents (AA-HA!): Guidance to Support Country Implementation: Brochure, 2017. Available online: https://apps.who.int/iris/handle/10665/255416 (accessed on 16 November 2021).
  33. Wang, M.C.; Dai, X.Y.; Wan, J. Factor Structure of PTSD Checklist: A Confirmatory Factor Analysis Study in Adolescents from Earthquake Region. Chin. J. Clin. Psychol. 2009, 17, 420–423. [Google Scholar]
  34. Taylor, S.; Kuch, K.; Koch, W.J.; Crockett, D.J.; Passey, G. The structure of posttraumatic stress symptoms. J. Abnorm. Psychol. 1998, 107, 154–160. [Google Scholar] [CrossRef]
  35. Cordova, M.J.; Studts, J.L.; Hann, D.M.; Jacobsen, P.B.; Andrykowski, M.A. Symptom structure of PTSD following breast cancer. J. Trauma. Stress 2000, 13, 301–319. [Google Scholar] [CrossRef]
  36. King, D.W.; Leskin, G.A.; King, L.A.; Weathers, F.W. Confirmatory factor analysis of the clinician-administered PTSD Scale: Evidence for the dimensionality of posttraumatic stress disorder. Psychol. Assess. 1998, 10, 90–96. [Google Scholar] [CrossRef]
  37. Simms, L.J.; Watson, D.; Doebbelling, B.N. Confirmatory factor analyses of posttraumatic stress symptoms in deployed and nondeployed veterans of the Gulf War. J. Abnorm. Psychol. 2002, 111, 637. [Google Scholar] [CrossRef] [PubMed]
  38. Elhai, J.D.; Biehn, T.L.; Armour, C.; Klopper, J.J.; Frueh, B.C.; Palmieri, P.A. Evidence for a unique PTSD construct represented by PTSD’s D1-D3 symptoms. J. Anxiety Disord. 2011, 25, 340–345. [Google Scholar] [CrossRef]
  39. Cronbach, L.J.; Shavelson, R.J. My Current Thoughts on Coefficient Alpha and Successor Procedures. Educ. Psychol. Meas. 2004, 64, 391–418. [Google Scholar] [CrossRef]
  40. Perrot, B.; Bataille, E.; Hardouin, J.-B. validscale: A Command to Validate Measurement Scales. Stata J. Promot. Commun. Stat. Stata 2018, 18, 29–50. [Google Scholar] [CrossRef]
  41. Cheung, G.W.; Rensvold, R.B. Evaluating Goodness-of-Fit Indexes for Testing Measurement Invariance. Struct. Equ Modeling 2002, 9, 233–255. [Google Scholar] [CrossRef]
  42. Church, A.T.; Alvarez, J.M.; Mai, N.T.; French, B.F.; Katigbak, M.S.; Ortiz, F.A. Are cross-cultural comparisons of per-sonality profiles meaningful? Differential item and facet functioning in the Revised NEO Personality Inventory. J. Pers. Soc. Psychol. 2011, 101, 1068–1089. [Google Scholar] [CrossRef] [PubMed]
  43. Shchebetenko, S.; Kaлyrин, A.Y.; Mishkevich, A.M.; Soto, C.J.; John, O.P. Measurement Invariance and Sex and Age Differences of the Big Five Inventory–2: Evidence from the Russian Version. Assessment 2019, 27, 472–486. [Google Scholar] [CrossRef] [PubMed]
  44. Weathers, F.W.; Litz, B.T.; Herman, D.S.; Huska, J.A.; Keane, T.M. The PTSD Checklist: Reliability, Validity and Diagnostic Utility. Presented at the Meeting of the International Society for Traumatic Stress Studies, San Antonio, TX, USA, October 1993; Available online: https://istss.org/clinical-resources/assessing-trauma/ptsd-checklist-dsm-5/ptsd-checklist-dsm-iv (accessed on 18 October 2021).
  45. Liu, A.; Tan, H.; Zhou, J.; Li, S.; Yang, T.; Sun, Z.; Wen, S.W. Brief Screening Instrument of Posttraumatic Stress Disorder for Children and Adolescents 7–15 Years of Age. Child Psychiatry Hum. Dev. 2007, 38, 195–202. [Google Scholar] [CrossRef] [PubMed]
  46. Ying, L.-H.; Wu, X.-C.; Lin, C.-D. Longitudinal linkages between depressive and posttraumatic stress symptoms in adolescent survivors following the Wenchuan earthquake in China: A three-wave, cross-lagged study. Sch. Psychol. Int. 2012, 33, 416–432. [Google Scholar] [CrossRef]
  47. Dobie, D.J.; Kivlahan, D.R.; Maynard, C.; Bush, K.R.; McFall, M.; Epler, A.J.; A Bradley, K. Screening for post-traumatic stress disorder in female Veteran’s Affairs patients: Validation of the PTSD checklist. Gen. Hosp. Psychiatry 2002, 24, 367–374. [Google Scholar] [CrossRef]
  48. Tang, W.; Hu, T.; Hu, B.; Jin, C.; Wang, G.; Xie, C.; Chen, S.; Xu, J. Prevalence and correlates of PTSD and depressive symptoms one month after the outbreak of the COVID-19 epidemic in a sample of home-quarantined Chinese university students. J. Affect. Disord. 2020, 274, 1–7. [Google Scholar] [CrossRef]
  49. StataCorp. Stata/MP 13.1 for Windows; StataCorp LP: College Station, TX, USA, 2013. [Google Scholar]
  50. Muthén, L.K.; Muthén, B.O. Mplus User’s Guide; Muthén & Muthén: Los Angeles, CA, USA, 2017. [Google Scholar]
  51. Kline, R.B. Principles and Practice of Structural Equation Modeling, 3rd ed.; The Guilford Press: New York, NY, USA, 2011. [Google Scholar]
  52. Satorra, A.; Bentler, P.M. A scaled difference chi-square test statistic for moment structure analysis. Psychometrika 2001, 66, 507–514. [Google Scholar] [CrossRef] [Green Version]
  53. Marsh, H.W.; Hau, K.T.; Wen, Z. In Search of Golden Rules: Comment on Hypothesis-Testing Approaches to Setting Cutoff Values for Fit Indexes and Dangers in Overgeneralizing Hu and Bentler’s (1999) Findings. Struct. Equ. Modeling 2004, 11, 320–341. [Google Scholar] [CrossRef]
  54. Hu, L.; Bentler, P.M. Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Struct Equ. Modeling 1999, 6, 1–55. [Google Scholar] [CrossRef]
  55. Raftery, A.E. Bayesian model selection in social research. Sociol. Methodol. 1995, 25, 111–163. [Google Scholar] [CrossRef]
  56. Peterson, R.A. A Meta-analysis of Cronbach’s Coefficient Alpha. J. Consum. Res. 1994, 21, 381–391. [Google Scholar] [CrossRef]
  57. Vandenberg, R. Toward a Further Understanding of and Improvement in Measurement Invariance Methods and Procedures. Organ. Res. Methods 2002, 5, 139–158. [Google Scholar] [CrossRef]
  58. Wang, L.; Cao, C.; Wang, R.; Zhang, J.; Li, Z. The dimensionality of PTSD symptoms and their relationship to health-related quality of life in Chinese earthquake survivors. J. Anxiety Disord. 2012, 26, 711–718. [Google Scholar] [CrossRef] [PubMed]
  59. Boal, A.L.; Vaughan, C.A.; Sims, C.S.; Miles, J.N.V. Measurement invariance across administration mode: Examining the Posttraumatic Stress Disorder (PTSD) Checklist. Psychol. Assess. 2017, 29, 76–86. [Google Scholar] [CrossRef] [PubMed]
  60. Cheung, G.W. Testing Factorial Invariance across Groups: A Reconceptualization and Proposed New Method. J. Manag. 1999, 25, 1–27. [Google Scholar] [CrossRef]
Figure 1. Factor loading of the five-factor PCL. R = reexperiencing; A = avoidance; N = numbing; DA = dysphoric arousal; AA = anxious arousal.
Figure 1. Factor loading of the five-factor PCL. R = reexperiencing; A = avoidance; N = numbing; DA = dysphoric arousal; AA = anxious arousal.
Ijerph 18 12245 g001
Table 1. Descriptive statistics of PTSD Checklist (N = 915).
Table 1. Descriptive statistics of PTSD Checklist (N = 915).
ItemsMinMaxMSDM6SkewnessKurtosis
pcl1. Intrusive thoughts151.821.01RM ± SD = 7.90 ± 3.841.334.37
pcl2. Nightmares151.360.782.6910.84
pcl3. Reliving trauma151.651.021.635.03
pcl4. Emotional cue reactivity151.751.041.514.80
pcl5. Physiological cue reactivity151.320.732.8712.04
pcl6. Avoidance of thoughts151.540.93AM ± SD = 3.06 ± 1.761.906.21
pcl7. Avoidance of reminders151.520.921.996.64
pcl8. Trauma-related amnesia151.470.80NM ± SD = 7.47 ± 3.341.886.64
pcl9. Loss of interest151.400.812.288.18
pcl10. Feeling detached151.550.911.856.14
pcl11. Feeling numb151.561.011.986.24
pcl12. Hopelessness151.490.942.137.07
pcl13. Difficulty sleeping151.621.05DAM ± SD = 5.14 ± 2.711.845.65
pcl14. Irritable/angry151.761.101.484.33
pcl15. Difficulty concentrating151.771.071.414.27
pcl16. Overly alert151.931.25AAM ± SD = 3.86 ± 2.301.223.33
pcl17. Easily startled151.931.221.213.41
PCL178527.4411.24---
M6 = Dysphoric Arousal Model; PCL = Posttraumatic Stress Disorder (PTSD) Checklist; R = reexperiencing; A = avoidance; N = numbing; DA = dysphoric arousal; AA = anxious arousal.
Table 2. Confirmatory factor analyses model fit statistics of the PCL.
Table 2. Confirmatory factor analyses model fit statistics of the PCL.
ModelMLM χ2dfCFITLIRMSEASRMRAICBICΔBIC
M11286.481190.730.690.100.0936,823.2337,069.00
M2606.021180.890.870.070.0535,468.5435,719.13−1349.87
M3698.101160.870.840.070.0635,661.6535,921.87202.74
M4a575.681130.950.940.070.0434,872.2135,146.89−774.98
M4b501.191130.960.950.060.0434,797.7235,072.40−74.49
M5a777.021150.920.910.080.0635,069.5535,334.59262.19
M5b701.701150.930.920.080.0634,994.2335,259.27−75.32
M6375.761090.970.960.050.0334,680.2834,974.24−285.03
M1 = Unidimensional; M2 = Two-factor model; M3 = DSM-IV; M4a = emotional numbing model; M4b = dysphoria model; M5a = second-order emotional numbing model; M5b = second-order dysphoria model; M6 = dysphoric arousal model.
Table 3. Reliability and validity statistics of five-factor PCL.
Table 3. Reliability and validity statistics of five-factor PCL.
ItemsRANDAAA
α0.890.900.800.790.84
H0.530.550.500.560.52
Hj-min0.640.820.340.540.74
pcl10.750.580.420.390.35
pcl20.730.550.450.430.34
pcl30.760.560.470.460.41
pcl40.770.620.420.440.40
pcl50.670.520.470.460.33
pcl60.640.810.470.400.40
pcl70.650.810.510.440.42
pcl80.310.340.400.350.29
pcl90.400.400.610.530.43
pcl100.430.440.650.510.46
pcl110.450.400.650.620.50
pcl120.360.340.600.580.47
pcl130.400.350.560.570.51
pcl140.460.400.580.670.58
pcl150.450.360.620.670.57
pcl160.430.410.560.640.73
pcl170.390.400.520.590.73
R = reexperiencing; A = avoidance; N = numbing; DA = dysphoric arousal; AA = anxious arousal.
Table 4. Measurement invariance model fit statistics for the PCL.
Table 4. Measurement invariance model fit statistics for the PCL.
ModelMLM χ2dfCFITLIRMSEASRMRAICBICΔCFIΔTLI
Across Gender
Female185.471090.970.960.040.0416,340.8716,590.03
Male138.871090.990.980.020.0318,326.4518,580.54
Configural597.252180.960.950.060.0434,667.3335,255.24
Weak615.732300.960.950.060.0434,661.8035,191.880.000.00
Scalar632.802420.960.950.040.0434,654.8735,127.120.000.00
Strict688.762590.950.950.060.0534,676.8335,067.16−0.010.00
Across with or without PTSD Symptom
With PTSD119.271090.980.980.030.068104.468289.72
Without PTSD206.461090.950.940.030.0522,656.8922,939.76
Configural465.622180.940.930.050.0530,696.4431,284.34
Weak513.162300.930.920.050.0530,719.9831,250.06−0.01−0.01
Scalar582.492420.920.910.060.0630,765.3131,237.56−0.01−0.01
Across early adolescents and late adolescents
early adolescents244.62 1090.97 0.96 0.05 0.03 16,935.14 17,183.88
late adolescents288.62 1090.96 0.95 0.06 0.04 17,186.74 17,439.67
Configural533.24 2180.96 0.96 0.06 0.04 34,121.88 34,708.18
Weak559.35 2300.96 0.96 0.06 0.04 34,123.99 34,652.62 0.000.00
Scalar568.81 2420.96 0.96 0.06 0.04 34,109.45 34,580.41 0.00 0.00
Strict615.46 2590.96 0.96 0.06 0.04 34,122.10 34,511.37 0.000.00
Across Time
T1342.251090.940.920.080.059816.9210,042.65
T2280.461090.940.920.070.0511,353.3911,579.32
Configural1034.454650.920.900.060.0520,775.3021,382.72
Weak1059.364770.920.900.060.0520,776.2121,339.180.000.00
Scalar1090.634890.910.900.060.0520,783.4821,302.01−0.010.00
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Chen, W.; Gao, R.; Yang, T. Factor Structure and Psychometric Properties for the PTSD Checklist of Chinese Adolescents in the Closed Period after the COVID-19 Outbreak. Int. J. Environ. Res. Public Health 2021, 18, 12245. https://doi.org/10.3390/ijerph182212245

AMA Style

Chen W, Gao R, Yang T. Factor Structure and Psychometric Properties for the PTSD Checklist of Chinese Adolescents in the Closed Period after the COVID-19 Outbreak. International Journal of Environmental Research and Public Health. 2021; 18(22):12245. https://doi.org/10.3390/ijerph182212245

Chicago/Turabian Style

Chen, Wei, Rongfen Gao, and Tao Yang. 2021. "Factor Structure and Psychometric Properties for the PTSD Checklist of Chinese Adolescents in the Closed Period after the COVID-19 Outbreak" International Journal of Environmental Research and Public Health 18, no. 22: 12245. https://doi.org/10.3390/ijerph182212245

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop