Next Article in Journal
An RNA-Based Vaccine Platform for Use against Mycobacterium tuberculosis
Next Article in Special Issue
Predictors of SARS-CoV-2 Vaccine Uptake among Health Professionals: A Cross-Sectional Study in Ghana
Previous Article in Journal
A Simple Epidemiologic Model for Predicting Impaired Neutralization of New SARS-CoV-2 Variants
Previous Article in Special Issue
Does the COVID-19 Vaccination Rate Change According to the Education and Income: A Study on Vaccination Rates in Cities of Turkey between 2021-September and 2022-February
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Psychological Distress and Physical Adverse Events of COVID-19 Vaccination among Healthcare Workers in Taiwan

1
Department of Nursing, College of Medicine, National Cheng Kung University, Tainan 701, Taiwan
2
International Doctoral Program in Nursing, Department of Nursing, College of Medicine, National Cheng Kung University, Tainan 701, Taiwan
3
Faculty of Nursing, University of Jember, Jember 68121, Indonesia
4
Center for Infection Control, National Cheng Kung University Hospital, Tainan 701, Taiwan
5
Department of Public Health, College of Medicine, National Cheng Kung University, Tainan 701, Taiwan
6
Institute of Allied Health Sciences, College of Medicine, National Cheng Kung University, Tainan 701, Taiwan
7
Department of Occupational Therapy, College of Medicine, National Cheng Kung University, Tainan 701, Taiwan
8
Biostatistics Consulting Center, National Cheng Kung University Hospital, College of Medicine, National Cheng Kung University, Tainan 701, Taiwan
9
Department of Internal Medicine, National Cheng Kung University Hospital, College of Medicine, National Cheng Kung University, Tainan 701, Taiwan
*
Authors to whom correspondence should be addressed.
Vaccines 2023, 11(1), 129; https://doi.org/10.3390/vaccines11010129
Submission received: 26 November 2022 / Revised: 25 December 2022 / Accepted: 28 December 2022 / Published: 5 January 2023

Abstract

:
The COVID-19 pandemic places high pressure on everyone, including healthcare workers (HCWs), thus causing them to experience psychological distress. HCWs have priority in receiving the COVID-19 vaccine. However, few studies have identified adverse events (AEs) and psychological distress in the HCWs group. Therefore, we investigated the association between psychological distress and AEs and the determinants of protective behaviors in Taiwanese HCWs. A longitudinal measurement was conducted among HCWs at National Cheng Kung University Hospital (NCKUH), Tainan, Taiwan (n = 483, mean age = 37.55 years). All HCWs completed an online questionnaire on psychological distress, COVID-19 vaccination AEs, and protective behaviors. We used generalized estimating equations (GEE) to analyze the correlation between psychological distress and AEs, and used multivariable logistic regressions to explore the predictors of protective behaviors. Depression and distress and anger were significantly associated with various physical AEs (p = 0.045 to p < 0.001). Suicidal thoughts became a significant independent variable of systemic AEs after COVID-19 vaccination (p = 0.014 to p < 0.001). People of older ages or females engaged more in washing their hands, wearing masks, and reducing their presence in crowded places. Suicidal thoughts were related to the occurrence of systemic AEs among HCWs. Doctors performed better at preventive behaviors compared to nurses and other HCWs. HCWs who experienced anxiety and nervousness tended to avoid crowds.

1. Introduction

The prevalence of COVID-19 among frontline healthcare workers (HCWs) was 2747 cases per 100,000 compared with 242 cases per 100,000 people in the general community during the first month of the COVID-19 pandemic in the UK and the US [1]. This figure indicates that HCWs have a 10-fold risk of COVID-19 infection because of direct patient care. Moreover, direct patient care during the COVID-19 pandemic, regardless of whether the patient was infected with COVID-19, results in HCWs experiencing both physical and psychosocial symptoms [2]. HCWs have been found to have poor general health, reduced sleep quality, increased psychological distress (e.g., stress, anxiety, and depression), reduced financial income, and decreased family relationships [3,4,5,6,7].
HCWs are the top priority for vaccination to protect them from COVID-19 infection [8]. They have a significant responsibility to promote vaccination and guide patients. On the other hand, they are at high risk of being infected and are potential candidates for spreading the disease [9]. COVID-19 infections among HCWs directly affects their work-related environment and the whole healthcare system. Secondary exposures, isolation, and staff infections can significantly harm a single ward’s capacity to care for patients, creating a multiplier effect on the facility’s functional resilience and staff confidence [10]. Comprehensive protection for HCWs from COVID-19 infection will guarantee the sustainability and protection of the healthcare system [11].
Unfortunately, the prevalence of COVID-19 vaccination hesitancy among HCWs worldwide ranges from 4.3 to 72%. Most studies have found concerns about vaccine safety, efficacy, and potential side effects as the leading reasons for COVID-19 vaccination hesitancy in HCWs [12,13]. Some HCWs reported that they wanted to wait until the vaccine experiences of others were known, and some others stated that they did not trust the rushed Food and Drug Administration (FDA) process [14]. The hesitancy of vaccination uptake among HCWs led to a low rate of COVID-19 vaccine uptake. The Kaiser Family Foundation and the Washington Post (2021) reported that only 52% of US frontline HCWs have received the COVID-19 vaccination. The 48% of HCWs who remained unvaccinated expressed that they had not yet decided if they will accept a vaccine dose. In Taiwan, the HCWs’ willingness to receive the COVID-19 vaccination is lower (23.4%) compared to hospital outpatient visitors (30.7%). The low willingness for COVID-19 vaccine uptake in Taiwan may be due to Taiwan’s status, as it was safer than other countries during the survey period [13].
One of the main reasons for vaccination hesitancy is the adverse events (AEs) after vaccine uptake. The literature has revealed some AEs following COVID-19 vaccination, which differs among various vaccine types. One of the most common vaccines approved by countries is the AstraZeneca vaccine (ChAdOx1 nCoV-19). The frequent AEs incurred by this vaccine are injection site pain (77.7–88.0%), fatigue (50.7–92.9%), myalgia (60.5–80.8%), malaise (83.8%), headaches (47.4–72.0%), and fever (≥38.0 °C, 36.1–38.7%). The severity of most AEs were mild-to-moderate, and occurred less in the older age groups [15,16,17]. Another common vaccine (Pfizer–BioNTech COVID-19) triggered common AEs including injection site pain (89.8%), fatigue (62.2%), headaches (45.6%), muscle pain (37.1%), and chills (33.9%) [18].
Apart from AEs, mental health problems (e.g., acute stress disorder, anxiety, and depression) from COVID-19 among HCWs are important concerns as HCWs are key individuals in the fight against the COVID-19 pandemic. Several systematic reviews have reported that HCWs experienced psychological disorders during the COVID-19 pandemic, including anxiety, depression, stress, sleep disorders, mental health-related factors, and decreased mental well-being [19,20,21,22]. However, to the best of our knowledge, there is a dearth of evidence regarding the AEs and mental health problems after vaccination in Taiwan. This study aimed to investigate the correlation of psychological distress during the pandemic and physical AEs among HCWs after receiving a COVID-19 vaccination. A secondary aim was to describe protective behavior and its association with psychological distress among HCWs.

2. Materials and Methods

2.1. Study Design and Sampling

This study adopted a longitudinal design and recruited participants from the National Cheng Kung University Hospital (NCKUH), Tainan, Taiwan. NCKUH played a crucial role in combating the spread of COVID-19 by establishing safe and high-quality outdoor coronavirus testing stations during the outbreak, both for patients and HCWs. In the data collection process, researcher 2 (W.-C.W.), researcher 3 (Y.-W.T.), researcher 4 (M.-Y.L.), and researcher 5 (P.-J.C.) approached each HCW who received the COVID-19 vaccination in the NCKUH. The researcher explained the research objectives and procedures, provided a QR code via cell phone, and printed a paper to be scanned by the HCWs. Then, the HCWs scanned a QR code to complete an online survey using Google documents. The first page of the online survey clearly indicated the study’s purpose and the participant’s rights: when an HCW agreed to participate after reading all the information, he or she must hit the “agree button” on this page to continue the survey. Those who did not hit the “agree button” had their online survey terminated immediately. The data collection was performed from March 24 to April 24, 2021. The inclusion criteria for the eligible participants were: (1) an HCW in the NCKUH; (2) aged over 20 years; and (3) willing to participate in the study.

2.2. Measures

2.2.1. Participants’ Characteristics

The online survey collected the following information from the participants: age (fill in a number with the unit of the year); gender (male or female); and type of occupation (physician, nurse, or others).

2.2.2. Physical Adverse Events

The physical AEs were collected by an online survey which included 20 items, including local pain, fatigue, weakness, muscle pain, local swelling, headache, dizziness, chills, local mass, joint pain, fever, local bruise, nausea, vomiting, swollen lymph nodes, poor appetite, abdominal pain, sweating, itching, and skin rash. One additional question (other symptoms) was added to the online survey to cover the other effects experienced by the HCWs. The participants reported their physical AEs five times after they were vaccinated: on day 1, day 2, day 3, day 7, and day 14 after vaccination uptake.

2.2.3. Psychological Distress

We used the Brief Symptom Rating Scale (BSRS-5) [23] to identify the psychological status of HCWs on the day of vaccination. It consisted of five questions identifying the following psychological distress: (i) trouble falling asleep; (ii) feeling tense or high strung; (iii) feeling irritable or angry; (iv) feeling down or depressed; and (v) feeling inferior to others. Each item was measured using a five-point Likert scale (0 = not at all, 1 = a little bit, 2 = moderately, 3 = quite a bit, and 4 = extremely). The assessment of this questionnaire used the following conditions: a score of 0–5 is good emotionally, 6–9 has mild emotional distress, 10–14 is moderate emotional distress, and a score of 15–20 is severe emotional distress. Regarding an additional question about suicidal thoughts, if the score was >2, the person requires expert consultation and psychiatric therapy. The Cronbach’s alpha coefficient for this questionnaire was 0.84 [24].

2.2.4. Protective Behaviors

The Preventive COVID-19 Infection Behaviors Scale (PCIBS) [25] consists of five items as follows: (i) avoiding crowds as much as you can; (ii) keeping your house ventilated; (iii) sanitizing and cleaning your house; (iv) washing your hands as much as you can; and (v) wearing a face mask as much as you can and was used to measure the HCWs behavior to prevent being infected by COVID-19. There were three options in the PCIBS for this study: (i) No, (ii); Yes, because of COVID-19; and (iii) Yes, but not because of COVID-19.

2.3. Statistical Analysis

Descriptive statistics were used to analyze the participants’ characteristics including frequency (percentage) for categorical data (e.g., gender) and means ± SD for continuous data (e.g., age). We used generalized estimating equations (GEE) with a linear scale function and an exchangeable structure correlation matrix to analyze the relationship between psychological disorders and physical AEs after receiving the COVID-19 vaccine. The exchangeable structure correlation matrix assessed the correlations between the repeated measures and a small number of missing data could be accommodated for in this model. In the GEE, the repeated measured AEs were treated as dependent variables and the psychological disorders were treated as independent variables. This seemed to be the best option given the fact that there were different trends in the different times of measurement. The relationship between variables with a p-value score of less than 0.05 indicated a statistically significant relationship. Then, multivariate logistic regression models were used to examine the adjusted odds ratios (AORs) regarding how different variables such as age, gender, occupation, and psychological distress, explained the participants’ protective behaviors to prevent the COVID-19 infection. All statistical analyses were performed using IBM SPSS 20 (IBM Corp., Armonk, NY, USA).

3. Results

There were 5948 HCWs registered with the NCKUH when the study was conducted. During the study period (24 March to 24 April 2021, and the survey continued after this survey), 10.9% of HCWs received the ChAdOx1 nCoV-19 vaccine, and 75.6% of HCWs filled out the online questionnaire. After excluding those with missing information in the measurements of AEs, data from 483 HCWs were used for data analysis. Female HCWs slightly dominated in this study (53.8%); compared to the population, the proportion of female HCWs was 82%. Based on age, most health workers were 30–39 years old (35.4%) with a mean (SD) age of 37.55 (10.73) years, compared to a mean age of the general HCW population of 34.8 years. Doctors were the dominant health profession in this study (38.7%) (Table 1).
There was a significant difference in the physical AEs’ response to each measurement by HCWs. On the first measurement day, 89.86% of respondents experienced AEs. The incidence of AEs continued to decrease significantly on the second, third, seventh, and fourteenth days of measurement after being given the AZ vaccination, at 83.02%, 74.53%, 72.67%, and 63.77%, respectively. HCWs reported that the most common physical AEs after COVID-19 vaccination were local pain, fatigue, weakness, muscle aches, headaches, chills, dizziness, swelling at the injection site, joint pain, poor appetite, and fever (Figure 1). The incidence of physical AEs felt by HCWs existed until the second and third days after vaccination and, on average, experienced a significant decrease on the seventh and fourteenth days of measurement. For example, 89.63%, 89.28%, and 80.00% of respondents reported experiencing local pain on the first, second, and third days of measurements, respectively. On the seventh and fourteenth days of measurement, there was a significant decrease to 26.78% and 9.74% of respondents who reported the incidence of local pain. Fever was felt by 35.25% of respondents on the first day after vaccination and still felt by 20.95% of respondents on the second day of measurement. On the third day, there was a decrease in the incidence of fever to 2.50% of HCWs, and it continued to decrease on the seventh and fourteenth days of measurement.
There was a significant difference between male and female HCWs who experienced AEs (p = 0.038 to p = 0.001). Similarly, in the age comparison group, there was a significant difference in the incidence of AEs (p = 0.002 to p ≤ 0.001), except for the incidence of local swelling (p = 0.094). There was no significant difference between the type of health professionals and the incidence of AEs in terms of muscle pain, fatigue, weakness, and dizziness (p = 0.058 to p = 0.103) after receiving the COVID-19 vaccine.
The results of the GEE analysis showed that depression and upset was significantly associated with various physical AEs in the HCWs group (p = 0.045 to p < 0.001). The type of psychological distress in the form of sleeping disorder only significantly correlated with three AEs, namely fatigue (p = 0.001), muscle pain (p = 0.049), and headache (p = 0.036). Suicidal thoughts became a significant independent variable on the incidence of AEs after COVID-19 vaccination (p = 0.014 to p < 0.001). All type of psychological distress were correlated with fatigue and muscle pain (p = 0.049 to p < 0.001) (Table 2) (Appendix A Table A1).
Of the five mental health domains from the BSRS-5 questionnaire that HCWs had filled out, most experienced mild anxiety disorders (31.7%), mild sleep disorders (30.2%), irritability (24.2%), mild depression (18.8%), and low self-esteem (15.5%). Regarding COVID-19 prevention behaviors among HCWs, the results showed that numerous HCWs did not adhere to health protocols properly: 36.9% of HCWs did not avoid crowds; 55.3% of HCWs did not keep the house clean; 40.4% of HCWs washed hands regularly but not because of COVID-19; and 55.9% of HCWs maintained indoor air ventilation but not because of COVID-19.
The results of multiple logistic regression models related to preventive behaviors showed that female HCWs tended to be more obedient in washing their hands regularly (AOR = 1.08; 95% CI = 0.65–1.77) and wearing masks (AOR = 1.01; 95% CI = 0.57–1.77) when compared to male HCWs. In addition, nurses performed fewer preventive behaviors than doctors and other HCWs (AOR = 0.54–0.99) in almost all aspects except for avoiding crowds (AOR = 1.15; 95% CI = 0.72–1.84). HCWs who experienced nervousness and anxiety tended to avoid crowds 1.83 times more than HCWs who did not feel nervousness and anxiety. Older HCWs were inclined to wash their hands and wear masks (0.97 and 0.96 times more often, respectively, for one year older) (Table 3) (Appendix A Table A2).

4. Discussion

The current study showed that the AEs experienced by HCWs after receiving the first dose of COVID-19 vaccine were local AEs (i.e., pain at the injection site and local swelling) and systemic AEs (i.e., fatigue, weakness, muscle pain, headache, chills, dizziness, joint pain, poor appetite, and fever). However, none of the HCWs reported life-threatening AEs after vaccination. All components of the BSRS-5: sleep disorder, nervousness and anxiety, distress and anger, depression and upset, inferiority to others, and suicidal thoughts, were significantly associated with the incidence of fatigue and muscle pain after COVID-19 vaccination in HCWs. Although depression was significantly associated with all types of AEs, sleep disorders in HCWs were only significantly associated with fatigue, muscle pain, and headaches. Suicidal thoughts were not significantly related to the occurrence of local AEs, namely local pain and swelling. Fever was the only occurrence of AEs associated with one component of psychological distress, namely depression. Being female and of older age were predictors of preventive behaviors, especially washing hands and wearing masks regularly in the HCWs group. An interesting finding was that the nursing profession did not perform preventive behaviors well compared to doctors and other HCWs. Nervousness and anxiety were significant predictors for HCWs in avoiding crowds.
The younger and female participants had a greater chance of experiencing AEs. This study’s results align with results reported by studies across San Francisco, Korea, and Japan [10,15,26]. One of the potential reasons is that the COVID-19 vaccine had a stronger immune response in women and younger people [27]. Another potential explanation is that the antibody response to the COVID-19 vaccine was related to sex hormones for both women and men, but had a greater impact on women [28].
This study additionally identified the occurrence of psychological distress experienced by HCWs during the COVID-19 pandemic. About one-fifth to one-third of the HCWs in the present study experienced different types of psychological distress such as sleep disorders, anxiety, and depression. A few HCWs reported suicidal thoughts (2.9%). The results of this study are consistent with findings from studies on Taiwan frontline HCWs [29], Singaporean HCWs (nurses, doctors, allied health professionals, and administrative and operations staff) [30], African HCWs including physicians, nurses, radiographers, midwives, psychosocial counselors, pharmacists, and medical laboratory technicians [19], and Canadian physicians [31]. Although our paper shared the same studied population of the paper [29], there are major differences between the current study and the published paper by Lu et al. Specifically, the purposes of the two studies are clearly different: the present paper aimed to investigate adverse effects of the COVID-19 vaccine, while Lu et al. aimed to examine psychological distress among healthcare workers who did not receive a vaccination against COVID-19.
Similar findings are supported and have been explained by several systematic reviews. A systematic review reported that HCWs who experience depression, anxiety, stress, sleep problems, mental health-related factors, and decreased mental well-being might be triggered by fear of COVID-19 [20]. Another explanation is that sleep problems among HCWs can potentially increase psychological distress [21]. During the pandemic, HCWs had to keep working and present physically to workplaces such as hospitals and clinics, workplaces which have a high risk of being infected with the novel coronavirus (nCoV). Furthermore, HCWs have a very high workload and face stigmatization from family members and the surrounding environment [20,32]. Therefore, it is essential to take preventive actions as early as possible, so that HCWs will not experience psychological distress. The long-term existence of psychological distress will reduce job performance, job satisfaction and lead to an increase in absenteeism and job turnover among HCWs [33].
The GEE analysis results showed that the presence of fatigue and muscle pain after the first vaccination shot was related to the occurrence of psychological distress reported by HCWs before the vaccination day. A study by Rakel stated that the main complaint of people who were depressed was of fatigue, as well as other symptoms such as headaches, dizziness, palpitations, abdominal cramping, loss of appetite, and pain [34]. HCWs who experienced sleep disturbances during the pandemic had a higher chance of experiencing fatigue, muscle pain, and headaches. An interesting finding from this study is that HCWs who experienced suicidal thoughts had a greater chance of experiencing post-vaccination systemic AEs, compared to HCWs who felt other psychological disorders. The results imply that suicidal thoughts have become a serious psychological disorder because of their high risk of generating individuals who may attempt to take their own life [35]. Although controlling and reducing the problem of suicidal thoughts is difficult, several alternative actions can be taken to prevent HCWs from committing suicide. One is to prepare a safety plan through warning signs, internal coping mechanisms, social contacts, relatives’ help, and professional therapies [35]. Another action that can be engaged to prevent suicidal attempts is to overcome depression experienced by HCWs, as depression is significantly associated with the presence of suicidal thoughts in HCWs [36].
Regarding the implementation of protective behaviors, our results indicated that HCWs who were older or female engaged more in the following behaviors: washing their hands, wearing masks, and avoiding crowded places. The results of this study are consistent with studies conducted in the US which indicated that older adults practice social distancing, mask-wearing, and handwashing at a high level (over 95%) [37]. Similarly, studies in Turkey and Bangkok showed that 70.8% of older adults strictly adhered to preventive behaviors [38,39]. The explanation for the higher levels of preventive behaviors among older HCWs can be due to vulnerability among older people; older people who are infected by the SARS-CoV-2 virus could have rapid disease progression with severe manifestations because of their decreased immunity, leading to a critical condition [40,41].
In addition, nurses in this study did not show the expected preventive behaviors, whereas doctors and other health workers were better at implementing preventive behaviors. A study in India reported the same findings. All doctors involved in the study carried out the actions of wearing masks, maintaining social distancing, and hand washing in good numbers [42]. The number of nurses in the hospital is the highest compared to other health workers. Nurses have a crucial role in health services and can be said to be in direct contact with patients for 24 h. Consequently, nurses sometimes experience fatigue and ignore standard healthcare procedures.
Depressive conditions, low self-esteem, and suicidal thoughts were not shown to be significantly related to preventive behaviors in this study. However, this does not mean that this situation can be ignored, considering that there are still many HCWs who report experiencing these conditions. Sleep disorders and nervousness and anxiety were significantly related to HCWs’ crowd-avoiding behaviors. However, they were not significantly related to measures such as maintaining room ventilation, keeping the house sanitized, washing hands, and wearing masks. Distress was significantly related to the behavior of washing hands regularly. Limkunakul et al. reported that the knowledge and perception of the personal preventability of HCWs in Thailand were related to preventive behaviors [43]. The additional information that components from the health behavioral model also contributes to explaining the factors that encourage HCWs to perform preventive behaviors.
Some limitations of the study are presented as follows. First, some HCWs did not report AEs experienced within the specified time, resulting in missing data. However, data analysis using GEE can handle missing data so that it does not affect the results of the data analysis. Second, the possibility of the occurrence of ascertainment bias may still exist due to the likelihood of some HCWs who agreed to get vaccination voluntarily, compared to those who may reject immunization. Third, this study involved HCWs from one medical center in southern Taiwan, so it cannot be generalized to all areas of Taiwan. There was no significant difference between HCWs in terms of characteristics from the northern and southern parts of Formosa Island. However, future research could involve more HCWs from all regions in Taiwan. The fourth limitation is that during the data collection period, only one type of vaccine was administered to HCWs, the Oxford–AstraZeneca vaccine, so we could not identify a difference in the occurrence of AEs from other types of COVID-19 vaccines. Fifth, the implementation of preventive behaviors was identified only on the first day, when HCWs received their vaccine; therefore, there was not enough information on the consistency of the HCWs’ implementation of preventive behaviors post-vaccination.

5. Conclusions

The results of the current study indicate that HCWs experienced various AEs, both local and systemic. Sleep disorders, nervousness and anxiety, distress and anger, depression and upset, inferiority to others, and suicidal thoughts were significantly associated with fatigue and muscle pain after the first dose of COVID-19 vaccination. We also found that suicidal thoughts were related to the occurrence of systemic AEs among HCWs. Doctors performed better at preventive behaviors compared to nurses and other HCWs, while older and female HCWs showed greater frequency in practicing hand washing and wearing masks. HCWs experiencing anxiety and nervousness about COVID-19 were motivated to avoid crowds.

Author Contributions

Conceptualization, A.R., W.-C.W., Y.-W.T., M.-Y.L., P.-J.C., P.-L.C., W.-C.K., C.S., C.-Y.L. and N.-Y.K.; methodology, A.R., N.-Y.K. and C.-Y.L.; software, A.R. and C.-Y.L.; validation, N.-Y.K. and C.-Y.L.; formal analysis, A.R., N.-Y.K. and C.-Y.L.; investigation, W.-C.W., Y.-W.T., M.-Y.L., P.-J.C., P.-L.C., W.-C.K., C.-Y.L. and N.-Y.K.; resources, W.-C.W., Y.-W.T., M.-Y.L., P.-J.C., P.-L.C., W.-C.K., C.-Y.L. and N.-Y.K.; data curation, A.R., W.-C.W., Y.-W.T., M.-Y.L. and P.-J.C.; writing—original draft preparation, A.R., N.-Y.K. and C.-Y.L.; writing—review and editing, A.R., W.-C.W., Y.-W.T., M.-Y.L., P.-J.C., C.S., P.-L.C., W.-C.K., N.-Y.K. and C.-Y.L.; visualization, A.R.; supervision, P.-L.C., W.-C.K., C.S., C.-Y.L. and N.-Y.K.; project administration, P.-L.C., W.-C.K., C.S., C.-Y.L. and N.-Y.K.; funding acquisition, N.-Y.K. and C.-Y.L. All authors have read and agreed to the published version of the manuscript.

Funding

This research was supported in part by a research grant from the Ministry of Science and Technology, Taiwan (MOST111-2321-B-006-009).

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki and approved by the Institutional Review Board of National Cheng Kung University Hospital (IRB number A-ER-109-149; date of approval 12 August 2020).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study through an online system.

Data Availability Statement

Corresponding authors will provide the data upon reasonable request.

Acknowledgments

We thank all respondents for joining this study.

Conflicts of Interest

The authors declare no conflict of interest.

Appendix A

Table A1. Generalized estimating equations for psychological distress and adverse events.
Table A1. Generalized estimating equations for psychological distress and adverse events.
Sleep DisorderNervousness–AnxietyDistress–AngerDepression–UpsetInferior to OthersSuicidal Thought
AEsBSEp-ValueBSEp-ValueBSEp-ValueBSEp-ValueBSEp-ValueBSEp-Value
Local pain0.1150.08770.1910.3190.0811<0.0010.2500.08580.0040.3440.0943<0.0010.1740.10830.1080.3470.24530.157
Fatigue0.2720.08420.0010.4080.0839<0.0010.4050.0845<0.0010.5270.0951<0.0010.3190.10260.0020.6520.21570.003
Weakness0.2130.08020.3160.3160.07990.0080.3660.0804<0.0010.4890.0963<0.0010.2760.09950.0060.8000.2131<0.001
Muscle pain0.1600.08130.0490.2800.0794<0.0010.2870.08260.0010.4540.0915<0.0010.2640.09870.0080.6680.22740.003
Headache0.1720.08210.0360.1640.08400.0510.2580.09020.0040.4050.1086<0.0010.2370.09680.0140.7780.25870.003
Chills0.1120.06650.0920.1300.06770.0550.1900.06930.0060.3290.0779<0.0010.2020.08020.0120.4690.18830.013
Dizziness0.1260.07770.1060.2120.08210.0100.1790.09490.0600.3040.10450.0040.1390.10020.1660.5590.22650.014
Local swelling0.0470.07330.5240.2010.07600.0080.1850.07790.0180.2530.09190.0060.1510.09720.1200.3250.19320.092
Joint pain0.0660.08230.4200.1520.08180.0640.1590.08570.0640.3380.10430.0010.1950.09900.0490.8040.24920.001
Poor appetite0.1200.07230.0970.2700.0726<0.0010.2960.0746<0.0010.4110.0863<0.0010.3220.0870<0.0010.8600.2112<0.001
Fever0.0100.01680.569-0.0020.01720.9090.0140.01790.4510.0470.02340.0450.0230.02100.2700.1000.05570.073
AEs = adverse events; B = beta; SE = standard Error.
Table A2. Multiple logistic regression of predicting factors to preventive behaviors.
Table A2. Multiple logistic regression of predicting factors to preventive behaviors.
AOR (95% CI)
Avoiding CrowdsHouse VentilatedHouse SanitizedHands WashedWearing Face Mask
Age1.01 (0.99–1.03)0.99 (0,97–1.02)0.99 (0.98–1.01)0.97 (0.96–0.99) **0.96 (0.94–0.98) ***
Gender (Ref: male)0.71 (0.45–1.11)0.88 (0.50–1.54)0.99 (0.64–1.55)1.08 (0.65–1.77)1.01 (0.57–1.77)
Occupation (Ref: Physician)
Nurse1.15 (0.72–1.84)0.72 (0.40–1.29)0.54 (0.34–0.85) **0.98 (0.59–1.63)0.99 (0.56–1.75)
Others1.24 (0.74–2.09)0.88 (0.46–1.70)0.67 (0.41–1.09)1.41 (0.78–2.54)1.64 (0.81–3.30)
Sleep disorders0.68 (0.47–0.99) *1.34 (0.83–2.16)0.96 (0.67–1.38)1.19 (0.79–1.80)1.21 (0.75–1.96)
Nervousness and anxiety1.83 (1.17–2.84) **1.34 (0.78–2.31)1.02 (0.67–1.54)1.02 (0.64–1.63)0.98 (0.57–1.69)
Distress and anger0.93 (0.56–1.56)1.14 (0.59–2.16)0.75 (0.45–1.24)0.56 (0.29–0.89)*0.72 (0.38–1.36)
Depression and upset1.07 (0.59–1.92)0.64 (0.32–1.27)0.68 (0.38–1.23)1.59 (0.84–3.02)1.21 (0.58–2.50)
Inferiority to others0.67 (0.41–1.09)0.82 (0.46–1.46)1.37 (0.84–2.24)0.85 (0.50–1.43)0.78 (0.44–1.41)
Suicidal thoughts1.11 (0.49–2.49)0.74 (0.29–1.82)1.66 (0.73–3.77)1.65 (0.55–4.97)1.28 (0.43–3.83)
Ref = reference group; AOR = adjusted odds ratio; CI = confidence interval. * p < 0.05; ** p < 0.01; *** p < 0.001.

References

  1. Nguyen, L.H.; Drew, D.A.; Graham, M.S.; Joshi, A.D.; Guo, C.G.; Ma, W.; Mehta, R.S.; Warner, E.T.; Sikavi, D.R.; Lo, C.H.; et al. Risk of COVID-19 among front-line health-care workers and the general community: A prospective cohort study. Lancet Public Health 2020, 5, e475–e483. [Google Scholar] [CrossRef] [PubMed]
  2. Shreffler, J.; Petrey, J.; Huecker, M. The Impact of COVID-19 on Healthcare Worker Wellness: A Scoping Review. West J. Emerg Med. 2020, 21, 1059–1066. [Google Scholar] [CrossRef] [PubMed]
  3. Gonzalo, R.M.; Ana, R.G.; Patricia, C.A.; Laura, A.L.; Nathalia, G.T.; Luis, C.; Asuncion, L.; Miguel, R.V.; Benedicto, C.F. Short-term emotional impact of COVID-19 pandemic on Spaniard health workers. J. Affect. Disord. 2021, 278, 390–394. [Google Scholar] [CrossRef] [PubMed]
  4. Jazieh, A.R.; Coutinho, A.K.; Bensalem, A.A.; Alsharm, A.A.; Errihani, H.; Mula-Hussain, L.; Al-Sukhun, S.; Sampaio-Filho, C.A.; Khorshid, O.M.R.; De Guzman, R.B.; et al. Impact of the COVID-19 pandemic on oncologists: Results of an international study. JCO Glob. Oncol. 2021, 7, 242–252. [Google Scholar] [CrossRef]
  5. Zhao, X.; Zhang, T.; Li, B.; Yu, X.; Ma, Z.; Cao, L.; Gu, Q.; Dong, C.; Jin, Y.; Fan, J.; et al. Job-related factors associated with changes in sleep quality among healthcare workers screening for 2019 novel coronavirus infection: A longitudinal study. Sleep Med. 2020, 75, 21–26. [Google Scholar] [CrossRef]
  6. Salari, N.; Khazaie, H.; Hosseinian-Far, A.; Khaledi-Paveh, B.; Kazeminia, M.; Mohammadi, M.; Shohaimi, S.; Daneshkhah, A.; Eskandari, S. The prevalence of stress, anxiety and depression within front-line healthcare workers caring for COVID-19 patients: A systematic review and meta-regression. Hum. Resour. Health 2020, 18, 100. [Google Scholar] [CrossRef]
  7. Wang, P.W.; Lu, W.H.; Ko, N.Y.; Chen, Y.L.; Li, D.J.; Chang, Y.P.; Yen, C.F. COVID-19-Related Information Sources and the Relationship With Confidence in People Coping with COVID-19: Facebook Survey Study in Taiwan. J. Med. Internet Res. 2020, 22, e20021. [Google Scholar] [CrossRef]
  8. Yang, J.; Zheng, W.; Shi, H.; Yan, X.; Dong, K.; You, Q.; Zhong, G.; Gong, H.; Chen, Z.; Jit, M.; et al. Who should be prioritized for COVID-19 vaccination in China? A descriptive study. BMC Med. 2021, 19, 45. [Google Scholar] [CrossRef]
  9. Di Gennaro, F.; Murri, R.; Segala, F.V.; Cerruti, L.; Abdulle, A.; Saracino, A.; Bavaro, D.F.; Fantoni, M. Attitudes towards Anti-SARS-CoV2 Vaccination among Healthcare Workers: Results from a National Survey in Italy. Viruses 2021, 13, 371. [Google Scholar] [CrossRef]
  10. Amit, S.; Beni, S.A.; Biber, A.; Grinberg, A.; Leshem, E.; Regev-Yochay, G. Postvaccination COVID-19 among Healthcare Workers, Israel. Emerg. Infect. Dis. 2021, 27, 1220–1222. [Google Scholar] [CrossRef]
  11. Gagneux-Brunon, A.; Detoc, M.; Bruel, S.; Tardy, B.; Rozaire, O.; Frappe, P.; Botelho-Nevers, E. Intention to get vaccinations against COVID-19 in French healthcare workers during the first pandemic wave: A cross-sectional survey. J. Hosp. Infect. 2021, 108, 168–173. [Google Scholar] [CrossRef] [PubMed]
  12. Biswas, N.; Mustapha, T.; Khubchandani, J.; Price, J.H. The Nature and Extent of COVID-19 Vaccination Hesitancy in Healthcare Workers. J. Community Health 2021, 46, 1244–1251. [Google Scholar] [CrossRef] [PubMed]
  13. Kukreti, S.; Lu, M.Y.; Lin, Y.H.; Strong, C.; Lin, C.Y.; Ko, N.Y.; Chen, P.L.; Ko, W.C. Willingness of Taiwan’s Healthcare Workers and Outpatients to Vaccinate against COVID-19 during a Period without Community Outbreaks. Vaccines 2021, 9, 246. [Google Scholar] [CrossRef]
  14. Meyer, M.N.; Gjorgjieva, T.; Rosica, D. Trends in Health Care Worker Intentions to Receive a COVID-19 Vaccine and Reasons for Hesitancy. JAMA Netw. Open 2021, 4, e215344. [Google Scholar] [CrossRef] [PubMed]
  15. Jeon, M.; Kim, J.; Oh, C.E.; Lee, J.Y. Adverse Events Following Immunization Associated with Coronavirus Disease 2019 Vaccination Reported in the Mobile Vaccine Adverse Events Reporting System. J. Korean Med. Sci. 2021, 36, e114. [Google Scholar] [CrossRef] [PubMed]
  16. Kim, S.H.; Wi, Y.M.; Yun, S.Y.; Ryu, J.S.; Shin, J.M.; Lee, E.H.; Seo, K.H.; Lee, S.H.; Peck, K.R. Adverse Events in Healthcare Workers after the First Dose of ChAdOx1 nCoV-19 or BNT162b2 mRNA COVID-19 Vaccination: A Single Center Experience. J. Korean Med. Sci. 2021, 36, e107. [Google Scholar] [CrossRef]
  17. Song, J.Y.; Cheong, H.J.; Kim, S.R.; Lee, S.E.; Kim, S.H.; Noh, J.Y.; Yoon, Y.K.; Choi, W.S.; Park, D.W.; Sohn, J.W.; et al. Early Safety Monitoring of COVID-19 Vaccines in Healthcare Workers. J. Korean Med. Sci. 2021, 36, e110. [Google Scholar] [CrossRef]
  18. Riad, A.; Pokorna, A.; Attia, S.; Klugarova, J.; Koscik, M.; Klugar, M. Prevalence of COVID-19 Vaccine Side Effects among Healthcare Workers in the Czech Republic. J. Clin. Med. 2021, 10, 1428. [Google Scholar] [CrossRef]
  19. Olashore, A.; Akanni, O.; Fela-Thomas, A.; Khutsafalo, K. The psychological impact of COVID-19 on health-care workers in African Countries: A systematic review. Asian J. Soc. Health Behav. 2021, 4, 85–97. [Google Scholar] [CrossRef]
  20. Alimoradi, Z.; Ohayon, M.M.; Griffiths, M.D.; Lin, C.Y.; Pakpour, A.H. Fear of COVID-19 and its association with mental health-related factors: Systematic review and meta-analysis. BJPsych Open 2022, 8, e73. [Google Scholar] [CrossRef]
  21. Alimoradi, Z.; Broström, A.; Tsang, H.W.H.; Griffiths, M.D.; Haghayegh, S.; Ohayon, M.M.; Lin, C.Y.; Pakpour, A.H. Sleep problems during COVID-19 pandemic and its’ association to psychological distress: A systematic review and meta-analysis. EClinicalMedicine 2021, 36, 100916. [Google Scholar] [CrossRef] [PubMed]
  22. Alimoradi, Z.; Gozal, D.; Tsang, H.W.H.; Lin, C.Y.; Broström, A.; Ohayon, M.M.; Pakpour, A.H. Gender-specific estimates of sleep problems during the COVID-19 pandemic: Systematic review and meta-analysis. J. Sleep Res. 2022, 31, e13432. [Google Scholar] [CrossRef]
  23. Lee, M.B.; Liao, S.C.; Lee, Y.J.; Wu, C.H.; Tseng, M.C.; Gau, S.F.; Rau, C.L. Development and verification of validity and reliability of a short screening instrument to identify psychiatric morbidity. J. Med. Assoc. 2003, 102, 687–694. [Google Scholar]
  24. Chen, H.C.; Wu, C.H.; Lee, Y.J.; Liao, S.C.; Lee, M.B. Validity of the five-item Brief Symptom Rating Scale among subjects admitted for general health screening. J. Formos. Med. Assoc. = Taiwan Yi Zhi 2005, 104, 824–829. [Google Scholar] [PubMed]
  25. Chang, K.C.; Hou, W.L.; Pakpour, A.H.; Lin, C.Y.; Griffiths, M.D. Psychometric Testing of Three COVID-19-Related Scales Among People with Mental Illness. Int. J. Ment. Health Addict. 2022, 20, 324–336. [Google Scholar] [CrossRef] [PubMed]
  26. Urakawa, R.; Isomura, E.T.; Matsunaga, K.; Kubota, K.; Ike, M. Impact of age, sex and medical history on adverse reactions to the first and second dose of BNT162b2 mRNA COVID-19 vaccine in Japan: A cross-sectional study. BMC Infect. Dis. 2022, 22, 179. [Google Scholar] [CrossRef]
  27. Hoffmann, M.A.; Wieler, H.J.; Enders, P.; Buchholz, H.G.; Plachter, B. Age- and Sex-Graded Data Evaluation of Vaccination Reactions after Initial Injection of the BNT162b2 mRNA Vaccine in a Local Vaccination Center in Germany. Vaccines 2021, 9, 911. [Google Scholar] [CrossRef]
  28. Di Resta, C.; Ferrari, D.; Viganò, M.; Moro, M.; Sabetta, E.; Minerva, M.; Ambrosio, A.; Locatelli, M.; Tomaiuolo, R. The Gender Impact Assessment among Healthcare Workers in the SARS-CoV-2 Vaccination-An Analysis of Serological Response and Side Effects. Vaccines 2021, 9, 522. [Google Scholar] [CrossRef]
  29. Lu, M.Y.; Ahorsu, D.K.; Kukreti, S.; Strong, C.; Lin, Y.H.; Kuo, Y.J.; Chen, Y.P.; Lin, C.Y.; Chen, P.L.; Ko, N.Y.; et al. The Prevalence of Post-traumatic Stress Disorder Symptoms, Sleep Problems, and Psychological Distress Among COVID-19 Frontline Healthcare Workers in Taiwan. Front Psychiatry 2021, 12, 705657. [Google Scholar] [CrossRef]
  30. Teo, I.; Chay, J.; Cheung, Y.B.; Sung, S.C.; Tewani, K.G.; Yeo, L.F.; Yang, G.M.; Pan, F.T.; Ng, J.Y.; Abu Bakar Aloweni, F.; et al. Healthcare worker stress, anxiety and burnout during the COVID-19 pandemic in Singapore: A 6-month multi-centre prospective study. PLoS One 2021, 16, e0258866. [Google Scholar] [CrossRef]
  31. Chang, B.P. The Health Care Workforce Under Stress—Clinician Heal Thyself. JAMA Netw. Open 2022, 5, e2143167. [Google Scholar] [CrossRef] [PubMed]
  32. Cabarkapa, S.; Nadjidai, S.E.; Murgier, J.; Ng, C.H. The psychological impact of COVID-19 and other viral epidemics on frontline healthcare workers and ways to address it: A rapid systematic review. Brain Behav. Immun. Health 2020, 8, 100144. [Google Scholar] [CrossRef] [PubMed]
  33. Rajabimajd, N.A.; Zainab, G.; Mark, D. Impact of COVID-19-Related Fear and Anxiety on Job Attributes: A Systematic Review. Asian J. Soc. Health Behav. 2021, 4, 51–55. [Google Scholar] [CrossRef]
  34. Rakel, R.E. Depression. Prim. Care 1999, 26, 211–224. [Google Scholar] [CrossRef] [PubMed]
  35. Harmer, B.; Lee, S.; Duong, T.V.H.; Saadabadi, A. Suicidal Ideation. In StatPearls; StatPearls Publishing LLC.: Treasure Island, FL, USA, 2022. [Google Scholar]
  36. Sahimi, H.M.S.; Mohd Daud, T.I.; Chan, L.F.; Shah, S.A.; Rahman, F.H.A.; Nik Jaafar, N.R. Depression and Suicidal Ideation in a Sample of Malaysian Healthcare Workers: A Preliminary Study During the COVID-19 Pandemic. Front Psychiatry 2021, 12, 658174. [Google Scholar] [CrossRef] [PubMed]
  37. Ng, B.P.; Park, C. The Role of Media Sources for COVID-19 Information on Engaging in Recommended Preventive Behaviors Among Medicare Beneficiaries Aged ≥ 65 Years. J. Gerontol. Ser. B Psychol. Sci. Soc. Sci. 2022, 77, e191–e198. [Google Scholar] [CrossRef] [PubMed]
  38. Upake, C.; Nanthamongkolchai, S.; Taechaboonsermsak, P.; Yodmai, K.; Suksatan, W. Factors Predicting the Coronavirus Disease 2019 Preventive Behaviors of Older Adults: A Cross-Sectional Study in Bangkok, Thailand. Int. J. Environ. Res. Public Health 2022, 19, 361. [Google Scholar] [CrossRef]
  39. Selçuk, F.Ü.; Grassie, S.S. Psychosocial Predictors and Mediators Relating to the Preventive Behaviors of Hospital Workers During the COVID-19 Pandemic in Turkey. J. Occup. Environ. Med. 2022. [Google Scholar] [CrossRef]
  40. Chen, Q.; Wang, L.; Yu, W.; Xi, H.; Zhang, Q.; Chen, X.; Huang, K.; Lu, X.; Liu, X.; Zhang, C.; et al. Recommendations for the prevention and treatment of the novel coronavirus pneumonia in the elderly in China. Aging Med. 2020, 3, 66–73. [Google Scholar] [CrossRef]
  41. Wang, X.; Sun, C.; Hu, H.X.; Wang, Z.X.; Wang, H.; Peng, H.; Qiao, J.H.; Gao, L. Expert consensus on the nursing management of critically ill elderly patients with coronavirus disease 2019. Aging Med. 2020, 3, 74–81. [Google Scholar] [CrossRef] [Green Version]
  42. Tendolkar, S.; Panigrahi, S.; Shatadal, P.; Mehta, R. Behavioural insight of resident doctors into COVID-19 pandemic: A cross sectional study. Eur. J. Mol. Clin. Med. 2022, 9, 1078–1091. [Google Scholar]
  43. Limkunakul, C.; Phuthomdee, S.; Srinithiwat, P.; Chanthanaroj, S.; Boonsawat, W.; Sawanyawisuth, K. Factors associated with preventive behaviors for COVID-19 infection among healthcare workers by a health behavior model. Trop. Med. Health 2022, 50, 65. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Trend of physical adverse events among HCWs after COVID-19 vaccination on day 1, day 2, day 3, day 7, and day 14 of measurement.
Figure 1. Trend of physical adverse events among HCWs after COVID-19 vaccination on day 1, day 2, day 3, day 7, and day 14 of measurement.
Vaccines 11 00129 g001
Table 1. Participant characteristics of COVID-19 vaccine recipients.
Table 1. Participant characteristics of COVID-19 vaccine recipients.
VariablesChAdOx1 nCoV-19 Vaccine
(n = 483)
Sex
Male
Female

223 (46.17)
260 (53.83)
Age (mean ± SD)37.55 ± 10.73
20–29 years old137 (28.4)
30–39 years old171 (35.4)
40–49 years old99 (20.5)
50–59 years old56 (11.6)
60–69 years old18 (3.7)
70–79 years old2 (0.4)
Type of occupation
Physician187 (38.7)
Nurse147 (30.4)
Others149 (30.8)
Data represent the number (%) of vaccine recipients. SD = standard deviation.
Table 2. Generalized estimating equations for psychological disorders (PDs) and adverse events (AEs).
Table 2. Generalized estimating equations for psychological disorders (PDs) and adverse events (AEs).
PDsSleep DisorderNervousness–AnxietyDistress–AngerDepression– UpsetInferior to OthersSuicidal Thoughts
AEs
Local pain0.191<0.0010.004<0.0010.1080.157
Fatigue 0.001<0.001<0.001<0.0010.0020.003
Weakness0.3160.008<0.001<0.0010.006<0.001
Muscle pain0.049<0.0010.001<0.0010.0080.003
Headache0.0360.0510.004<0.0010.0140.003
Chills0.0920.0550.006<0.0010.0120.013
Dizziness0.1060.0100.0600.0040.1660.014
Local swelling0.5240.0080.0180.0060.1200.092
Joint pain0.4200.0640.0640.0010.0490.001
Poor appetite0.097<0.001<0.001<0.001<0.001<0.001
Fever0.5690.9090.4510.0450.1080.073
Footnote: Black cells indicate a significant association (p < 0.05); grey cells indicate a marginally significant association (p-values between 0.05 and 0.1); white cells indicate a non-significant association.
Table 3. Multiple logistic regression of predicting factors (PFs) to preventive behaviors (PBs).
Table 3. Multiple logistic regression of predicting factors (PFs) to preventive behaviors (PBs).
PBsAvoiding CrowdsHouse VentilatedHouse SanitizedHands WashedWearing Face Mask
PFs
Age1.010.990.990.970.96
Gender (Ref: male)0.710.880.991.081.01
Occupation
(Ref: Physician)
Nurse1.150.720.540.980.99
Others1.240.880.671.411.64
Sleep disorders0.681.340.961.191.21
Nervousness and anxiety1.831.341.021.020.98
Distress and anger0.931.140.750.560.72
Depression and upset1.070.640.681.591.21
Inferiority to others0.670.821.370.850.78
Suicidal thoughts1.110.741.661.651.28
Footnote: Black cells indicate significantly more association with PBs; white cells indicate significantly less association with PBs; grey cells indicate a nonsignificant association.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Rifai, A.; Wu, W.-C.; Tang, Y.-W.; Lu, M.-Y.; Chiu, P.-J.; Strong, C.; Lin, C.-Y.; Chen, P.-L.; Ko, W.-C.; Ko, N.-Y. Psychological Distress and Physical Adverse Events of COVID-19 Vaccination among Healthcare Workers in Taiwan. Vaccines 2023, 11, 129. https://doi.org/10.3390/vaccines11010129

AMA Style

Rifai A, Wu W-C, Tang Y-W, Lu M-Y, Chiu P-J, Strong C, Lin C-Y, Chen P-L, Ko W-C, Ko N-Y. Psychological Distress and Physical Adverse Events of COVID-19 Vaccination among Healthcare Workers in Taiwan. Vaccines. 2023; 11(1):129. https://doi.org/10.3390/vaccines11010129

Chicago/Turabian Style

Rifai, Ahmad, Wan-Ching Wu, Yu-Wen Tang, Mei-Yun Lu, Pei-Jen Chiu, Carol Strong, Chung-Ying Lin, Po-Lin Chen, Wen-Chien Ko, and Nai-Ying Ko. 2023. "Psychological Distress and Physical Adverse Events of COVID-19 Vaccination among Healthcare Workers in Taiwan" Vaccines 11, no. 1: 129. https://doi.org/10.3390/vaccines11010129

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop