Skip to main content
Advertisement
  • Loading metrics

Preferences regarding COVID-19 vaccination among 12,000 adults in China: A cross-sectional discrete choice experiment

  • Fengyun Yu ,

    Roles Data curation, Formal analysis, Investigation, Methodology, Writing – original draft, Writing – review & editing

    ‡ FY, LJ and QC contributed equally to this study as co-first authors. TB and SC are co-senior authors to this work.

    Affiliation Interdisciplinary Centre for Scientific Computing, University of Heidelberg, Heidelberg, Germany

  • Lirui Jiao ,

    Roles Formal analysis, Writing – original draft, Writing – review & editing

    ‡ FY, LJ and QC contributed equally to this study as co-first authors. TB and SC are co-senior authors to this work.

    Affiliation Department of Health Policy and Management, Gillings School of Global Public Health, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina, United States of America

  • Qiushi Chen ,

    Roles Supervision, Visualization, Writing – original draft, Writing – review & editing

    ‡ FY, LJ and QC contributed equally to this study as co-first authors. TB and SC are co-senior authors to this work.

    Affiliation The Harold and Inge Marcus Department of Industrial and Manufacturing Engineering, The Pennsylvania State University, University Park, Pennsylvania, United States of America

  • Qun Wang,

    Roles Data curation, Methodology, Project administration, Supervision

    Affiliation Faculty of Humanities and Social Sciences, Dalian University of Technology, Dalian, China

  • Manuela De Allegri,

    Roles Investigation, Validation, Writing – review & editing

    Affiliation Heidelberg Institute of Global Health (HIGH), Faculty of Medicine and University Hospital, Heidelberg University, Heidelberg, Germany

  • Zhong Cao,

    Roles Data curation, Formal analysis, Resources

    Affiliation State Key Lab of Intelligent Technologies and Systems, Department of Automation, Tsinghua University, Beijing, China

  • Wenjin Chen,

    Roles Resources

    Affiliation School of Population Medicine and Public Health, Chinese Academy of Medical Sciences & Peking Union Medical College, Beijing, China

  • Xuedi Ma,

    Roles Writing – original draft

    Affiliation School of Population Medicine and Public Health, Chinese Academy of Medical Sciences & Peking Union Medical College, Beijing, China

  • Chao Wang,

    Roles Resources

    Affiliation School of Population Medicine and Public Health, Chinese Academy of Medical Sciences & Peking Union Medical College, Beijing, China

  • Jonas Wachinger,

    Roles Conceptualization, Data curation, Methodology, Writing – review & editing

    Affiliation Heidelberg Institute of Global Health (HIGH), Faculty of Medicine and University Hospital, Heidelberg University, Heidelberg, Germany

  • Zhangfeng Jin,

    Roles Writing – review & editing

    Affiliation School of Economics, Zhejiang University of Technology, Hangzhou, China

  • Aditi Bunker,

    Roles Writing – review & editing

    Affiliation Heidelberg Institute of Global Health (HIGH), Faculty of Medicine and University Hospital, Heidelberg University, Heidelberg, Germany

  • Pascal Geldsetzer,

    Roles Supervision, Writing – review & editing

    Affiliations Department of Medicine, Division of Primary Care and Population Health, Stanford University School of Medicine, Stanford, California, United States of America, Chan Zuckerberg Biohub – San Francisco, San Francisco, California, United States of America

  • Juntao Yang ,

    Roles Conceptualization, Funding acquisition, Resources, Supervision

    yangjt@pumc.edu.cn (JY); xuelan@mail.tsinghua.edu.cn (LX); simiao.chen@uni-heidelberg.de (SC)

    Affiliation School of Population Medicine and Public Health, Chinese Academy of Medical Sciences & Peking Union Medical College, Beijing, China

  • Lan Xue ,

    Roles Supervision, Writing – review & editing

    yangjt@pumc.edu.cn (JY); xuelan@mail.tsinghua.edu.cn (LX); simiao.chen@uni-heidelberg.de (SC)

    Affiliations Institute for AI International Governance, Tsinghua University, Beijing, China, School of Public Policy and Management, Tsinghua University, Beijing, China

  • Till Bärnighausen ,

    Roles Conceptualization, Supervision, Writing – review & editing

    ‡ FY, LJ and QC contributed equally to this study as co-first authors. TB and SC are co-senior authors to this work.

    Affiliations Heidelberg Institute of Global Health (HIGH), Faculty of Medicine and University Hospital, Heidelberg University, Heidelberg, Germany, School of Population Medicine and Public Health, Chinese Academy of Medical Sciences & Peking Union Medical College, Beijing, China

  •  [ ... ],
  • Simiao Chen

    Roles Conceptualization, Data curation, Funding acquisition, Investigation, Resources, Writing – review & editing

    yangjt@pumc.edu.cn (JY); xuelan@mail.tsinghua.edu.cn (LX); simiao.chen@uni-heidelberg.de (SC)

    ‡ FY, LJ and QC contributed equally to this study as co-first authors. TB and SC are co-senior authors to this work.

    Affiliations Heidelberg Institute of Global Health (HIGH), Faculty of Medicine and University Hospital, Heidelberg University, Heidelberg, Germany, School of Population Medicine and Public Health, Chinese Academy of Medical Sciences & Peking Union Medical College, Beijing, China

  • [ view all ]
  • [ view less ]

Abstract

Understanding public preferences concerning vaccination is critical to inform pandemic response strategies. To investigate Chinese adults’ preferences regarding COVID-19 vaccine attributes, we conducted a cross-sectional online survey in 12,000 Chinese adults in June-July, 2021. Participants were requested to answer a series of discrete choice questions related to hypothetical COVID-19 vaccines. Using mixed logit models, our analysis revealed that participants had a higher preference for COVID-19 vaccines with longer duration of protection (coefficient: 1.272, 95% confidence interval [1.016 to 1.529]) and higher efficacy (coefficient: 1.063, [0.840, 1.287]). Conversely, participants demonstrated a lower preference associated with higher risk of rare but serious side-effects (coefficient: -1.158, [-1.359, -0.958]), oral administration (coefficient: -0.211, [-0.377, -0.046]), more doses (coefficient: -0.148, [-0.296, 0.000]) and imported origin (coefficient: -0.653, [-0.864, -0.443]). Moreover, preferences were heterogeneous by individual factors: highly educated participants were more sensitive to the negative vaccine attributes including price (coefficient -0.312, [-0.370, -0.253]) and imported vaccine (coefficient -0.941, [-1.186, -0.697]); there was also substantial heterogeneity in vaccine preferences with respect to age group, marital status, work status, income, chronic diagnosis history, COVID-19 vaccination history and geographic regions. As the first study of examining the public preferences for COVID-19 vaccine in China with a large nationwide sample of 12,000 adults, our results indicate that future vaccine should pose lower risk, possess longer protection period, have higher efficacy, be domestically produced, and have lower costs to increase the COVID-19 vaccination coverage. Our current study findings from this study provide insights and recommendations for not only COVID-19 vaccine design but also vaccine attribute preferences to increase vaccine uptake in potential future pandemics.

Introduction

The coronavirus disease 2019 (COVID-19) pandemic has substantially harmed population health and economies worldwide [14]. Researchers, policymakers, and other stakeholders have sought effective measures to control the pandemic [5, 6]. Of the potential options, safe and effective vaccination was considered as a preferable pathway to reduce morbidity and mortality against COVID-19 pandemic [710]. In February 2023, thirteen COVID-19 vaccines have been approved for emergency use by World Health Organization (WHO), including inactivated vaccines, viral vector vaccines, mRNA vaccines, and protein subunit vaccines [11]. Beyond these approved vaccines, 183 vaccine candidates have been approved for clinical trials, and 199 vaccines are in preclinical trials, according to WHO data released on March 30st, 2023 [12]. However, vaccine availability alone does not necessarily lead to high vaccination rates [13]. Additionally, as COVID-19 vaccines may be regularly offered similar to flu shots in years to come [14], it is of critical importance to understand vaccine preferences and factors that affect vaccine decision-making in order to increase global vaccination coverage for both the ongoing COVID-19 responses and for future pandemic preparedness.

Discrete choice experiments (DCEs) have been frequently utilized in previous studies examining COVID-19 vaccine preferences, due to their robust and accurate estimation of health behaviors and preferences [15]. In vaccine-related DCEs, participants for example have been asked to choose between vaccines with different attributes, such as efficacy, availability, doses, country of production, price, duration of protection, and risk of side effects [1520]. Some experiments also offered “opt-out” options for cases when the participants felt that the vaccines offered were unacceptable for them [21, 22]. Via DCEs, researchers have studied how attributes influence people’s preferences and affect the uptake of a COVID-19 vaccine, but available studies commonly have focused on specific populations, such as healthcare workers [23], university students [24], or people with chronic immune-mediated inflammatory diseases [25]. Existing literature indicates that attributes including high vaccine efficacy, low risk of side effects, long duration of immunity, and low number of required doses have the highest influence on COVID-19 vaccine uptake probability. For example, a study exploring COVID-19 vaccine preferences in China found that vaccine uptake probability increased by 45.7% if vaccine effectiveness increased from 40% to 85%, and increased by 43.2% if the risk of severe side effects fell from 50/100,000 to 1/100,000 [16].

Current literature related to COVID-19 vaccine preferences has yet to utilize nationwide samples that contain more than a few thousand participants to study the vaccine preferences of the general population. With the relatively small samples in these studies, DCEs have limited power to identify heterogeneities and interactions between vaccine attributes and individual characteristics with further details. Furthermore, limited research has closely examined the geographical heterogeneities with regards to vaccine uptake probability. To fill these gaps, this study investigated vaccine preferences and associated determinants for COVID-19 vaccines among individuals in China utilizing a large, nationwide sample. In addition, we predicted the changes in vaccine uptake probability when varying one attribute from the baseline vaccine to provide insights into the impact of vaccine attributes on vaccine uptake. Furthermore, we predicted the vaccine uptake probability of hypothetical Sinovac-CoronaVac (COVID-19) vaccines at different prices for different provinces, to demonstrate pricing-dependent geographical heterogeneities in vaccine uptake. This study aimed to facilitate the development of vaccination strategies, such as targeted vaccine campaigns, and provided empirical findings that can elucidate optimal vaccine pricing for anticipated vaccination rates across subpopulations for relevant policymaking. Through this research, we hope to inform best practices in promoting future vaccine uptake.

Methods

Survey development, attributes, and attribute levels

We developed the survey, “Questionnaire on Willingness to COVID-19 Vaccination,” which included questions in four sections: choice tasks, participants’ basic information, health conditions, and historical vaccination behaviors (S1 Text). In the first section, we investigated adults’ preferences for the COVID-19 vaccines using a DCE. Specifically, each participant was presented with and expected to choose between two competing scenarios representing two different hypothetical COVID-19 vaccines that contained different sets of attributes. We also provided an opt-out option because COVID-19 vaccinations were not mandatory in China at the time of our study [26].

A sequential mixed-methods approach [27] was applied to develop vaccine attributes and their corresponding levels (S2 Text), including a review of the available literature and in-depth qualitative interviews to identify suitable attributes and attribute levels. The chosen attributes of the hypothetical vaccines are listed as follows (Table 1): total price (free, 200 RMB ≈ $30.8, 400 RMB ≈ $61.6, 600 RMB ≈ $92.4), risk of rare but serious side-effects such as temporary or permanent paralysis from the vaccine (no risk: 0, moderate risk: 1/1,000,000, high risk: 1/100,000), duration of protection (6 months, 12 months, life-long), degree of efficacy (50%, 70%, 90%), method of vaccine administration (injection, oral), frequency of vaccination (one dose, two doses, three doses), and vaccine origin (domestic, imported). These seven attributes resulted in 1,296 (= 4*34*22) hypothetical vaccine profiles and a total of 839,160 possible pairwise choice scenarios. We used a sequential orthogonal design to reduce the choice scenarios to 36 choice tasks in three blocks, with 12 choice tasks in each block [27]. We assigned each participant randomly to one of the three blocks to complete the survey.

thumbnail
Table 1. Discrete choice experiment attributes and attribute levels.

https://doi.org/10.1371/journal.pgph.0003387.t001

Prior to finalizing the DCE design, we recruited 45 adults into a pilot study with similar characteristics to the target population in June 2021 to validate the clarity of vaccine attribute definitions, confirm the appropriateness of size of choice sets, and generate parameters for the final design [28, 29]. Based on the parameters from the pilot study, we used the Ngene (version 1.2.1) DCE design software package to generate a series of choice tasks for participants to choose. We did not add an exercise choice set to help respondents get familiar with the choice tasks due to the following reasons. First, nearly all participants passed the internal consistency test in the pilot study and had no cognitive difficulties in understanding the choice set. Second, it takes approximately 10 minutes to finish the actual choice set, and so an additional exercise choice set would increase the time burden. See S2 Text for more details on the process of developing the DCE and S1 Table for an example of choice tasks provided to participants.

Data collection

We conducted the online survey among the general adult population of China between June 4th and July 11th in 2021. The survey was distributed via KuRunData, a private online survey company that maintains a database of potential survey participants and administers surveys. KuRunData takes advantage of its own platform and partnerships with other websites in recruiting participants, and also encourages registered members to recruit new members through the popular mobile application WeChat Mini [30]. KuRunData verified that members have access to mobile phones, internet, and can navigate online surveys. In this study, KuRunData sampled between 360–480 participants in each of China’s 31 provincial-level administrative units, adjusting the specific sample size with respect to each unit’s entire population, with a total target sample size of 12,000 adults. Within each province, KuRunData sampled a proportion of participants reflective of the demographic composition of the province’s population (as per the 2019 census [31]) by sex, age group, and urban-rural residence.

Adults in the survey pool could participate in the survey on KuRunData’s platform until the total target sample size threshold was reached. Survey participants would receive 2–5 RMB (depending on their membership level in KuRunData platform) upon the completion of the questionnaire. Before filling out the questionnaire, participants provided their informed written consent with signature confirmation. In total, 12,193 adults agreed to take the online survey, among which 193 samples were excluded for not meeting the following requirements: 1) the participants must complete this survey between the time period of 360–1000 seconds, and 2) the age, marital status and education status should be consistent. This resulted in 12,000 total valid samples to be included in our final analysis. Further details of our data quality control methods are provided in S2 Text.

Ethical review

This study was approved by the Ethics Review Committee for Biomedical Research Involving Humans of the Chinese Academy of Medical Sciences and Peking Union Medical College (CAMS&PUMC-IEC-2020-001) and the Ethics Committee of the Medical Faculty of Heidelberg University (S-041/2021). All participants provided online informed consent before completing the survey.

Inclusivity in global research

Additional information regarding the ethical, cultural, and scientific considerations specific to inclusivity in global research is included in the S1 Checklist.

Data analysis

To model an individual’s vaccine preference with different attributes, we started by defining the individual’s utility function based on vaccine attributes and attribute levels [32]. Following the random utility maximization model framework [33], each participant chose alternative j that yields the maximum utility among the three presented alternatives [34]. We specified the utility Uij associated with alternative j for individual i in each choice scenario as: (1) where Vij is the deterministic utility and ϵij is the random utility that was assumed to follow a Type 1 extreme value distribution. In particular, the deterministic utility Vij was parameterized as a linear function of the seven vaccine attributes (with price coded as a continuous variable and the other categorical attributes coded as dummy variables), in addition to two alternative-specific constants accounting for the tendency to vaccinate and the tendency to choose left options over right ones, respectively [35]. As a result, the deterministic utility that individual i obtained from an alternative j admitted the following mathematical form: (2) where ASCj is an alternative-specific constant of preference for having a vaccine (versus opt-out), ASC_1stj is a constant accounting for the first option, β1i, …, β11i are the preference parameters of each attribute level for individual i. To account for preference heterogeneity among the population, we considered the preference parameters as random effects. That is, we applied a mixed logit model [34] to investigate adults’ preferences for vaccines with different attributes. In our basic mixed logit model, we assumed preference parameters βmi to follow a normal distribution, (3) where μm is the mean of the preference parameter and ξmi captures the individual-level heterogeneity.

To further examine the heterogeneity in the preference parameter βmi in the population, we considered an extended mixed logit model by incorporating the interaction effects between individual’s characteristics and the preference parameter for those vaccine attribute levels with significant heterogeneity [28]. That is, if the variance estimate was shown to be significantly different from 0 based on model (3), we re-parameterized vaccine preference parameter βmi by incorporating individual participant’s characteristics as: (4) where νm is the mean of the preference parameter for the reference population, Zik represents the characteristic k of participant i, γmk denotes interaction effect between m-th vaccine attribute level and k-th individual characteristic, and ξmi captures participant i’s unobserved preference heterogeneity for attribute m. For participants’ characteristics, we included sex (male and female), age group (18–39 years, 40–59 years, ≥ 60 years), education (primary school or less, middle and high school, college and above), current residence (rural, urban), work situation (work in a private setting, work in a public setting, no job), insurance type (Urban Employees Basic Medical Insurance [UEBMI], Basic Medical Insurance for Urban and Rural Residents [BMIURR]), yearly household income level (< 60,000 RMB, 60,000–149,999 RMB, ≥ 150,000 RMB), whether the participant had been diagnosed with any chronic disease, and whether they had been vaccinated with at least one dose of vaccine.

Our basic mixed logit model showed that a vaccine administered in two doses had non-significant standard deviations (SD) for its random effect (see S2 Table for detailed results). Therefore, we did not include this attribute when adding the interaction with other participants’ covariates in the extended mixed logit model.

With all the model parameters estimated from the extended mixed logit model (4), we calculated the predicted vaccine uptake probability of each participant, assuming only two choices available: vaccination vs. opt-out. We used the following formula to compute the vaccine uptake probability of individual i for vaccine alternative j: (5) where utility Vij was obtained from Eq (2) and the preference parameter βmi for calculating the utility Vij was estimated using model (4).

Lastly, to examine the geographical heterogeneity in adults’ preferences for vaccines, we stratified our analysis by province using the basic mixed logit model (3) (considering that the sample size in each province may not be sufficiently large for applying the extended mixed logit model) and predicted the vaccine uptake probability for a hypothetical vaccine at different prices in each province to provide insights into real-world vaccination. The attributes of the hypothetical vaccine were chosen to closely resemble the Sinovac-CoronaVac vaccine selected from the vaccine attribute levels in the questionnaire [36]. All models were conducted using simulated maximum likelihood in the Apollo package (version 0.2.8) for R (version 4.2.0) [37].

Results

Sample characteristics

A total of 12,193 participants were recruited, and 12,000 participants were included in our analysis, resulting in 144,000 choices with each participant answering twelve choice tasks. Among these participants, only 132 (1.10%) participants refused all COVID-19 vaccines regardless of vaccine characteristics. In total, 51.1% participants were male, 38.6% were 18–39 years old, and 60.5% were from urban areas, which represented a similar demographic distribution to the 2019 nationwide census [31]. Nearly half (45.8%) of all participants worked in a public setting, and all participants were covered by public health insurance, with 70.6% enrolled in UEBMI (Table 2).

Main effects of vaccine attribute preferences

In the main results from the extended mixed logit model (Table 3), we found that adults in China generally preferred to have a vaccine compared with opt-out (coefficient 2.882, 95% Confidence Interval [2.809, 2.954]). The positive estimate of the alternative-specific constant for the first option (coefficient 0.121, [0.097, 0.145]) indicated that participants tended to choose the first option, in line with the known left-to-right reading bias from the literature [35]. Our results also revealed that participants had a higher preference for vaccines with lower risk (coefficient of high risk -1.158, [-1.359, -0.958]), longer duration of protection (coefficient 1.272, [1.016, 1.529]), higher efficacy (coefficient 1.063, [0.840, 1.287]), injection over oral administration (coefficient of oral vaccine -0.211, [-0.377, -0.046]), and fewer doses (coefficient of 2 doses -0.205, [-0.233, -0.176]). In addition, an imported vaccine was associated with a decrease in vaccine utility (coefficient -0.807, [-0.846, -0.767]).

thumbnail
Table 3. Main effects from the extended mixed logit model.

https://doi.org/10.1371/journal.pgph.0003387.t003

Heterogeneity among adults’ vaccine preferences

There was significant heterogeneity in vaccine attribute preferences by individual characteristics including age group, education level, marital status, work situation, income level, chronic conditions, and vaccination history (Fig 1). In particular, we found that highly educated adults showed higher sensitivity to negative vaccine attributes (i.e., attributes with negative means of the preference parameters νm for non-reference levels; such attributes included price, risk, being imported, several doses). Participants with college-level education and above were more sensitive to vaccine attributes of price (coefficient -0.312, [-0.370, -0.253]) and imported vaccine (coefficient -0.941, [-1.186, -0.697]) than those who did not exceed primary school-level education. In addition, participants who were vaccinated, married, or were older were less sensitive to high risk and price. On the other hand, regarding positive vaccine attributes, participants with high income displayed higher sensitivity to long protection duration and high efficacy while participants diagnosed with a chronic disease were less sensitive to these attributes, compared with the reference group. Detailed results for the interaction effects from the extended mixed logit model are provided in S3 Table.

thumbnail
Fig 1. Main effects plus interaction effects across groups for different vaccine attributes estimated from the extended mixed logit model.

Notes: Each subfigure presents the main effect of vaccine attribute m plus interaction effects with individual’s characteristics (i.e., νm + γmk, see Methods Section for further details of variable notations and model specifications.). The red dashed line indicated the mean of main effect of the reference group (male, 18–39 years, primary school or less, unmarried, rural, work in a private setting, UEBMI, < 60,000 RMB, not ever diagnosed with a chronic disease, not vaccinated by COVID-19 vaccines). Heterogneity is considered significant if confidence interval of each individual’s characteistic does not intersect with the red dashed line (detailed reports are provided in S3 Table). The black dashed line represented the point of no preference. The relationship of the confidence interval to the black dashed line indicated whether this attribute was preferred or not preferred by this group. The interactions between two doses and participants’ characteristics were excluded in the extended mixed logit model.

https://doi.org/10.1371/journal.pgph.0003387.g001

Vaccine uptake probabilities

The predicted uptake probability for the baseline vaccine (free, no risk of severe side-effects, protection duration of 6 months, 50% vaccine effectiveness, one dose-injected, and domestically produced) was 95.3%. In Fig 2, we present the change in vaccine uptake probabilities by changing one vaccine attribute at a time compared with the baseline vaccine. The vaccine uptake probability increased by 2.7%, when vaccine protection duration increased from 6 months to life long. The vaccine uptake probability decreased by 12.1% when the domestic vaccine was replaced with an imported vaccine and decreased by 19.7% when vaccine price changed from free to 600 RMB.

thumbnail
Fig 2. Effects of changing the attribute levels on uptake probabilities from baseline vaccine uptake of 95.3%.

https://doi.org/10.1371/journal.pgph.0003387.g002

In Fig 3, we depict the effect of price on the predicted uptake probabilities for the baseline vaccine. As price increased from free (baseline) to 1,000 RMB, the predicted vaccine uptake probability dropped from 95.3% to 63.1%. We also observed steepest decrease in the predicted uptake probability from 88.9% to 80.6% when the vaccine price increased from 400 to 600 RMB. When stratified by sex, age, and education populations (S1S3 Figs), we found that female, older, and middle-level educated people were less sensitive to price increase, whereas male, middle-aged, and highly educated people were more sensitive, which is in line with the findings from the S3 Table.

thumbnail
Fig 3. Effect of price on predicted uptake probabilities from the extended mixed effect model.

https://doi.org/10.1371/journal.pgph.0003387.g003

Geographical heterogeneity across price levels in vaccine preferences

To explore geographical heterogeneity in vaccine uptake probability, we estimated vaccine uptake probabilities for the hypothetical Sinovac-CoronaVac vaccine (moderate risk, protection duration of 6 months, 50% vaccine effectiveness, two dose-injected, and domestically produced) at different prices for each province in China (Fig 4). As the price of the vaccine increased, heterogeneity in predicted vaccine uptake probabilities across provinces gradually widened. When the vaccine was free, the highest vaccine uptake probability by province ranged from 76.5% (Shanghai) to 89.7% (Jiangxi)—this range widened from 49.7% (Shanghai) to 71.5% (Heilongjiang), when the price of the vaccine increased to 600 RMB. The provinces with relatively low vaccine uptake probabilities, such as Shanghai, Liaoning, Jiangsu, Sichuan, and Chongqing, are primarily concentrated in coastal and central areas of the country.

thumbnail
Fig 4. Predicted vaccine uptake probabilities across provinces from the mixed effect model at different prices.

Note: Areas in grey color represent missing data. Base layer data source: GaryBikini/ChinaAdminDivisonSHP: ChinaAdminDivisonSHP v24.02.06 (zenodo.org) Republished from [39] under a CC BY license, with permission from GaryBikini, original copyright 2020.

https://doi.org/10.1371/journal.pgph.0003387.g004

Discussion

Utilizing a discrete choice experiment and mixed logit models, this study examined vaccine preferences with regard to vaccine characteristics and quantification of how the intent to receive vaccination changes with different COVID-19 vaccine attributes [9, 29]. We found a widespread openness for COVID-19 vaccines in China, in which only 132 out of 12,000 (1.1%) participants opted for no vaccine in all twelve tasks, regardless of vaccine characteristics. Vaccine preference increased with longer protection duration and higher efficacy, and lower risks of side effects. Findings on heterogeneities in vaccine preferences also elucidated different uptake probabilities across geographic regions, education levels, age groups, and other subpopulations in relation to vaccine price. Furthermore, this study contributes to the existing vaccine preference literature by employing a large nationwide sample and using a wide range of vaccine attributes.

We found an exceptionally high percentage of people in China who hold a positive attitude toward preventing and controlling COVID-19 through vaccination. Only 1.1% of participants opted for no vaccine in our study. Our findings show a sharp increase in the percentage of people who hold positive preferences toward vaccination, compared with the findings from an earlier study in China prior to vaccine availability that showed 80% of Chinese respondents would be willing to take the vaccine when it becomes available [18]. In addition, we found a high predicted vaccine uptake probability of 95.3% for the baseline vaccine, which had attributes including free costs, no risk of severe side-effects, six months duration of protection, 50% vaccine efficacy, one-dose injection, and domestic production. An earlier study in China found a predicted uptake probability of 84.8% under conditions including 85.0% vaccine effectiveness, 1/100,000 severe side-effect risks, free costs, one dose, delivery at tertiary vaccination sites (i.e., county hospitals and above), two years duration of protection and 90.0% of acquaintances vaccinated [16]. The higher predicted uptake probability in our study suggests that vaccine promotion and increased knowledge of the COVID-19 pandemic over time contributed to increased vaccine uptake [40].

Our findings also demonstrate the impact of vaccine attributes on vaccine preferences. For example, whether the vaccine was imported or domestically manufactured significantly impacted participants’ uptake probabilities, with the vaccine uptake probability decreasing by 12.1% when the domestic vaccine was replaced with an imported vaccine. This finding is in line with most existing literature, such as a cross-country analysis conducted in Latin American [41] and a DCE conducted in India [20], where studies identified a higher preference for domestic vaccines rather than imported vaccines [4, 4244]. However, our findings contradict a prior study in China which found higher preference for imported vaccines instead of domestically manufactured vaccines using a smaller sample [18]. The inconsistency in findings relating to whether there was higher preference for imported or domestic vaccines may result from constraints in sample size and representativeness, as the prior study that found a preference for imported vaccines did not have a large sample size and was not nationally representative. Considering the larger sample size and national representativeness of this study as well as the high levels of trust placed in the government and healthcare system in China [45], we have sufficient evidence to conclude that there is a higher preference for domestic vaccines rather than imported vaccines in China.

Vaccine price is also an important attribute that showed a significant impact from our analysis. The uptake probability of 95.3% dropped sharply to 63.1% when the free baseline vaccine increased in price to 1,000 RMB (US $154). While this was a steep decrease in vaccine uptake probability, the results still indicate that more than half the people would be willing to receive vaccinations if the price was 1,000 RMB. This preference contradicts previous studies in early 2020 that revealed a willingness-to-pay (WTP) within the range of 100–300 RMB for COVID-19 vaccines in China [46, 47], where WTP refers to the price when the predicted vaccine uptake probability is 50%. The contradiction may be explained by vaccination promotion efforts. When the majority of people considered the price to be too high when the expected Chinese vaccine price was about 1,000 RMB in August 2020 [48], numerous strategies were adopted in China to facilitate vaccine uptake [49], some of which may have had a positive impact on WTP, such as health communication campaigns [50]. In September 2020, the Chinese public already favored a vaccine price of 600 RMB [51]. It is likely that by 2021, the emphasis on vaccination had become stronger such that WTP increased to 1,000 RMB, which supports our findings. Another possible explanation for the increase in WTP from 600 RMB to 1000 RMB may be that by the time the participants were surveyed in this study, the Chinese government had already announced that COVID-19 vaccinations would be offered free to Chinese citizens [52] and so participants may have believed that they would not have to pay for COVID-19 vaccines out-of-pocket regardless of vaccine price. Knowing that vaccines are provided for free might change the behavior of participants through cognitive mechanisms such as anchoring effects, which is the tendency for participants to rely heavily on the first piece of information when making decisions [53]. When vaccines are announced as free, this sets an initial anchor of zero cost, which may lead participants to express a high WTP as a form of positive feedback or approval of the free vaccine initiative, even if they do not actually expect to pay that amount–this may also explain our findings of the lower sensitivity to vaccine price among adults with high income. However, not all participants may have been aware of the free COVID-19 vaccination announcement and there could have been uncertainty about how long the free COVID-19 vaccination may last for. Furthermore, this anchoring effect may be moderated by the fact that influenza vaccines in the past were typically paid out-of-pocket and were only partially or fully subsidized for children and older adults via health insurance or local government funds in economically developed regions in China [54, 55]. As the pandemic progressed and the Chinese government relaxed COVID-19 restrictions, the perceived severity of COVID-19 decreased among the public, and the lessened threat of being infected with COVID-19 was likely accompanied by a decrease in WTP. In fact, WTP of COVID-19 booster dose in China was estimated to decrease to 149 RMB from a 2022 survey [56].

This study also sheds light on heterogeneities regarding vaccine preferences. We demonstrated geographical heterogeneities in predicted vaccine uptake probability between Chinese provinces as vaccine price changed. In particular, when vaccine price increased to 600 RMB, predicted vaccine uptake probabilities dropped to about 40.0% - 50.0% for coastal regions such as Shanghai and Liaoning. This could be attributed to the higher sensitivity to price changes in coastal regions as a result of higher living costs despite potentially higher average incomes [57]. With regards to heterogeneities in vaccine preferences across education levels, we found that as the vaccine price increased, the predicted vaccine uptake probabilities among those who received college education decreased substantially relative to those who received primary school or no school education. The observed relationship between education level and vaccine preference is supported by several previous studies [5861]. One possible reason is that people with higher education levels may have greater access to information, which increases the likelihood of being exposed to misinformation about COVID-19 vaccines, leading to vaccine hesitancy [62]. People who endorse more misinformation are less likely to follow behaviors to prevent COVID-19 [63]. Specifically, social media usage was identified as the main source of COVID-19 vaccine misinformation in China, and public health authorities and professionals should make an active effort to debunk false claims [64]. However, it is important to note that education level is found to be positively associated with vaccine uptake in most countries and regions [65, 66]. The discrepancy in findings may be attributed to the varying level of health education or vaccine-related education in relation to general education level in different countries (i.e., if a higher general education level necessarily leads to higher awareness and knowledge of the benefits of vaccination). Understanding the varying degrees of vaccine preferences among each region and subpopulations with different education levels as well as the underlying reasons can support local policymakers to mitigate these factors and increase the likelihood of successfully executing vaccination campaigns.

The findings of this study have several policy implications. First, we found that price is a critical factor in determining vaccine uptake probability. Currently, COVID-19 vaccination is free of charge in China, but the findings from this study indicate that policymakers must seriously consider the level at which vaccine prices are set, when vaccines are no longer free in the future. Furthermore, targeted vaccine campaigns in specific geographic regions can be helpful in promoting vaccine uptake, especially in regions that are more price-sensitive. Second, while there has been mixed evidence in the literature regarding preferences between imported vaccines and domestic vaccines, our nationally representative findings from a large sample size confirm higher preferences for domestic vaccines. However, levels of trust in the government are situational and may change in the future. Therefore, it is important to facilitate strong and sustainable trust in the government and healthcare system by increasing credibility and promoting open communication [45]. In particular, sending consistent and unified vaccine-related messages on media is much needed to facilitate trust and combat misinformation [63, 65, 67]. Third, our results indicate that oral administration is not beneficial and vaccines should require as few doses as possible.

This study also has several limitations. First, participants were selected from a pool of registered adults with KuRunData who agreed to participate in the survey, and thus the study may be subject to selection bias depending on profiles of platform users. In particular, it presented challenges in reaching older individuals, and thus our sample may not fully represent the entire adult population, especially due to the absence of participants aged over 70. To minimize bias, we utilized quota sampling and stratified sampling by age, gender, and residence to increase representativeness of the general adult population. Second, we included only a selected set of vaccine attributes, leaving out several other attributes that have also been discussed in vaccine literature such as vaccination site [16] and distance to vaccination site [68], to ensure that participants had the cognitive capacity to consider all attributes when making choices. To guarantee that the most important attributes were included, we conducted a systematic qualitative investigation and literature review beforehand to identify the most important attributes and specify the corresponding levels for our study. Third, it is crucial to acknowledge the common problem of cognitive difficulty present in discrete choice experiments, which is aggravated when DCEs are online without support, and the possible discrepancy between participants’ stated preferred choices and actual choice made in reality.

Conclusion

Our findings suggest that to facilitate higher adults’ preferences for COVID-19 vaccines, future vaccines should be domestically produced, offer longer protection period, have higher efficacy, and be of no risk to health. We provide empirical evidence on general adults’ vaccine preferences with relevance for policymakers in China, as well as other countries with similar concerns, to inform future best practices with respect to pandemic preparedness. Our results also offer recommendations for adjusting vaccine subsidy policies and vaccine design policies for targeted vaccine campaigns in general to facilitate wider vaccination coverage.

Supporting information

S1 Text. Questionnaire in English and Chinese.

https://doi.org/10.1371/journal.pgph.0003387.s002

(DOCX)

S1 Fig. Effect of price on predicted uptake probabilities by sex from the extended mixed effect model.

https://doi.org/10.1371/journal.pgph.0003387.s004

(TIFF)

S2 Fig. Effect of price on predicted uptake probabilities by age from the extended mixed effect model.

https://doi.org/10.1371/journal.pgph.0003387.s005

(TIFF)

S3 Fig. Effect of price on predicted uptake probabilities by education level from the extended mixed effect model.

https://doi.org/10.1371/journal.pgph.0003387.s006

(TIFF)

S2 Table. Results of the basic mixed logit model.

https://doi.org/10.1371/journal.pgph.0003387.s008

(DOCX)

S3 Table. Detailed results of the extended mixed logit model.

https://doi.org/10.1371/journal.pgph.0003387.s009

(DOCX)

References

  1. 1. Chen S, Chen Q, Yang J, Lin L, Li L, Jiao L, et al. Curbing the COVID-19 pandemic with facility-based isolation of mild cases: a mathematical modeling study. J Travel Med. 2021;28(2).
  2. 2. Chen S, Chen Q, Yang W, Xue L, Liu Y, Yang J, et al. Buying Time for an Effective Epidemic Response: The Impact of a Public Holiday for Outbreak Control on COVID-19 Epidemic Spread. Engineering (Beijing). 2020;6(10):1108–14. pmid:32983582
  3. 3. Chen S, Jin Z, Bloom DE. Act Early to Prevent Infections and Save Lives: Causal Impact of Diagnostic Efficiency on the COVID-19 Pandemic. Bonn: Institute of Labor Economics (IZA); 2020 2020-09-30. Report No.: 2365–9793 Contract No.: 13749.
  4. 4. Chen M, Li Y, Chen J, Wen Z, Feng F, Zou H, et al. An online survey of the attitude and willingness of Chinese adults to receive COVID-19 vaccination. Human Vaccines & Immunotherapeutics. 2021;17(7):2279–88. pmid:33522405
  5. 5. Yu F G P, Meierkord A, Yang J, Chen Q, Jiao L, Abou-Arraj NE, et al. Knowledge About COVID-19 Among Adults in China: Cross-sectional Online Survey. J Med Internet Res. 2021 Apr 29;23(4): e26940. pmid:33844637
  6. 6. H Y., C S.. What can we learn from COVID-19 vaccine R&D in China? A discussion from a public policy perspective. J Travel Med. 2021;28(4):taab026.
  7. 7. Organization WH. Coronavirus disease (COVID-19) advice for the public 2020 [https://www.who.int/emergencies/diseases/novel-coronavirus-2019/advice-for-public.
  8. 8. Organization WH. COVID-19 vaccines 2020 [https://www.who.int/emergencies/diseases/novel-coronavirus-2019/covid-19-vaccines.
  9. 9. Schwarzinger M, Watson V, Arwidson P, Alla F, Luchini S. COVID-19 vaccine hesitancy in a representative working-age population in France: a survey experiment based on vaccine characteristics. The Lancet Public Health. 2021;6(4):e210–e21. pmid:33556325
  10. 10. Yu H, Du R, Wang M, Yu F, Yang J, Jiao L, et al. Attitudes Toward the Global Allocation of Chinese COVID-19 Vaccines: Cross-sectional Online Survey of Adults Living in China. JMIR Public Health and Surveillance. 2022;8(6):e33484. pmid:35483084
  11. 11. World Health Organization. COVID-19 Vaccines with WHO Emergency Use Listing 2023 [https://extranet.who.int/pqweb/vaccines/vaccinescovid-19-vaccine-eul-issued.
  12. 12. World Health Organization. COVID-19 vaccine tracker and landscape 2023 [updated March 30, 2023. https://www.who.int/publications/m/item/draft-landscape-of-covid-19-candidate-vaccines.
  13. 13. Thomson A, Robinson K, Vallée-Tourangeau G. The 5As: A practical taxonomy for the determinants of vaccine uptake. Vaccine. 2016;34(8):1018–24. pmid:26672676
  14. 14. Couzin-Frankel J. What’s next for COVID-19 vaccines? Scientists and regulators chart a course amid uncertainty: Science; 2023.
  15. 15. McPhedran R, Toombs B. Efficacy or delivery? An online Discrete Choice Experiment to explore preferences for COVID-19 vaccines in the UK. Economics letters. 2021;200:109747. pmid:33551522
  16. 16. Leng A, Maitland E, Wang S, Nicholas S, Liu R, Wang J. Individual preferences for COVID-19 vaccination in China. vaccine. 2021;39(2):247–54. pmid:33328140
  17. 17. Huang W, Shao X, Wagner AL, Chen Y, Guan B, Boulton ML, et al. COVID-19 vaccine coverage, concerns, and preferences among Chinese ICU clinicians: a nationwide online survey. Expert Review of Vaccines. 2021;20(10):1361–7. pmid:34415816
  18. 18. Dong D, Xu RH, Wong EL-y, Hung C-T, Feng D, Feng Z, et al. Public preference for COVID-19 vaccines in China: A discrete choice experiment. Health Expectations. 2020;23(6):1543–78. pmid:33022806
  19. 19. Mouter N, Boxebeld S, Kessels R, van Wijhe M, de Wit A, Lambooij M, et al. Public Preferences for Policies to Promote COVID-19 Vaccination Uptake: A Discrete Choice Experiment in The Netherlands. Value in Health. 2022;25(8):1290–7. pmid:35527162
  20. 20. Bansal P, Raj A, Shukla DM, Sunder N. COVID-19 vaccine preferences in India. Vaccine. 2022;40(15):2242–6. pmid:35282928
  21. 21. Mouter N, de Ruijter A, de Wit GA, Lambooij MS, van Wijhe M, van Exel J, et al. “Please, you go first!” preferences for a COVID-19 vaccine among adults in the Netherlands. Social Science & Medicine. 2022;292:114626. pmid:34883311
  22. 22. Craig BM. United States COVID-19 vaccination preferences (CVP): 2020 hindsight. The Patient-Patient-Centered Outcomes Research. 2021;14:309–18. pmid:33783724
  23. 23. Fu C, Wei Z, Zhu F, Pei S, Li S, Zhang L, et al. Acceptance of and preference for COVID-19 vaccination in healthcare workers: a comparative analysis and discrete choice experiment. MedRxiv. 2020:2020.04. 09.20060103.
  24. 24. Li X, Chong MY, Chan CY, Chan VWS, Tong X. COVID-19 vaccine preferences among university students in Hong Kong: a discrete choice experiment. BMC research notes. 2021;14:1–3.
  25. 25. Hazlewood GS, Colmegna I, Hitchon C, Fortin PR, Bernatsk S, Clarke AE, et al. Preferences for COVID-19 vaccination in people with chronic immune-mediated inflammatory diseases. The Journal of Rheumatology. 2023. pmid:36642432
  26. 26. News C. The NHC reaffirms that novel Coronavirus vaccination is voluntary 2021 [http://m.news.cctv.com/2021/07/16/ARTIdD7mrutKsTCrRu6kCf0r210716.shtml.
  27. 27. Marshall HS, Chen G, Clarke M, Ratcliffe J. Adolescent, parent and societal preferences and willingness to pay for meningococcal B vaccine: A Discrete Choice Experiment. Vaccine. 2016;34(5):671–7. pmid:26740249
  28. 28. Wang Q, Abiiro GA, Yang J, Li P, De Allegri M. Preferences for long-term care insurance in China: Results from a discrete choice experiment. Social Science & Medicine. 2021;281:114104.
  29. 29. Abiiro GA, Torbica A, Kwalamasa K, De Allegri M. Eliciting community preferences for complementary micro health insurance: A discrete choice experiment in rural Malawi. Social Science & Medicine. 2014;120:160–8. pmid:25243642
  30. 30. Witzig TE, Vukov AM, Habermann TM, Geyer S, Kurtin PJ, Friedenberg WR, et al. Rituximab therapy for patients with newly diagnosed, advanced-stage, follicular grade I non-Hodgkin’s lymphoma: a phase II trial in the North Central Cancer Treatment Group. Journal of Clinical Oncology. 2005;23(6):1103–8. pmid:15657404
  31. 31. Czuczman M, Grillo-Lopez AJ, LoBuglio AI, Gordon LI, Starostik P, Dowden S, et al. Patients with low-grade NHL treated with rituximab plus CHOP experience prolonged clinical and molecular remission. Blood. 2003;102(11):411A–A.
  32. 32. Louviere JJ, Hensher DA, Swait JD. Stated Choice Methods: Analysis and Applications. Cambridge: Cambridge University Press; 2000.
  33. 33. McFadden D. Conditional logit analysis of qualitative choice behavior. 1973.
  34. 34. Hensher DA, Rose JM, Rose JM, Greene WH. Applied choice analysis: a primer: Cambridge university press; 2005.
  35. 35. Ryan M, Krucien N, Hermens F. The eyes have it: Using eye tracking to inform information processing strategies in multi-attributes choices. Health Econ. 2018;27(4):709–21. pmid:29280222
  36. 36. WHO. The Sinovac-CoronaVac COVID-19 vaccine: What you need to know 2022 [https://www.who.int/news-room/feature-stories/detail/the-sinovac-covid-19-vaccine-what-you-need-to-know.
  37. 37. Hess S, Palma D. Apollo: A flexible, powerful and customisable freeware package for choice model estimation and application. Journal of Choice Modelling. 2019;32:100170.
  38. 38. ApolloChoice. FREQUENTLY ASKED QUESTIONS (FAQ) [http://apollochoicemodelling.com/faq.html.
  39. 39. GaryBikini. GaryBikini/ChinaAdminDivisonSHP: v24.02.06. 2024.
  40. 40. Salali GD, Uysal MS. Effective incentives for increasing COVID-19 vaccine uptake. Psychological Medicine. 2021:1–3. pmid:34538287
  41. 41. Argote P, Barham E, Daly SZ, Gerez JE, Marshall J, Pocasangre O. The shot, the message, and the messenger: COVID-19 vaccine acceptance in Latin America. npj Vaccines. 2021;6(1):118. pmid:34593822
  42. 42. Lin Y, Hu Z, Zhao Q, Alias H, Danaee M, Wong LP. Understanding COVID-19 vaccine demand and hesitancy: A nationwide online survey in China. PLoS neglected tropical diseases. 2020;14(12):e0008961. pmid:33332359
  43. 43. Wang J, Jing R, Lai X, Zhang H, Lyu Y, Knoll MD, et al. Acceptance of COVID-19 Vaccination during the COVID-19 Pandemic in China. Vaccines. 2020;8(3):482. pmid:32867224
  44. 44. Lin Y, Hu Z, Zhao Q, Alias H, Danaee M, Wong LP. Chinese parents’ intentions to vaccinate their children against SARS-CoV-2 infection and vaccine preferences. Human vaccines & immunotherapeutics. 2021;17(12):4806–15. pmid:34892992
  45. 45. Jiao L, Wachinger J, Dasch S, Bärnighausen T, McMahon SA, Chen S. Calculation, knowledge, and identity: Dimensions of trust when making COVID-19 vaccination choices in China. SSM Qual Res Health. 2023;4:100288. pmid:37334196
  46. 46. Wang J, Lyu Y, Zhang H, Jing R, Lai X, Feng H, et al. Willingness to pay and financing preferences for COVID-19 vaccination in China. Vaccine. 2021;39(14):1968–76. pmid:33714653
  47. 47. Qin W, Wang E, Ni Z. Chinese consumers’ willingness to get a COVID-19 vaccine and willingness to pay for it. PLoS One. 2021;16(5):e0250112. pmid:33945544
  48. 48. 21世纪经济报道. 国产新冠灭活疫苗预计12月底上市! 两针不到1000元! 中国首个新冠疫苗专利获批, 大规模生产再近一步 2020 [https://news.sina.com.cn/o/2020-08-18/doc-iivhvpwy1626285.shtml.
  49. 49. Wang J, Zhu H, Lai X, Zhang H, Huang Y, Feng H, et al. From COVID-19 vaccination intention to actual vaccine uptake: A longitudinal study among Chinese adults after six months of a national vaccination campaign. Expert review of vaccines. 2022;21(3):385–95. pmid:34974779
  50. 50. Huang C-L, Chen J-Y, Lin X-Q, Deng J-S, Tung T-H, Zhu J-S. Parents’ willingness to pay for their children’s COVID-19 vaccine in Taiwan, China: A cross-sectional study. Human Vaccines & Immunotherapeutics. 2023;19(1):2168936. pmid:36683206
  51. 51. Yin F, Wu Z, Xia X, Ji M, Wang Y, Hu Z. Unfolding the determinants of COVID-19 vaccine acceptance in China. Journal of medical Internet research. 2021;23(1):e26089. pmid:33400682
  52. 52. Xinhua. China to offer free COVID-19 vaccination to citizens: official 2021.
  53. 53. Azarpanah H, Farhadloo M, Vahidov R, Pilote L. Vaccine hesitancy: evidence from an adverse events following immunization database, and the role of cognitive biases. BMC Public Health. 2021;21:1–13.
  54. 54. Du Y, Jin C, Jit M, Chantler T, Lin L, Larson HJ, et al. Influenza vaccine uptake among children and older adults in China: a secondary analysis of a quasi-experimental study. BMC Infect Dis. 2023;23(1):225. pmid:37055738
  55. 55. Ye C, Zhu W, Yu J, Li Z, Hu W, Hao L, et al. Low coverage rate and awareness of influenza vaccine among older people in Shanghai, China: A cross-sectional study. Human Vaccines & Immunotherapeutics. 2018;14(11):2715–21. pmid:29995561
  56. 56. Zhou HJ, Pan L, Shi H, Luo JW, Wang P, Porter HK, et al. Willingness to pay for and willingness to vaccinate with the COVID-19 vaccine booster dose in China. Frontiers in pharmacology. 2022;13:1013485. pmid:36204240
  57. 57. Niu G, Zhao G. Living condition among China’s rural–urban migrants: Recent dynamics and the inland–coastal differential. Housing Studies. 2018;33(3):476–93.
  58. 58. Cooper S, van Rooyen H, Wiysonge CS. COVID-19 vaccine hesitancy in South Africa: how can we maximize uptake of COVID-19 vaccines? Expert Review of Vaccines. 2021;20(8):921–33. pmid:34252336
  59. 59. Zhang S, Yin Z, Suraratdecha C, Liu X, Li Y, Hills S, et al. Knowledge, attitudes and practices of caregivers regarding Japanese encephalitis in Shaanxi Province, China. Public Health. 2011;125(2):79–83. pmid:21288546
  60. 60. Hak E, Schönbeck Y, Melker HD, Essen GAV, Sanders EAM. Negative attitude of highly educated parents and health care workers towards future vaccinations in the Dutch childhood vaccination program. Vaccine. 2005;23(24):3103–7. pmid:15837208
  61. 61. Zhou Y, Zhang J, Wu W, Liang M, Wu Q-S. Willingness to receive future COVID-19 vaccines following the COVID-19 epidemic in Shanghai, China. BMC Public Health. 2021;21(1):1103. pmid:34107930
  62. 62. Facciolà A, Visalli G, Orlando A, Bertuccio MP, Spataro P, Squeri R, et al. Vaccine hesitancy: An overview on parents’ opinions about vaccination and possible reasons of vaccine refusal. Journal of public health research. 2019;8(1):jphr. 2019.1436. pmid:30997357
  63. 63. Dhawan D, Bekalu M, Pinnamaneni R, McCloud R, Viswanath K. COVID-19 news and misinformation: do they matter for public health prevention? Journal of health communication. 2021;26(11):799–808. pmid:34865604
  64. 64. Zhao S, Hu S, Zhou X, Song S, Wang Q, Zheng H, et al. The prevalence, features, influencing factors, and solutions for COVID-19 vaccine misinformation: systematic review. JMIR public health and surveillance. 2023;9(1):e40201. pmid:36469911
  65. 65. Viswanath K, Bekalu M, Dhawan D, Pinnamaneni R, Lang J, McLoud R. Individual and social determinants of COVID-19 vaccine uptake. BMC public health. 2021;21(1):818. pmid:33910558
  66. 66. Shakeel CS, Mujeeb AA, Mirza MS, Chaudhry B, Khan SJ. Global COVID-19 vaccine acceptance: a systematic review of associated social and behavioral factors. Vaccines. 2022;10(1):110. pmid:35062771
  67. 67. Bekalu MA, Dhawan D, McCloud R, Pinnamaneni R, Viswanath K. Adherence to COVID-19 mitigation measures among American adults: the need for consistent and unified messaging. Health Education Research. 2021;36(2):178–91. pmid:33496331
  68. 68. Teh HS, Woon YL, Leong CT, Hing NYL, Mien TYS, Roope LSJ, et al. Malaysian public preferences and decision making for COVID-19 vaccination: A discrete choice experiment. Lancet Reg Health West Pac. 2022;27:100534. pmid:35966625