Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Masks, money, and mandates: A national survey on efforts to increase COVID-19 vaccination intentions in the United States

  • Rikki H. Sargent,

    Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Writing – original draft, Writing – review & editing

    Affiliation RIWI Corp., Toronto, Ontario, Canada

  • Shaelyn Laurie,

    Roles Conceptualization, Data curation, Investigation, Methodology, Project administration, Writing – review & editing

    Affiliation RIWI Corp., Toronto, Ontario, Canada

  • Leah Moncada,

    Roles Methodology, Project administration, Writing – review & editing

    Affiliation RIWI Corp., Toronto, Ontario, Canada

  • Leo F. Weakland,

    Roles Investigation, Methodology, Project administration, Writing – review & editing

    Affiliation Center for Global Health Innovation, Atlanta, Georgia, United States of America

  • James V. Lavery,

    Roles Writing – review & editing

    Affiliations Hubert Department of Global Health, Rollins School of Public Health, Emory University, Atlanta, Georgia, United States of America, Center for Ethics, Emory University, Atlanta, Georgia, United States of America

  • Daniel A. Salmon,

    Roles Investigation, Methodology, Writing – review & editing

    Affiliations Institute for Vaccine Safety, Johns Hopkins Bloomberg School of Public Health, Baltimore, Maryland, United States of America, Department of International Health, Johns Hopkins Bloomberg School of Public Health, Baltimore, Maryland, United States of America, Department of Health, Behavior and Society, Johns Hopkins Bloomberg School of Public Health, Baltimore, Maryland, United States of America

  • Walter A. Orenstein,

    Roles Writing – review & editing

    Affiliations Hubert Department of Global Health, Rollins School of Public Health, Emory University, Atlanta, Georgia, United States of America, School of Medicine, Emory University, Atlanta, Georgia, United States of America

  • Robert F. Breiman

    Roles Conceptualization, Investigation, Methodology, Project administration, Supervision, Writing – original draft, Writing – review & editing

    rfbreiman@emory.edu

    Affiliations Center for Global Health Innovation, Atlanta, Georgia, United States of America, Hubert Department of Global Health, Rollins School of Public Health, Emory University, Atlanta, Georgia, United States of America, School of Medicine, Emory University, Atlanta, Georgia, United States of America

Abstract

Various efforts to increase COVID-19 vaccination rates have been employed in the United States. We sought to rapidly investigate public reactions to these efforts to increase vaccination, including self-reported responses to widespread reduced masking behavior, monetary incentive programs to get vaccinated, and work vaccination requirements. Using a unique method for data collection (Random Domain Intercept Technology), we captured a large (N = 14,152), broad-based sample of the United States Web-using population (data collected from June 30 –July 26, 2021). About 3/4 of respondents reported being vaccinated. The likelihood of vaccination and vaccination intention differed across various demographic indicators (e.g., gender, age, income, political leaning). We observed mixed reactions to efforts aimed at increasing vaccination rates among unvaccinated respondents. While some reported that specific efforts would increase their likelihood of getting vaccinated (between 16% and 32%), others reported that efforts would decrease their likelihood of getting vaccinated (between 17% and 42%). Reactions differed by general vaccination intention, as well as other demographic indicators (e.g., race, education). Our results highlight the need to fully understand reactions to policy changes, programs, and mandates before they are communicated to the public and employed. Moreover, the results emphasize the importance of understanding how reactions differ across groups, as this information can assist in targeting intervention efforts and minimizing potentially differential negative impact.

Introduction

As of January 5, 2022, 85.9% of the United States adult population had received at least one COVID-19 vaccination [1]. Immunizing the remaining 36 million adults is a challenging and complicated task, as there are a variety of reasons that underpin vaccination decision-making. Although COVID-19 vaccinations are effective at preventing severe disease and death—even with high prevalence of infections due to SARS CoV2 variants (e.g., [2, 3])—national polls, such as those conducted by the Kaiser Family Foundation, have found that almost half of the unvaccinated population are firmly resistant to COVID-19 vaccination [4]. Some local governments have implemented monetary incentive programs to increase vaccinations [5]. Workplace vaccination mandates have also been imposed [6], and the removal of mask mandates for vaccinated citizens could encourage some people to seek vaccination. However, relaxed mask wearing requirements, monetary incentive programs, and work vaccination mandates could backfire, tightening resistance to vaccination within some demographic groups (e.g., [7, 8]). Understanding reactions to these measures (e.g., becoming more or less willing to get vaccinated) would be helpful in designing effective, data-driven policies, interventions, and programs.

Most previous studies on reactions to behavior change efforts implement an experimental design and/or aim to uncover complex theory-based processes (e.g., research on psychological reactance), and they often do not focus on identifying groups who may respond negatively (or positively) to efforts aimed at increasing intentions to get vaccinated. While this approach and aim are crucial to the expansion of scientific knowledge, the findings are often not directly and/or immediately relevant to policy makers, community leaders, intervention specialists, and business leadership. There is a need for direct assessment of reactions that can be immediately applied in a real-world setting. The current work was conducted by the CDC-funded COVID Vaccines Information Equity and Demand creation (COVIED) program, focused on evidence-based context-specific/tailored messaging to increase vaccination, especially among minority and hard-to-reach populations. In line with the program’s aim, this work emphasizes the need to rapidly assess public sentiment broadly and among subpopulations to characterize how different groups perceive and respond to COVID immunization campaigns. To do this, we harnessed a unique data collection method that allowed us to reach the broadest, most diverse population of respondents possible quickly, so that we could in turn inform policy as it was being formed/implemented.

We set out to assess reactions to widespread reduced masking behavior and efforts to increase COVID-19 vaccination rates (i.e., monetary incentive programs and work vaccination requirements). We aimed to characterize reactions among the unvaccinated population, as well as identify differences across general vaccination intention level and basic demographic characteristics (e.g., age, gender, race). We conducted this assessment using a unique method for data collection that allowed us to capture a large, broad-based sample of the Web-using population quickly across the United States—in doing so, we were able to rapidly reach subpopulations and uncover differential reactions that could shed light on issues surrounding vaccine equity and could, in turn, inform messaging and policy.

Method

Procedure and design

We conducted an internet-based cross-sectional survey collecting data from June 30 –July 26, 2021, using a standardized survey format. We utilized RIWI (Real-Time Interactive World-Wide Intelligence) technology to engage with a sample of the US Web-using population. RIWI’s Random Domain Intercept Technology works as follows: first, Web users land on an inactive (broken) Web domain that RIWI temporarily manages. RIWI then validates the Web user’s country location and delivers the appropriate survey to the Web user. Web users choose whether to safely and anonymously opt-in to participate in the study, and they may end their participation at any time. Unlike panel surveys, no incentives are provided and no personally identifiable information is exchanged. RIWI technology has been described as nonprobability, online intercept sampling [9], and has been previously employed to assess various topics such as health care quality [1012], mental illness stigma [1315], and anti-vaccine sentiment [16].

Participants first identified whether they would like to complete the survey in English or Spanish. Following the language selection, participants reported their age (to participate, respondents had to be 18 years of age or older), gender, and COVID-19 vaccination status. Those who reported receiving at least one dose of a COVID-19 vaccine answered several questions about the vaccine (e.g., which vaccine they received and when). Those who reported that they were unvaccinated were asked up to 17 questions (depending on skip/display logic) surrounding their vaccination intentions, reactions to reduced mask-wearing, incentive programs, and work vaccination requirements, reasons for not getting vaccinated, and discussions with healthcare providers about vaccination, among other vaccination-related questions. All respondents (regardless of vaccination status) completed measures assessing their primary daily news source, entertainment sources, and basic demographics (i.e., race, education, living location, political leaning, and annual household income). We designed the survey to take less than 5 minutes to complete. The Institutional Review Boards at Emory University and Johns Hopkins University designated this project as public health practice (not human subjects research). Respondents implied consent by voluntarily participating in the survey.

Participants

Of the 1,026,850 Web-users who landed on the RIWI-operated inactive Web domain, 63,853 opted in, were eligible to participate (18+ years old, located in the US), and answered the first three questions of the survey (age, gender, vaccination status). Among those, 14,152 completed the entirety of the survey (22%) and were included in the current analysis (see S1 Fig for survey progression). Participant demographics are displayed in Table 1.

thumbnail
Table 1. Demographic characteristics of the full sample, vaccinated subsample, and unvaccinated subsample.

https://doi.org/10.1371/journal.pone.0267154.t001

Primary measures

The primary measures reported in the current manuscript are described below. In addition to these items, we also measured demographic information on age, gender, race, education level, living location, political leaning, and annual household income. See S1 File for the full survey instrument.

Vaccination status and intention.

We measured vaccination status and, among unvaccinated respondents, intentions to get vaccinated. The five response options for the vaccination intention item ranged from I will definitely get it as soon as I can to I will definitely not get vaccinated. For the current manuscript, we categorized respondents as either vaccinated (with at least one dose of a COVID-19 vaccine received) or unvaccinated, and, among those unvaccinated, as either leaning toward vaccination (definitely/likely to get vaccinated or likely to get vaccinated but not right away) or resistant to vaccination (definitely/likely to not get vaccinated).

Masking.

We asked unvaccinated respondents how fewer people wearing masks impacted their intentions to get vaccinated (more likely; less likely; no effect).

Monetary incentives.

We asked unvaccinated respondents to indicate how monetary incentive programs ($25 gift card and $100,000 lottery) impacted their intention to get vaccinated (I would be more likely to get vaccinated right away; I would be less likely to seek vaccination; there would be no effect on my getting vaccinated).

Work requirements.

We asked working unvaccinated respondents to indicate how employer vaccination requirements impacted their vaccination intentions (I would get vaccinated; I would not get vaccinated; I am not sure what I would do). Workers who said that they would not get vaccinated then reported what they would do instead (quit my job; protest; consider legal action; other).

Analysis

We report on a series of chi-square tests, multiple logistic regression analyses, multinomial logistic regression analyses, and correlational analyses. We provide odds ratios in-text where appropriate, as well as the 95% confidence intervals surrounding any odds ratios that are not provided in the tables.

We first outline basic demographic differences in vaccination status (Table 1). We then further assess unique demographic predictors of vaccination status (vaccinated vs. unvaccinated) and vaccination intention among those unvaccinated (leaning toward vaccination vs. resistant to vaccination) using two multiple logistic regression models (Table 2). The models predict each variable as a function of the following factor variables: age group, gender, race, education, living location, political leaning, and annual household income. We next report results from a series of chi-square tests assessing the relationship between reactions to each effort and vaccination intention among those unvaccinated (Table 3).

thumbnail
Table 2. Multiple logistic regression analyses predicting vaccination status and intention (dichotomized) by demographics.

https://doi.org/10.1371/journal.pone.0267154.t002

thumbnail
Table 3. Chi-square analyses predicting impact on vaccination intention by general vaccination intention (dichotomized).

https://doi.org/10.1371/journal.pone.0267154.t003

To assess unique demographic differences in how reduced mask-wearing, monetary incentive programs, and work vaccination requirements impact intentions to get vaccinated, we conducted a series of multinomial logistic regression models predicting each outcome of interest as a function of the following factor variables: age group, gender, race, education, living location, political leaning, and annual household income. Due to the consistent observation of differences across general intention to vaccinate, we also adjusted for this individual difference in analyses. Of note, we originally aimed to perform a series of ordinal logistic regressions; however, our data violated the proportional odds assumption. As such, we performed multinomial logistic regressions and chose to highlight demographic comparisons between those who report being more likely to get vaccinated vs. those who report being less likely to get vaccinated in response to each vaccination effort (Table 4).

thumbnail
Table 4. Multinomial logistic regression analyses predicting impact on vaccination intention by demographics (more likely vs. less likely to get vaccinated comparison).

https://doi.org/10.1371/journal.pone.0267154.t004

Finally, we performed correlational analyses to assess the relationships between reactions to reduced mask-wearing, monetary incentives, and work vaccination requirements.

Results

Vaccination status and intention

Of the 63,853 individuals who opted in to take the survey, 44,524 (69.7%) were vaccinated and 19,329 (30.3%) were unvaccinated (manuscript submitted for publication). The survey designed for unvaccinated respondents was longer than the survey designed for vaccinated respondents. As such, we retained proportionately more vaccinated respondents relative to unvaccinated respondents in the final analytic sample. Among the analytic sample (i.e., those who completed the entire survey), 10,866 (76.8%) had received at least one dose of a COVID-19 vaccine at the time of data collection and 3,286 (23.2%) respondents were unvaccinated.

We first assessed demographic indicators of vaccination status without adjusting for other demographic variables (Table 1). Those 46 years of age or older were 1.8 [1.7, 2.0] times more likely to be vaccinated than those 45 years of age or younger. Those with more than a high school education were 1.7 [1.6, 1.9] times more likely to be vaccinated than those with a high school education or less. Those living in towns/villages, suburbs, or large cities were 1.5 [1.4, 1.7] times more likely to be vaccinated than those living in rural/farm areas. Individuals who identified as Democrat or Democrat-leaning Independent were 2.5 [2.3, 2.7] times more likely to be vaccinated than those who identified as Independent, Republican-leaning Independent, or Republican. Those with annual household incomes greater than $50,001 were 1.5 [1.4, 1.7] times more likely to be vaccinated than those with annual household incomes at or under $50,000.

Among the unvaccinated respondents, 15.6% indicated that they would definitely get vaccinated as soon as they could, 5.7% that they would likely get vaccinated as soon as they could, 17.3% that they would likely get vaccinated but not right away, 18.7% that they would likely not get vaccinated, and 42.8% that they would definitely not get vaccinated (i.e., 38.5% were leaning toward vaccination and 61.5% were resistant).

Vaccination status.

Adjusting for all demographic variables (Table 2), those ages 56+ were 2.1 [1.9, 2.3] times more likely to be vaccinated than those 55 years of age or younger. Males were 1.2 [1.1, 1.3] times more likely to be vaccinated than females. White respondents were 1.3 [1.1, 1.5] times more likely to be vaccinated than Black respondents, whereas Asian respondents were 2.3 times more likely to be vaccinated than White respondents. Those with college degrees or higher were 1.6 [1.5, 1.7] times more likely to be vaccinated than those with technical/vocational training or less. Those living in large cities or suburbs were 1.2 [1.1, 1.3] times more likely to be vaccinated than those living in towns/villages or rural/farm areas. Democrats and Democrat-leaning Independents were 2.4 [2.2, 2.7] times more likely than Independents, Republican-leaning Independents, and Republican respondents to be vaccinated. Those with annual household incomes between $75,001-$250,000 were 1.4 [1.3, 1.6] times more likely to be vaccinated than those with household incomes under $75,000.

Vaccination intention.

Adjusting for all demographic variables (Table 2), those unvaccinated and from the youngest age group (18–25 years old) were 1.4 [1.2, 1.7] times more likely to lean toward vaccination relative to those unvaccinated and 26 years of age and older. Unvaccinated Black, Latinx, and Asian respondents were 1.4, 2.5, and 1.9 times more likely to lean toward vaccination relative to unvaccinated White respondents. Unvaccinated Democrats and Democrat-leaning Independents were 1.8 [1.5, 2.2] times more likely to lean toward vaccination, than Independents, Republican-leaning Independents, and Republican respondents.

Masking

Among unvaccinated respondents, 20.9% reported that fewer people wearing masks in public made them more likely to get vaccinated, whereas 16.7% said it made them less likely to get vaccinated, and the majority (62.4%) said it had no effect on their vaccination intentions. These reactions differed by overall intention to get vaccinated (Table 3). Those leaning toward vaccination were 11.3 [8.6, 14.9] times more likely than those resistant to vaccination to report an increased (vs. decreased) likelihood of getting vaccinated in response to reduced mask-wearing.

Monetary incentives

Among unvaccinated respondents, only 16.4% reported that a $25 gift card would make them more likely to get vaccinated, whereas 30.6% said it would make them less likely to get vaccinated and 53.0% said it would have no effect on their vaccination intention. Reactions to the $100,000 lottery incentive were similar– 19.6% said they would be more likely to get vaccinated, 29.3% said they would be less likely to get vaccinated, and 51.1% said the lottery incentive would have no impact on their vaccination intentions. These reactions again differed by overall intention (Table 3). Those leaning toward vaccination were 9.9 [7.8, 12.6] and 8.6 [6.8, 10.8] times more likely than the resistant population to report an increased (vs. decreased) likelihood of getting vaccinated in response to the gift card and lottery incentive, respectively.

Work requirements

Among working unvaccinated respondents (N = 2,135), 32.1% said that they would get vaccinated in response to a work requirement, 42.2% said they would not get vaccinated, and 25.7% reported that they were unsure if they would get vaccinated. These reactions to work requirements differed by overall vaccination intention (Table 3). Those leaning toward vaccination were 28.6 [21.8, 37.8] times more likely than resistant unvaccinated workers to get vaccinated (vs. refuse vaccination) in response to a workplace requirement. Among those who reported that they would not get vaccinated despite a mandate (n = 901), 43.1% said that they would consider legal action, 30.1% would quit their jobs, 9.0% would protest, and 17.9% chose an unspecified course of action (see S1 Table for an analysis of demographic differences in anticipated reactionary responses).

Demographic differences

Adjusting for all demographic indicators (Table 4), those leaning toward vaccination were 7.5 to 27.0 times more likely to report an increased (vs. decreased) likelihood of getting vaccinated in response to each vaccination effort (i.e., reduced masking, gift card incentive, lottery incentive, and workplace requirements). Those who identified as Democrat or Democrat-leaning Independent were 1.6 [1.2, 2.2] to 2.6 [2.0, 3.4] times more likely to report an increased (vs. decreased) likelihood of getting vaccinated in response to each effort relative to those who identified as Independent, Republican-leaning Independent, or Republican. Those with high school educations or less were 1.7 [1.1, 2.7] times more likely than those with masters degrees or higher to report an increased (vs. decreased) likelihood of getting vaccinated in response to reduced mask-wearing. White respondents were 2.1 [1.5, 3.0] and 1.6 [1.2, 2.3] times more likely than Black respondents to report an increased (vs. decreased) likelihood of getting vaccinated in response to a gift card and lottery incentive, respectively. Those living in large cities or suburbs were 1.4 [1.1, 1.8] and 1.4 [1.1, 1.7] times more likely to be vaccinated than those living in towns/villages or rural/farm areas in response to a gift card and lottery incentive, respectively. Those with high school educations or less were 1.8 [1.4, 2.4] times more likely than those with tech/vocational training or higher to report an increased (vs. decreased) likelihood of getting vaccinated in response to a workplace requirement. Finally, those with annual household incomes under $125,000 were 1.9 [1.3, 2.9] times more likely than those with incomes over $125,001 to report an increased (vs. decreased) likelihood of getting vaccinated in response to a workplace requirement.

Relationships among reactions

Reactions were significantly and positively related to one another (at p < .001; see S2 Table for full correlation matrix). In general, people who respond positively to one program are likely to respond positively to others, and vice versa. However, most reactions were only moderately correlated with one another, indicating that there are nuances in reactions to different incentives/mandates that require further investigation.

Discussion

At the time of data collection, about 3/4 of our respondents were vaccinated, and the likelihood of vaccination uniquely differed across all demographic indicators. For example, men were more likely to be vaccinated than women, those with lower education (technical/vocational training or less) were less likely to be vaccinated than those with higher education (college degree or higher), and Democrats were more likely to be vaccinated than those with other political leanings. We again saw unique demographic differences in vaccination intention among the unvaccinated respondent group (e.g., those in the youngest age group were more likely to lean toward vaccination than all other age groups). These findings support previous research identifying individual differences in vaccination rates and vaccination hesitancy based on race, income, and political leaning [17, 18], and they highlight the importance of continuing to monitor demographic differences in vaccination status/intention moving forward. Moreover, these findings emphasize the necessity for targeted assessment and messaging to meet the needs of different populations.

Reduced public masking (especially in response to changing public health guidelines) could differentially impact vaccination intentions. Although reduced masking made many of those already leaning toward vaccination more likely to get vaccinated, the positive impact is minimally observed among those resistant to vaccination. Perhaps more importantly though, we found that reduced mask-wearing deterred some individuals from seeking vaccination. While we did not collect data on this point, it is conceivable that reduced mask-wearing signaled to some people that the pandemic was winding down, so the need to “risk” immunization was correspondingly reduced. As we enter an endemic COVID-19 [19], society needs to be prepared for changing public health policies. However, policy makers should also be fully aware of how such changes might influence (and perhaps impede on) other efforts, such as efforts to increase vaccination.

Monetary incentive programs have been implemented across the United States, but it is unclear how unvaccinated individuals respond to these programs. We observed mixed reactions, with most unvaccinated respondents indicating that these programs have no impact on their intention, followed by large proportions (over a quarter) of respondents indicating that the programs make them less likely to get vaccinated. The promising effects of these programs on vaccination intention are more prevalent among those who are already leaning toward vaccination (vs. resistant to vaccination), but even so, less than half of respondents who are leaning toward vaccination say that the programs would make them more likely to get vaccinated. These findings support previous claims that monetary incentives do not have a widespread, positive impact on vaccination intention (e.g., [20]). Nonetheless, a recent program in Dekalb County, GA offering $100 for people receiving their first dose of a COVID-19 vaccine resulted in immunization of more than 2,500 people on a single Saturday in one location [21]. Clearly, there are nuances about incentive programs that need further characterization. Moreover, we should point out that, at the time of data collection, some of those who were recently vaccinated may have been favorably impacted by incentives and mandates, and thus were not included in our unvaccinated analyses.

As workplaces begin to require vaccinations, it is important to be prepared for potentially differential reactions among unvaccinated workers. We also observed mixed reactions to such requirements, with relatively equal proportions of respondents saying that they would get vaccinated, would not get vaccinated, and were unsure of if they would get vaccinated. These reactions again differed by intention, with a small proportion of those resistant to vaccination saying that they would get vaccinated in response to a work requirement. While such requirements might be helpful in pushing those leaning toward vaccination to get vaccinated, it is likely to be accompanied with widespread refusal and discontent among those already resistant to vaccination (which, we remind the reader, makes up a large proportion of the unvaccinated population). Such widespread negative reactance could result in legal action, protests, and loss of employees. Nonetheless, a substantial proportion of hospitals, major corporations, Universities, and the military are moving ahead with mandates (e.g., [6, 22]); it will be important to fully characterize the response to these incentives, including long term attitudes and behaviors regarding public health recommendations.

We placed emphasis on the assessment of different demographic indicators as uniquely predicting reactions to reduced mask wearing, monetary incentive programs, and work vaccination requirements (e.g., race as a predictor of reactions while adjusting for vaccination intention, age, gender, etc.). We specifically focused on comparing reports of being more likely to get vaccinated to reports of being less likely to get vaccinated; however, further analysis could highlight differences centered on the middle “no impact” response option (i.e., no impact vs. less likely and more likely vs. no impact). General intention to get vaccinated and political leaning served as meaningful and consistent predictors in all models, and in turn, they should be included in future analyses and intervention development/implementation (cf. [23]). Various other individual differences emerged that are also of note and expand our understanding of differential reactions to reduced mask-wearing and efforts to increase vaccinations. For example, when adjusting for all other demographic indicators, those with high school education or less were more likely to get vaccinated in response to a work requirement than those with more than a high school education. Similarly, those with lower household incomes were more likely to get vaccinated than those from higher income brackets. These findings indicate that work vaccination requirements might produce inequality in autonomy over one’s health decision making. As another example, White respondents reported more positive intentions to get vaccinated in response to monetary incentive programs relative to Black respondents. Future research should investigate contributing factors for this difference, including differential mistrust stemming from historic mistreatment of Black populations. Additional factors could be assessed to further this line of work, such as differences based on religion. Emphasizing individual differences in reactions to changing public health practices and deliberate efforts to increase intentions to get vaccinated are necessary, because without such emphasis, messages to encourage immunization could backfire, negatively impacting vaccine uptake.

Finally, there were substantial numbers of respondents for whom reduced mask-wearing, monetary incentive programs, and work vaccination requirements were reported to have no impact on vaccination intention. For example, 76% of those resistant to vaccination reported that changes in local masking behavior did not impact their intentions. The increased “no impact” or “neutral” response among resistant respondents is likely a reflection of the hardening of vaccination intentions among a proportion of the unvaccinated population, highlighting the difficulty that public health officials face when designing efforts to move many unvaccinated individuals into the “vaccinated column.” An alternative explanation is that researchers, public health officials, and policy makers have not yet “found” the optimal ingredients to impact intentions.

Limitations and future directions

There are several limitations that we should note. First, our findings are limited to the Web-using population, and in turn, we were not able to hear from respondents who do not have access to the Web. However, our use of RIWI’s novel online data collection technology allowed us to reach the most diverse Web-population possible using nonprobability sampling, serving as a strength relative to other online data collection platforms (e.g., panel-based research). All Web-users in the US had a chance of encountering this survey, thus minimizing self-selection biases, and maximizing our reach to a broader set of respondents who might otherwise not participate in research. Future research could consider alternative, non-Web-based forms of data collection as a means of reaching non-Web-using respondents (e.g., random digit dialing procedures); however, those methods of course come with their own limitations.

Second, we observed a high drop off in respondents from opt-in to survey completion. Of note, RIWI’s methodology does not allow for the collection of any personally identifying information (avoiding social desirability bias), and, in turn, no incentives are provided to respondents that would encourage their continued participation beyond general interest in the survey (avoiding incentive bias). A 22% completion rate is typical compared to other RIWI surveys in the US and expected considering the survey length and its non-incentivized nature (e.g., [24]). Future research could highlight demographic differences in drop-off to better understand which populations choose to engage (and disengage) with COVID-19 related content. In the current survey, we observed similar age and gender distributions among those who opted-in to participate and those who completed the entire survey. In any case, we retained a large sample size at the conclusion of our survey that provided substantial power for the analyses.

Third, we were unable to confirm the vaccination status given by respondents, and instead had to rely on self-reported vaccination status. Among our total opt-in sample, 69.7%, 95% CI [69.4%, 70.1%] of respondents self-reported that they had received at least one dose of a COVID-19 vaccine (manuscript submitted for publication). This is comparable to the CDC’s reported adult vaccination rate of 67.9% midway through our data collection period (on July 15th, 2021) [25]. Although we were unable to confirm vaccination status, this comparison suggests that what people are reporting is similar to what the active vaccine coverage data shows.

We aimed to measure reactions to changing masking behavior and efforts to increase vaccination (i.e., monetary incentives and work vaccination requirements) by directly asking respondents to report on such reactions. It is possible that reactions are more nuanced than this and require more comprehensive measures for deeper understanding, which could be achieved in focus groups or key informant interviews. Our findings are also limited in providing a theoretical extension to the existing literature on reactance and public health policy. However, these limitations are offset by the strengths of producing actionable evidence that is accessible to public health policy makers and communication programs and can be immediately applied in a real-world setting.

Finally, future research might wish to assess the efforts relative to one another, and pinpoint which effort works best (or works worst) for different demographic groups. While we focused on within-effort demographic differences in this report, a comparative analysis could prove useful to those who are determining which policies to implement in their communities.

Conclusion

The findings of this report suggest that the targeting of vaccine uptake strategies needs to be aligned with those populations who behave quite differently. For example, unvaccinated Black respondents were more likely to lean toward vaccination than unvaccinated White respondents, however White respondents were more likely than Black respondents to report positive reactions to monetary incentive programs. Rural residents not only had lower vaccination coverage and more resistance to vaccination relative to urban dwellers, but they were also more resistant to monetary incentive programs and work vaccination requirements, and in turn, may require novel, targeted messaging/incentives. Awareness of such nuances, and the ability to gauge them quickly and broadly, can assist practitioners, policy makers, and public health officials in designing and implementing communication strategies and policies that will yield optimal outcomes.

Supporting information

S1 Table. Chi-Square analyses predicting anticipated reactionary response among those who would not get vaccinated in response to a work vaccination requirement by demographics.

https://doi.org/10.1371/journal.pone.0267154.s002

(DOCX)

S2 Table. Correlations among reactions to reduced masking, monetary incentives, and work vaccination requirements.

https://doi.org/10.1371/journal.pone.0267154.s003

(DOCX)

S1 File. Survey questions and skip/display logic.

https://doi.org/10.1371/journal.pone.0267154.s004

(DOCX)

References

  1. 1. Centers for Disease Control and Prevention. COVID data tracker [Internet]. Atlanta: US Department of Health and Human Services, CDC; 2022 Jan 5 [cited 2022 Jan 5]. Available from: https://covid.cdc.gov/covid-data-tracker
  2. 2. Fowlkes A, Gaglani M, Groover K, Thiese MS, Tyner H, Ellingson, K, et al. Effectiveness of COVID-19 vaccines in preventing SARS-CoV-2 infection among frontline workers before and during B.1.617.2 (Delta) variant predominance—Eight U.S. locations, December 2020—August 2021. MMWR Morb Mortal Wkly Rep. 2021;70(34):1167–9. pmid:34437521
  3. 3. Tartof SY, Slezak JM, Fischer H, Hong V, Ackerson BK, Ranasinghe ON, et al. Effectiveness of mRNA BNT162b2 COVID-19 vaccine up to 6 months in a large health system in the USA: A retrospective cohort study. Lancet. 2021;398(10309):1407–16. pmid:34619098
  4. 4. Hamel L, Lopes L, Sparks G, Kirzinger A, Kearney A, Stokes M, et al. KFF COVID-19 vaccine monitor: September 2021 [Internet]. San Francisco: Kaiser Family Foundation; 2021 Sep 28 [cited 2022 Jan 5]. Available from: https://www.kff.org/coronavirus-covid-19/poll-finding/kff-covid-19-vaccine-monitor-september-2021/
  5. 5. Roy B, LeBlanc M. COVID-19 vaccine incentives [Internet]. Washington, D.C.: National Governors Association; 2021 Aug 19 [cited 2022 Jan 5]. Available from: https://www.nga.org/center/publications/covid-19-vaccine-incentives/
  6. 6. Messenger M. From McDonald’s to Goldman Sachs, here are the companies mandating vaccine for all or some employees. NBC News [Internet]. 2021 Aug 3 [updated 2021 Nov 16, cited 2022 Jan 5]. Available from: https://www.nbcnews.com/business/business-news/here-are-companies-mandating-vaccines-all-or-some-employees-n1275808
  7. 7. Largent EA, Miller FG. Problems with paying people to be vaccinated against COVID-19. JAMA. 2021;325(6):534–5. pmid:33404585
  8. 8. Largent EA, Persad G, Sangenito S, Glickman A, Boyle C, Emanuel EJ. US public attitudes toward COVID-19 vaccine mandates. JAMA Netw Open. 2020;3(12):e2033324. pmid:33337490
  9. 9. Schonlau M, Couper MP. Options for conducting web surveys. Stat Sci. 2017;32(2):279–92.
  10. 10. Kim J, Bell GA, Ratcliffe HL, Moncada L, Lipsitz S, Hirschhorn LR, et al. Predictors of patient-reported quality of care in low- and middle-income countries: a four-country survey of person-centered care. Int J Qual Health Care. 2021;33(3):1–8. pmid:34318883
  11. 11. Roder-DeWan S, Gage AD, Hirschhorn LR, Twum-Danso NAY, Liljestrand J, Asante-Shongwe K, et al. Expectations of healthcare quality: A cross-sectional study of internet users in 12 low- and middle-income countries. PLoS Med. 2019:16(8):e1002879. pmid:31390364
  12. 12. Roder-DeWan S, Gage A, Hirschhorn LR, Twum-Danso NAY, Liljestrand J, Asante-Shongwe K, et al. Level of confidence in and endorsement of the health system among internet users in 12 low-income and middle-income countries. BMJ Glob Health. 2020;5(8):e002205. pmid:32859647
  13. 13. Seeman N. Use data to challenge mental health stigma. Nature. 2015;582:309. pmid:26672520
  14. 14. Seeman NL, Seeman MV. An anonymous survey method for obtaining sensitive, personal, or embarrassing information in the context of mental illness stigma. SAGE Research Methods Cases. 2020. [cited 2022 Jan 5]. Available from: https://www.doi.org/10.4135/9781529719260
  15. 15. Seeman N, Tang S, Brown AD, Ing A. World survey of mental illness stigma. J Affect Disord. 2016;190:115–121. pmid:26496017
  16. 16. Seeman N, Ing A, Rizo C. Assessing and responding in real time to online anti-vaccine sentiment during a flu pandemic. Healthc Q. 2010;13:8–15. pmid:20959725
  17. 17. Khubchandani J, Sharma S, Price JH, Wiblishauser MJ, Sharma M, Webb FJ. COVID-19 vaccination hesitancy in the United States: A rapid national assessment. J Community Health. 2021;46:270–7. pmid:33389421
  18. 18. Nguyen LH, Joshi AD, Drew DA, Merino J, Ma W, Lo C, et al. (2021). Racial and ethnic differences in COVID-19 vaccine hesitancy and uptake. medRxiv [Preprint]. 2021. [cited 2022 Jan 5]. Available from: pmid:33655271
  19. 19. Phillips N. The coronavirus is here to stay—here’s what that means. Nature. 2021;590, 382–4. pmid:33594289
  20. 20. Sprengholz P, Eitze S, Felgendreff L, Korn L, Betsch C. Money is not everything: Experimental evidence that payments do not increase willingness to be vaccinated against COVID-19. J Med Ethics. 2021;47(8):547–8. pmid:33602717
  21. 21. Abusaid S. DeKalb vaccine drive draws more than 2,500 to Stonecrest mall. The Atlanta Journal-Constitution [Internet]. 2021 Aug 28 [cited 2022 Jan 5]. Available from: https://www.ajc.com/news/dekalb-vaccine-drive-draws-more-than-2500-to-stonecrest-mall/OP7D63YKRVBJJGA2EJKXP5FY3Q/
  22. 22. Cooper H, Steinhauer J. The U.S. military will mandate Covid-19 vaccines for troops. The New York Times [Internet]. 2021 Aug 9 [updated 2021 Nov 2, cited 2022 Jan 5]. Available from: https://www.nytimes.com/2021/08/09/us/politics/vaccine-mandate-military-covid.html
  23. 23. Siegler AJ, Luisi N, Hall EW, Bradley H, Sanchez T, Lopman BA, et al. Trajectory of COVID-19 vaccine hesitancy over time and association of initial vaccine hesitancy with subsequent vaccination. JAMA Netw Open. 2021;4(9):e2126882. pmid:34559232
  24. 24. Elevyst, RIWI Corp., PRO-A. Addressing drug use and recovery stigma: Initial findings released [Internet]. Toronto: RIWI Corp.; 2021 Aug 24 [cited 2022 Jan 5]. Available from: https://riwi.com/research/addressing-drug-use-recovery-stigma-initial-findings-released/
  25. 25. Centers for Disease Control and Prevention. COVID-19 vaccinations in the United States, jurisdiction [dataset]. 2022 Jan 4 [cited 2022 Jan 4]. Available from: https://data.cdc.gov/Vaccinations/COVID-19-Vaccinations-in-the-United-States-Jurisdi/unsk-b7fc