Skip to main content
Log in

Behaviorally Informed Text Message Nudges to Schedule COVID-19 Vaccinations: A Randomized Controlled Trial

  • Original Research
  • Published:
Journal of General Internal Medicine Aims and scope Submit manuscript

Abstract

Background

Vaccine hesitancy, especially related to COVID-19 vaccinations among Veterans, may limit uptake. Behaviorally informed text-based messages have the potential to improve uptake of COVID-19 vaccinations.

Objective

To evaluate the impact of two different behaviorally informed text message nudges on COVID-19 vaccine scheduling and completion, compared to standard control message.

Design

Prospective, three-arm patient-level randomized quality improvement trial.

Participants

Between March and May 2021, 20,523 Veterans were eligible for the initial series of COVID-19 vaccination, enrolled at two large Veterans Health Administration sites.

Intervention

Arm 1 (Control): standard scheduling message; Arm 2 (Social Good): standard message plus behaviorally informed text message “When you get a vaccine now, you help protect yourself, your family, and your community”; and Arm 3 (Scarcity): standard plus behaviorally informed text message “Only a limited number of vaccine appointments are available.”

Main Measures

Outcomes were vaccine scheduling and/or completion rate within 7 days of receipt of text message (primary), and within 14 days and 30 days after receipt of text message (secondary).

Key Results

Veterans had an overall rate of 19% of scheduling or receiving a vaccination in 7 days. In our adjusted intention-to-treat analysis, we found no difference between intervention social good or scarcity (aOR 0.98, 95% CI, 0.88–1.09, for both arms) compared to standard scheduling message. We found no statistical differences in our secondary outcomes.

Conclusions

During the initial phases of vaccine roll-out, two behaviorally informed text messages did not increase COVID-19 vaccination rates among Veterans compared to a standard scheduling message.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Figure 1
Figure 2

Similar content being viewed by others

References

  1. Fauci AS. The story behind COVID-19 vaccines. Science. 2021;372(6538):109-109. https://doi.org/10.1126/science.abi8397

    Article  CAS  PubMed  Google Scholar 

  2. Coustasse A, Kimble C, Maxik K. COVID-19 and Vaccine Hesitancy: A Challenge the United States Must Overcome. J Ambulatory Care Manage. 2021;44(1):71-75. https://doi.org/10.1097/JAC.0000000000000360

    Article  PubMed  Google Scholar 

  3. U.S. Department of Health And Human Services, CDC. Centers for Disease Control and Prevention COVID Data Tracker.; 2024. https://covid.cdc.gov/covid-data-tracker

  4. Shulkin DJ. Why VA health care is different. fed pract health care prof VA DoD PHS. 2016;33(5):9-11.

    Google Scholar 

  5. Thaler RH, Sunstein CR. Nudge: The Final Edition. Updated edition. Penguin Books, an imprint of Penguin Random House LLC; 2021.

  6. Milkman KL, Patel MS, Gandhi L, et al. A megastudy of text-based nudges encouraging patients to get vaccinated at an upcoming doctor’s appointment. Proc Natl Acad Sci. 2021;118(20):e2101165118. https://doi.org/10.1073/pnas.2101165118

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  7. Milkman KL, Beshears J, Choi JJ, Laibson D, Madrian BC. Using implementation intentions prompts to enhance influenza vaccination rates. Proc Natl Acad Sci U S A. 2011;108(26):10415-10420. https://doi.org/10.1073/pnas.1103170108

    Article  PubMed  PubMed Central  Google Scholar 

  8. Chapman GB, Li M, Leventhal H, Leventhal EA. Default clinic appointments promote influenza vaccination uptake without a displacement effect. Behav Sci Policy. 2016;2(2):40-50. https://doi.org/10.1353/bsp.2016.0014

    Article  PubMed  PubMed Central  Google Scholar 

  9. Regan AK, Bloomfield L, Peters I, Effler PV. Randomized Controlled Trial of Text Message Reminders for Increasing Influenza Vaccination. Ann Fam Med. 2017;15(6):507-514. https://doi.org/10.1370/afm.2120

    Article  PubMed  PubMed Central  Google Scholar 

  10. Patel MS. Text-message nudges encourage COVID vaccination. Nature. 2021;597(7876):336-337. https://doi.org/10.1038/d41586-021-02043-2

    Article  CAS  PubMed  Google Scholar 

  11. Aggarwal P, Jun SY, Huh JH. Scarcity Messages. J Advert. 2011;40(3):19-30. https://doi.org/10.2753/JOA0091-3367400302

    Article  Google Scholar 

  12. Opel DJ, Reich JA, Peek ME. Amplifying Appeals to the Common Good in COVID-19 Vaccine Messaging. JAMA Health Forum. 2022;3(5):e220991. https://doi.org/10.1001/jamahealthforum.2022.0991

    Article  PubMed  Google Scholar 

  13. Korn L, Böhm R, Meier NW, Betsch C. Vaccination as a social contract. Proc Natl Acad Sci. 2020;117(26):14890-14899. https://doi.org/10.1073/pnas.1919666117

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  14. Nelson K, Reddy A, Stockdale SE, et al. The Primary Care Analytics Team: Integrating research and clinical care within the Veterans Health Administration Office of Primary Care. Healthc Amst Neth. 2021;8 Suppl 1:100491. https://doi.org/10.1016/j.hjdsi.2020.100491

    Article  Google Scholar 

  15. Deeds S, Schuttner L, Wheat C, et al. Automated Reminders Enhance Mailed Fecal Immunochemical Test Completion Among Veterans: a Randomized Controlled Trial. J Gen Intern Med. 2024;39(1):113-119. https://doi.org/10.1007/s11606-023-08409-8

    Article  PubMed  Google Scholar 

  16. Deeds S, Liu T, Schuttner L, et al. A Postcard Primer Prior to Mailed Fecal Immunochemical Test Among Veterans: a Randomized Controlled Trial. J Gen Intern Med. 2023;38(14):3235-3241. https://doi.org/10.1007/s11606-023-08248-7

    Article  PubMed  PubMed Central  Google Scholar 

  17. Marcotte LM, Deeds S, Wheat C, et al. Automated Opt-Out vs Opt-In Patient Outreach Strategies for Breast Cancer Screening: A Randomized Clinical Trial. JAMA Intern Med. 2023;183(11):1187-1194. https://doi.org/10.1001/jamainternmed.2023.4321

    Article  PubMed  PubMed Central  Google Scholar 

  18. Deeds SA, Moore CB, Gunnink EJ, et al. Implementation of a mailed faecal immunochemical test programme for colorectal cancer screening among Veterans. BMJ Open Qual. 2022;11(4):e001927. https://doi.org/10.1136/bmjoq-2022-001927

    Article  PubMed  PubMed Central  Google Scholar 

  19. Fogg B. A behavior model for persuasive design. In: Proceedings of the 4th International Conference on Persuasive Technology. ACM; 2009:1-7. https://doi.org/10.1145/1541948.1541999

  20. Bicchieri C, Dimant E. Nudging with care: the risks and benefits of social information. Public Choice. 2022;191(3-4):443-464. https://doi.org/10.1007/s11127-019-00684-6

    Article  Google Scholar 

  21. Mehta SJ, Mallozzi C, Shaw PA, et al. Effect of Text Messaging and Behavioral Interventions on COVID-19 Vaccination Uptake: A Randomized Clinical Trial. JAMA Netw Open. 2022;5(6):e2216649. https://doi.org/10.1001/jamanetworkopen.2022.16649

    Article  PubMed  PubMed Central  Google Scholar 

  22. United States Department of Veterans Affairs. VA Employee Technical Innovation Reduces Nationwide Appointment No-Shows. DigitalVA. Published January 7, 2020. https://digital.va.gov/general/va-employee-technical-innovation-reduces-nationwide-appointment-no-shows/

  23. Jasuja GK, Meterko M, Bradshaw LD, et al. Attitudes and Intentions of US Veterans Regarding COVID-19 Vaccination. JAMA Netw Open. 2021;4(11):e2132548. https://doi.org/10.1001/jamanetworkopen.2021.32548

    Article  PubMed  PubMed Central  Google Scholar 

  24. Bajema KL, Rowneki M, Berry K, et al. Rates of and Factors Associated With Primary and Booster COVID-19 Vaccine Receipt by US Veterans, December 2020 to June 2022. JAMA Netw Open. 2023;6(2):e2254387. https://doi.org/10.1001/jamanetworkopen.2022.54387

    Article  PubMed  PubMed Central  Google Scholar 

  25. Elwy AR, Clayman ML, LoBrutto L, et al. Vaccine hesitancy as an opportunity for engagement: A rapid qualitative study of patients and employees in the U.S. Veterans Affairs healthcare system. Vaccine X. 2021;9:100116. https://doi.org/10.1016/j.jvacx.2021.100116

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  26. Lin C, Tu P, Beitsch LM. Confidence and Receptivity for COVID-19 Vaccines: A Rapid Systematic Review. Vaccines. 2020;9(1):16. https://doi.org/10.3390/vaccines9010016

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  27. Fisher KA, Bloomstone SJ, Walder J, Crawford S, Fouayzi H, Mazor KM. Attitudes Toward a Potential SARS-CoV-2 Vaccine : A Survey of U.S. Adults. Ann Intern Med. 2020;173(12):964-973. https://doi.org/10.7326/M20-3569

    Article  PubMed  Google Scholar 

  28. Rabb N, Swindal M, Glick D, et al. Evidence from a statewide vaccination RCT shows the limits of nudges. Nature. 2022;604(7904):E1-E7. https://doi.org/10.1038/s41586-022-04526-2

    Article  CAS  PubMed  Google Scholar 

  29. Patel MS, Fogel R, Winegar AL, et al. Effect of Text Message Reminders and Vaccine Reservations on Adherence to a Health System COVID-19 Vaccination Policy: A Randomized Clinical Trial. JAMA Netw Open. 2022;5(7):e2222116. https://doi.org/10.1001/jamanetworkopen.2022.22116

    Article  PubMed  PubMed Central  Google Scholar 

  30. Dai H, Saccardo S, Han MA, et al. Behavioural nudges increase COVID-19 vaccinations. Nature. 2021;597(7876):404-409. https://doi.org/10.1038/s41586-021-03843-2

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  31. Robertson DA, Timmons S, Lunn PD. Behavioural evidence on COVID-19 vaccine uptake. Public Health. 2024;227:49-53. https://doi.org/10.1016/j.puhe.2023.10.046

    Article  CAS  PubMed  Google Scholar 

  32. Jensen UT, Ayers S, Koskan AM. Video-based messages to reduce COVID-19 vaccine hesitancy and nudge vaccination intentions. PloS One. 2022;17(4):e0265736. https://doi.org/10.1371/journal.pone.0265736

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  33. Batteux E, Mills F, Jones LF, Symons C, Weston D. The Effectiveness of Interventions for Increasing COVID-19 Vaccine Uptake: A Systematic Review. Vaccines. 2022;10(3):386. https://doi.org/10.3390/vaccines10030386

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  34. Johansen ND, Vaduganathan M, Bhatt AS, et al. Electronic nudges to increase influenza vaccination uptake in Denmark: a nationwide, pragmatic, registry-based, randomised implementation trial. Lancet Lond Engl. 2023;401(10382):1103-1114. https://doi.org/10.1016/S0140-6736(23)00349-5

    Article  Google Scholar 

Download references

Acknowledgements

This work was made possible through operational support and funding from VA Puget Sound Health Care System Leadership. Additionally, this work was funded by the Primary Care Analytics Team through the Veterans Health Administration Office of Primary Care. The funder had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; and decision to submit the manuscript for publication. The views expressed in this article are those of the authors and do not necessarily reflect the position or policy of the US government, the Department of Veterans Affairs, and the University of Washington.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Ashok Reddy MD, MS.

Ethics declarations

Conflict of Interest:

The authors declare that they do not have a conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Below is the link to the electronic supplementary material.

Supplementary file1 (DOCX 24 KB)

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Reddy, A., Geyer, J., Wheat, C. et al. Behaviorally Informed Text Message Nudges to Schedule COVID-19 Vaccinations: A Randomized Controlled Trial. J GEN INTERN MED 40, 1078–1084 (2025). https://doi.org/10.1007/s11606-024-09170-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11606-024-09170-2

KEY WORDS