Skip to main content

Quantifying the relationship between lockdowns, mobility, and effective reproduction number (Rt) during the COVID-19 pandemic in the Greater Toronto Area

Abstract

Background

The effectiveness of lockdowns in mitigating the spread of COVID-19 has been the subject of intense debate. Data on the relationship between public health restrictions, mobility, and pandemic growth has so far been conflicting.

Objective

We assessed the relationship between public health restriction tiers, mobility, and COVID-19 spread in five contiguous public health units (PHUs) in the Greater Toronto Area (GTA) in Ontario, Canada.

Methods

Weekly effective reproduction number (Rt) was calculated based on daily cases in each of the five GTA public health units between March 1, 2020, and March 19, 2021. A global mobility index (GMI) for each PHU was calculated using Google Mobility data. Segmented regressions were used to assess changes in the behaviour of Rt over time. We calculated Pearson correlation coefficients between GMI and Rt for each PHU and mobility regression coefficients for each mobility variable, accounting for time lag of 0, 7, and 14 days.

Results

In all PHUs except Toronto, the most rapid decline in Rt occurred in the first 2 weeks of the first province-wide lockdown, and this was followed by a slight trend to increased Rt as restrictions decreased. This trend reversed in all PHUs between September 6th and October 10th after which Rt decreased slightly over time without respect to public health restriction tier. GMI began to increase in the first wave even before restrictions were decreased. This secular trend to increased mobility continued into the summer, driven by increased mobility to recreational spaces. The decline in GMI as restrictions were reintroduced coincides with decreasing mobility to parks after September. During the first wave, the correlation coefficients between global mobility and Rt were significant (p < 0.01) in all PHUs 14 days after lockdown, indicating moderate to high correlation between decreased mobility and decreased viral reproduction rates, and reflecting that the incubation period brings in a time-lag effect of human mobility on Rt. In the second wave, this relationship was attenuated, and was only significant in Toronto and Durham at 14 days after lockdown.

Conclusions

The association between mobility and COVID-19 spread was stronger in the first wave than the second wave. Public health restriction tiers did not alter the existing secular trend toward decreasing Rt over time.

Peer Review reports

Introduction

During the COVID-19 pandemic, public health orders have imposed lengthy restrictions on movement, business operations, and social gatherings. Colloquially referred to as lockdowns, the scope and intensity of such restrictions have been heterogenous and varied widely between jurisdictions worldwide [1]. Quantitative evaluations of the effectiveness of such measures in attenuating pandemic peaks are rapidly emerging [2,3,4,5].

Many lockdown studies lack a true counterfactual and merely suggest correlation between lockdown measures and temporally associated reductions in case counts [6]. The use of pre-intervention growth rates to define the success of interventions is similarly limited by the recognition that epidemic curves are time varying and that slowing occurs through natural dynamics even in the absence of intervention [7]. Likewise, ecological studies suffer from confounding by both known and unknown factors, and ample comparisons exist to favour nearly any hypothesis. Furthermore, it remains unclear how pandemic curves might look based on social distancing recommendations alone rather than legal mandate. As a direct result, there has been intense public debate over whether lockdown policies should be ever more restrictive or rely on voluntary compliance.

Lockdown policies have generated unprecedented controversy as their potential benefits are weighed against direct and indirect harms, as well as impositions on civil liberties [8]. In particular, extraordinary evidence of efficacy is required to justify restrictions on movement and assembly in liberal democratic societies [3, 9], and mandatory restrictions may further isolate the marginalized, elderly, and those living alone.

This is particularly relevant in Canada, where the Toronto region has experienced one of the longest periods of business closures in North America, and one of the world’s longest continuous periods of lockdown. There is a need for critical examination of the effects of such policies on viral spread, and the use of colour-coded restriction tiers in the province Ontario offers an unprecedented opportunity for the analysis of the relationship of such restrictions with both movement and viral reproduction rate. Here, we conducted a similar analysis to one performed in Australia [10] comparing mobility and effective viral reproductive number (Rt) before and after lockdown measures.

The aim of this observational study was to compare the effect of public health restrictions on mobility and COVID-19 spread in five contiguous public health units within the Greater Toronto Area (GTA), a densely populated urban region within Ontario, Canada.

Methods

The province of Ontario, Canada is divided into 36 public health units (PHUs) that administer public health services, and of those, Peel (PEL), Toronto (TOR), York (YRK), Halton (HAL), and Durham (DUR) comprise the Greater Toronto Area (GTA), the most densely populated contiguous region in Canada with 6.4 million total inhabitants (548,430 in Halton, 645,862 in Durham, 1,381,744 in Peel, 1,109,909 in York, 2,731,571 in Toronto) [11].

The effective reproduction number (Rt) is defined as the mean number of secondary cases generated by a typical primary case at a given time t in a population, making it well suited as an indicator of transmission before and after public health interventions [12]. After November 7, 2020, Ontario imposed a colour-coded tiered approach to the escalation and de-escalation of regional public health restrictions (Table 1), based on weekly incidence, percent positivity, effective reproduction number (Rt), and outbreak trends. This allowed direct comparison of their relative effectiveness in reducing Rt.

Table 1 Lockdown restrictions according to the colour-coded five-tier COVID-19 framework implemented in Ontario on November 7, 2020. The provincial restriction tiers used prior to November 7 (stage 1, stage 2, and stage 3) were categorized as grey, red, and green, respectively due to their similarities

Official COVID-19 data (daily PCR-confirmed cases) from March 1, 2020 to March 19, 2021 were obtained at the level of the five PHUs from the official websites of each PHU. By March 13, 589,270 Ontarians (4.0%) had at least one dose of vaccine and 285,667 Ontarians (1.9%) had been fully vaccinated [13], representing approximately 1.85% of the population. Increasingly transmissible variants of concern (VOC) in the GTA ranged from 31.4% in Halton to 49.7% in Durham by the week of March 3–9, 2020 [13]. Weekly estimates of the effective reproduction number (Rt) at the PHU level were calculated using the EpiEstim R package calculator, found at https://github.com/alechay/covid19-rt. Rt was calculated assuming a Poisson distribution, and using a Bayesian framework to estimate credible serial intervals for infections [14] with the parametric si option in EpiEstim, where the mean and SD of the serial interval were based on previous studies [15,16,17].

Google Daily Mobility Reports [18] are comprised of anonymized and aggregated regional data and use a GPS-linked index of visits and length of stay compared to the pre-pandemic baseline January 3 to March 1, 2020. These reports were collected for each PHU for workplaces, residential, parks, grocery and pharmacy, retail and recreation, and transit stations. A global mobility index (GMI) similar to that used in a previous Australian study [10] was calculated to represent global mobility change, as the mean of each type of mobility i in a day t:

$$ \mathrm{GMI}\left(\mathrm{t}\right)=\sum 6\mathrm{i}=1\mathrm{Mobilityi}/6. $$

Segmented regressions were used to identify breakpoints in the behavior of Rt for each of the PHUs over time (and shifts in COVID-19 transmission trends) using the ‘segmented’ function in R, which employs an algorithm that iteratively fits standard linear regressions to the data and finds points where the properties of the regression (slope, intercept) are significantly changed [19]. Only regression segments with at least five data points per segment were retained. Intercepts and slopes were calculated for the best model, using separate intercepts at each different segment, allowing for separate identification of increases or decreases in Rt, and sudden jumps or plunges in daily values.

The median incubation period for COVID-19 is 5.8 days, and 97.5% of patients develop symptoms within 11.7 days of infection [20]. Therefore, we selected three scenarios to account for reporting delays from illness onset, testing, and incubation—immediately following policy change, 7 days following policy change, and 14 days following policy change—to relate policy change and mobility change to Rt.

To evaluate the impact of mobility on Rt, generalized linear models were estimated using the ‘glm’ function in R for each mobility variable separately. Models with a 0-day, 7-day and 14-day lag of each mobility variable were estimated. We then extracted the mobility regression coefficients for each model.

We then calculated Pearson correlation coefficients between global mobility and Rt using the ‘cor.test’ function in R. This allowed us to calculate the association between mobility and COVID-19 spread. All calculations were made using R (version 4.02), with code available on GitHub.

Results

Figure 1 shows the daily case counts in each PHU in the GTA during the first and second pandemic wave. In general, restrictions were decreased between June 19, 2020 and July 31, 2020, and then progressively increased between September 18, 2020 and December 26, 2020 as daily cases increased in all PHUs during the second wave.

Fig. 1
figure 1

PCR-confirmed daily COVID-19 cases and 7-day moving average in the five public health units in the Greater Toronto Area during the first and second pandemic wave. Shaded areas indicate colour-coded public health restriction tiers

Figure 2 indicates changes in viral reproduction rate (Rt) in each PHU based on increasing or decreasing public health restriction tiers. In all PHUs except Toronto, the most rapid decline in Rt occurred in the first 2 weeks of the first province-wide lockdown, and this was followed by a change to increasing Rt that began during the lockdown period and continued as restrictions were decreased. This trend changed to decreasing Rt in all PHUs between September 6th and October 10th after which there were no further significant slope changes over time. With the exception of Peel, this breakpoint occurred during the lowest level of public health restrictions.

Fig. 2
figure 2

Segmented regressions and effective reproduction number (Rt) for the COVID-19 pandemic in five public health units in the Greater Toronto Area (top graphs). Breakpoints with significant increases and decreases in Rt are indicated as solid blue vertical lines. Global mobility index (GMI) using Google mobility data and 7-day moving average by Greater Toronto Area public health unit (bottom graphs). Shaded areas indicate colour-coded public health restriction tiers

The GMI in all five PHUs decreased with the first lockdown (Fig. 2) and showed weekly cycles with outliers on public holidays. GMI began to increase even before restrictions were decreased. This secular trend to increased mobility continued into the summer, driven by increased mobility to recreational spaces (Fig. 3). The decline in GMI as restrictions were reintroduced coincides with decreasing mobility to parks after September. Mobility in Durham and Halton paradoxically increased in the Red (control) tier, then decreased with enhanced lockdown. Mobility in York decreased prior to reintroduction of restrictions and continued to decrease at the same rate with increasing restrictions. The greatest mobility decreases were seen to retail, transit stations, and workspaces, while mobility to residence increased. Mobility to groceries and pharmacies were largely unchanged throughout the observation period.

Fig. 3
figure 3

Changes in six types of Google mobility data for five public health units in the Greater Toronto Area. Shaded areas indicate colour-coded public health restriction tiers

During the first wave, the correlation coefficients between global mobility and Rt (Fig. 4) were significant (p < 0.01) in Peel 7 days after lockdown and in all PHUs 14 days after lockdown, indicating a moderate to high correlation between decreased mobility and decreased viral reproduction rates and reflecting that the incubation period brings in a time-lag effect of human mobility on Rt. In the second wave, this relationship was attenuated, and only significant in Durham and Halton at 7 days after lockdown and in Toronto and Durham at 14 days after lockdown. Paradoxically, in the first wave there were significant correlations between decreased mobility and increased viral reproduction rates in Durham and Toronto in the period immediately after lockdown.

Fig. 4
figure 4

Correlation between global mobility index (GMI) and Rt over three periods of time (right after, 7 days after the lockdown date, and 14 days after the lockdown date) following public health mandated lockdowns in the first and second COVID-19 pandemic wave

Figure 5 compares the regression coefficients for each form of mobility in each PHU over three periods of time (immediately after, 7 days after lockdown, and 14 days after lockdown). During the first wave, Rt had a negative association with residential mobility at 7 and 14 days after lockdown and a positive association with all other forms of mobility except parks. The associations between Rt and mobility were inconsistent in the period immediately after lockdown, reflecting the time lag effect of mobility on spread and the delay of policy intervention. During the second wave, the associations between Rt and mobility were inconsistent in all three periods of time, indicating an attenuated relationship.

Fig. 5
figure 5

Regression coefficients of each type of mobility in each of five public health units in the Greater Toronto Area over three periods of time (right after, 7 days after the lockdown date, and 14 days after the lockdown date) following public health mandated lockdowns in the first and second COVID-19 pandemic wave

Discussion

Using COVID-19 epidemiologic data and Google mobility data, our study relates human mobility, public health restriction policies, and COVID-19 spread in the Greater Toronto Area in Ontario, Canada. Our analysis was similar to that of an Australian study [10] but its results have important differences. While increased mobility was correlated with increased spread, increased restrictions had inconsistent effects on this mobility. Restrictive measures were associated with a small decrease in virus transmission, but due to the challenges of disentangling multiple confounders, we interpret our findings with caution and link them to the empirical experiences in other countries.

Visual inspection of cases, viral reproductive rate, and mobility level alongside the timeline of policy interventions suggests that the lockdown policies shows little clear indication that these policies altered existing secular trends. This challenges the assumption of a strong association between the current tiered mandatory restrictions and overall virus transmission. With the exception of parks, mobility remained low even after restrictions were lifted, and did not decrease further with increased restrictions. The steep initial decline in mobility even prior to mandatory restrictions closely resembled observations in Sweden, South Korea, Australia, and the United States [21, 22].

Mobility, however, had a 7 to 14-day time lag association with viral spread, which may reflect the viral incubation period, and suggests a dynamic association between mobility and COVID-19 spread. Similar local findings have been reported in New York City [23], where decreased commuting movements between boroughs as measured by Facebook mobility data were negatively correlated with COVID-19 prevalence. Preliminary data suggests the same is true internationally, where the strong relationship between mobility and virus spread may also be affected by individual preventative behaviours such as social distancing, hygiene, and mask wearing [24]. Changes in weather conditions could also weaken the association between mobility and virus spread, as people are more likely to spend time outdoors and in parks in summer, where likelihood of transmission is substantially lower [25]. There were more mixed patterns in mobility-spread correlation after the initial lockdowns, which might reflect diminishing effects due to lockdown fatigue.

Limitations

Our study has a number of limitations that should influence interpretation. First, Google data uses 3 January 3, 2020 to February 6, 2020 as its baseline, which would bias results if human mobility declined as early reaction to fears of COVID-19 influenced by media reports. Second, it is possible that GMI should be weighted to account for the inherent risk level of each mobility type. Since workspace mobility appears in this study to be higher risk than mobility to parks, for example, it would be reasonable to assign a higher weight to the former. There are also several types of delays to consider that might bias these results: 1) delay between the mobility measure and the date of confirmed cases, 2) the reporting delay from the illness onset date, and 3) delay introduced by incubation and testing. Google data is also a coarse proxy for mobility and social distancing and relies on the movement of those who have a smart device [21].

The effects of lockdowns may also be confounded by simultaneous media messaging and voluntary changes in behaviour, such as increased mask-wearing. These changes could have caused a temporal autocorrelation of the Rt and mobility data, as observations closer in time are likely to be more similar than observations farther apart. Finally, the effects of such lockdowns can be positioned within the context of previous studies indicating a frequently paradoxical effect of more restrictive lockdowns in increasing transmission [7, 26], which may ultimately depend on population density, household density, political climate, travel and border closures, as well as whether sectors of the economy closed by lockdowns are in fact major drivers of spread. The effect of confounders will become increasingly relevant as vaccination campaigns compete with more infectious viral variants during the third wave.

Conclusion

The association between mobility and COVID-19 spread was stronger in the first wave than the second wave. Public health restriction tiers had no consistent additive effect on altering secular trends to decreasing Rt. Our findings should be interpreted with caution, since they describe correlation, which may not indicate causal direction between mobility controls and virus spread. Governments should consider the 14-day relationship between mobility and virus spread when reducing restrictions.

Availability of data and materials

The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.

References

  1. Thomas, H. Angrist, N. Cameron-Blake, E. Hallas, L. et al. Oxford COVID-19 government response tracker. Available online: https://www.bsg.ox.ac.uk/research/research-projects/coronavirus-government-response-tracker (accessed on 5 Mar 2021).

  2. Islam N, et al. Physical distancing interventions and incidence of coronavirus disease 2019: natural experiment in 149 countries. BMJ. 2020;370:m2743. https://doi.org/10.1136/bmj.m2743.

    Article  PubMed  Google Scholar 

  3. Fong MW, Gao H, Wong JY, Xiao J, Shiu EYC, Ryu S, et al. Nonpharmaceutical measures for pandemic influenza in nonhealthcare settings—social distancing measures. Emerg Infect Dis. 2020;26(5):976–84. https://doi.org/10.3201/eid2605.190995.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  4. Brauner JM, Mindermann S, Sharma M, Johnston D, Salvatier J, Gavenčiak T, et al. Inferring the effectiveness of government interventions against COVID-19. Science. 2020;371(6531):eabd9338. https://doi.org/10.1126/science.abd9338.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  5. Flaxman S, Mishra S, Gandy A, Unwin HJT, Mellan TA, Coupland H, et al. Estimating the effects of non-pharmaceutical interventions on COVID-19 in Europe. Nature. 2020;584(7820):257–61. https://doi.org/10.1038/s41586-020-2405-7.

    Article  CAS  PubMed  Google Scholar 

  6. Edelstein M, Obi C, Chand M, et al. SARS-CoV2 infection in London, England: impact of lockdown on community point-prevalence, march-may 2020. medRxiv 20109017 [preprint]. 2020 25 [cited 2020 Nov 17. Available from. https://doi.org/10.1101/2020.04.27.20076000.

  7. Bendavid E, Oh C, Bhattacharya J, Ioannidis JP. Assessing mandatory stay-at-home and business closure effects on the spread of COVID-19. Eur J Clin Investig. 2020;51(4):e13484. https://doi.org/10.1111/eci.13484.

    Article  CAS  Google Scholar 

  8. Wilder-Smith A, Freedman DO. Isolation, quarantine, social distancing and community containment: pivotal role for old-style public health measures in the novel coronavirus (2019-nCoV) outbreak. J Travel Med. 27(2):taaa020, March 2020. https://doi.org/10.1093/jtm/taaa020.

  9. Kass NE. An ethics framework for public health. Am J Public Health. 2001;91(11):1780–2. https://doi.org/10.2105/AJPH.91.11.1776.

    Article  Google Scholar 

  10. Wang S, Liu Y, Hu T. Examining the change of human mobility adherent to social restriction policies and its effect on COVID-19 cases in Australia. Int J Environ Res Public Health. 2020;17(21):7930. https://doi.org/10.3390/ijerph17217930.

    Article  CAS  PubMed Central  Google Scholar 

  11. Statistics Canada. Census profile, 2016. Retrieved from https://www12.statcan.gc.ca on March 28, 2021.

  12. Inglesby TV. Public health measures and the reproduction number of SARS-CoV-2. JAMA. 2020;323(21):2186–7. https://doi.org/10.1001/jama.2020.7878.

    Article  PubMed  Google Scholar 

  13. Ontario Agency for Health Protection and Promotion (public health Ontario). COVID-19 vaccine uptake in Ontario: December 14, 2020 to march 13, 2021. Toronto: Queen’s Printer for Ontario; 2021.

    Google Scholar 

  14. Cori A, Ferguson NM, Fraser C, Cauchemez S. A new framework and software to estimate time-varying reproduction numbers during epidemics. Am J Epidemiol. 2013;178(9):1505–12. https://doi.org/10.1093/aje/kwt133.

    Article  PubMed  Google Scholar 

  15. Rai B, Shukla A, Dwivedi LK. Estimates of serial interval for COVID-19: a systematic review and meta-analysis. Clin Epidemiol Glob Health. 2021;9:157–61. https://doi.org/10.1016/j.cegh.2020.08.007.

    Article  PubMed  Google Scholar 

  16. Ali ST, et al. Serial interval of SARS-CoV-2 was shortened over time by nonpharmaceutical interventions. Science. 2020;369(6507):1106–9. https://doi.org/10.1126/science.abc9004.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  17. Du Z, et al. COVID-19 serial interval estimates based on confirmed cases in public reports from 86 Chinese cities. medRxiv. 2020:04.23.20075796. https://doi.org/10.1101/2020.04.23.20075796 Preprint.

  18. Google LLC. Google COVID-19 community mobility reports. Available online: https://www.google.com/covid19/mobility/

  19. Wood SN. Minimizing model fitting objectives that contain spurious local minima by bootstrap restarting. Biometrics. 2001;57(1):240–4. https://doi.org/10.1111/j.0006-341X.2001.00240.x.

    Article  CAS  PubMed  Google Scholar 

  20. McAloon C, Collins A, Hunt K, Barber A, et al. Incubation period of COVID-19: a rapid systematic review and meta-analysis of observational research. BMJ Open. 2020;10(8):e039652. https://doi.org/10.1136/bmjopen-2020/039652.

    Article  PubMed  PubMed Central  Google Scholar 

  21. Gupta S, Nguyen TD, Rojas FL, Raman S, Lee B, Bento A, et al. Tracking public and private response to the COVID-19 epidemic: evidence from state and local government actions. Natl Bur Econ Res. 2020; Work. Pap. No. 27027. https://doi.org/10.3386/w27027.

  22. Tran TH, Sasikumar S, Hennessy A, O’Loughlin A, Morgan L. Interpreting the effect of social restrictions on cases of COVID-19 using mobility data. Med J Aust. 2020:1. Available online: https://www.mja.com.au/system/files/2020-09/Tran%20mja20.00505%20-%2014%20September%202020.pdf. Accessed 6 Sept 2020.

  23. Kissler SM, Kishore N, Prabhu M, Goffman D, Beilin Y, Landau R, et al. Reductions in commuting mobility correlate with geographic differences in SARS-CoV2 prevalence in new York City. Nat Commun. 2020;11(1):4674. https://doi.org/10.1038/s41467-020-18271-5.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  24. Badr HS, Du H, Marshall M, Dong E, et al. Association between mobility patterns and COVID-19 transmission in the USA: a mathematical modelling study. Lancet Infect Dis. 2020;20(11):1247–54. (20)30553-3. https://doi.org/10.1016/S1473-3099.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  25. Celeste Bulfone T, Malekinejad M, Rutherford GW, Razani N. Outdoor transmission of SARS-CoV-2 and other respiratory viruses: a systematic review. J Infect Dis. 2021;223(4):550–61. https://doi.org/10.1093/infdis/jiaa742.

    Article  CAS  Google Scholar 

  26. Santamaría L, Hortal J. COVID-19 effective reproduction number dropped during Spain’s nationwide lockdown, then spiked at lower-incidence regions. Sci Total Environ. 2021;751:142257. Epub 2020 Sep 9. PMID: 33181975; PMCID: PMC7480327. https://doi.org/10.1016/j.scitotenv.2020.142257.

    Article  CAS  PubMed  Google Scholar 

Download references

Acknowledgements

None.

Funding

No funding was received for this study.

Author information

Authors and Affiliations

Authors

Contributions

CD conceived and designed the study, acquired and interpreted the data, and drafted the work. AH was responsible for data analysis and was involved in substantively revising the draft. All authors approved the submitted version.

Corresponding author

Correspondence to Christopher Dainton.

Ethics declarations

Ethics approval and consent to participate

Only de-identified and anonymized data was used, and therefore it is not possible to identify individual subjects in order to obtain consent. All retrieved data was publicly available, and therefore separate institutional ethical approval was not obtained nor required. All methods were carried out in accordance with relevant guidelines and regulations.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Dainton, C., Hay, A. Quantifying the relationship between lockdowns, mobility, and effective reproduction number (Rt) during the COVID-19 pandemic in the Greater Toronto Area. BMC Public Health 21, 1658 (2021). https://doi.org/10.1186/s12889-021-11684-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12889-021-11684-x

Keywords