Skip to main content
  • Research article
  • Open access
  • Published:

Social distancing intentions to reduce the spread of COVID-19: The extended theory of planned behavior

Abstract

Background

Due to the absence of a vaccine of SARS-CoV-2 virus pandemic, the most effective way to reduce transmission of the virus is by applying social distancing practices. Exploring factors that determine whether people adopt social distancing measures is, therefore, critical to reducing the spread of the virus. This study aimed to investigate people’s intentions to socially distance based on the extended Theory of Planned Behavior.

Methods

A questionnaire was distributed to the sample population and collected through social media online and WhatsApp groups from March 26, 2020 to March 29, 2020. There were 823 analyzed out of 1870 responses. The extended TPB variables and risk perception were measured using a 7-point scale (scored from 1 to 7). Data were analyzed using the partial least squares (PLS) structural equation modeling method.

Results

Study found that the factors influencing the intention to perform social distancing were subjective norms and perceived behavior control. Risk perception affected attitudes, subjective norms, and perceived behavioral control. Media exposure was found to determine attitudes, subjective norms, and risk perceptions. The relationship between attitudes and intentions, and media use and perceived behavior control were not significant. The better and effective risk communication that can change the level of risk perception, raise family and religious leader as well as increase to control behavior are the keys to people’s perform social distancing. Results from a multigroup analysis revealed that younger individuals showed a stronger relationship between the influence of risk perception and PBC and media use on risk perception. The predictive strength of subjective norms from risk perception and risk perception from media use was more strongly associated with rural populations.

Conclusions

The results of study provide an initial understanding of the level of the public’s risk perception to reduce the spread of SARS-CoV-2. Findings also revealed the role of media use in determining risk perception, attitudes and subjective norms and, in turn, change people’s intention to socially distance. This study may add to the literature of behavioral changes in pandemic and provide a framework for both policymakers and practitioners to formulate effective interventions in the future.

Peer Review reports

Background

Since the first case of COVID-19, the disease caused by the novel coronavirus SARS-CoV-2 that was first reported in December 2019 in Wuhan, Hubei Province, China, the virus has achieved a global spread. While China has reported a significant reduction of new cases, the outbreak continues to escalate in other parts of the world [1]. The virus is especially difficult to control as many infected individuals experience only mild to moderate respiratory symptoms and recover with no medical treatment [2]. Despite efforts to develop an effective treatment for COVID-19 and a vaccine against the virus, currently there is nothing yet available that has been shown to be effective. Public officials in the United States have suggested that a vaccine against Sars-CoV-2 will likely be available in 12 to 18 months [3] [4];.

While the public awaits a vaccine, public health measures need to be taken to stop the spread of SARS-CoV-2. To both prevent and slow transmission of the virus, the WHO has recommended protective behaviors such as regularly washing hands with soap and water or alcohol-based hand sanitizers, keeping a distance of at least 1 meter from others, avoiding crowded places, covering the mouth and nose when coughing, staying at home or self-isolating at home, and practicing physical activities [5, 6]. Governments have disseminated information and encouraged people to stay at home through television, newspapers, internet-based media, and social media. However, hoaxes, rumors, and false information are also spreading through social media, which has influenced the public’s perception of COVID-19.

Although the majority of people strongly support social distancing practices, the number of people who refuse to socially distance remains high. For example, a Politico/Morning Consult Poll involving 1991 people conducted from April 21–26, 2020 in the United States revealed that 73% of respondents socially distanced, with 15% refusing to engage in the practice [7]. In India, Bangladesh, Pakistan, and Indonesia people continue to go to shopping malls, houses of worship, tourism destinations, as well as continue to use public transport [8, 9], which are activities that make social distancing difficult. As governments decide not to impose lockdown policies, effective control over the spread of the virus and minimizing the effects of the pandemic will be dependent on public behavior. Exploring factors that determine whether people adopt social distancing measures is, therefore, critical to reducing the spread of the virus. As Indonesia is one the most densely populated and diverse countries in terms of culture, race, language, and religion, the population is especially vulnerable to COVID-19.

There has been a growing body of theory, research, and application regarding human behavior. Behavior and behavior changes have become a particular topic and attract the attention of scholars because it is important to understand and predict human behavior [10]. Many studies focused on investigating factors causing personal behavior such as health behavior [11], disaster preparedness [12], election, and environmental protection [13, 14]. Public health authority, for example, needs to know the reasons for people to quit or not to quit smoking in order to make intervention policies in reducing the negative impact of smoking. In regard to the importance of understanding and predicting behavior change, significant midrange theories exist and can be divided into some clusters such as behavior or individual model, communities or cultures model, and social cognition model [15].

One theory that comes from the individual model is Rational Choice Theory (RCT). The RCT posits that every choice is based on assessing the costs, risks, and advantages of making that option [16]. Similar to the RCT is the Fogg Behavior Model (FBM), which claims that individual behavior is influenced by motivation, ability, and trigger components that occur together at the same time [17]. Instead of depending on individual motive, the social learning theory introduced by Albert Bandura [18] highlighted that people’s behavior is a process of observing and modeling the behavior, attitude, and emotional reactions. It concerns learning that takes place in a social setting.

Behavioral theories focusing on the social cognition model have been widely used and become the foreground of research into predicting and explaining health behavior [19], social marketing [15], and lifestyle [20]. According to Goldberg et al., [15], they include the Theory of Reasoned Action (TRA), Theory of Planned and Behavior (TPB), Protection Motivation Theory (PMT), the Health Belief Model (HBM), and the Stage of Change Model. Social cognition models emphasize assessing people’s behavior and their beliefs in a social context [19]. Although each model has a different emphasis, they have similar ideas on how people take action.

To explore factors that determine whether people practice social distancing behavior, this study uses the TPB [10]. The TPB is popular as it can be used to explain a wide-range of behaviors and can be applied to different populations and contexts [13, 21,22,23,24,25,26]. According to the TPB, behavior is predicted by intention, and intention is influenced by attitudes towards the behavior, subjective norms, and perceived behavior control (PBC). The more strongly an individual holds an attitude, subjective norm, or PBC towards a behavior, the more likely the person intends to perform the behavior. Based on this theory, attitude is the degree to which a person is in favor (or not) of a particular behavior. A person who accepts as true that performing a certain behavior will lead to a mostly positive outcome will hold a favorable attitude towards performing the behavior [10]. Social norms are a function of beliefs that most referents will approve and support a particular behavior, which will exert pressure on an individual to perform the behavior. Referents can be family members, religious leaders, friends, and teachers. Another component of the TPB is PBC. PBC refers to a person’s perception of whether there is an aid or obstacle to performing a given behavior [27].

Due to the widespread news during the COVID-19 outbreak, it is advantageous to include other variables related to the performance of health behaviors: risk perception and media use [28]. Previous studies that have applied the TPB have demonstrated an increasing predictive ability of the model by adding more TPB variables [29,30,31,32]. Risk perception, in particular, has been widely used to investigate protective behavior. A number of studies have concluded that disaster preparedness and health-risk behavior is influenced by risk perception [19, 33]. For example, the Health Behavior Model (HBM) theory posits that people will perform health behaviors in response to perceived susceptibility, severity, benefits, barriers, and cues to action [34]. Moreover, the integration of risk perception and the TPB has been found to be effective in studies of dental flossing [35], predicting safe food handling in adolescents [36], and the intention to take precautions to avoid consuming foods with additives [37]. However, few studies have been conducted that include risk perception in determining the components of the TPB.

The causal relationship between information and risk perception has also been studied. For instance, the effect of audience motivation and influence of news media on risk perception [38,39,40]. Most researchers agree that information and an individual’s level of knowledge can positively influence protective behavior [41]. For example, the results of a study on malaria prevention in Rwanda showed that providing timely malaria-related information improved the ability of people to control and eliminate the disease [42]. Likewise, the results of review on inaccurate communication regarding mortality caused by air pollution showed that shifting the focus away from blame to more accurate and clear information help people change their behaviors [43]. Another study that applied the extended TPB found evidence to support the important role of information in determining behavioral changes. However, the role of media use in influencing attitudes, social norms, and PBC are limited, especially in the context of a pandemic.

Other studies related to health behavior have investigated the role of demographic variables in determining health behavior. In particular, sex, age, and income are often used to explain variation in behavior. One study, conducted by Mniszewski and his colleagues [44], concerned the use of face masks during an epidemic in Southern California. They found that using masks was correlated with an individual’s age and sex, whereby females and older adults were more likely to wear a mask than males or youths. Other studies that have investigated the relationship between demographic variables and protective behavior support findings such as income differences concerning the prevention of SARS [45] and the association between age and preventative cardiovascular disease behaviors [46].

The purpose of this study was to explore people’s intention to practice social distancing during the COVID-19 pandemic based on the extended TPB. We proposed the following hypotheses:

  1. 1.

    Hypothesis 1 (H1): Attitude positively influences the intention to socially distance

  2. 2.

    Hypothesis 2 (H2): Subjective norms influence the intention to socially distance

  3. 3.

    Hypothesis 3 (H3): PBC positively influences the intention to socially distance

  4. 4.

    Hypothesis 4 (H4): Risk perception positively influences attitudes towards social distancing

  5. 5.

    Hypothesis 5 (H5): Risk perception positively influences subjective norms

  6. 6.

    Hypothesis 6 (H6): Risk perception positively influences PBC

  7. 7.

    Hypothesis 7 (H7): Media use positively influences risk perception

  8. 8.

    Hypothesis 8 (H8): Media use positively influences attitudes towards social distancing

  9. 9.

    Hypothesis 9 (H9): Media use positively influences subjective norms

  10. 10.

    Hypothesis 10 (H10): Media use positively influences PBC

We also explored demographic variables such sex, age and residential areas relative to the intension to socially distance. Previous studies have supported the idea that there are different behaviors between males and females, elder and young people, as well as whether one lives in a rural or urban area.

The TPB has been claimed to result in consistent findings across behavior categories [47] and different populations [10]. This study provides fundamental information on applicability of the TPB due to the specific social-cultural characteristic of the study population. Indonesians can be categorized as a collectivist culture in which the expression of the people is controlled by social norms [48]. According to [49], collectivist cultures focused more on feeling/emotion instead of logical thinking. It is also important to note that traditionally the informal leader plays an important role in the community. Indonesia has maintained a quasi-feudalistic character due to being ruled by kingdoms and sultanates before the colonial era [50]. It is interesting to comprehend whether such collectivism and patronage-client culture will result in a similar effect because one of the variables of the TPB is the subjective norm.

Methods

Aim and participants

As the aim of this study was to investigate people’s intention to practice social distancing during the COVID-19 pandemic based on the extended TPB, a cross-sectional study design was used. As social distancing policies were already enacted, a questionnaire (see Additional file 1) was designed and distributed to the sample population and collected through online-based media (google form) from March 26, 2020 to March 29, 2020. The questionnaire that consists of 23 questions and 14 variables was shared on social media (Facebook, Instagram and Twitter) and WhatsApp groups. Only people living in Indonesia who were at least 17 years of age were allowed to voluntarily participate. There were 1870 responses to the questionnaire. However, after data cleaning, only 823 questionnaires were analyzed. Cleaning includes checking the completeness of filled-in questionnaire, no double participant, and other criteria. Respondents answered questions about their age, sex, level of education, city of residence, information-seeking (media use) behavior, risk perception, attitudes toward social distancing, subjective norms, PBC, and their intentions to take social distancing actions. To protect private information of the participants, the questionnaire did not ask the name and address of the participants (anonymity).

Measures

All of the extended TPB variables were measured using a 7-point scale (scored from 1 to 7) and most of the items were adopted from a previous study by Ajzen and Fishbein [10]. Risk perception was measured using 2 items: (i) “COVID-19 is a deadly disease”, and (ii) “I am likely infected with COVID-19”. However, the second item was dropped as Cronbach’s alpha and composite reliability did not meet the standard score. Attitudes regarding intention to perform social distancing were measured using 2 items: (i) “Spreading COVID-19 can be controlled by staying at home” and (ii) “Avoiding gatherings of large numbers of people and staying a minimum of 1 meter away from others will reduce the possibility of transmitting COVID-19”. Measures of subjective norms consisted of 3 items: (i) “my family (sons/daughter/wife/husband/parents/others) agree that I should stay at home to avoid being infected with COVID-19”, (ii) “my family (sons/daughter/wives/husband/parents/others) think I should stay at home to avoid being infected with COVID-19”, and (iii) “religious leaders support performing social distancing to avoid being infected with COVID-19”.

There were 3 items used for constructing perceived behavioral control: (i) “For myself, social distancing and avoiding large gatherings are easy to do”, (ii) “I can do anything while staying at home”, and (iii) “I have control over whether or not I see other people to prevent being infected with COVID-19”. Intention to perform social distancing consisted of 2 items: (i) “This week I am planning to stay at home and avoid meeting many people” and, (ii) “This week I will make an effort to stay at home and avoid meeting many people (and stay at least one meter away from others)”. Seven items were measured media information use: (i) television, (ii) radio, (iii) print, (iv) social media (Facebook, Twitter, Instagram, etc.), (v) domestic website, (vi) overseas website, and, (vii) WhatsApp groups. Demographic information included sex, age, and area of residence.

Data analysis

Descriptive data were analyzed using the IBM SPSS Statistic 23.0 software package (IBM Corp., Armonk, NY, USA) and SmartPLS 3.3.2 (SmartPLS GmbH, Boenningstedt, Germany) was used for factor loading and structural equation analyses. The partial least squares (PLS) method is considered the most appropriate for prediction or exploratory modeling [51]. Other advantages of the method are the ability to include multiple dependent and independent variables, the ability to treat multicollinearity among the independent variables, and the ability to handle single-item measurements [52]. Therefore, PLS is a suitable tool to explore and predict people’s behavior regarding social distancing during the emergence of SARS-CoV-2 and for the application of the extended TPB model. The significant values of the structural model are set to p-value < 0.05.

Results

Respondent profiles and measurement models

The profiles of the respondents are shown in Table 1. There were 439 males (53.3%) and 384 females (46.7%). This sex’s proportion is similar to the national population with males about 50.2% and female 49.8% [53]. The majority of the respondents were between 26 and 55 years of age and had either undergraduate/diplomas (56.1%) or masters and/or doctoral degrees (33%). The highest percentage of respondents were government officers (51.9%). In regards to residence, 60.8% of the respondents resided on Java Island. Information on whether respondents had family members older than 65 years with heart and lung disease are also shown in Table 1.

Table 1 Demographic characteristics of the respondents

To test the proposed hypotheses, it was essential to evaluate the reliability and validity of the latent variables before examining the structural model. Table 2 shows the results of factor loadings, Cronbach’s alpha, the composite reliability (CR), and the average variance extracted (AVE). Factor loading is preferred equal to or greater than 0.70, however if it is an exploratory research 0.4 or higher is acceptable [52]. Factor loading was set at a minimum of 0.6 [54] and the Cronbach’s alpha values were set at a minimum of 0.60 [54]. Internal consistency was evaluated and resulted in a composite reliability > 0.7. AVE reflects convergence and divergent validity and it is recommended that the threshold value for AVE should be exceed 0.5 [52]. The construct validity test is another discriminant validity, which aims to confirm that certain latent variables differ from others. The AVE square root was calculated and its value should be the highest in comparison with the correlations with other latent variables [55]. Table 3 shows the standard of discriminant validity. It can be seen from the Fornell-Larcker criterion table, the number of the square root of AVE appears in the diagonal cells are higher than the number correlations appear below it. Based on these results, the model was considered to be reliable, internally consistent, and with adequate discriminant validity.

Table 2 Mean, SD, Factor Loading, Cronbach’s Alpha, Composite Reliability and AVE
Table 3 Discriminant validity tests results (Fomell-Larcker Criterion)

Structural model and hypotheses testing

To test the structural model and hypotheses, a bootstrapping procedure with 5000 iterations and 823 subsamples was used [56]. Figure 1 shows the results of the explained variance or adjusted R-square (R2) and path-values of the model. These results show that the R2 value of intention was 0.183, attitude was 0.052, social norms was 0.084, PBC was 0.046, and risk perception had value of 0.012. The R2 of intention was higher than the 0.10 threshold [57] indicating that 18.3% of the variance in social distancing intention can be explained by the components of the extended TPB.

Fig. 1
figure 1

Structural Model Results. Note: The dashed lines denote the non-significant of predictive path. The solid lines denote a significant predictive effect. * indicates p < .01, ** indicates p < .05

Table 4 shows the assessment of the significance of the path coefficients, t-statistics and p-values among the components of the extended TPB model. Intention to socially distance was determined by social norms (β = 0.265, t-value = 4.575, p-value < 0.000) and PBC (β = 0.234, t-value = 4.625, p < 0.000). Risk perception significantly influenced attitudes (β = 0.207, t-value = 4.717, p < 0.000), social norms (β = 0.276, t-value = 6.333, p < 0.000), and PBC (β = 0.216, t-value = 5.418, p < 0.000). In addition, media use affected risk perception (β = 0.116, t-value = 3.177, p < 0.001), attitudes (β = 0.083, t-value = 2.323, p < 0.020), and social norms (β = 0.072, t-value = 2.158, p < 0.031). Therefore, hypotheses H2 through H9 were supported. Hypotheses H1 and H10 were not supported, as there were no significant causal relationships between attitudes and intentions, and media to PBC.

Table 4 Results of the proposed hypotheses test

Multigroup analysis

As this study involved a wide range of respondent backgrounds, a multigroup analysis was used to explore whether media use, risk perception, and the TPB components were different across sexes (male vs. female), ages (elder vs. younger), and residential areas (urban vs. rural). A two-step procedure was used to examine the statistical differences between the groups under investigation: bootstrapping and Multi-Group Analysis (MGA). The bootstrapping procedure was used to assess the path coefficients and p-values of each group, as well as the mean, STDEV and t-values from the results. The PLS-MGA test assessed the differences in path coefficients and significant p-values between each group. A PLS-MGA test indicates significance differences between groups if the p-value is lower than 0.05 or larger than 0.95 for the differences between group-specific path coefficients [52].

Table 5 shows the result of the path coefficient for each group. H1 hypothesized that attitude positively influences the intention to socially distance, which was not supported across all of the groups. However, H2, which proposed that subjective norms influence the intention to socially distance, was supported across all of the groups: sex (male: β = 0.226, p < 0.05; female: β = 0.299, p < 0.001), age group (elder: β = 0.281, p < 0.05; younger: β = 0.263, p < 0.001), and residential area (urban: β = 0.262, p < 0.001; rural: β = 0.282, p < 0.05,). The third hypothesis, the influence of PBC on intention to socially distance (H3), was also confirmed for all of the groups: sex (male: β 0.310, p < 0.001; female: β = 0.153, p < 0.05), age group (elder: β = 0.357, p < 0.001; younger: β = 0.176 p < 0.001) and residential area (urban: β = 0.240, p < 0.001; rural: β = 0.229, p < 0.05). Similar to H2 and H3, the fourth hypothesis (H4), which suggested that risk perception influences attitudes towards social distancing, and H5, which suggested that risk perception influences subjective norms, was supported across all of the groups: sex (male: β = 0.263, p < 0.001 and β = 0.320, p < 0.001; female: β = 0.154, p < 0.05 and β = 0.227, p < 0.05), age group (elder: β = 0.191, p < 0.05 and β = 0.230, p < 0.05; younger: β = 0.221, p < 0.001 and β = 0.308, p < 0.001), and living area (urban: β = 0.164, p < 0.05 and β = 0.215, p < 0.001; rural: β = 0.299, p < 0.001). H7, which proposed that media use influenced risk perception, was supported in all of the groups: sex only for females (β = 0.127, p < 0.05), ages for the younger group (β = 0.127, p < 0.05) and residential areas for rural populations (β = 0.234, p < 0.05). The effect of media use on attitude, as hypothesized in H8, was only confirmed for the younger age group (β = 0.111, p < 0.05). H9 which suggested media use influences subjective norms, was supported only for females (β = 0.123, P < 0.05), while H10, which proposed media use positively influences PBC, was not supported in any of the groups.

Table 5 Multigroup analysis statistical tests

The PLS-MGA p-values indicated that there were no significant differences between sex. Multigroup analysis also indicated that there were small differences between the elder and younger age groups. Among the 10 hypotheses, only H6 and H7 were supported. H6 suggests that the effect of risk perception on PBC for young people (equal to and under 45 years old) was stronger than for elder people (difference = − 0.178, p < 0.05). H7 indicated that media use had more of an impact on risk perception for young people compare to elder people (difference = − 0.009, p > 0.095).

The differences between rural and urban residents applied to hypotheses H5 and H7. Hypothesis 5 (H5) described the effect of risk perception on social norms and was supported in rural populations (difference = − 0.188, p < 0.05). Similarly, H7 explained that the media’s effect on risk perception was also more effective for people living in rural areas (difference = − 0.174, p > 0.05).

Discussion

Out of the 3 components of the TPB, social norms and PBC were significant in determining the intention to socially distance, while attitude was not a significant predictor of intention. These findings are in agreement with a previous study that found subjective norms and PBC had a significant impact on behavioral intentions [58,59,60]. In line with the findings of Alfahan’s study [61], the social norm component emerged as the most important predictor. Family members and religious leaders were important in influencing people’s intention to practice social distancing to reduce the spread of SARS-CoV-2. One possible reason for this finding could be due to the behavioral style of Indonesians, which is grouped into 3 categories: (1) sociable community-oriented (70%), (2) positive but still self-oriented (27%), and (3) self-centric (3%) [62]. This implies that effective policy interventions to influence behavior to include more social distancing would be to involve religious and community leaders, and large families. As found in a study conducted by Rajib Shaw and his colleagues [63] people in China, Japan, and South Korea also made decisions that strongly depended on community solidarity and behavior.

The contribution of the PBC variable to the model indicates that people have control and the ability to take social distancing intention. This finding supports past TPB studies that have found PBC variables are typically less important than attitudes and social norms [64] [47, 65, 66];. Contrary to our expectations, attitude was not predictor of intention. This finding is in contrast to previous studies on alcohol consumption and smoking cessation, which have concluded that attitude was a predictor of intention [20, 67]. One possible reason for this result is that individuals may believe that reducing the spreading of the virus is not limited to staying at home and avoiding crowds, as questioned in the questionnaires. For example, to reduce the spread SARS-CoV-2, WHO suggests that regularly washing hands using soap and water or cleaning with alcohol-based hand sanitizers, covering the mouth and nose when coughing, and consuming healthy foods be included with social distancing. As argued by Ajzen and Fishbein [10] the relative importance of the TPB components for the prediction of behavior intention diverges depending on the target behavior and population.

The role of risk perception in protective behavior has been widely studied, and its effect on social norms, risk perception and PBC components are important. Risk perception can predict behavioral intentions mediated by attitudes, social norms, and PBC. The present results are consistent with a previous study in which risk perception was a strong determining factor for attitudes and self-efficacy in a health context [35]. These findings suggest that it is critical to identify the level of risk perception of COVID-19 when social distancing is promoted and intervention policies are formulated. Policymakers should consider applying behavioral promotions that increase risk perception. To our knowledge, this the first study to include risk perception as influencing the components of TPB in the context of global health crisis in less-developed country.

The influence of media use on risk perception and the intention to enact behavior was also investigated. Media use significantly changed risk perception, attitudes, and social norms but not the PBC variable. Similar to risk perception, most studies have focused on the direct effects of communication variables on behavioral change, and these have resulted in mixed findings [13, 68]. This study used communication variables as predictors of risk perception, attitudes, and social norms, and the results were significant. This finding supports the elaboration of the likelihood model and suggests that attention to message content is a necessary condition for persuasive effects [69]. These results also suggest that both print and digital media influence the level of risk perception, attitudes, and social norms when predicting social distancing practices to prevent the spreading of the COVID-19.

In addition, the present study found minor differences in demographic characteristics such as sex, age, and area of residence. In contrast to previous studies [64, 70], we found no differences between males and females in how behavioral change is influenced. These findings are inconsistent with past studies that found differences in behavioral intention between the sex [71]. It may be due to the wide media coverage reporting on COVID-19 causing both males and females to receive and respond to social distancing recommendations equally. Factors related to media and its social influence may be significant in the context of a pandemic [72]. Therefore, it is necessary to consider the media’s role in planning effective risk communication.

Age and residential area showed partial differences. Younger respondents demonstrated a stronger relationship between the influence of risk perception and PBC as well as media use and risk perception. This finding is consistent with a previous study that found PBC associated with self-efficacy and that control ability was more easily acquired by younger individuals [30]. The relationship between risk perception and perceived behavioral control, and media use and risk perception for people living in rural areas was greater than those living in urban areas. This finding contrasts with a previous study that found people living in the city were more likely to buy green products due to a greater availability of information than those living in rural areas [73]. In the case of COVID-19, people in rural areas may often only use official, government media compared to urban residents, who also use social media or WhatsApp groups—where the information may not be valid. This finding also supports the negative association between media use and perceived behavioral control, which was significant for people living in rural areas.

Conclusions

This study included an examination of risk perception and media use in the extended TPB model to predict the public’s intention of practicing social distancing during the SARS-CoV-2 pandemic. The empirical results of a partial least squares structural equation modeling analysis with 823 participants revealed that the extended TPB model supported 8 out of 10 proposed hypotheses. Subjective norms and PBC significantly influenced the intention to practice social distancing, while attitude was not significantly associated with intention. Risk perception significantly affected attitudes, subjective norms, and PBC. Furthermore, while media use influenced risk perception, attitudes, and subjective norms, it was not a significant factor in influencing PBC. A multigroup analysis of demographic variables found partial differences. Younger individuals showed a stronger relationship between the influence of risk perception and PBC and media use on risk perception. In addition, the predictive strength of subjective norms from risk perception and risk perception from media use was more strongly associated with rural populations.

The results of current study provide a foundational understanding of the level of the public’s risk perception such that it can be used to target policy interventions needed to reduce the spread of SARS-CoV-2. Our findings also revealed the role of media use in determining risk perception, attitudes and subjective norms. Better and effective risk communication can change the level of risk perception, attitudes and subjective norms and, in turn, change people’s intention to socially distance. This study can be a valuable addition to the literature, as it explores the notions of behavioral changes in the context of a large infectious disease pandemic especially in developing countries context. While this study supported the extended TPB, the collection of data through social media was a limitation. Therefore, future studies should be expanded to include random population sampling. Another limitation of the study is that the non-significant differences might be caused by demographic factors such as sex, age, educational background, and marital status. Furthermore, since the characters of the population are collectivist cultures, the roles of risk perception, media use, emotional and environmental factors contribute to the non-significant differences. Future studies should investigate in-depth the contribution of demographic and social factors of the participants. It will also critical to investigate the effect of the government’s risk communication on public behavior in the context of a pandemic.

Availability of data and materials

The data used in this this study are available from the corresponding author upon reasonable request.

Abbreviations

AT:

Attitude

AVE:

Average Variance Extracted

COVID-19:

Coronavirus disease 2019

CA:

Cronbach’s alpha

CR:

Composite Reliability

INT:

Intention

MGA:

Multigroup Analysis

PBC:

Perceived Behavior Control

TPB:

Theory of Planned Behavior

PLS:

Partial Least Squares

RP:

Risk Perception

SARS-CoV-2:

Severe acute respiratory syndrome coronavirus 2

SD:

Standard Deviation

SN:

Subjective Norms

SPSS:

Statistical Package for the Social Sciences

WHO:

World Health Organization

References

  1. Adiyoso W. Does the Covid-19 pandemic have any positive impact on SDGs? J Indonesia Sustain Dev Plan. 2020;I(2):i–iii.

    Article  Google Scholar 

  2. The WHO and China Joint Mission. Report of the WHO-China Joint Mission on Coronavirus Disease 2019 (COVID-19). In: The WHO-China Joint Mission on Coronavirus Disease 2019; 2020. p. 16–24.

    Google Scholar 

  3. Thompson D. Vaccine? Why will it take so long for a COVID-19. US News. 2020 [cited 2020 Apr 7]. Available from: https://www.usnews.com/news/health-news/articles/2020-04-06/why-will-it-take-so-long-for-a-covid-19-vaccine

  4. Hanney SR, Wooding S, Sussex J, Grant J. From COVID-19 research to vaccine application: why might it take 17 months not 17 years and what are the wider lessons? Health Res Policy Syst. 2020;18(1):1–10. https://doi.org/10.1186/s12961-020-00571-3.

    Article  Google Scholar 

  5. WHO. Coronavirus disease 2019 (COVID-19) Situation Report – 77. 2020. Available from: https://www.who.int/docs/default-source/coronaviruse/situation-reports/20200406-sitrep-77-covid-19.pdf?sfvrsn=21d1e632_2. [cited 2020 Apr 6]

  6. BNPB. Jumlah Kasus Covid-19. 2020 [cited 2020 Apr 7]. Available from: http://covid19.bnpb.go.id. [cited 2020 Apr 7]

  7. Burns K. Polls: Americans don’t want to end social distancing policies despite financial devastation. Vox. 2020;29. Available from: https://www.vox.com/policy-and-politics/2020/4/29/21241069/polls-social-distancing-policies-financial-devastation. [cited 2020 April 27].

  8. Fliegauf E, Ayres A. Coronavirus in South Asia, April 2, 2020: Crowds in India and Pakistan thwart social distancing: Council on Foreign Relations; 2020. Available from: https://www.cfr.org/blog/coronavirus-south-asia-april-2-2020-crowds-india-and-pakistan-thwart-social-distancing. [cited 2020 April 20].

  9. Djalante R, Lassa J, Setiamarga D, Mahfud C, Sudjatma A, Indrawan M, et al. Review and analysis of current responses to COVID-19 in Indonesia: Period of January to March 2020. Progress Disast Sci. 2020:100091 Available from: https://linkinghub.elsevier.com/retrieve/pii/S2590061720300284.

  10. Fishbein M, Ajzen I. Understanding attitudes and predicting social behavior; 1980.

    Google Scholar 

  11. Roncancio AM, Ward KK, Sanchez IA, Cano MA, Byrd TL, Vernon SW, et al. Using the theory of planned behavior to understand cervical Cancer screening among Latinas. Health Educ Behav. 2015;42(5):621–6. https://doi.org/10.1177/1090198115571364.

    Article  PubMed  PubMed Central  Google Scholar 

  12. Najafi M, Ardalan A, Akbarisari A, Noorbala AA, Elmi H. The theory of planned behavior and disaster preparedness. PLoS Curr. 2017;9:2017.

    Google Scholar 

  13. Ho SS, Liao Y, Rosenthal S. Applying the theory of planned behavior and media dependency theory: predictors of public pro-environmental behavioral intentions in Singapore. Environ Commun. 2015;9(1):77–99. https://doi.org/10.1080/17524032.2014.932819.

    Article  Google Scholar 

  14. Conner M, Norman P. Health behaviour: current issues and challenges. Psychol Health. 2017;32(8):895–906. https://doi.org/10.1080/08870446.2017.1336240.

    Article  PubMed  Google Scholar 

  15. Goldberg ME, Fishbein M, Middlestadt SE. Social marketing: theoretical and practical perspectives: Psychology Press; 2018. https://doi.org/10.4324/9781315805795.

  16. Zey M. Rational choice and organization theory. Int Encycloped Soc Behav Sci. 2001:12751–5. https://doi.org/10.1016/B0-08-043076-7/04212-1.

  17. Agha S, Tollefson D, Paul S, Green D, Babigumira JB. Use of the Fogg behavior model to assess the impact of a social marketing campaign on condom use in Pakistan. J Health Commun. 2019 Mar 4;24(3):284–92. https://doi.org/10.1080/10810730.2019.1597952.

    Article  PubMed  Google Scholar 

  18. Rumjaun A, Narod F. Social learning theory—Albert bandura BT - science education in theory and practice: an introductory guide to learning theory. In: Akpan B, Kennedy TJ, editors. . Cham: Springer International Publishing; 2020. p. 85–99. https://doi.org/10.1007/978-3-030-43620-9_7.

    Chapter  Google Scholar 

  19. Rutter D, Quine L. Social cognition models and changing health behaviours. In D. Rutter & L. Quine (Eds.). Changing health behaviour: Intervention and research with social cognition models. Bekshire: Open University Press; 2002. pp. 1–27

  20. Topa G, Moriano JA. Theory of planned behavior and smoking: meta-analysis and SEM model. Subst Abus Rehabil. 2010. https://doi.org/10.2147/SAR.S15168.

  21. Ceccato NE, Ferris LE, Manuel D, Grimshaw JM. Adopting health behavior change theory throughout the clinical practice guideline process. J Contin Educ Health Prof. 2007;27(4):201–7. https://doi.org/10.1002/chp.138.

    Article  PubMed  Google Scholar 

  22. Abamecha F, Godesso A, Girma E. Intention to voluntary HIV counseling and testing (VCT) among health professionals in Jimma zone, Ethiopia: The theory of planned behavior (TPB) perspective. BMC Public Health. 2013;13(1):1–7.

    Article  Google Scholar 

  23. Ko N-Y, Feng M-C, Chiu D-Y, Wu M-H, Feng J-Y, Pan S-M. Intention and volunteering to care for SARS patients applying theory of planned behavior to predict nurses’ intention and volunteering to care for SARS patients in Southern Taiwan. Vol. 20; 2004.

    Google Scholar 

  24. Masser BM, White KM, Hamilton K, McKimmie BM. Beliefs underlying blood donors’ intentions to donate during two phases of an avian influenza outbreak. Transfus Apher Sci. 2012;46(1):47–52. https://doi.org/10.1016/j.transci.2011.11.001.

    Article  PubMed  Google Scholar 

  25. Yang ZJ. Predicting young adults’ intentions to get the H1N1 vaccine: an integrated model. J Health Commun. 2015;20(1):69–79. https://doi.org/10.1080/10810730.2014.904023.

    Article  CAS  PubMed  Google Scholar 

  26. Hansstein FV, Echegaray F. Exploring motivations behind pollution-mask use in a sample of young adults in urban China. Glob Health. 2018;14(1):1–10.

    Article  Google Scholar 

  27. Russo DA, Stochl J, Painter M, Shelley GF, Jones PB, Perez J. Use of the theory of planned behaviour to assess factors influencing the identification of students at clinical high-risk for psychosis in 16+ education. BMC Health Serv Res. 2015;15(1). https://doi.org/10.1186/s12913-015-1074-y.

  28. Michael Cummings K, Becker MH, Maile MC. Bringing the models together: an empirical approach to combining variables used to explain health actions. J Behav Med. 1980;3(2):123–45. https://doi.org/10.1007/BF00844986.

    Article  Google Scholar 

  29. Conner M, Armitage CJ. Extending the theory of planned behavior: a review and avenues for further research. J Appl Soc Psychol. 1998;28(15):1429–64. https://doi.org/10.1111/j.1559-1816.1998.tb01685.x.

    Article  Google Scholar 

  30. Høie M, Moan IS, Rise J. An extended version of the theory of planned behavour: prediction of intentions to quit smoking using past behaviour as moderator. Addict Res Theory. 2010;18(5):572–85. https://doi.org/10.3109/16066350903474386.

    Article  Google Scholar 

  31. Hsu CHC, Huang S. (Sam). An extension of the theory of planned behavior model for tourists. J Hosp Tourism Res. 2010;36(3):390–417. https://doi.org/10.1177/1096348010390817.

    Article  Google Scholar 

  32. Graham-Rowe E, Jessop DC, Sparks P. Predicting household food waste reduction using an extended theory of planned behaviour. Resour Conserv Recycl. 2015;101:194–202. https://doi.org/10.1016/j.resconrec.2015.05.020.

    Article  Google Scholar 

  33. Adiyoso W, Kanegae H. Effectiveness of disaster-based school program on students’ earthquake-preparedness. J Disast Res. 2013;8(5):1009–17. https://doi.org/10.20965/jdr.2013.p1009.

    Article  Google Scholar 

  34. Mashanda-Tafaune B, Monareng LV. Perception and attitude of healthcare workers towards the use of a female condom in Gaborone, Botswana. Health SA Gesondheid. 2016;21:162–70. https://doi.org/10.1016/j.hsag.2015.12.002.

    Article  Google Scholar 

  35. Schmiege SJ, Bryan A, Klein WMP. Distinctions between worry and perceived risk in the context of the theory of planned behavior. J Appl Soc Psychol. 2009;39(1):95–119. https://doi.org/10.1111/j.1559-1816.2008.00431.x.

    Article  Google Scholar 

  36. Mullan BA, Wong C, Kothe EJ. Predicting adolescents’ safe food handling using an extended theory of planned behavior. Food Control. 2013;31(2):454–60. https://doi.org/10.1016/j.foodcont.2012.10.027.

    Article  Google Scholar 

  37. Chen M-F. Modeling an extended theory of planned behavior model to predict intention to take precautions to avoid consuming food with additives. Food Qual Prefer. 2017;58:24–33. https://doi.org/10.1016/j.foodqual.2017.01.002.

    Article  Google Scholar 

  38. So J. Uses, gratifications, and beyond: toward a model of motivated media exposure and its effects on risk perception. Commun Theory. 2012;22(2):116–37. https://doi.org/10.1111/j.1468-2885.2012.01400.x.

    Article  Google Scholar 

  39. Wahlberg AAF, Sjoberg L. Risk perception and the media. J Risk Res. 2000;3(1):31–50. https://doi.org/10.1080/136698700376699.

    Article  Google Scholar 

  40. Agha S. The impact of a mass media campaign on personal risk perception, perceived self-efficacy and on other behavioural predictors. AIDS Care. 2003;15(6):749–62. https://doi.org/10.1080/09540120310001618603.

    Article  CAS  PubMed  Google Scholar 

  41. Johnston DM, Bebbington Chin‐Diew Lai MS, Houghton BF, Paton D. Volcanic hazard perceptions: comparative shifts in knowledge and risk. Disaster Prevention and Management. 1999;8(2):118–26. https://doi.org/10.1108/09653569910266166.

  42. Asingizwe D, Poortvliet PM, Koenraadt CJM, Van Vliet AJH, Murindahabi MM, Ingabire C, et al. Applying citizen science for malaria prevention in Rwanda: an integrated conceptual framework. NJAS Wageningen J Life Sci. 2018;86–87:111–22.

    Article  Google Scholar 

  43. Cox LA. Communicating more clearly about deaths caused by air pollution. Global Epidemiol. 2019;1:100003. https://doi.org/10.1016/j.gloepi.2019.100003.

    Article  Google Scholar 

  44. Mniszewski SM, Del Valle SY, Priedhorsky R, Hyman JM, Hickman KS. Understanding the impact of face mask usage through epidemic simulation of large social networks. In: Dabbaghian V., Mago V. (eds) Theoriesand Simulations of Complex Social Systems. Intelligent Systems Reference Library, vol 52. Berlin: Springer; 2002. https://doi.org/10.1007/978-3-642-39149-1_8.

  45. Liddell JL, Saltzman LY, Ferreira RJ, Lesen AE. Cumulative disaster exposure, gender and the protective action decision model. Progress Disast Sci. 2020;5:100042. https://doi.org/10.1016/j.pdisas.2019.100042.

    Article  Google Scholar 

  46. McKenzie SH, Jayasinghe UW, Fanaian M, Passey M, Lyle D, Davies GP, et al. Socio-demographic factors, behaviour and personality: associations with psychological distress. Eur J Prev Cardiol. 2011;19(2):250–7. https://doi.org/10.1177/1741826711399426.

    Article  PubMed  Google Scholar 

  47. Godin G, Kok G. The theory of planned behavior: a review of its applications to health- related behaviors. Am J Health Promot. 1996;11(2):87–98. https://doi.org/10.4278/0890-1171-11.2.87.

    Article  CAS  PubMed  Google Scholar 

  48. Teoh HY, Serang DP, Lim CC. Individualism-collectivism cultural differences affecting perceptions of unethical practices: some evidence from Australian and Indonesian accounting students. Teach Bus Ethics. 1999;3(2):137–53. https://doi.org/10.1023/A:1009832018849.

    Article  Google Scholar 

  49. Adrianson L, Ancok D, Ramdhani N, Archer T. Cultural influences upon health, affect, self-esteem and impulsiveness: an Indonesian-Swedish comparison. Int J Res Stud Psychol. 2013;2(3):25–44. https://doi.org/10.5861/ijrsp.2013.228.

    Article  Google Scholar 

  50. Berenschot W, van Klinken G. Informality and citizenship: the everyday state in Indonesia. Citizsh Stud. 2018;22(2):95–111. https://doi.org/10.1080/13621025.2018.1445494.

    Article  Google Scholar 

  51. Hair JF, Sarstedt M, Ringle CM, Gudergan SP. Advanced issues in partial least squares structural equation modeling (PLS-SEM). Thousand Oaks: Sage; 2018. https://doi.org/10.3926/oss.37.

    Book  Google Scholar 

  52. Garson GD. Partial Least Square S (PLS - SEM) - regression and structural equation models. 2016 Editi. Statistical associates publishing. Asheboro: Statistical Publishing Associates Publshing; 2016.

    Google Scholar 

  53. Indonesia Statistic. Statistical Yearbook of Indonesia 2020. BPS 2020. Jakarta: BPS Indonesia; 2020. p. 790.

    Google Scholar 

  54. Wong KK. 28/05 - partial least squares structural equation modeling (PLS-SEM) techniques using SmartPLS. Mark Bull. 2013;24(1):1–32.

    Google Scholar 

  55. Fornell C, Larcker DF. Structural equation models with unobservable variables and measurement error: algebra and statistics. J Mark Res. 1981;18(3):382–8. https://doi.org/10.1177/002224378101800313.

    Article  Google Scholar 

  56. Hair JF, G., Thomas MH, Ringle CM, Sarstedt M. A primer on partial least squares structural equation modeling (PLS-SEM). 2nd ed. Thousand Oaks: Sage; 2017.

    Google Scholar 

  57. Siyal AW, Donghong D, Umrani WA, Siyal S, Bhand S. Predicting mobile banking acceptance and loyalty in chinese bank customers. SAGE Open. 2019;9(2):2158244019844084.

    Article  Google Scholar 

  58. Lu Y, Zhou T, Wang B. Exploring Chinese users’ acceptance of instant messaging using the theory of planned behavior, the technology acceptance model, and the flow theory. Comput Hum Behav. 2009;25(1):29–39. https://doi.org/10.1016/j.chb.2008.06.002.

    Article  CAS  Google Scholar 

  59. Lin CY, Cheung MKT, Hung ATF, Poon PKK, Chan SCC, Chan CCH. Can a modified theory of planned behavior explain the effects of empowerment education for people with type 2 diabetes? Ther Adv Endocrinol Metabol. 2020;11:1–12.

    CAS  Google Scholar 

  60. Chirayil EI, Thompson CL, Burney S. Predicting human papilloma virus vaccination and pap smear screening intentions among young singaporean women using the theory of planned behavior. SAGE Open. 2014;4(4):1–10. https://doi.org/10.1177/2158244014554961.

    Article  Google Scholar 

  61. Alfahan A, Alhabib S, Abdulmajeed I, Rahman S, Bamuhair S. In the era of corona virus: health care professionals’ knowledge, attitudes, and practice of hand hygiene in Saudi primary care centers: a cross-sectional study. J Commun Hosp Intern Med Perspect. 2016;6(4):32151. https://doi.org/10.3402/jchimp.v6.32151.

    Article  Google Scholar 

  62. Maulana EM. Etnomarker: Dimensi Perilaku Masyarakat Dari Malaikat Hingga Covidiot: Unair News; 2020. Available from: https://infobrand.id/img/posts/2020/04/10/8-dimensi-perilaku-masyarakat-di-era-covid-19.pdf. [cited 2020 April 26].

  63. Shaw R, Kim Y, Hua J. Progress in disaster science governance, technology and citizen behavior in pandemic : lessons from COVID-19 in East Asia. Progress Disast Sci. 2020;6:100090. https://doi.org/10.1016/j.pdisas.2020.100090.

    Article  Google Scholar 

  64. Zhang X, Wang F, Zhu C, Wang Z. Willingness to self-isolate when facing a pandemic risk: Model, empirical test, and policy recommendations. Int J Environ Res Public Health. 2020;17(1):197.

    Article  CAS  Google Scholar 

  65. Conner M, Norman P. Predicting health behaviour: reseaarch and practice with social congnition model. Second. Open University press. Berkshire: Open University Press; 2006.

    Google Scholar 

  66. Babrow AS, Black DR, Tiffany ST. Beliefs, attitudes, intentions, and a smoking-cessation program: a planned behavior analysis of communication campaign development. Health Commun. 1990;2(3):145–63. https://doi.org/10.1207/s15327027hc0203_2.

    Article  Google Scholar 

  67. Cooke R, Dahdah M, Norman P, French DP. How well does the theory of planned behaviour predict alcohol consumption? A systematic review and meta-analysis. Health Psychol Rev. 2016;10:148–67.

    Article  Google Scholar 

  68. Silva NT, Paleo U, Ferreira Neto JA. Conflicting discourses on wildfire risk and the role of local media in the Amazonian and temperate forests. Int J Disast Risk Sci. 2019;10(4):529–43. https://doi.org/10.1007/s13753-019-00243-z.

    Article  Google Scholar 

  69. Petty RE, Cacioppo JT. The elaboration likelihood model of persuasion BT - communication and persuasion: central and peripheral routes to attitude change. In: Petty RE, Cacioppo JT, editors. Communication and persuasion: central and peripheral routes to attitude change. New York: Springer New York; 1986. p. 1–24. https://doi.org/10.1007/978-1-4612-4964-1_1.

    Chapter  Google Scholar 

  70. Bish A, Michie S. Demographic and attitudinal determinants of protective behaviours during a pandemic: a review. Br J Health Psychol. 2010;15(4):797–824. https://doi.org/10.1348/135910710X485826.

    Article  PubMed  PubMed Central  Google Scholar 

  71. Jafarkarimi H, Saadatdoost R, Sim ATH, Hee JM. Behavioral intention in social networking sites ethical dilemmas: an extended model based on theory of planned behavior. Comput Hum Behav. 2016;62:545–61. https://doi.org/10.1016/j.chb.2016.04.024.

    Article  Google Scholar 

  72. Karasneh R, Al-azzam S, Mu S, Soudah O, Hawamdeh S. Research in Social and Administrative Pharmacy Media’s effect on shaping knowledge, awareness risk perceptions and communication practices of pandemic COVID-19 among pharmacists. Res Soc Admin Pharm. 2020;17:1897–902.

    Article  Google Scholar 

  73. Wang B, Li J, Sun A, Wang Y, Wu D. Residents’ green purchasing intentions in a developing-country context: integrating PLS-SEM and MGA methods. Sustainability. 2019;12(1):1–21. https://doi.org/10.3390/su12010030.

    Article  Google Scholar 

Download references

Acknowledgements

The authors would like to thank their two research assistants, IN and NY in the Research Centre for Conflict and Policy (RCCP), for their invaluable support with data collection, data cleaning and partial manuscript preparation. We would also like to thank the Dean of Faculty Administrative Science, Brawijaya University, Head of Centre for Planner’s Development, Education and Training Bappenas and all of the survey respondents for participating in this study.

Funding

The authors received no financial support for the research, authorship, and/or publication of this article.

Author information

Authors and Affiliations

Authors

Contributions

WA conducted the research design, statistical analysis and theoretical framework writing. WI was responsible for data collection, data analysis and conclusions. Both authors read and approved the final manuscript.

Corresponding author

Correspondence to Wignyo Adiyoso.

Ethics declarations

Ethics approval and consent to participate

The Research Centre of Brawijaya University has determined that the study would not have required ethics approval. This study was conducted in accordance with (1) Indonesia Laws No. 18 Year 2002 on National System of Research, Development and Application of Natural Science, (2) Indonesia Government Regulation No. 48 of 2009 on Permission for Conducting Activities, Developing and the Implementation of the Science and Technology with the High Risk and Dangerous, and (3) Indonesia Government Regulation No. 39 of 1995 on Health Research and Development. This study is not categorized as a high risk and dangerous, so it is not necessary to obtain permission from ethical committee. All study participants were informed about the purpose of the study, voluntary to participate, anonymity, confidentiality of the information, age above 17 year old and Indonesian citizen living in Indonesia territory. As this was online survey, informed consent was provided in the introduction of the questionnaires survey, only participants who consent and agree was participating in the study.

Consent for publication

Not applicable.

Competing interests

The authors declare that there is no competing interest.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Adiyoso, W., Wilopo Social distancing intentions to reduce the spread of COVID-19: The extended theory of planned behavior. BMC Public Health 21, 1836 (2021). https://doi.org/10.1186/s12889-021-11884-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12889-021-11884-5

Keywords