Vicki Osborne1,2*
Saad A. W. Shakir1,2- 1Drug Safety Research Unit, Southampton, United Kingdom
- 2School of Pharmacy and Biomedical Sciences, University of Portsmouth, Portsmouth, United Kingdom
Introduction
There is a continuous need to identify safe, effective treatments and vaccines which will have a significant impact. However, data can be misinterpreted because of confusion over terminology. We attempt to clarify the difference between observed association and causal association, in addition to the difference between signals and evidence, with examples that have arisen during the COVID-19 pandemic.
Association and Causation
Determining if there is an association between an exposure and an outcome is one of the fundamental goals in all biomedical research. Specifically in medicine, examining the association between a drug (exposure) and subsequent adverse or beneficial events (outcomes) is one area of interest. However, establishing an association between a drug and an event is not the end of the story but this is where confusion can often arise. The true question of interest is often whether taking the drug causes the event, which can not be established solely because an association is observed. Observed association (the event occurs after taking the drug) is not equivalent to causal association (the event is caused by taking the drug). The reason for this is that there can be other explanations for why a drug appears to be associated with an event; chance, bias and confounding can all play a role. To provide an example in COVID-19, there are many observational studies which have examined the use of experimental treatments and their association with recovery from the disease. However, there could be many possible explanations for the patient’s recovery and recovery is not necessarily because of using those experimental treatments. It is important to ensure that any observed associations are not due to other causes.
In interpreting exposure and outcome data from studies, consideration should be given to the study design being examined. Causal association can often be elucidated from randomised controlled trials (RCTs) because the study design minimizes biases and confounding. The role of chance may still be a factor though. Observational studies can be subject to bias and confounding depending on the design, so should be interpreted with caution. Methods for assessing causal association do exist however, such as the concepts set out by Austin Bradford Hill (Hill, 2015) and subsequent suggested modification (Fedak et al., 2015). Other approaches include causal inference methods which use algorithms and other statistical methods to assess causal associations. Experimental treatments in COVID-19 under investigation include novel therapies such as convalescent plasma; theoretically, the plasma of those who have recovered from COVID-19 may contain sufficient antibodies to treat a patient currently infected with COVID-19 (Chen et al., 2020). Several studies have been completed so far; some of these have not been useful due to small sample sizes and/or lack of randomization or robust study design, so it could not be confirmed that any association between convalescent plasma and recovery was causal (Duan et al., 2020; Shen et al., 2020). Data from ongoing clinical trials which can determine causal association have been inconsistent to date, so a conclusion regarding a causal association is still not possible at this time (Chai et al., 2020). Another example in COVID-19 is hydroxychloroquine, which was originally thought to be a possible treatment because an association with viral clearance was observed in one small study (Gautret et al., 2020). However, there were concerns about the study design (Voss, 2020) and results from a larger RCT revealed no clinical benefit for hydroxychloroquine in COVID-19 (Horby and Landray, 2020). The initial observed association was not found to be causal.
Signals and Evidence
Signals can arise when examining events that occur after taking drugs (from an observed association). The European Medicines Agency (EMA) defines a safety signal as “Information on a new or known adverse event that is potentially caused by a medicine and that warrants further investigation” (EMA, 2020). Signals are important to identify but are often considered to be hypothesis generating and require further hypothesis testing to provide evidence, which includes evidence of a causal association. Signals are not equivalent to evidence for this reason. They can arise from a single case report or from several spontaneous suspected adverse drug reaction reports. Signal strengthening occurs through assessment of available data related to the signal. In the vast majority of cases a signal alone is not evidence, which must arise from well designed studies e.g., observational or RCTs.
Within the context of COVID-19, safety signals have been identified and investigated further for angiotensin II receptor blockers or angiotensin-converting enzyme inhibitors (ARBs/ACEIs). Due to their mechanism of action, concerns were raised over the potential for predisposition to COVID-19 infection, accelerated coronavirus replication and aggravated symptoms of pneumonia with ARB/ACEI treatment (Guo et al., 2020; Yang and Meng, 2020). Discontinuation of these treatments in patients with hypertension has been suggested as a result. However, results from two retrospective studies in China indicated a lower risk of mortality in COVID-19 patients with hypertension using ARBs/ACEIs compared to non-users. This evidence suggests that discontinuation of ARBs/ACEIs is unlikely to be beneficial (Yang et al., 2020; Zhang et al., 2020). While potential signals should always be investigated further, this should not be considered evidence of a safety concern. Similarly, signals of treatment effectiveness (or lack of effectiveness) should be treated with the same caution. Many experimental treatments are currently under investigation for use in COVID-19 treatment (Thorlund et al., 2020), with case reports on patients who have recovered following treatment (Holshue et al., 2020; Michot et al., 2020). However, this cannot be considered evidence of effectiveness until robust data from ongoing clinical trials become available. Further, there has been much publicized anticipation that vaccines in development for COVID-19 could show “signals” of efficacy prior to final study results (Burger, 2020; Cohen, 2020). Again, it is important to remember that even if such a signal is found, further clinical trial data over a pre-planned data collection period are necessary to provide robust evidence, in addition to further studies in the post-marketing period.
Conclusion
Despite the need to identify effective and safe treatments as rapidly as possible in the current crisis, it is important to make clear distinctions between observed associations and causal associations. Additionally, consideration should be given to whether exposure and outcome data arise from study designs that provide actual evidence of a causal association or whether they only indicate an observed association (a signal) that requires further investigation. These distinctions are important to ensure understanding and avoid dangerous misinformation.
Author Contributions
All authors listed have made a substantial, direct, and intellectual contribution to the work and approved it for publication.
Funding
The Drug Safety Research Unit is an independent charity (No. 327206), which works in association with the University of Portsmouth. It receives unconditional donations from pharmaceutical companies. The companies have no control on the conduct or the publication of the studies conducted by the DSRU.
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
References
Burger, L. (2020). Human trials of British coronavirus vaccine to reach 10,000. London, United Kingdom: Reuters. https://uk.reuters.com/article/us-health-coronavirus-astrazeneca-oxford-idUKKBN22Y1A4.
Chai, K. L., Valk, S. J., Piechotta, V., Kimber, C., Monsef, I., Doree, C., et al. (2020). Convalescent plasma or hyperimmune immunoglobulin for people with COVID-19: a living systematic review. Cochrane Database Syst. Rev. 10, CD013600. doi:10.1002/14651858.CD013600.pub3
Chen, L., Xiong, J., Bao, L., and Shi, Y. (2020). Convalescent plasma as a potential therapy for COVID-19. Lancet Infect. Dis. 20 (4), 398–400. doi:10.1016/S1473-3099(20)30141-9
Cohen, J. (2020). Doubts greet $1.2 billion bet by United States on a coronavirus vaccine by October. Science doi:10.1126/science.abc9603
Duan, K., Liu, B., Li, C., Zhang, H., Yu, T., Qu, J., et al. (2020). Effectiveness of convalescent plasma therapy in severe COVID-19 patients. Proc. Natl. Acad. Sci. U.S.A. 117, 9490–9496. doi:10.1073/pnas.2004168117
EMA (2020). Safety signal. European Medicines Agency. https://www.ema.europa.eu/en/glossary/safety-signal.
Fedak, K. M., Bernal, A., Capshaw, Z. A., and Gross, S. (2015). Applying the Bradford Hill criteria in the 21st century: how data integration has changed causal inference in molecular epidemiology. Emerg. Themes Epidemiol. 12, 14. doi:10.1186/s12982-015-0037-4
Gautret, P., Lagier, J.-C., Parola, P., Hoang, V. T., Meddeb, L., Mailhe, M., et al. (2020). Hydroxychloroquine and azithromycin as a treatment of COVID-19: results of an open-label non-randomized clinical trial. Int. J. Antimicrob. Agents 56, 105949. doi:10.1016/j.ijantimicag.2020.105949
Guo, J., Zheng, H., Lin, L., and Lv, J. (2020). Coronavirus Disease 2019 (COVID‐19) and cardiovascular disease: a viewpoint on the potential influence of angiotensin‐converting enzyme inhibitors/angiotensin receptor blockers on onset and severity of severe acute respiratory syndrome coronavirus 2 infection. J. Am. Heart Assoc. 9 (7), e016219. doi:10.1161/JAHA.120.016219
Hill, A. B. (2015). The environment and disease: association or causation? 1965. J. R. Soc. Med. 108 (1), 32–37. doi:10.1177/0141076814562718
Holshue, M. L., DeBolt, C., Lindquist, S., Lofy, K. H., Wiesman, J., Bruce, H., et al. (2020). First case of 2019 novel coronavirus in the United States. N. Engl. J. Med. 382 (10), 929–936. doi:10.1056/NEJMoa2001191
Horby, P., and Landray, M. (2020). No clinical benefit from use of hydroxychloroquine in hospitalised patients with COVID-19—RECOVERY Trial. Oxford, United Kindom: Oxford. https://www.recoverytrial.net/news/statement-from-the-chief-investigators-of-the-randomised-evaluation-of-covid-19-therapy-recovery-trial-on-hydroxychloroquine-5-june-2020-no-clinical-benefit-from-use-of-hydroxychloroquine-in-hospitalised-patients-with-covid-19.
Michot, J.-M., Albiges, L., Chaput, N., Saada, V., Pommeret, F., Griscelli, F., et al. (2020). Tocilizumab, an anti-IL6 receptor antibody, to treat Covid-19-related respiratory failure: a case report. Ann. Oncol.: Off. J. Eur. Soc. Med. Oncol. 31, 961–964. doi:10.1016/j.annonc.2020.03.300
Shen, C., Wang, Z., Zhao, F., Yang, Y., Li, J., Yuan, J., et al. (2020). Treatment of 5 critically Ill patients with COVID-19 with convalescent plasma. J. Am. Med. Assoc. 323, 1582–1589. doi:10.1001/jama.2020.4783
Thorlund, K., Dron, L., Park, J., Hsu, G., Forrest, J. I., and Mills, E. J. (2020). A real-time dashboard of clinical trials for COVID-19. Lancet Digital Health 2, e286–e287. doi:10.1016/S2589-7500(20)30086-8
Voss, A. (2020). Statement on IJAA paper. International Society of Antimicrobial ChemotherapyAvailable at: https://www.isac.world/news-and-publications/official-isac-statement.
Yang, S., and Meng, G. (2020). More evidence is urgently needed to confirm the relation between angiotensin-converting enzyme inhibitors and COVID-19. J. Mol. Cell. Cardiol. 141, 110–111. doi:10.1016/j.yjmcc.2020.04.003
Yang, G., Tan, Z., Zhou, L., Yang, M., Lang, P., Liu, J., et al. (2020). Effects of ARBs and ACEIs on virus infection, inflammatory status and clinical outcomes in COVID-19 patients with hypertension: a single center retrospective study. Hypertension 76, 51–58. doi:10.1161/HYPERTENSIONAHA.120.15143
Zhang, P., Zhu, L. H., Cai, J., Fang, L., Qin, J.-J., Xie, J., et al. (2020). Association of inpatient use of angiotensin converting enzyme inhibitors and angiotensin II receptor blockers with mortality among patients with hypertension hospitalized with COVID-19. Circ. Res. 126 (12), 1671–1681. doi:10.1161/CIRCRESAHA.120.317134
Keywords: COVID-19, association, causation, signal, evidence
Citation: Osborne V and Shakir SA (2021) What Is the Difference Between Observed Association and Causal Association, Signals and Evidence? Examples Related to COVID-19. Front. Pharmacol. 11:569189. doi: 10.3389/fphar.2020.569189
Received: 03 June 2020; Accepted: 14 December 2020;
Published: 29 January 2021.
Edited by:
Sam Salek, University of Hertfordshire, United KingdomReviewed by:
Deborah Layton, IQVIA, United KingdomCopyright © 2021 Osborne and Shakir. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Vicki Osborne, Vicki.osborne@dsru.org