Skip to main content

Laboratory information management system for COVID-19 non-clinical efficacy trial data

Abstract

Background

As the number of large-scale studies involving multiple organizations producing data has steadily increased, an integrated system for a common interoperable format is needed. In response to the coronavirus disease 2019 (COVID-19) pandemic, a number of global efforts are underway to develop vaccines and therapeutics. We are therefore observing an explosion in the proliferation of COVID-19 data, and interoperability is highly requested in multiple institutions participating simultaneously in COVID-19 pandemic research.

Results

In this study, a laboratory information management system (LIMS) approach has been adopted to systemically manage various COVID-19 non-clinical trial data, including mortality, clinical signs, body weight, body temperature, organ weights, viral titer (viral replication and viral RNA), and multiorgan histopathology, from multiple institutions based on a web interface. The main aim of the implemented system is to integrate, standardize, and organize data collected from laboratories in multiple institutes for COVID-19 non-clinical efficacy testings. Six animal biosafety level 3 institutions proved the feasibility of our system. Substantial benefits were shown by maximizing collaborative high-quality non-clinical research.

Conclusions

This LIMS platform can be used for future outbreaks, leading to accelerated medical product development through the systematic management of extensive data from non-clinical animal studies.

Background

The novel severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) has resulted in the serious respiratory illness pandemic, coronavirus disease 2019 (COVID-19). It was first reported in Wuhan, the capital of Hubei, China, in late December 2019 and has attracted international attention [1]. After four months, it spread to multiple countries, leading to more than one million confirmed cases worldwide [2]. SARS-CoV-2, a single-stranded RNA-enveloped virus [3], enters the host cells by binding its structural spike (S) protein to cell surface receptors, angiotensin-converting enzyme 2 (ACE2) [4]. After entering the host cells, the virus hijacks the cell to undergo viral replication [5]. During this process, an aberrant host immune condition called a cytokine storm can occur in response to SARS-CoV-2 infection, which is characterized by high concentrations of pro-inflammatory cytokines and chemokines, including tumor necrosis factor-α, interleukin-1, and interleukin-6 [6], resulting in severe COVID-19 associated with excessive inflammation [7].

Along with understanding the mechanism of transmissibility and pathogenesis of SARS-CoV-2, significant efforts are being devoted to developing novel vaccines and therapeutic agents to prevent or treat COVID-19. In particular, various COVID-19 related research has been conducted with the participation of multiple organizations. Among such studies, animal models, such as of monkeys, cats, ferrets, hamsters, and human angiotensin converting enzyme 2 (hACE2) transgenic mice [8], capable of conducting controlled experiments, have made significant contributions [9,10,11,12,13]. Because various parameters such as mortality, clinical signs, body weight, organ weights, viral titer (viral replication and viral RNA), and multiorgan histopathology should be comprehensively analyzed for a reliable interpretation of the results, there is an increasing need for an integrated system in which multiple institutions can apply a streamlined analysis and input the results simultaneously when conducting large-scale non-clinical efficacy tests of a COVID-19. When experimental data are collected from multiple institutions, “organization-level effects” may occur owing to non-standardization in the data coding process and coding errors, which can act as a batch effect in a data analysis. In large-scale experimental multicenter research, it is necessary to prevent the loss of reliability in the data analysis caused by batch effects; however, this is a difficult goal to achieve without an integrated system. An effective approach to overcoming the limitations caused by the batch effects mentioned above is to use a laboratory information management system (LIMS) [14]. LIMS systematizes the research process by automating data-related tasks that were conducted manually using information technology, and simultaneously realizes various needs, such as the standardization of experimental data, sharing, problem tracking, and the creation of reports based on document templates. The accumulated data stored in LIMS can be useful in understanding the current clinical knowledge and making decisions, which is a remarkable advantage in research on rapidly changing epidemics such as COVID-19. Despite the advantages of LIMS, no systems allowing multiple institutions to participate simultaneously in research related to COVID-19 have yet been proposed among the published LIMSs. Therefore, we aimed to clearly understand the standard procedures of non-clinical trials for COVID-19 therapeutics and vaccines and to design and implement an LIMS suitable for the research procedure.

Results

User management and functionalities

The COVID-19 non-clinical trial LIMS has four different types of users with different authorizations to handle multiple organizations: a chief director, a local administrator and researcher from each organization, and a pathologist (Fig. 1). The role of the chief director includes new project initiation, modification, deactivation, user account management, and data management. It can also control the registration of new organizations and the removal of existing organizations. The role of the local administrators is the same as that of the chief director, except that they are limited to the organization to which they belong. This enables the efficient management of each organization as well as data security. Researchers can manage the data entry/removal and check the project progress. Pathologists can conduct pathological analyses, pathological data entry, and related functions. Furthermore, multiple user types for multiple roles are allowed. If multiple authorizations are granted, the screen manual is shown based on the user’s choice.

Fig. 1
figure 1

Authority organization chart. The proposed LIMS fully supports co-operated, multi-center study. In this respect, each institute can have pathologists and multiple local researchers and administrators, directed by a chief director

The proposed system, which applies a convenient user interface, was created to provide many functions related to data management for multicenter research. The detailed function list is presented in Table 1. Functions can be classified into four different categories: access management, trial, audit, and comparison. The access management function forms the basis of the system and manages the user group. The trial function controls the entire project process, including initiation, progression, and finalization. The audit function records all activities that occur in the system and implements data entry, cancelation, and restoration. The comparison function provides several plots according to the investigational product (new drug/repositioning, vaccine/therapeutic), sponsor, experimental animals (hamster model/hACE2 mouse model), research objective, and study site. It performs access control and visualization by classifying all data accumulated in the system.

Table 1 Detailed function list of the proposed system

Data security and audit

The proposed system provides several functions for data security and audits. For security, an access management system based on the access control list (ACL) [15] was incorporated to protect the data entry. The unintended data leakage was minimized by providing limited access points to users according to the user access levels. For each running instance, data security at the terminal level was obtained through secure HTTPS-based communication. For audits, the proposed system records, monitors, and manages all user activities, including data entry, by generating a separate database. Furthermore, it provides a history-tracking function to maintain data integrity. The chief director can identify the path of a data contamination and restore it to its original state, which minimizes the problem related to data entry or damage to the raw data.

Process management

Data entry and monitoring are possible for each institution, which makes it possible for the local administrator of each institution to check the data status in real time. It is also composed of a system in which the chief director supervises the overall project progress of each organization in real time. In addition, by systematically managing various types of non-clinical data and enabling collaboration between multiple organizations, researchers are expected to be able to quickly derive the desired results. Figure 2 shows the workflow of the COVID-19 non-clinical trial LIMS for vaccine and therapeutics treatments.

Fig. 2
figure 2

Recording workflow in LIMS. The proposed LIMS audits the activities and controls the access throughout the study. All the accesses to the trials are systematically consented and controlled with complete auditing. Therefore, the trial data can be tracked and managed using the audit record

Graphics and analysis functions

The COVID-19 non-clinical trial LIMS provides various visualizations that can review the data characteristics at each stage for each institution, as well as optimized visualizations such as line diagrams, bar diagrams, and survival curves according to the data type for awareness of current situations and early detection of unusual situations. The proposed system generates suitable plots for a correspondence analysis according to the data types. In particular, a comparison function was developed to facilitate mutual comparisons according to user-selected conditions, and the system can also generate easy-to-read study-specific graphs.

Data downloading and result reporting

After obtaining approval from the chief director and administrators of each organization, the stored data can be downloaded as an Excel or Word file. In particular, it is possible to create an integrated Word file that includes a data description table, summary plot, and raw data, and all currently entered data can be downloaded as a multi-sheet Excel file with a single click for convenient data management. In addition, the proposed system can be used to monitor the data entry status of each participating organization and simultaneously create reports with a function for automatically summarizing the analysis results.

Notification

In applying important commands such as research initiation and termination, a notification system through a mail and messenger (limited to South Korea) notification service was established for relevant individuals such as chief directors and administrators. When a major change occurs in the research, the manager can quickly identify and respond to any unintended situations.

Data management and recording

Data entry control can be achieved according to the characteristics of each data, and the user input is automatically controlled according to the condition of each stage of the study. Human error is minimized by limiting the range of unobservable values ​​for each data parameters, and entry omission is prevented by notifying the data that need to be input according to the investigation schedule, current date, and data entry status (Fig. 3). In addition, all data entry activities were recorded, and an audit function was reviewed for each dataset. If necessary, an unsuitable data entry can be canceled to prevent data errors. On the data entry screen, users can check all data during the full research period (Fig. 4A) or partial data by dividing the data based on date (Fig. 4B).

Fig. 3
figure 3

LIMS calendar. The proposed LIMS provides a calendar to facilitate research under the pre-deteremined study plan, which allows the researchers to review the overall schedule, and its corresponding data type and completion status at once

Fig. 4
figure 4

LIMS sample input. A The data entry screen for the entire schedule. B The data entry screen for the selected schedule

Discussion

Non-clinical studies are essential for identifying the potential effects of promising drug candidates prior to entering human clinical trials [16]. Numerous animal studies have been conducted in the development of therapeutic agents and vaccines during the recent COVID-19 pandemic, leading to the need for rapid and accurate non-clinical efficacy analyses in standardized animal study design protocols [9, 10]. The inoculation of hACE2 transgenic mice with SARS-CoV-2 induced weight loss, increased the viral titer in the lungs, and histopathological changes with increased cytokine levels and interstitial pneumonia [17, 18]. In addition, infection with SARS-CoV-2 in a golden Syrian hamster model induced signs resembling COVID-19 disease, including decreased activity, weight loss, high lung viral load, and the presence of T-lymphocytes in the respiratory tract [19,20,21]. Therefore, systematic management of these extensive data, including mortality, clinical signs, body weight, body temperature, viral titer (viral replication and viral RNA), organ weights, and multiorgan histopathology, that can be observed in COVID-19 research using animal models such as hACE2 transgenic mice and hamsters is required for a reliable evaluation and development of a therapeutic agent or vaccine.

The implemented LIMS has many distinctive features providing many user-friendly functions. First, the implemented system classifies COVID-19 non-clinical trial topics into six sub-themes (investigational product, types of investigational product, sponsor, experimental animals, research objective, and study site). It also applies access control and visualization by classifying the research accumulated in the system. Second, using a streamlined analysis, it creates a four-step process related to the research progress, pathology analysis, entry of the results, and report generation. Access control and customized user interfaces are provided for each step, which highlights the work to be done and provides step-by-step guidance as a project planner. Third, a pathology analysis was incorporated to organize various types of pathology data and support the resulting input from pathologists. Finally, the data are organized systematically, and raw data, summary tables, and graph visualizations are documented. In addition, Table 2 provides brief summaries of other existing LIMS versions and the proposed COVID-19 non-clinical trial LIMS.

Table 2 Comparison with open-

The COVID-19 non-clinical trial data management system developed in this study consists of a mode for the chief director, administrators, researchers of each organization, and pathologists. It aims to improve the completeness of the database by managing the data entry process for each institution. To confirm this, we applied the proposed system to an actual COVID-19 non-clinical multicenter study. For the actual application through the proposed system, thirtytwo COVID-19 non-clinical efficacy studies were conducted by six animal biosafety level-3 institutions in South Korea from July 2020 to February 2021 through the research funding. During the implementation period, the project progress was monitored by the chief director in real time through the management of the data entry process for each organization. In addition, the administrators of each institution were able to check and manage the data entry status of the researchers in real time. Researchers were able to review the status of the data entry by outputting descriptive statistics and graphics, such as histograms or box plots. The administrator of the institution mainly used the function for automatically generating a report based on the data entry, which enabled the efficient management and monitoring of the study.

As research on infectious diseases steadily increases after the COVID-19 pandemic, such studies are usually conducted as joint research involving multiple centers [22,23,24,25,26]. Therefore, a system for efficiently managing multicenter laboratory data is required, and standardization is essential for integrating the units of different studies. The COVID-19 non-clinical trial LIMS proposed in this study for organizing laboratory sample management, analysis, and reporting of the results can be beneficial for researchers in large-scale studies where multiple organizations participate in the production of data. The proposed system enables experimental data management, data sharing, and data analysis through a web-based interface. It provides various functions focusing on practical usabilities such as the construction of management systems, data quality control processes, various graphics and analysis modules, result reporting functions, and data security and notification functions by systematically implementing access management, test execution, auditing, and comparisons. Large-scale data can therefore be managed more quickly and effectively. In particular, the proposed system is focused on multicenter laboratory data collection and the prevention of various problems owing to the non-standardization of the data coding processes at each institution. Furthermore, it was shown through a streamlined analysis that multicenter non-clinical trials can be systematically conducted.

The contribution of the COVID-19 non-clinical trial LIMS toward vaccines and therapeutics has focused on providing an environment helping health care professionals and researchers establish new hypotheses to solve various problems in research by investigating trends related to COVID-19 prevention and treatment, as well as the use of collected databases. Therefore, we anticipate the high adaptability of our system in overcoming COVID-19. Despite these desirable properties, further challenging issues remain to be resolved. Representatively, advanced statistical analysis function modules should be applied to the system. Because the proposed system does not support analysis modules such as descriptive statistics, data accumulated in the system must be downloaded and processed individually when a statistical analysis is required. To complement this, a comparison function module was developed, and the researchers can compare the data ​​of each study in a graph by selecting the components to be compared. The development of linking the accumulated data in LIMS with a cloud-based statistical analysis program will bring considerable benefits for researchers in the near future.

Conclusions

As research related to COVID-19 will continue to expand and become more complex in the future, the systematic storage and structuring of research data is expected to become more important. In conclusion, the present study provided a new usage of an LIMS, enabling efficient and reliable documentation, management, and reporting of the results. This tool will help researchers test therapeutic agents and vaccines against COVID-19, and can be adapted to different research projects. In addition to COVID-19 research, this LIMS platform can also be used for future diseases driven by pathogens currently unknown to result in a pandemic [27], leading to an accelerated development of medical products through the systematic management of extensive data from non-clinical animal studies.

Methods

COVID-19 data management system description

The COVID-19-specific LIMS was developed to manage accumulated data for a large-scale multicenter study of actual non-clinical efficacy trials for COVID-19. It provides several distinctive user-friendly features that are not provided in other COVID-19 LIMS (see Table 2 for details).

The COVID-19 non-clinical LIMS provides a web-based interface, and its implementation requires both front- and back-end developments [28]. The back-end of the COVID-19 LIMS was developed to run on PHP 7.0, MySQL 5.2, and nodeJS 11. Its front-end supports HTML5 [29] and can be run on a modern web browser. The proposed system functionality was built with external libraries such as PHPOffice, headless chromium, and semantic UI. All components are accessible by request to the authors. The main web page for the proposed system is shown in Fig. 4.

Availability of data and materials

The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.

Abbreviations

ACE2:

Angiotensin-converting enzyme 2

ACL:

Access control list

COVID-19:

Coronavirus disease 2019

LIMS:

Laboratory information management system

SARS-CoV-2:

Severe acute respiratory syndrome coronavirus 2

References

  1. Kahn N. New virus discovered by Chinese scientists investigating pneumonia outbreak. The Wall Street Journal. 2020. https://www.wsj.com/articles/new-virus-discovered-by-chinese-scientists-investigating-pneumonia-outbreak-11578485668. Accessed 27 May 2022.

  2. Morens DM, Daszak P, Taubenberger JK. Escaping Pandora’s box—another novel coronavirus. N Engl J Med. 2020;382(14):1293–5.

    Article  CAS  Google Scholar 

  3. James M, Marguerite L, Tomasz Z, James B. Pharmacologic treatments for coronavirus disease 2019 (COVID-19): a review. JAMA. 2020;323(18):1824–36.

    Google Scholar 

  4. Hoffmann M, Kleine-Weber H, Schroeder S, Krüger N, Herrler T, Erichsen S, et al. SARS-CoV-2 cell entry depends on ACE2 and TMPRSS2 and is blocked by a clinically proven protease inhibitor. Cell. 2020;181(2):271–80.e8.

  5. Wu R, Wang L, Kuo HD, Shannar A, Peter R, Chou PJ, et al. An update on current therapeutic drugs treating COVID-19. Curr Pharmacol Rep. 2020;6(3):56–70.

    Article  CAS  Google Scholar 

  6. Levi M, Thachil J, Iba T, Levy JH. Coagulation abnormalities and thrombosis in patients with COVID-19. Lancet Haematol. 2020;7(6):e438–40.

    Article  Google Scholar 

  7. Nile SH, Nile A, Qiu J, Li L, Jia X, Kai G. COVID-19: pathogenesis, cytokine storm and therapeutic potential of interferons. Cytokine Growth Factor Rev. 2020;53:66–70.

    Article  CAS  Google Scholar 

  8. Cleary SJ, Pitchford SC, Amison RT, Carrington R, Robaina Cabrera CL, Magnen M, et al. Animal models of mechanisms of SARS-CoV-2 infection and COVID-19 pathology. Br J Pharmacol. 2020;177(21):4851–65.

    Article  CAS  Google Scholar 

  9. Lakdawala SS, Menachery VD. The search for a COVID-19 animal model. Science. 2020;368(6494):942–3.

    Article  CAS  Google Scholar 

  10. Munoz-Fontela C, Dowling WE, Funnell SGP, Gsell PS, Riveros-Balta AX, Albrecht RA, et al. Animal models for COVID-19. Nature. 2020;586(7830):509–15.

    Article  CAS  Google Scholar 

  11. Rockx B, Kuiken T, Herfst S, Bestebroer T, Lamers MM, Oude Munnink BB, et al. Comparative pathogenesis of COVID-19, MERS, and SARS in a nonhuman primate model. Science. 2020;368(6494):1012–5.

    Article  CAS  Google Scholar 

  12. Sun J, Zhuang Z, Zheng J, Li K, Wong RL, Liu D, et al. Generation of a broadly useful model for COVID-19 pathogenesis, vaccination, and treatment. Cell. 2020;182(3):734-43.e5.

    Article  CAS  Google Scholar 

  13. Rothan HA, Byrareddy SN. The epidemiology and pathogenesis of coronavirus disease (COVID-19) outbreak. J Autoimmun. 2020;109: 102433.

    Article  CAS  Google Scholar 

  14. Gibbon GA. A brief history of LIMS. Lab Autom Inf Manage. 1996;32(1):1–5.

    Article  Google Scholar 

  15. Sandhu RS, Samarati P. Access control: principle and practice. IEEE Commun Mag. 1994;32(9):40–8.

    Article  Google Scholar 

  16. Guideline IHT, editor Guidance on nonclinical safety studies for the conduct of human clinical trials and marketing authorization for pharmaceuticals M3 (R2). International conference on harmonisation of technical requirements for registration of pharmaceuticals for human use; 2009.

  17. Bao L, Deng W, Huang B, Gao H, Liu J, Ren L, et al. The pathogenicity of SARS-CoV-2 in hACE2 transgenic mice. Nature. 2020;583(7818):830–3.

    Article  CAS  Google Scholar 

  18. Sun SH, Chen Q, Gu HJ, Yang G, Wang YX, Huang XY, et al. A mouse model of SARS-CoV-2 infection and pathogenesis. Cell Host Microbe. 2020;28(1):124-33.e4.

    Article  CAS  Google Scholar 

  19. Huang C, Wang Y, Li X, Ren L, Zhao J, Hu Y, et al. Clinical features of patients infected with 2019 novel coronavirus in Wuhan. China Lancet. 2020;395(10223):497–506.

    Article  CAS  Google Scholar 

  20. Sia SF, Yan LM, Chin AWH, Fung K, Choy KT, Wong AYL, et al. Pathogenesis and transmission of SARS-CoV-2 in golden hamsters. Nature. 2020;583(7818):834–8.

    Article  CAS  Google Scholar 

  21. Chan JF, Zhang AJ, Yuan S, Poon VK, Chan CC, Lee AC, et al. Simulation of the Clinical and Pathological Manifestations of Coronavirus Disease 2019 (COVID-19) in a Golden Syrian Hamster Model: implications for disease pathogenesis and transmissibility. Clin Infect Dis. 2020;71(9):2428–46.

    CAS  PubMed  Google Scholar 

  22. Hoyer C, Ebert A, Huttner HB, Puetz V, Kallmunzer B, Barlinn K, et al. Acute stroke in times of the COVID-19 pandemic: a multicenter study. Stroke. 2020;51(7):2224–7.

    Article  CAS  Google Scholar 

  23. Barret JP, Chong SJ, Depetris N, Fisher MD, Luo G, Moiemen N, et al. Burn center function during the COVID-19 pandemic: an international multi-center report of strategy and experience. Burns. 2020;46(5):1021–35.

    Article  Google Scholar 

  24. Huang M, Li M, Xiao F, Pang P, Liang J, Tang T, et al. Preliminary evidence from a multicenter prospective observational study of the safety and efficacy of chloroquine for the treatment of COVID-19. Natl Sci Rev. 2020;7(9):1428–36.

    Article  CAS  Google Scholar 

  25. D’Ascenzo F, De Filippo O, Borin A, Barbieri L, Adamo M, Morici N, et al. Impact of COVID-19 pandemic and infection on in hospital survival for patients presenting with acute coronary syndromes: a multicenter registry. Int J Cardiol. 2021;332:227–34.

    Article  Google Scholar 

  26. Yu C, Zhou M, Liu Y, Guo T, Ou C, Yang L, et al. Characteristics of asymptomatic COVID-19 infection and progression: a multicenter, retrospective study. Virulence. 2020;11(1):1006–14.

    Article  CAS  Google Scholar 

  27. Simpson S, Kaufmann MC, Glozman V, Chakrabarti A. Disease X: accelerating the development of medical countermeasures for the next pandemic. Lancet Infect Dis. 2020;20(5):e108–15.

    Article  CAS  Google Scholar 

  28. Smith PG. Professional website performance: optimizing the front-end and back-end. 1st ed. Indianapolis: Wiley; 2012.

    Google Scholar 

  29. Lubbers P, Albers B, Salim F, Pye T. Pro HTML5 programming. 2nd ed. Berkeley: Apress; 2011.

    Book  Google Scholar 

Download references

Acknowledgements

Not applicable.

Funding

This research was supported by the National research foundation of Korea(NRF) grant funded by the Korea government(MSIT) (2020M3A9I2109027 and 2021M3H9A1030260).

Author information

Authors and Affiliations

Authors

Contributions

SY, HN, and HJ participated in the design of the study, contributed to the analyzing the data and wrote the manuscript. SL and SH contributed to the analyzing the data and provided technical advices. SHK, JK, JSS, JJK, IHP, JO, JYB, GEL, SJW, SMS, NWK, YWL, HJJ, SMH, SHA, KSL, MY, HL, BJ, SWY, JAK, SHS, YJL, SYK, YBK, JYH, DO, SYL, SPK, and JYJ contributed to the analyzing the data. HL, KK, HJL, HBK, JWP, DGJ, DS, KSC, HYL, YKC, JC, MS, MSP, JYS, KTN, and JSS provided technical advices. SW, JWY, and JKS participated in the design of the study, in discussions and reviewed the manuscript. All authors read and approved the final manuscript.

Corresponding authors

Correspondence to Sungho Won, Jun-Won Yun or Je Kyung Seong.

Ethics declarations

Competing interests

The authors declare that they have no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Yoon, S., Noh, H., Jin, H. et al. Laboratory information management system for COVID-19 non-clinical efficacy trial data. Lab Anim Res 38, 17 (2022). https://doi.org/10.1186/s42826-022-00127-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s42826-022-00127-2

Keywords