Accepted for/Published in: JMIR Human Factors
Date Submitted: Sep 22, 2022
Date Accepted: Jan 12, 2023
Date Submitted to PubMed: Jan 12, 2023
A medical assistive robot for tele-healthcare during the COVID-19 pandemic: development and usability study in an isolation ward
ABSTRACT
Background:
The coronavirus disease 2019 (COVID-19) pandemic is affecting the mental and emotional well-being of patients, family members, and healthcare workers. Patients in the isolation ward may have psychological problems due to long-term hospitalization, the development of the epidemic, and the inability to meet their families. The medical assistive chatbot, acting as an intermediary of communication, can be deployed to address mental pressures.
Objective:
CareDo, a medical assistive chatbot with telepresence and teleoperation functions, is developed in this work for remote healthcare. This study aims to investigate its practical performance in the isolation ward during the pandemic.
Methods:
Two systems were integrated into the CareDo robot. For the telepresence system, web real-time communications (WebRTC) solution is used for the multi-user chat system and the convolutional neural network (CNN) is used for expression recognition. For the teleoperation system, an incremental motion mapping method is used for operating the robot remotely. This study was finally conducted at the First Affiliated Hospital, Zhejiang University (FAHZU) for clinical trials.
Results:
The patients in the isolation ward, their family members, and medical staff are open and receptive to the use of medical assistive chatbot for tele-healthcare. During the clinical trials in FAHZU, tasks such as video chatting, emotion detection, and medical supplies delivery are performed through this robot. Seven voice commands are set for performing system wakeup, video chatting, and system exiting. Statistical duration from 1 second to 3 seconds of common commands are set to improve the voice command detection. The facial expression was recorded 152 times for a patient in one day for the psychological intervention. The recognition accuracy reaches 95% and 92.8% for happy and neutral expressions respectively.
Conclusions:
Patients and healthcare workers can use this medical assistive chatbot in the isolation ward for tele-healthcare during the COVID-19 pandemic. It can be a useful approach to break the chains of virus transmission, and also an effective way for remote psychological intervention.
Citation
Request queued. Please wait while the file is being generated. It may take some time.
Copyright
© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.