Use of a Smartphone to Gather Parkinson’s Disease Neurological Vital Signs during the COVID-19 Pandemic

Alberts, Jay L.; Koop, Mandy Miller; McGinley, Marisa P.; Penko, Amanda L.; Fernandez, Hubert H.; Shook, Steven; Bermel, Robert A.; Machado, André; Rosenfeldt, Anson B.

doi:https://doi.org/10.1155/2021/5534282

Parkinson’s Disease

On this page

Abstract Introduction Methods Results Discussion Data Availability Disclosure Conflicts of Interest Acknowledgments References Copyright Related Articles

Research Article | Open Access

Volume 2021 | Article ID 5534282 | https://doi.org/10.1155/2021/5534282

Use of a Smartphone to Gather Parkinson’s Disease Neurological Vital Signs during the COVID-19 Pandemic

Jay L. Alberts,^1,2Mandy Miller Koop,¹Marisa P. McGinley,³Amanda L. Penko,¹Hubert H. Fernandez,^2,4Steven Shook,²Robert A. Bermel,³André Machado,^2,4and Anson B. Rosenfeldt¹

Academic Editor: Pablo Mir

Received13 Jan 2021

Revised25 Feb 2021

Accepted26 Mar 2021

Published10 Apr 2021

Abstract

Introduction. To overcome travel restrictions during the COVID-19 pandemic, consumer-based technology was rapidly deployed to the smartphones of individuals with Parkinson’s disease (PD) participating in a 12-month exercise trial. The aim of the project was to determine the feasibility of utilizing a combined synchronous and asynchronous self-administered smartphone application to characterize PD symptoms. Methods. A synchronous video virtual visit was completed for the administration of virtual Movement Disorder Society-Unified Parkinson’s Disease Rating Scale III (vMDS-UPDRS III). Participants asynchronously completed a mobile application consisting of a measure of upper extremity bradykinesia (Finger Tapping Test) and information processing. Results. Twenty-three individuals completed the assessments. The mean vMDS-UPDRS III was 23.65 ± 8.56 points. On average, the number of taps was significantly greater for the less affected limb, 97.96 ± 17.77 taps, compared to the more affected, 89.33 ± 18.66 taps (p = 0.025) with a significantly greater number of freezing episodes for the more affected limb (). Correlation analyses indicated the number of errors and the number of freezing episodes were significantly related to clinical ratings of vMDS-UPDRS III bradykinesia (Rho = 0.44, ; R = 0.43, , resp.) and finger tapping performance (Rho = 0.31, ; Rho = 0.32, , resp.). Discussion. The objective characterization of bradykinesia, akinesia, and nonmotor function and their relationship with clinical disease metrics indicate smartphone technology provides a remote method of characterizing important aspects of PD performance. While theoretical and position papers have been published on the potential of telemedicine to aid in the management of PD, this report translates the theory into a viable reality.

1. Introduction

The coronavirus infectious disease (COVID-19) results from infection from the novel SARS-CoV-2 and causes mild-moderate respiratory infection in most individuals; however, the infection can cause severe infection and death in some people. COVID-19 was first identified in late 2019, and with global concern escalating, the impact on the United States began in March 2020. This resulted in sweeping travel restrictions and limited in-person gathering in an attempt to decrease transmission rates. The emergence of COVID-19 catapulted telemedicine as an essential service for patients across all domains of medicine to aid in disease management and contain virus spread. The World Health Organization defines telemedicine as “the delivery of health care services, where distance is a critical factor, by all health care professionals using information and communication technologies for the exchange of valid information for diagnosis, treatment, and prevention of disease and injuries, research and evaluation” [1]. For decades, telemedicine has promised to aid in the delivery of care and monitoring of research outcomes for neurological patients [2] with greater convenience and comfort [3]; however, direct experience and prospective data utilizing synchronous and asynchronous virtual visits are lacking. There have been several reports of remote smartphone monitoring in Parkinson’s disease (PD); however, several of these reports have neglected assessing nonmotor function [4, 5] while others are time prohibitive by taking 20 minutes to administer [6]. Previously, we utilized the inertial measurement unit (IMU) data derived from smartphones to characterize postural stability and gait [7–13] and executive functioning [14–16], in neurological patients as part of routine in-person care with improved efficiencies in time and cost [17–20]. COVID-19 catalyzed our translation of this validated mobile technology from the clinic to the patient’s home.

COVID-19 travel restrictions prevented in-person data collection sessions in a longitudinal PD exercise trial. Rather than sacrificing final assessment data, a remote model of data collection was implemented where consumer-based technology was rapidly deployed to a group of individuals with PD participating in a 12-month pragmatic exercise trial. The goal of the remote assessments was to complete the 12-month assessments of motor and nonmotor function within the confines of a clinical study. We sought to determine the feasibility of gathering data from a synchronous virtual visit and asynchronous self-administered smartphone application and evaluate the relationship between smartphone outcomes and clinical assessments.

2. Methods

Participants across five community-based exercise sites in northern Washington and central Colorado were enrolled in an observational trial evaluating the long-term effects of exercise on PD progression in individuals enrolled in a year-round, disease-specific, community-based cycling class, Pedaling for Parkinson’s. In-person collection of motor and nonmotor performance was planned on three occasions: baseline, 6 months, and 12 months while off antiparkinsonian medication. The assessments consisted of a variety of upper and lower extremity motor tasks, as well as nonmotor assessments. The initiation of trial activities began prior to the COVID-19 pandemic, and therefore all baseline assessments were completed, in-person, as originally planned.

In Washington, data at all three time points (baseline, 6 months, and 12 months) were collected in-person by January 2020, prior to the beginning of the COVID-19 pandemic in the United States. In the spring of 2020, COVID-19 travel restrictions prevented in-person data collection for 12-month assessments in Colorado. In lieu of an in-person visit, a two-part remote assessment was completed: (1) a synchronous clinical video visit with a physical therapist (PT) and (2) an asynchronous data collection session with the Cleveland Clinic Digital Neurological Vital Signs (DNVS) smartphone application. The Cleveland Clinic IRB approved remote data collection in response to COVID-19.

2.1. Participants

Thirty-eight individuals with PD were successfully contacted at the Colorado sites; 23 had a suitable iPhone and installed and completed DNVS application and were included in the final analysis. Fifteen participants were unable to download the DNVS application. The primary reasons for being unable to download the DNVS app were no access to an Apple iPhone (n = 9), poor understanding of downloading applications, or lacking motivation to download (n = 5), and one patient was able to download, but cognitive issues prevented completion of DNVS modules (n = 1). Consistent with the original protocol, participants withheld antiparkinsonian medication 12 hours prior to the assessments. Participant demographics at the time of the 12-month assessment are displayed in Table 1.

2.2. Outcome Measures

2.2.1. Design of the DNVS Application

The DNVS application was developed using the native iPhone operating system (iOS) in the programming language of Swift. It consisted of two modules: (1) Finger Tapping Test (FTT) to assess upper extremity bradykinesia and (2) Processing Speed Test (PST) to assess cognition, specifically, processing speed. Both modules are described in further detail below. Data were sampled at a rate of 60 Hz and outcome metrics were automatically processed on the device. Data were encrypted on the device to protect subject identity, and no protected health information was stored in the module application. The deidentified data were transmitted to health information privacy (HIPPA) secure cloud managed by the Cleveland Clinic’s Information Technology Department. Members of the study team then downloaded data for subsequent analysis.

2.2.2. Synchronous and Asynchronous Assessments

The project employed a series of synchronous and asynchronous visits. Synchronous assessments referred to the subject performing the task at the same time the rater was grading/assessing the task (i.e., virtual Movement Disorder Society–Unified Parkinson’s disease Rating Scale III (vMDS-UPDRS) and mobility assessment). Asynchronous assessments referred to the subject performing the task independently on their mobile device (i.e., FTT and PST). The asynchronous DNVS data were processed in the manner described above.

2.2.3. vMDS-UPDRS III (Synchronous)

Via a video platform, the PT with six years of experience administering the MDS-UPDRS III performed the vUPDRS III, sans rigidity and postural instability items [21–23]. Symptoms were subdivided into: upper extremity (UE) score (items: 3.4–3.6, 3.15–3.17a-b), lower extremity score (items: 3.7-3.8, 3.17c-d), UE bradykinesia (items 3.4–3.6), UE tremor (items 3.15–3.17a-b), finger tapping (item 3.4), and postural instability and gait dysfunction (PIGD) subscore included items (3.9–3.13).

2.3. Functional Mobility (Synchronous)

Functional mobility was assessed via the Timed up and go (TUG) [24], where the individual stands from a chair, walks 10 feet, turns, returns to the chair, and sits. Patients measured the appropriate distance in their home and completed the task while being timed via a stopwatch by the PT via a video platform.

2.4. Smartphone Upper Extremity Bradykinesia (Asynchronous)

Upper extremity function was evaluated using a reciprocal target-directed FTT (Figure 1) [25]. Following uniform instructions provided within the DNVS application, participants used their index finger to continuously and quickly tap between targets for 30 seconds; two trials per limb. The number of taps, intertap interval (time interval between the onset of a tap and the onset of the next consecutive tap), and errors (double tapping the same target) were automatically calculated by the DNVS. The average of two trials per limb was used in the analyses.

(a)

(b)

(c)

Figure 1

(a) Screenshot of the display from the FTT application on an iPhone. Representative data from one participant performing FTT test with their less affected (b) and more affected (c) hands. Each bar represents the time duration (ms) between the onset of consecutive taps (intertap interval) with the left target shown in red and the right one in green. Errors were defined as consecutive taps on the same target. Intertap intervals greater than 500 msec were classified as a freeze (blue line denotes threshold for a freeze). The more affected side performed a lower number of total taps compared to the less affected hand (95 vs. 64 taps, resp.), with a longer average intertap interval (461.6 vs. 315.1 ms, resp.), committed an increased number of errors (1 vs. 0 errors, respectively), and exhibited a greater number of freezing episodes (11 vs. 0, resp.).

2.4.1. Nonmotor Performance (Asynchronous)

Our previously validated PST, a symbol-digit matching test, was used to quantify information processing, attention, and working memory [15, 16]. In this module, individuals are asked to match numbers with their corresponding symbols while referring to a matching key.

2.5. Statistical Analysis

A one-sample Kolmogorov–Smirnov test was performed on each of the outcome metrics to test for normal distribution. Paired t-tests or Wilxcon signed-rank tests, as appropriate, were utilized to evaluate differences across outcomes as a function of the self-reported more and less affected side. Pearson or Spearman rank correlation analyses, as appropriate, were performed to determine the level of agreement between DNVS outcomes (FTT, TUG, and PST) and vMDS-UPDRS III. Statistical analysis was conducted using R (version 4.0.2) with an alpha of 0.05.

3. Results

All 23 participants were able to complete assessment modules except for two individuals who were unable to complete the PST secondary to cognitive issues.

3.1. vUPDRS III

The mean vUPDRS III was 23.65 ± 8.56. Clinical ratings for the more and less affected side for clinical subscores are provided in Table 2. The more affected side was significantly worse for all clinical ratings compared to the less affected side (), except for tremor.

3.2. Smartphone Bradykinesia Is Related to vMDS-UPDRS III and Laterality

The number of taps was significantly greater for the less affected limb 97.96 ± 17.77 taps compared to the more affected, 89.33 ± 18.66 taps (; Figure 1; Table 2). The time interval between taps was used to estimate the freezing or pauses in movement (intervals 500+ ms) [26]. The number of freezing episodes was significantly greater for the more affected compared to the less affected limb (, Table 2). Lateralized clinical and quantitative data of the more and less affected limbs were paired and a Spearman rank correlation analysis revealed that participants with greater upper extremity disease severity on the vMDS-UPDRS III completed fewer taps during the FTT (Rho = −0.31, p = 0.04) and committed more errors (double taps) (Rho = 0.36, ). Correlation analyses indicated the number of errors committed and the number of freezing episodes were significantly related to clinical ratings of vMDS-UPDRS III bradykinesia (Rho = 0.44, ; R = 0.43, , resp.) and finger tapping performance (Rho = 0.31, ; Rho = 0.32, ) (Figure 2).

(a)

(b)

(c)

(d)

3.3. Functional Mobility Is Related to vMDS-UPDRS III

The average time to complete the TUG was 10.1 ± 2.3 seconds. TUG time was significantly correlated to overall disease severity, total vMDS-UPDRS III (Rho = 0.47, ), lower extremity function on the vMDS-UPDRS III (Rho = 0.42, ), and posture and gait impairments on the vMDS-UPDRS III (PIGD; Rho = 0.65, ).

3.4. Cognitive Function

The average number of correct responses on the PST was 36.05 ± 8.87, while incorrect responses were 0.95 ± 1.28. There was no relationship between the number of correct responses and any vMDS-UPDRS or FTT outcomes.

4. Discussion

The physical examination is the cornerstone for evaluating and treating PD. The objective characterization of bradykinesia, akinesia, and functional mobility using technology such as the DNVS application may be critical for the broad adoption of telemedicine in clinical and research settings. We quickly and securely deployed smartphone technology to a group of older adults with PD to preserve the integrity of a 12-month clinical trial. The data from the DNVS application provided objective and quantitative data related to the cardinal symptoms of PD that exhibited agreement with traditional clinical ratings.

Freezing of movement is a debilitating aspect of PD, yet it can be difficult to elicit during in-person clinical visits [27] and certainly challenging as part of a virtual assessment. Furthermore, clinical rating of freezing varies widely between clinicians and does not always correlate with objective metrics [28]. The FTT was successful in eliciting movement freezing and precisely and automatically quantifying its occurrence. Hence, the use of a relatively simple motor task combined with the data recording capabilities of a mobile device provides unique insight into PD motor function. Demonstrating agreement between clinical and derived biomechanical outcomes combined with the success in self-administration provides rationale for the utilization of applications that leverage consumer devices in both a research and clinical environment. The use of consumer electronic technology coupled with self-administered assessments has the potential to facilitate the use of telemedicine outside of a pandemic by collecting objective, serial data that can potentially aid with clinical decision-making. For example, the DNVS application could be taken throughout the day to quantify fluctuations in motor and nonmotor function and response to medication, specifically regarding “off” periods when antiparkinsonian medication becomes less effective.

The concept of telemedicine was introduced in the early 1960s and has largely failed to gain acceptance due to lack of reimbursement, cost of hardware and software necessary to connect the patient to provider, and insufficient bandwidth (for perspectives over the decades, see Jerant 1998 [29], Grigsby 1998 [2], and Dorsey 2018 [30]). The utilization of smartphone applications addresses these obstacles that slowed the implementation of telemedicine. The leveraging of pervasive, consumer-based technology essentially eliminates the cost of technology as a barrier for patients and hospital systems. Self-administration of the application by the patient in their home addresses the recent call that telemedicine be convenient and comfortable for PD patients [3]. Importantly, we ensured confidentiality through application development by employing information technology personnel with previous experience programming mobile devices and cloud computing for HIPPA compliance. The collaborative nature of these interactions facilitated the use of DVNS in a research project that otherwise would have been compromised as a result of COVID-19. Consumer-available technology that is user-friendly toward older individuals with neurological disease has the potential to evolve telemedicine beyond a video chat by objectively tracking motor and nonmotor data. By augmenting the traditional subjective video visit, telemedicine can be expanded to potentially more precisely improve PD-medication titration and deep brain stimulation programming.

Efforts are currently underway to create an Android version of DNVS to increase the availability of the technology to patients who may not have an iOS device. This is a critical step toward widespread clinical use and integration. We are currently working with other neurological centers to deploy the DNVS app to other neurological populations, including individuals with dementia, Multiple Sclerosis (MS), and community-dwelling adults who experience falls, as much of the clinical data collected in the DNVS application (functional mobility, upper extremity function, and information processing) are important in managing other patient populations. Our goal is to establish a standardized core group of physical and cognitive telemedicine assessments that could be used to aid in the management of multiple neurological patients. Telemedicine is a viable option for many individuals, as 89 percent of individuals in the United States own a smartphone or other Internet access device [31], and the COVID-19 pandemic has demonstrated that more individuals are equipped to perform virtual visits than was initially anticipated. Moving beyond subjective video visits in the treatment of neurological disease is a critical step in propelling telemedicine to a preferred method of medical visits.

Data Availability

The data are stored in a secured database at the Cleveland Clinic and can be made available upon request.

Disclosure

The funding sources had no role in the study design, implementation, analysis, or reporting.

Conflicts of Interest

The authors have no financial disclosures to declare related to this article.

Acknowledgments

This project was made possible by the dedication of the cycling participants in the states of Washington and Colorado. The authors are grateful for all of the hard work these individuals committed over the 12-month project. The project was funded by the Davis Phinney Foundation (DPF1808AR), the Edward F. and Barbara A. Bell Family Endowed Chair, and the Farmer Foundation.

References

World Health Organization, Telemedicine: Opportunities and Developments in Member States: Report on the Second Global Survey on eHealth 2009, World Health Organization, Geneva, Switzerland, 2010, https://www.who.int/goe/publications/goe_telemedicine_2010.pdf.
J. Grigsby and J. H. Sanders, “Telemedicine: where it is and where it’s going,” Annals of Internal Medicine, vol. 129, no. 2, pp. 123–127, 1998.
View at: Publisher Site | Google Scholar
E. R. Dorsey, M. S. Okun, and B. R. Bloem, “Care, convenience, comfort, confidentiality, and contagion: the 5 C’s that will shape the future of telemedicine,” Journal of Parkinson’s Disease, vol. 10, no. 3, 2020.
View at: Publisher Site | Google Scholar
S. Arora, V. Venkataraman, A. Zhan et al., “Detecting and monitoring the symptoms of Parkinson’s disease using smartphones: a pilot study,” Parkinsonism & Related Disorders, vol. 21, no. 6, pp. 650–653, 2015.
View at: Publisher Site | Google Scholar
A. Zhan, S. Mohan, C. Tarolli et al., “Using smartphones and machine learning to quantify Parkinson disease severity: the mobile Parkinson disease score,” JAMA Neurology, vol. 75, no. 7, pp. 876–880, 2018.
View at: Publisher Site | Google Scholar
F. Motolese, A. Magliozzi, F. Puttini et al., “Parkinson’s disease remote patient monitoring during the COVID-19 lockdown,” Frontiers in Neurology, vol. 11, Article ID 567413, 2020.
View at: Publisher Site | Google Scholar
S. J. Ozinga and J. L. Alberts, “Quantification of postural stability in older adults using mobile technology,” Experimental Brain Research, vol. 232, no. 12, pp. 3861–3872, 2014.
View at: Publisher Site | Google Scholar
S. J. Ozinga, M. M. Koop, S. M. Linder, T. Dey, and J. L. Alberts, “Three-dimensional evaluation of postural stability in Parkinson's disease with mobile technology,” Neuro Rehabilitation, vol. 41, no. 1, pp. 211–218, 2017.
View at: Publisher Site | Google Scholar
S. J. Ozinga, S. M. Linder, and J. L. Alberts, “Use of mobile device accelerometry to enhance evaluation of postural instability in Parkinson disease,” Archives of Physical Medicine and Rehabilitation, vol. 98, no. 4, pp. 649–658, 2017.
View at: Publisher Site | Google Scholar
S. J. Ozinga, A. G. Machado, M. Koop, A. B. Rosenfeldt, and J. L. Alberts, “Objective assessment of postural stability in Parkinson's disease using mobile technology,” Movement Disorders, vol. 30, no. 9, pp. 1214–1221, 2015.
View at: Publisher Site | Google Scholar
M. Miller Koop, S. J. Ozinga, A. B. Rosenfeldt, and J. L. Alberts, “Quantifying turning behavior and gait in Parkinson's disease using mobile technology,” IBRO Reports, vol. 5, pp. 10–16, 2018.
View at: Publisher Site | Google Scholar
M. Miller Koop, A. B. Rosenfeldt, and J. L. Alberts, “Mobility improves after high intensity aerobic exercise in individuals with Parkinson’s disease,” Journal of the Neurological Sciences, vol. 399, pp. 187–193, 2019.
View at: Publisher Site | Google Scholar
J. L. Alberts, J. R. Hirsch, M. M. Koop et al., “Quantification of postural stability using accelerometer and gyroscopic measures,” Journal of Athletic Training, vol. 82, no. 10, 2015.
View at: Google Scholar
D. Burke, S. Linder, J. Hirsch et al., “Characterizing information processing with a mobile device: measurement of simple and choice reaction time,” Assessment, vol. 24, no. 7, pp. 885–895, 2017.
View at: Publisher Site | Google Scholar
S. M. Rao, G. Losinski, L. Mourany et al., “Processing speed test: validation of a self-administered, iPad-based tool for screening cognitive dysfunction in a clinic setting,” Multiple Sclerosis Journal, vol. 23, no. 14, pp. 1929–1937, 2017.
View at: Publisher Site | Google Scholar
E. Z. Gorodeski, A. B. Rosenfeldt, K. Fang et al., “An iPad-based measure of processing speed in older adults hospitalized for heart failure,” Journal of Cardiovascular Nursing, vol. 34, no. 3, pp. E9–E13, 2019.
View at: Publisher Site | Google Scholar
J. K. Rhodes, D. Schindler, S. M. Rao et al., “Multiple sclerosis performance test: technical development and usability,” Advances in Therapy, vol. 36, no. 7, pp. 1741–1755, 2019.
View at: Publisher Site | Google Scholar
J. L. Alberts, M. T. Modic, B. Udeh et al., “Development and implementation of a multi-disciplinary technology enhanced care pathway for youth and adults with concussion,” Journal of Visualized Experiments, vol. 143, 2019.
View at: Publisher Site | Google Scholar
G. Macaron, B. Moss, H. Li et al., “Implementation of technology-enabled data capture in routine clinical care of patients with multiple sclerosis,” in Proceedings of the European Committee for Treatment and Research in Multiple Sclerosis (ECTRIMS), C. Poster, Ed., Berlin, Germany, October 2018.
View at: Google Scholar
J. L. Alberts, M. T. Modic, B. L. Udeh et al., “A technology enabled concussion care pathway reduces costs and enhances care,” Physical Therapy, vol. 100, pp. 136–148, 2020.
View at: Publisher Site | Google Scholar
T. Stillerova, J. Liddle, L. Gustafsson et al., “Remotely assessing symptoms of Parkinson’s disease using videoconferencing: a feasibility study,” Neurology Research International, vol. 2016, Article ID 4802570, 8 pages, 2016.
View at: Publisher Site | Google Scholar
E. R. Dorsey, J. D. Wagner, M. T. Bull et al., “Feasibility of virtual research visits in fox trial finder,” Journal of Parkinson’s Disease, vol. 5, no. 3, pp. 505–515, 2015.
View at: Publisher Site | Google Scholar
E. R. Dorsey, L. M. Deuel, T. S. Voss et al., “Increasing access to specialty care: a pilot, randomized controlled trial of telemedicine for Parkinson's disease,” Movement Disorders, vol. 25, no. 11, pp. 1652–1659, 2010.
View at: Publisher Site | Google Scholar
S. Mathias, U. S. Nayak, and B. Isaacs, “Balance in elderly patients: the “get-up and go” test,” Archives of Physical Medicine and Rehabilitation, vol. 67, pp. 387–389, 1986.
View at: Google Scholar
L. Fernandez, R. Huys, J. Issartel, J.-P. Azulay, and A. Eusebio, “Movement speed-accuracy trade-off in Parkinson’s disease,” Frontiers in Neurology, vol. 9, p. 897, 2018.
View at: Publisher Site | Google Scholar
M. T. Barbe, M. Amarell, A. H. Snijders et al., “Gait and upper limb variability in Parkinson’s disease patients with and without freezing of gait,” Journal of Neurology, vol. 261, no. 2, pp. 330–342, 2014.
View at: Publisher Site | Google Scholar
A. Nieuwboer and N. Giladi, “The challenge of evaluating freezing of gait in patients with Parkinson’s disease,” British Journal of Neurosurgery, vol. 22, no. S1, pp. S16–S18, 2008.
View at: Publisher Site | Google Scholar
T. R. Morris, C. Cho, V. Dilda et al., “A comparison of clinical and objective measures of freezing of gait in Parkinson's disease,” Parkinsonism & Related Disorders, vol. 18, no. 5, pp. 572–577, 2012.
View at: Publisher Site | Google Scholar
A. F. Jerant, L. Schlachta, T. D. Epperly et al., “Back to the future: the telemedicine house call,” Family Practice Management, vol. 5, pp. 18–22, 1998.
View at: Google Scholar
E. R. Dorsey, A. M. Glidden, M. R. Holloway, G. L. Birbeck, and L. H. Schwamm, “Teleneurology and mobile technologies: the future of neurological care,” Nature Reviews Neurology, vol. 14, no. 5, pp. 285–297, 2018.
View at: Publisher Site | Google Scholar
Pew Research Center, Smartphone Ownership and Internet Usage Continues to Climb in Emerging Economies, 2016, https://www.diapoimansi.gr/PDF/pew_research%201.pdf.

Copyright

Copyright © 2021 Jay L. Alberts et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies

Views

896

Downloads

934

Citations