Escolar Documentos
Profissional Documentos
Cultura Documentos
Abstract— Parkinson’s disease is a complex condition In this paper we present the development of a detection
currently monitored at home with paper diaries which rely on system to distinguish between normal and Parkinsonian signal
subjective and unreliable assessment of motor function at in the accelerometer data, as well as to classify different types
nonstandard time intervals. We present an innovative wearable of PD symptoms. We then evaluated the system in 12 patients
and unobtrusive monitoring system for patients which can help suffering from Parkinson’s disease.
provide physicians with significantly improved assessment of
patients’ responses to drug therapies and lead to better-targeted II. RELATED WORK
treatment regimens. In this paper we describe the algorithmic
development of the system and an evaluation in patients for There has been significant work accomplished in analyzing
assessing the onset and duration of advanced PD motor time series data from wearable accelerometers [4, 5, 6, 9, 10,
symptoms. 13, 15, 16, 17]. Preece et al [16] provide a nice review of
advances in the literature along with different classification
Keywords—Parkinson’s, accelerometer, time series methods that have been employed. Other research such as [6,
9, 15] provides detailed explanations on feature extraction
I. INTRODUCTION methods.
Parkinson’s disease (PD) is a degenerative disorder of the There has also been work done in assessing accelerometer
central nervous system which affects the motor control of the signals for the analysis of Parkinson's disease [2, 3, 7, 8, 11,
patients it inflicts. Three of the most common symptoms are 18]. The works by Bonato [2], LeMoyne et al [11] and Cho et
hand and leg tremors, and dyskinesia, an uncontrollable al [3] in particular are notable. Commercially available device
spasming/movement of the patient’s upper body. with sensor configurations on the hand, write, finger, arms,
Medication for PD attempts to control these symptoms, but trunk, back, and/or waist [1, 12] can detect gain and postural
the frequency and dosage as well as the appropriate type of impairments as well as tremor and dyskinesia severity.
medication is often difficult to determine. Patients frequently However, it has been observed that [14] such studies often are
keep track of their symptoms in inaccurate self-maintained result of short monitoring periods as subjects are often required
handwritten diaries, from which physicians attempt to learn to wear cumbersome sensor configurations that are impractical
about and manage their symptoms. Assessment of PD is in a daily life setting.
difficult with paper diaries as they are labor-intensive, We present a system that is based on a single accelerometer
requiring patients to self-report every half-hour, for several worn on the waist. Additionally, while different classification
days in a row. For this reason, compliance tends to fall methods are assessed in the literature, most of the focus has
dramatically overtime. In addition, the self-assessment is been on developing robust and informative feature extraction
frequently imprecise. methodologies. Accelerometer data is often quite noisy and
More accurate digital records of the patient’s symptoms, difficult to work with. A comparison of some of the core
including time, duration and intensity of onset could facilitate classification techniques has not really been present in the
better disease management, as well as permit potentially literature. Some recent work [12] has mentioned the use of
dynamic adjustment of the treatment regimen. The use of neural networks in a 10-fold cross validation framework. We
accelerometers is a potential solution; however the detection of used the body of related literature as a rich resource for feature
PD movement from normal signal is non-trivial. There are development and concentrated on comparing a set of well-
challenges of accurately detecting signal from background known classification techniques.
noise. Symptoms such as dyskinesia may be easily identifiable
III. BACKGROUND
due to their drastic movements, but those such as hand tremors
can be nearly indistinguishable. Finally, if digital sensors are A. Equipment
obtrusive (in number and bodily location) and interfere with BioMotion Suite’s wearable system kit consists of a tri-
patients’ daily routines, they will not be used and discarded. axial accelerometer (STMicro STM33DH) worn on the
subject’s waist, in Sedio EVC 4g Spring Clips. The sensor
121
classes maximizing the margin between the two classes. Given and leg tremors. The time interval of each state was monitored
a set of input vectors x with class labels y, the following and recorded, and subsequently synchronized with the
objective function is optimized: accelerometer data for activity labels at each time point.
ͳ The accelerometer was measuring signal on the x, y and z-
ܪ ڭൌ ߙ ߙ ݕ ݕ ܭሺݔ ǡ ݔ ሻ െ ߙ ܾ ݕ ן
ஸఈ ஸ ʹ axes once every 0.1 seconds.
ǡ
0.1
given the constraints:
Leg Tremor
0 Dyskinesia
ݕ ߙ ൌ Ͳ Hand Tremor
-0.1
Normal
-0.2
݃ ൌ ߙ ݕ ݕ ܭ൫ݔ ǡ ݔ ൯ ݕ ܾ െ ͳ
-0.3
-0.7
The choice of the kernel function K(xi,xj) and the resulting -0.8
feature space is crucially interesting in theoretical and practical
terms. It determines the functional form of the support vectors -0.9
680 700 720 740 760 780 800 820
given the regularization parameter C and thus different kernels
behave differently. Two common kernels are the linear and Fig. 1. Accelerometer data for a patient
non-linear Gaussian or RBF:
Fig. 1 presents the data on an axis for one of the
షȁȁೣషȁȁమ participants, along with the target true class labels for each
linear: ܭሺݔǡ ݕሻ ൌ ݔȉ ݕ RBF: ܭሺݔǡ ݕሻ ൌ ݁ మమ
time instance. In purple is a normal state, in light blue hand
In this study we employed the default Matlab SVM tremors, in red leg tremors and in green dyskinesia. It is
implementation for both kernels. interesting but not surprising to observe the significantly
unique signature of dyskinesia, as well as the periodicity in that
F. Multi-Class Problem signal. It is also important to note the similarity between leg
In the second round of multi-class classification we and hand tremors, a fact that will become significant during the
employed the traditional sequential "one-against-all" approach second round multi-class experiments. Finally, some of the
where multiple classifiers were trained and applied practical challenges in synchronizing accelerometer signals
sequentially. First a model to distinguish Parkinsonian vs with their true labels can be observed around time point 690 on
normal signal was developed, then the samples classified as the x-axis, some points which are clearly dyskinesia are labeled
Parkinsonian were classified by a second classifier as either as leg tremor and depicted in red. Luckily, such mislabels
dyskenisia or tremor, and finally a third classifier was were an insignificant fraction of the data points, but do
employed to distinguish between hand and leg tremors. illustrate the challenges of working with real data.
122
TABLE I. Performance of the six classification algorithms in the class problems, or may need modification of parameters for
Two-Class Problem Setting
such a situation.
SVM- SVM- C. Developmental Round 2: Multi-Class Problem
ANN FLD GNB LR
Lin RBF In the second round of experimentation, the problem was
transformed into a multi-class one with the goal being to
Average Training Performance Across 10 Folds identify each time point as either normal or as a specific
Parkinsonian symptom. Due to significant superiority of the
Accuracy 76.5% 30.5% 98.6% 65.9% 82.4% 83.3% support vector machine with the RBF kernel over all other
approaches in the first round of experiments, only SVM-RBF
Sensitivity 91.6% 99.8% 95.5% 60.0% 64.3% 25.1% was evaluated in this round.
Specificity 72.5% 11.8% 99.4% 67.4% 87.3% 99.0% As described earlier, in this round a sequential "one-
against-all" approach was employed for classifying multiple
Average Test Performance Across 10 Folds classes. Again results were evaluated in a 10-fold cross
validation framework, with the same 10 folds as from round 1.
Accuracy 76.7% 30.4% 98.4% 65.8% 87.4% 83.3% Table II presents the results of the SVM-RBF averaged across
the 10 folds.
Sensitivity 92.0% 99.8% 95.2% 59.9% 57.9% 25.1% TABLE II. Accuracy of SVM-RBF in the Multi-Class Problem
The best performance is exhibited by the non-linear support Testing Accuracy 87.65%
vector machine classifier with the Gaussian/radial basis
function kernel. However the support vector machine with the
linear kernel performs very poorly, likely due to significant The SVM-RBF approach performed well in the multi-class
non-linearities in the dataset. For a similar reason, the Fisher setting as well. However, there was a noteworthy drop in
linear discriminant classifier also fares poorly. performance from the two-class problem setting. To
investigate further, we observed the performance in each of the
The mediocre performance of the artificial neural network
10 folds. Tables III-XII present the classification confusion
is initially surprising. However, given the complex number of
matrices of the test set for all 10 folds. In each table, the label
parameters needed to optimally tune a neural network,
"N" refers to the normal class, "Dysk" to dyskinesia, "HT" to
investment of more optimally searching the parameter space
hand tremor and "LT" to leg tremor. The columns represent
may improve performance.
the true classes and the rows the predicted classes.
The Gaussian Naive Bayes classifier and logistic regression TABLE III. Multi-Class SVM-RBF Test Classification for Fold 1
perform well, although interestingly enough, logistic regression
tends to strongly favor specificity over sensitivity (thereby Total Accuracy: 73.7%
classifying most signals as normal). This bias, while not as
significantly, also plagues the Gaussian Naive Bayes. N Dysk HT LT
By contrast, the support vector machine with the linear N 477 4 0 8
kernel emphasizes sensitivity, classifying most instances as Dysk 3 568 1 3
Parkinsonian. The neural network, support vector machine HT 21 3 516 560
with the RBF kernel, and the Fisher linear discriminant
function attempt to maintain somewhat of a balance across LT 0 0 4 136
both classes.
The distribution of classes in the data is probably affecting TABLE IV. Multi-Class SVM-RBF Test Classification for Fold 2
these results to some extent. The primary purpose of the data
acquisition was to obtain a good representative sampling of all Total Accuracy: 73.8%
three Parkinsonian symptoms and the normal state. As N Dysk HT LT
depicted in Fig. 1, all four classes are equally represented for
the most part. However, the consequence of this data N 475 7 4 3
acquisition in the two-class problem space is that there is a Dysk 4 625 0 6
significant imbalance in the classes, with the Parkinsonian HT 15 1 449 561
states outnumbering the normal states 3:1. Some of the
LT 0 1 2 151
methods may perform better for balanced versus imbalanced
123
TABLE V. Multi-Class SVM-RBF Test Classification for Fold 3 TABLE X. Multi-Class SVM-RBF Test Classification for Fold 8
TABLE VI. Multi-Class SVM-RBF Test Classification for Fold 4 TABLE XI. Multi-Class SVM-RBF Test Classification for Fold 9
TABLE VII. Multi-Class SVM-RBF Test Classification for Fold 5 TABLE XII. Multi-Class SVM-RBF Test Classification for Fold 10
TABLE VIII. Multi-Class SVM-RBF Test Classification for Fold 6 As can be observed, the multi-class SVM-RBF has
excellent performance in six of the ten folds. In the four folds
Total Accuracy: 97.3% where performance deteriorates, it is due to leg tremor being
misclassified as hand tremor. As discussed earlier and
N Dysk HT LT depicted in Fig. 1, the accelerometer signal for leg and hand
N 473 5 0 2 tremors appear very similar, and in some of the folds, the
Dysk 2 595 0 6 classes are too similar for the classifier to properly separate
HT 22 0 513 5 them.
LT 4 0 16 661 In general however, the system appears to be doing quite
well in distinguishing between normal, dyskinesia and
(combined hand and leg) tremor states.
TABLE IX. Multi-Class SVM-RBF Test Classification for Fold 7
D. Validation on Real Patients
Total Accuracy: 72.5% The developed multi-class algorithm was then implemented
into the Biomotion Suite System Kit, and deployed to be
N Dysk HT LT
evaluated on real patients suffering from PD. 12 patients with
N 434 3 8 11 mid to late stage disease (ages 55 to 83) with varying degrees
Dysk 2 644 0 4 of symptom frequency and severity and currently prescribed
HT 21 3 512 580 Levodopa were recruited. Patients were not recruited if they
did not regularly report experiencing dyskinesia after their
LT 0 1 0 81 Levodopa regimen as the physicians were interested in
employing the BioMotion System to adjust the dosage and
frequency of the patients’ prescriptions. Each patient wore the
124
kit for a period of approximately 1 hour while engaged in groups of patients prescribed with different medications, not
everyday activities. The patients were also video-taped during just Levodopa, and determining the effectiveness of the system
the monitoring period. All subjects provided informed consent across various therapies.
to participate in the study according to a protocol approved by
the Institutional Review Board of the Institute for Muscular REFERENCES
and Neurologic Function.
[1] C. Bishop, Pattern Recognition and Machine Learning. Springer, 2006.
The accelerometer signal was correlated with observed
[2] P. Bonato, D. Sherrill, D. Standaert, S. Salles, M. Akay, “Data Mining
symptoms as noted by domain experts observing the patients, Techniques to Detect Motor Fluctuations in Parkinson's Disease.” 26th
and secondarily confirmed by the synchronized video Annual International Conference of the IEEE Engineering in Medicine
recordings. Patients’ states were classified as either normal, and Biology Society, 2004.
tremor (hand or leg) or dyskinesia. The overall classification [3] C. Cho, Y. Osaki, M. Kunin, C. Cohen, W. Olanov, and T. Raphan, “A
accuracy was 72%, with a majority of the errors due to falsely Model-Based Approach for Assessing Parkinsonian Gait and Effects of
detecting tremor. The false negative rate was low, indicating Levodopa and Deep Brain Stimulation.” Prooceedings of the 28th IEEE
EMBS Annual International Conference, 2006.
minimal missing of PD symptoms. Of interest, the frequency
[4] D. Gaurov, K. Helkala, and T. Sondrol, “Biometric Gait Authentication
analysis in the power spectral density detected significant Using Accelerometer Sensor.” Journal of Computers, 1:7, 2006.
differences between tremor and dyskinesia, indicative of a
[5] A. Godfrey, R. Conway, D. Meagher, and G. OLaighin, “Direct
difference in motor behavior between the symptoms, largely Measurement of Human Movement by Accelerometry.” Medical
due to the periodicity of the tumor. Engineering and Physics. 30., 2008.
[6] Z. He, Z. Liu, L. Jin, and J. Huang, J. “Weightlessness Feature - A
VI. CONCLUSIONS AND FUTURE WORK Novel Feature for Single Tri-axial Accelerometer based Activity
We have presented an innovative wearable and unobtrusive Recognition.” 19th International Conference on Pattern Recognition,
ICPR 2008., 2008.
system for the monitoring of motor symptoms as expressed by
[7] J. Hoff, A. van der Plas, E. Wagemans, and J. van Hilten, J.
patients suffering from Parkinson’s disease. During the “Accelerometric assessment of levodopa-induced dyskinesia in
development of the system, we evaluated the ability of six well Parkinson's disease.” Movement Disorders. 16:1, 2001, pp58-61.
known and regarded machine learning classification algorithms [8] N. Keijsers, M. Horstink, and S. Gielen, “Ambulatory motor assessment
to detect symptoms of Parkinson's disease on time-series data in Parkinson's Disease.” Movement Disorders, 21:1, 2006, pp34-44.
from a wearable accelerometer. We gathered data from [9] M. Khan, S. Ahamed, M. Rahman, and R. Smith. “A Feature Extraction
simulated patients and conducted experiments in two rounds. Method for Realtime Human Activity Recognition on Cell Phones.”
Third Third International Symposium on Quality of Life Technology
When we first considered a two-class formulation of the (isQoLT 2011) (Toronto, Canada), June 2011.
problem, the support vector machine classifier with a non- [10] J. Kwapisz, G. Weiss, and S. Moore. “Activity Recognition using Cell
linear RBF kernel manifestly outperformed other methods. Phone Accelerometers.” ACM SIGKDD Explorations 12:2, 2010,
When expanded to a multi-class problem setting, the SVM- pp74-82.
RBF continued to perform well, but struggled to distinguish [11] R. LeMoyne, C. Corojan, and T. Mastroianni. “Quantification of
between hand and leg tremors in some cases. This study Parkinson's Disease Characteristics using Wireless Accelerometers.”
ICME International Conference on Complex Medical Engineering.,
suggests that the SVM-RBF is a robust method for classifying 2009.
Parkinson's disease from an accelerometer signal, and likely [12] W. Maetzler, J. Domingos, K. Srulijes, J. Ferreira, and B. Bloem.
would perform well for other accelerometer applications as “Quantitative Wearable Sensors for Objective Assessment of
well and should be considered as a possible solution. Parkinson’s Disease”. Movement Disorders, 28:12, 2013, pp1628-1637.
[13] M. Mathie, A. Coster, N. Lovell, and B. Celler. “Detection of daily
We then validated our system on 12 patients suffering from physical activities using a triaxial accelerometer.” Med. Biol. Eng.
PD. The system performed well, providing physicians with Comput. vol 41, 2003, pp296-301.
invaluable information in the onset, frequency and intensity of [14] M. Merello and A. Antonini. “Evaluation of Motor Complications:
patients’ symptoms for adjustment of their prescription. Motor Fluctuations”. In Rating Scales in Parkinson’s Disease, C.
Sampaio, C. Goetz and A. Schrag Eds. New York: Oxford University
From a developmental perspective, we plan to improve the Press, 2012, pp99-114.
misclassification between hand and leg tremors in the multi- [15] S. Preece, J. Goulermas, L. Kenney, and D. Howard. “A comparison of
class setting. In this study we limited ourselves to three Feature Extraction Methods for the Classification of Dynamic Activities
categories of features for analyzing time-series/accelerometer from Accelerometer Data.” IEEE Transactions on Biomedical
data, and only certain types of features within these three Engineering, 56:3 (March 2009).
categories. It would be advisable to consider additional [16] S. Preece, J. Goulermas, L. Kenney, D. Howard, K. Meijer, and R.
Crompton. “Activity identification using body-mounted sensors - a
features, notably of different types, to determine whether they review of classification techniques.” Physiological Measurement, 2009.
improve overall performance, and in particular, distinguishing [17] N. Ravi, N. Dandekar, P. Mysore, and M. Littman. “Activity
between hand and leg tremors. Additionally, the performance Recognition from Accelerometer data.” Proceedings of the 17th
of some of the approaches, in particular the artificial neural Conference on Innovative Applications of Artificial Intelligence (IAA),
network, may improve through more extensive tuning and 2005.
optimization of the algorithm parameters. [18] J. Weaver. A Wearable Heath Monitor to Aid Parkinson Disease
Treatment. Masters Thesis. MIT., 2003.
We also plan on deploying and evaluating the system in a [19] http://www.mathworks.com/matlabcentral/fileexchange/19998-fast-
larger set of patients, particularly looking at the effectiveness in smoothing-function
125