activity recognition from user-annotated acceleration data
DESCRIPTION
Activity Recognition from User-Annotated Acceleration Data. Presented by James Reinebold CSCI 546. Outline. Motivation Experiment Design Classification Methods Used Results Conclusion Critique. Motivation. Can we recognize human activities based on mobile sensor data? Applications - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Activity Recognition from User-Annotated Acceleration Data](https://reader036.vdocuments.net/reader036/viewer/2022081418/56813abd550346895da2c921/html5/thumbnails/1.jpg)
Activity Recognition from User-Annotated Acceleration Data
Presented by James ReineboldCSCI 546
![Page 2: Activity Recognition from User-Annotated Acceleration Data](https://reader036.vdocuments.net/reader036/viewer/2022081418/56813abd550346895da2c921/html5/thumbnails/2.jpg)
Outline
• Motivation• Experiment Design• Classification Methods Used• Results• Conclusion• Critique
![Page 3: Activity Recognition from User-Annotated Acceleration Data](https://reader036.vdocuments.net/reader036/viewer/2022081418/56813abd550346895da2c921/html5/thumbnails/3.jpg)
Motivation
• Can we recognize human activities based on mobile sensor data?
• Applications– Medicine– Fitness– Security
![Page 4: Activity Recognition from User-Annotated Acceleration Data](https://reader036.vdocuments.net/reader036/viewer/2022081418/56813abd550346895da2c921/html5/thumbnails/4.jpg)
Related Work
• Recognition of gait pace and incline [Aminan, et. al. 1995]
• Sedentary vs. vigorous activities [Welk and Differding 2000]
• Unsupervised learning [Krause, et. al. 2003]
![Page 5: Activity Recognition from User-Annotated Acceleration Data](https://reader036.vdocuments.net/reader036/viewer/2022081418/56813abd550346895da2c921/html5/thumbnails/5.jpg)
Scientifically Meaningful Data
• Most research is done in highly controlled experiments.– Occasionally the test subjects are the researchers
themselves!– Can we generalize to the real world?
• Noisy• Inconsistent• Sensors must be practical
• We need ecologically valid results.
![Page 6: Activity Recognition from User-Annotated Acceleration Data](https://reader036.vdocuments.net/reader036/viewer/2022081418/56813abd550346895da2c921/html5/thumbnails/6.jpg)
Experiment Design
• Semi-Naturalistic, User-Driven Data Collection– Obstacle course / worksheet– No researcher supervision while subjects
performed the tasks
• Timer synchronization• Discard data within 10 seconds of start and
finish time for activities
![Page 7: Activity Recognition from User-Annotated Acceleration Data](https://reader036.vdocuments.net/reader036/viewer/2022081418/56813abd550346895da2c921/html5/thumbnails/7.jpg)
Experiment Design (2)
Source: Bao 2004
![Page 8: Activity Recognition from User-Annotated Acceleration Data](https://reader036.vdocuments.net/reader036/viewer/2022081418/56813abd550346895da2c921/html5/thumbnails/8.jpg)
Sensors Used
• Five ADXL210E accelerometers (manufactured by Analog Devices)– Range of +/- 10g– 5mm x 5mm x 2mm– Low Power, Low Cost– Measures both static and dynamic acceleration
• “Hoarder Board”
Source: http://vadim.oversigma.com/Hoarder/LayoutFront.htm
![Page 9: Activity Recognition from User-Annotated Acceleration Data](https://reader036.vdocuments.net/reader036/viewer/2022081418/56813abd550346895da2c921/html5/thumbnails/9.jpg)
Activities
![Page 10: Activity Recognition from User-Annotated Acceleration Data](https://reader036.vdocuments.net/reader036/viewer/2022081418/56813abd550346895da2c921/html5/thumbnails/10.jpg)
Example Signals
Source: Bao 2004
![Page 11: Activity Recognition from User-Annotated Acceleration Data](https://reader036.vdocuments.net/reader036/viewer/2022081418/56813abd550346895da2c921/html5/thumbnails/11.jpg)
Activity Recognition Algorithm
• FFT-based feature computation– Sample at 76.25 Hz– 512 sample windows– Extract mean energy, entropy, and correlation
features
• Classifier algorithms– All supervised learning techniques
![Page 12: Activity Recognition from User-Annotated Acceleration Data](https://reader036.vdocuments.net/reader036/viewer/2022081418/56813abd550346895da2c921/html5/thumbnails/12.jpg)
Source: Bao 2004
![Page 13: Activity Recognition from User-Annotated Acceleration Data](https://reader036.vdocuments.net/reader036/viewer/2022081418/56813abd550346895da2c921/html5/thumbnails/13.jpg)
Naïve Bayes Classifier
• Multiplies the probability of an observed datapoint by looking at the priority probabilities that encompass the training set.– P(B|A) = P(A|B) * P(B) / P(A)
• Assumes that each of the features are independent.
• Relatively fast.
Source: cis.poly.edu/~mleung/FRE7851/f07/naiveBayesianClassifier.pdf
![Page 14: Activity Recognition from User-Annotated Acceleration Data](https://reader036.vdocuments.net/reader036/viewer/2022081418/56813abd550346895da2c921/html5/thumbnails/14.jpg)
Nearest Neighbor
• Split up the domain into various dimensions, with each dimension corresponding to a feature.
• Classify an unknown point by having its K nearest neighbors “vote” on who it belongs to.
• Simple, easy to implement algorithm. Does not work well when there are no clusters.
Source: http://pages.cs.wisc.edu/~dyer/cs540/notes/learning.html
![Page 15: Activity Recognition from User-Annotated Acceleration Data](https://reader036.vdocuments.net/reader036/viewer/2022081418/56813abd550346895da2c921/html5/thumbnails/15.jpg)
Nearest Neighbor Example
![Page 16: Activity Recognition from User-Annotated Acceleration Data](https://reader036.vdocuments.net/reader036/viewer/2022081418/56813abd550346895da2c921/html5/thumbnails/16.jpg)
Decision Trees
• Make a tree where the non-leaf nodes are the features, and each leaf node is a classification. Each edge of the tree represents a value range of the feature.
• Move through the tree until you arrive at a leaf node
• Generally, the smaller the tree the better.– Finding the smallest is NP-Hard
Source: http://pages.cs.wisc.edu/~dyer/cs540/notes/learning.html
![Page 17: Activity Recognition from User-Annotated Acceleration Data](https://reader036.vdocuments.net/reader036/viewer/2022081418/56813abd550346895da2c921/html5/thumbnails/17.jpg)
Decision Tree Example
WeightWeight
FriendlinessFriendliness
DogDogGoatGoat
CatCat
< 20 pounds>= 20 pounds
Not friendlyFriendly
![Page 18: Activity Recognition from User-Annotated Acceleration Data](https://reader036.vdocuments.net/reader036/viewer/2022081418/56813abd550346895da2c921/html5/thumbnails/18.jpg)
Results
• Decision tree was the best performer, but…
Classifier User-specific Training Leave-one-subject-out Training
Decision Table 36.32 +/- 14.501 46.75 +/- 9.296
Nearest Neighbor 69.21 +/- 6.822 82.70 +/- 6.416
Decision Tree 71.58 +/- 7.438 84.26 +/- 5.178
Naïve Bayes 34.94 +/- 5.818 52.35 +/- 1.690
![Page 19: Activity Recognition from User-Annotated Acceleration Data](https://reader036.vdocuments.net/reader036/viewer/2022081418/56813abd550346895da2c921/html5/thumbnails/19.jpg)
![Page 20: Activity Recognition from User-Annotated Acceleration Data](https://reader036.vdocuments.net/reader036/viewer/2022081418/56813abd550346895da2c921/html5/thumbnails/20.jpg)
Trying With Less Sensors
Accelerometer (s) Left In Difference in Recognition Activity
Hip -34.12 +/- 7.115
Wrist -51.99 +/- 12.194
Arm -63.65 +/- 13.143
Ankle -37.08 +/- 7.601
Thigh -29.47 +/- 4.855
Thigh and Wrist -3.27 +/- 1.062
Hip and Wrist -4.78 +/- 1.331
![Page 21: Activity Recognition from User-Annotated Acceleration Data](https://reader036.vdocuments.net/reader036/viewer/2022081418/56813abd550346895da2c921/html5/thumbnails/21.jpg)
Conclusion
• Accelerometers can be used to affectively distinguish between everyday activities.
• Decision trees and nearest neighbor algorithms are good choices for activity recognition.
• Some sensor locations are more important than others.
![Page 22: Activity Recognition from User-Annotated Acceleration Data](https://reader036.vdocuments.net/reader036/viewer/2022081418/56813abd550346895da2c921/html5/thumbnails/22.jpg)
Critique - Strengths
• Ecological validity– Devices cannot just work in the lab, they have to
live in the real world.
• Variety of classifiers used• Decent sample size
![Page 23: Activity Recognition from User-Annotated Acceleration Data](https://reader036.vdocuments.net/reader036/viewer/2022081418/56813abd550346895da2c921/html5/thumbnails/23.jpg)
Critique - Weaknesses
• Lack of supervision• Practicality of wearing five sensors• Post-processing?• Why only accelerometers?
– Heart rate– Respiration rate– Skin conductance– Microphone– Etc..
![Page 24: Activity Recognition from User-Annotated Acceleration Data](https://reader036.vdocuments.net/reader036/viewer/2022081418/56813abd550346895da2c921/html5/thumbnails/24.jpg)
Sources
• www.analog.com• http://vadim.oversigma.com/Hoarder/Hoarde
r.htm• http://pages.cs.wisc.edu/~dyer/cs540/notes/l
earning.html• cis.poly.edu/~mleung/FRE7851/f07/naiveBayesianClassifier.pdf