human body movement analysis decoding the movement and emotion yunyu wang, professor c. c. lin,...
Post on 22-Dec-2015
219 views
TRANSCRIPT
Human Body Movement Analysis Decoding the Movement and
Emotion
Yunyu Wang, Professor
C. C. Lin, Associate Professor
W. C. Chen, Professor
A three years researchresearch and application developmentdevelopment project
2
Origin--2003Origin--2003 The Exchange/Discussion
PeoplePeople from Animation, Dance, Laban Movement Analysis, Computer Science and Sports Science.
TopicsTopics about Movement Quality, Emotion, Expression, Skill Analysis, Dance Innovation and LMA Application.
3
Project DescriptionProject Description
Period:Three-year: 2006 to 2009First year: April 1, 2006
ParticipantsProfessors: 5Graduate students: 18Full time staffs and technicians: 5
4
TNUATNUA
The College of DanceThe College of DanceGraduate School of Technology and ArtsGraduate School of Technology and ArtsCenter for Art and TechnologyCenter for Art and TechnologyThe E Motion LabThe E Motion Lab
5
The E Motion LabThe E Motion Lab
6
Partner Organizations and InstitutionsNCPESNCPES (National College of Physical Educatio
n and Sports)
ITRIITRI (Industrial Technology Research Institute)
Academia SinicaAcademia Sinica (http://www.sinica.edu.tw/as/intro/hist_e.html)
7
WHY WHY ??
In DanceIn Dance In AnimationIn Animation In Exercise and SportsIn Exercise and Sports In health industryIn health industry
8
Sub-Project I Motion Database and Metadata
10
Motion Database and MetadataProject Leadership and Project integrationTheory development, movement knowledge
analysisMovement Data Collection Motion Database Schema and StructureMetadata
11
Sub-project IIMotion Synthesis and Detection
Motion Synthesis and Detection
13
Motion Synthesis and Detection A kernel Engine for Laban motion and emotio
n analysis Laban motion
Effort Shape Body
Emotion Cyclic Non-Cyclic
14
Motion SynthesisLabanmocap
emotionalmocap
Construction of Basis Functions(LM and EM separately)
EmotionalMocap(EM)
LabanMocap(LM)
DdPCA FTDynamicSystems
Movement Primitive Lib.(LM and EM)
Motion compiler
Output Motion
LearningAlgorithm
Task Objective
Construction of Basis Functions
EM MotivesLM
15
Motion Detection/Classification
Labanmocap
emotionalmocap
Construction of Basis Functions(LM and EMCAP)
EmotionalMocap
LabanMocap
DdPCA FT Neural Net
Movement Primitive Lib.(LM and EM)
Motion Classifier Construction
Motion DetectionLearningAlgorithm
Unclassified MotionUnclassified Motion
Motion Classifier Lib.
16
Example Result: PCA elbow up
17
Demo(Man’s arm up movement)
Mocap original motion PCA motion synthesis
Sub-project III Industry Applications
19
Application…Application…in Dance Dance
Dance engine for ChoreographyDance analysisDance creationInteractive Dance
Sub-3
20
Application…Application…
in movie and animationMotion/Emotion Quantity Model
and Synthesis techniquesCommon Motion LanguageAnimation Plug-inGame engine
Sub-3
21
Application…Application…In Exercise and Sports
Efficient and safe (Basketball shooting and Discus throwing)
Online instruction and learning Skill Analysis and diagnosis
Sub-3
22
Application…Application…
In Health industry Better Rehab. --Motivating Moves
Janet Hamburg (University of Kansas)
Fitness Instructor ---My Best FriendOnline Stretching, exercise monitoring, …
Sub-3
The End
In describing movement, we must make a mental note of the most important intermediary positions.