towards human-realistic animation by observing real human dynamics darren cosker towards...

Towards Human-Realistic Animation by Observing Real Human DynamicsDarren Cosker

QuickTime™ and aTIFF (Uncompressed) decompressor

are needed to see this picture.

Towards Human-Realistic Animation by Observing Real Human Dynamics

Towards Human-Realistic Animation by Observing Real Human Dynamics

Darren CoskerDepartment of Computer Science,University of Bath




MotivationMotivation






OverviewOverview

• Analysis and Re-Synthesis of Facial Dynamics– Dynamics > CG Puppet– Dynamics > us– Dynamics > Computer Vision

• Intuitive/Automatic methods for animation– Voice Driven Animation/Analysis– Reactive Avatars




Analysing/Resynthesising DynamicsAnalysing/Resynthesising Dynamics

QuickTime™ and aMPEG-4 Video decompressor


Time

Par

amet

er M

agni

tude




Analysing/Resynthesising DynamicsAnalysing/Resynthesising Dynamics

• Study effect of manipulating temporal characteristics of emotions, e.g. smiles

QuickTime™ and a decompressor


[Emotion 2007]




Analysing/ResynthesisingDynamicsAnalysing/ResynthesisingDynamics







• What did we learn?– ‘Genuine’ Dynamics = More

likeable/Trustworthy/Employable– ‘Fake’ Dynamics = Less

Likeable/Trustworthy/Employable

• Relationship between Attractiveness and Facial Dynamics

• To Do! - Mock Video Game Scenario




1. Define facial regions local

to sub-facial actions

2. Construct new training

set of artificial images

Analysing Multiple ActionsAnalysing Multiple Actions




Analysing Multiple ActionsAnalysing Multiple Actions

3. Create a corresponding artificial training set of shape vectors




Performance AnalysisPerformance Analysis




Image Based TransferImage Based Transfer

QuickTime™ and aH.264 decompressor





Performance AnalysisPerformance Analysis






3D Model Transfer3D Model Transfer

• Animation of a 3D facial model




3D Model Transfer3D Model Transfer



Dynamic knowledge easily applied to existing pipelines




3D Facial Modelling3D Facial Modelling

• 4D Camera– Continuous 3D Scanning (Cardiff/Surrey)





(Link to 3D Example Expression)




Voice Driven AnimationVoice Driven AnimationVisual Speech Synthesis

‘Non-Verbal’ Action Synthesis



QuickTime™ and aCinepak decompressor


QuickTime™ and aNone decompressor





Perceptual EvaluationPerceptual Evaluation

• Motivation: How best to evaluate facial animation?– Perceptual test based on McGurk effect

QuickTime™ and aSorenson Video decompressorare needed to see this picture.

[ACM TAP 2005]




Perceptual EvaluationPerceptual Evaluation

• Record participant responses

• Compare real and synthetic

• Subtle - participants blind to real motivation

• Isolate strengths and weaknesses




Reactive Full Body Avatar AnimationReactive Full Body Avatar Animation

• Motivation:– Animate based on

an input performance

– Key avatar drives other avatar behaviour

QuickTime™ and aSorenson Video 3 decompressorare needed to see this picture.




Conclusions and Future DirectionsConclusions and Future Directions• Humans are very sensitive to different dynamics

• Different interpretation depending on timing

• Human realism will depend on understanding dynamic behaviours

• Realism will also depend on the accurate modelling and resynthesis of dynamics - e.g. McGurk effect

• Technology now allows study of 3D dynamics - our work has only just started!




Thanks for listening!

Acknowledgements:• Eva Krumhuber, Antony Manstead, Lanthao Benedikt,

David Marshall, Paul Rosin, Alistair Calvert, Cathy Holt, Daniel Mason, Gemma Whatling, Simon Rushton, Susan Paddock

• RAEng, EPSRC.

towards human-realistic animation by observing real human dynamics darren cosker towards...

Documents

humanrealistic animation

d dynamics

resynthesis of dynamics

genuine dynamics

facial animation

timing human realism

transfer slide

d facial modelling slide