optimality in motor control by : shahab vahdat seminar of human motor control spring 2007
TRANSCRIPT
![Page 1: Optimality in Motor Control By : Shahab Vahdat Seminar of Human Motor Control Spring 2007](https://reader035.vdocuments.net/reader035/viewer/2022062407/56649de65503460f94aded8c/html5/thumbnails/1.jpg)
Optimality in
Motor Control
By : Shahab VahdatSeminar of Human Motor
ControlSpring 2007
![Page 2: Optimality in Motor Control By : Shahab Vahdat Seminar of Human Motor Control Spring 2007](https://reader035.vdocuments.net/reader035/viewer/2022062407/56649de65503460f94aded8c/html5/thumbnails/2.jpg)
Agenda Optimal Estimation
Optimal Control
Proposed Model
![Page 3: Optimality in Motor Control By : Shahab Vahdat Seminar of Human Motor Control Spring 2007](https://reader035.vdocuments.net/reader035/viewer/2022062407/56649de65503460f94aded8c/html5/thumbnails/3.jpg)
Optimality Wolpert, D. M., Ghahramani, Z. & Jordan, M. I. An
internal model for sensorimotor integration. Science (1995).
Van Beers RJ, Baraduc P & Wolpert DM. Role of uncertainty in sensorimotor control. Transactions of the Royal Society (2002)
Emanuel Todorov. Optimality principles in sensorimotor control. NatureNeuroscience (2004)
Emanuel Todorov Optimal Control Theory. Bayesian Brain, Doya, K. (ed), MIT Press (2006)
![Page 4: Optimality in Motor Control By : Shahab Vahdat Seminar of Human Motor Control Spring 2007](https://reader035.vdocuments.net/reader035/viewer/2022062407/56649de65503460f94aded8c/html5/thumbnails/4.jpg)
Kalman Filter
kkkkkk wuBcFc 1
kkkk vcHy
State-space model is described with these equations:
![Page 5: Optimality in Motor Control By : Shahab Vahdat Seminar of Human Motor Control Spring 2007](https://reader035.vdocuments.net/reader035/viewer/2022062407/56649de65503460f94aded8c/html5/thumbnails/5.jpg)
The prediction step consists of two calculations:
State estimate propagation:
Kalman Filter
1)1|( ˆ.ˆ kkkk cFc
Error covariance propagation:
kTkkk QFPF
1kP
![Page 6: Optimality in Motor Control By : Shahab Vahdat Seminar of Human Motor Control Spring 2007](https://reader035.vdocuments.net/reader035/viewer/2022062407/56649de65503460f94aded8c/html5/thumbnails/6.jpg)
The updating step consists of three calculations
Kalman Filter
Kalman gain matrix:
State estimate update:
Error covariance update:
1kk )P(P k
Tkk
Tkk RHHHG
kkkkk IGcc )1|(ˆˆ)1|(ˆ. kkkkk cHyI
kkkkk PHGPP
![Page 7: Optimality in Motor Control By : Shahab Vahdat Seminar of Human Motor Control Spring 2007](https://reader035.vdocuments.net/reader035/viewer/2022062407/56649de65503460f94aded8c/html5/thumbnails/7.jpg)
For controlling a goal-directed arm movement, there are three sources of noise :
(i) noise in the sensory signals that limits perception, (ii) noise in the motor commands, leading to inaccurate
movements (iii) sensorimotor noise, which origins from inaccuracies in the
forward model and causes noisy predicted location of the body during movement.
Therefore, the time-varying Kalman gain is used for minimizing the effect of these noises and uncertainty in the overall estimate.
Sources of Noise
![Page 8: Optimality in Motor Control By : Shahab Vahdat Seminar of Human Motor Control Spring 2007](https://reader035.vdocuments.net/reader035/viewer/2022062407/56649de65503460f94aded8c/html5/thumbnails/8.jpg)
Kalman Filter: Sensorimotor Integration
![Page 9: Optimality in Motor Control By : Shahab Vahdat Seminar of Human Motor Control Spring 2007](https://reader035.vdocuments.net/reader035/viewer/2022062407/56649de65503460f94aded8c/html5/thumbnails/9.jpg)
Sensorimotor Integration
When we move our arm in darkness, we may estimate the position of our hand based on three sources of information:
• proprioceptive feedback.
• a forward model of how the motor commands have moved our arm.
• by combining our prediction from the forward model with actual proprioceptive feedback.
Experimental procedures:
Subject holds a robotic arm in total darkness. The hand is briefly illuminated. An arrow is displayed to left or right, showing which way to move the hand. In some cases, the robot produces a constant force that assists or resists the movement. The subject slowly moves the hand until a tone is sounded. They use the other hand to move a mouse cursor to show where they think their hand is located.
![Page 10: Optimality in Motor Control By : Shahab Vahdat Seminar of Human Motor Control Spring 2007](https://reader035.vdocuments.net/reader035/viewer/2022062407/56649de65503460f94aded8c/html5/thumbnails/10.jpg)
Experiment: Sensorimotor Integration
![Page 11: Optimality in Motor Control By : Shahab Vahdat Seminar of Human Motor Control Spring 2007](https://reader035.vdocuments.net/reader035/viewer/2022062407/56649de65503460f94aded8c/html5/thumbnails/11.jpg)
Optimal Control
Bellman equations:
![Page 12: Optimality in Motor Control By : Shahab Vahdat Seminar of Human Motor Control Spring 2007](https://reader035.vdocuments.net/reader035/viewer/2022062407/56649de65503460f94aded8c/html5/thumbnails/12.jpg)
Continuous control:
Hamilton-Jacobi-Bellman equations:
![Page 13: Optimality in Motor Control By : Shahab Vahdat Seminar of Human Motor Control Spring 2007](https://reader035.vdocuments.net/reader035/viewer/2022062407/56649de65503460f94aded8c/html5/thumbnails/13.jpg)
Deterministic control: Pontryagin’s maximum principle
Hamiltonian:
![Page 14: Optimality in Motor Control By : Shahab Vahdat Seminar of Human Motor Control Spring 2007](https://reader035.vdocuments.net/reader035/viewer/2022062407/56649de65503460f94aded8c/html5/thumbnails/14.jpg)
Linear-quadratic-Gaussian control:
Riccati equation:
![Page 15: Optimality in Motor Control By : Shahab Vahdat Seminar of Human Motor Control Spring 2007](https://reader035.vdocuments.net/reader035/viewer/2022062407/56649de65503460f94aded8c/html5/thumbnails/15.jpg)
Optimal control as a theory of biological movement
state equations:
![Page 16: Optimality in Motor Control By : Shahab Vahdat Seminar of Human Motor Control Spring 2007](https://reader035.vdocuments.net/reader035/viewer/2022062407/56649de65503460f94aded8c/html5/thumbnails/16.jpg)
Optimal control as a theory of biological movement
![Page 17: Optimality in Motor Control By : Shahab Vahdat Seminar of Human Motor Control Spring 2007](https://reader035.vdocuments.net/reader035/viewer/2022062407/56649de65503460f94aded8c/html5/thumbnails/17.jpg)
Open-Loop versus Close-Loop Optimal Controller
Feed forward optimality models explain some of the classical motor properties (bell shaped profiles, etc) Harris & Wolpert, 1998- Min. Variance Flash and Hogan, 1985- Min. Jerk
Task constraints and motor noise combine to determine optimal motor plans
Humans use continuous visual feedback Noise in the sensory system very accurately predicts how
people use feedback Task constraints may also impact feedback control
strategies
![Page 18: Optimality in Motor Control By : Shahab Vahdat Seminar of Human Motor Control Spring 2007](https://reader035.vdocuments.net/reader035/viewer/2022062407/56649de65503460f94aded8c/html5/thumbnails/18.jpg)
Schematic illustration of open- and closed-loop optimization. (a) The optimization phase, which corresponds to planning or learning, starts with a specification of the task goal and the initial state. Both approaches yield a feedback control law, but in the case of open-loop optimization, the feedback portion of the control law is predefined and not adapted to the task.
![Page 19: Optimality in Motor Control By : Shahab Vahdat Seminar of Human Motor Control Spring 2007](https://reader035.vdocuments.net/reader035/viewer/2022062407/56649de65503460f94aded8c/html5/thumbnails/19.jpg)
(b) Either feedback controller can be used online to execute movements, although controller 2 will generally yield better performance. The estimator needs an efference copy of recent motor commands in order to compensate for sensory delays. Note that the estimator and controller are in a loop; thus they can continue to generate time-varying commands even if sensory feedback becomes unavailable. Noise is typically modeled as a property of the sensorimotor periphery, although a significant portion of it may originate in the nervous system.
![Page 20: Optimality in Motor Control By : Shahab Vahdat Seminar of Human Motor Control Spring 2007](https://reader035.vdocuments.net/reader035/viewer/2022062407/56649de65503460f94aded8c/html5/thumbnails/20.jpg)
Proposed Model:
Optimal Primitive State Prediction
k
iii tqqct
1
),,()(
),,()( qqqDt
k
iii tqqcqqqD
1
),,(),,(
Force fields as primitives for internal models:
![Page 21: Optimality in Motor Control By : Shahab Vahdat Seminar of Human Motor Control Spring 2007](https://reader035.vdocuments.net/reader035/viewer/2022062407/56649de65503460f94aded8c/html5/thumbnails/21.jpg)
Proposed Model:
Optimal Primitive State Prediction
Estimation and Control Equations:
)...( )1|()1|()|( kkkkkkkkk CHYGCC
..)|()|1( kkkkkk UBCC
![Page 22: Optimality in Motor Control By : Shahab Vahdat Seminar of Human Motor Control Spring 2007](https://reader035.vdocuments.net/reader035/viewer/2022062407/56649de65503460f94aded8c/html5/thumbnails/22.jpg)
Proposed Model:
Optimal Primitive State Prediction
![Page 23: Optimality in Motor Control By : Shahab Vahdat Seminar of Human Motor Control Spring 2007](https://reader035.vdocuments.net/reader035/viewer/2022062407/56649de65503460f94aded8c/html5/thumbnails/23.jpg)
Proposed Model:
Optimal Primitive State Prediction
![Page 24: Optimality in Motor Control By : Shahab Vahdat Seminar of Human Motor Control Spring 2007](https://reader035.vdocuments.net/reader035/viewer/2022062407/56649de65503460f94aded8c/html5/thumbnails/24.jpg)
Primitive modular representation of the cerebellum