cascaded estimation architecture for integration of …...integration of foot-mounted inertial...

23
Folie 1 Integration of Foot-Mounted Inertial Sensors > Bernhard Krach > 06.05.2008 Cascaded Estimation Architecture for Integration of Foot-Mounted Inertial Sensors Bernhard Krach and Patrick Robertson German Aerospace Center (DLR) Institute of Communications and Navigation

Upload: others

Post on 20-Aug-2020

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Cascaded Estimation Architecture for Integration of …...Integration of Foot-Mounted Inertial Sensors > Bernhard Krach > 06.05.2008 Folie 13 The Step-Measurement Inertial sensor platform

Folie 1Integration of Foot-Mounted Inertial Sensors > Bernhard Krach > 06.05.2008

Cascaded Estimation Architecture for Integration of Foot-Mounted Inertial Sensors

Bernhard Krach and Patrick RobertsonGerman Aerospace Center (DLR)Institute of Communications and Navigation

Page 2: Cascaded Estimation Architecture for Integration of …...Integration of Foot-Mounted Inertial Sensors > Bernhard Krach > 06.05.2008 Folie 13 The Step-Measurement Inertial sensor platform

Integration of Foot-Mounted Inertial Sensors > Bernhard Krach > 06.05.2008

Folie 2

INS: Orientation change (3D),Velocity change (3D);

Very short term stability,Long term errors Barometer:

Altitude change; Short-Mid term stability,

Long term errors

GNSS:3D-PVT;

Long term stability,Short term errors

Pedestrian Movement Model:

Some short term aiding

Magnetometer:Orientation (2D or 3D);

Long term stability,Short term errors

3D Maps (Map matching):Long and short term aiding in buildings

Optimal SensorFusion Algorithm

“3D”

“Attitude/Orientation”

“Maps andMovement”

“INS measurement”

“Long termaccuracy”

Sensor Fusion for Pedestrian Applications

Foot mounted INS:With Zero Update (ZUPT).Velocity: Long term stable,Position error linear in time

Step counter INS:Estimation of step

sequence and length;Long term stable

RFID: 3D-P; Long term stability, Short term errors

Page 3: Cascaded Estimation Architecture for Integration of …...Integration of Foot-Mounted Inertial Sensors > Bernhard Krach > 06.05.2008 Folie 13 The Step-Measurement Inertial sensor platform

Integration of Foot-Mounted Inertial Sensors > Bernhard Krach > 06.05.2008

Folie 3

INS: Orientation change (3D),Velocity change (3D);

Very short term stability,Long term errors Barometer:

Altitude change; Short-Mid term stability,

Long term errors

GNSS:3D-PVT;

Long term stability,Short term errors

Pedestrian Movement Model:

Some short term aiding

Magnetometer:Orientation (2D or 3D);

Long term stability,Short term errors

3D Maps (Map matching):Long and short term aiding in buildings

Optimal SensorFusion Algorithm

“3D”

“Attitude/Orientation”

“Maps andMovement”

“INS measurement”

“Long termaccuracy”

Sensor Fusion for Pedestrian Applications

Step counter INS:Estimation of step

sequence and length;Long term stable

RFID: 3D-P; Long term stability, Short term errors

Foot mounted INS:With Zero Update (ZUPT).Velocity: Long term stable,Position error linear in time

Page 4: Cascaded Estimation Architecture for Integration of …...Integration of Foot-Mounted Inertial Sensors > Bernhard Krach > 06.05.2008 Folie 13 The Step-Measurement Inertial sensor platform

Integration of Foot-Mounted Inertial Sensors > Bernhard Krach > 06.05.2008

Folie 4

Motivation

Transition Model

LikelihoodUpdate

Prediction

Posterior

Prior

k=k+1

Measurements z

*TOA

Multi-sector Antenna

Independent errors: Factorization of LikelihoodEstimation of the state x: Posterior PDF contains inferable knowledge about the state

Soft-Location: Sequential Bayesian estimation for localization

Hidden Markov Model

),( 11 −−= kkkk vxfxCurrent state depends on the previous state and some noise v only

),( kkkk nxhz =Measurements depend on the current state and some noise n only

Page 5: Cascaded Estimation Architecture for Integration of …...Integration of Foot-Mounted Inertial Sensors > Bernhard Krach > 06.05.2008 Folie 13 The Step-Measurement Inertial sensor platform

Integration of Foot-Mounted Inertial Sensors > Bernhard Krach > 06.05.2008

Folie 5

Implementation via Particle Filter

Particle filter is a technique for implementing recursive Bayesian filter by Monte Carlo sampling The idea: represent the posterior density by a set of random samples (particles) with associated weights.

For large numbers of samples the Random (Monte Carlo) Sampling approximation converges to the true PDF and is an optimal estimate.

∑=

−≈sN

i

ikk

ikkk xxwzxp

1:1 )(δ)|(

states sampled of weights:},...,0,{

states sampled ofset :},...,0,{ rticles)samples(paofnumber :Ns where,

Nsiw

Nixik

sik

=

=higher density more particles

more weight

Page 6: Cascaded Estimation Architecture for Integration of …...Integration of Foot-Mounted Inertial Sensors > Bernhard Krach > 06.05.2008 Folie 13 The Step-Measurement Inertial sensor platform

Integration of Foot-Mounted Inertial Sensors > Bernhard Krach > 06.05.2008

Folie 6

LikelihoodFunctions:

GNSS,Altimeter,

RFIDCompass

FusionFilter

(PF, RBPF)Particles

PedestrianMovement

Model

GNSSPseudoranges& Carriers

Particles,PVT, Sensor errors

3D MapDatabase

Sensors

PVT Output

~1 Hz

Altimeter Outputs

Compass Outputs

Bayesian Location Estimation Framework

RFID Detections

• Real-time sensor fusion framework (JAVA)• Fusion via Bayesian filtering: Particle filter• Measurements are incorporated via likelihood functions• Movement model takes dynamic constraints into account

Idea: Extend framework towards inertial sensors

Page 7: Cascaded Estimation Architecture for Integration of …...Integration of Foot-Mounted Inertial Sensors > Bernhard Krach > 06.05.2008 Folie 13 The Step-Measurement Inertial sensor platform

Integration of Foot-Mounted Inertial Sensors > Bernhard Krach > 06.05.2008

Folie 7

Foot Mounted Inertial Sensors

Classical INS integration scheme: Accelerometers, Gyros, INS computer, Kalman filterDrift compensation via regular zero-velocity updates (ZUPT)Good performance even with low-cost MEMS

24,8 %

Foot at rest

20,5 % 38,0 %

Step

16,7 %

Walk signatures, several steps

Page 8: Cascaded Estimation Architecture for Integration of …...Integration of Foot-Mounted Inertial Sensors > Bernhard Krach > 06.05.2008 Folie 13 The Step-Measurement Inertial sensor platform

Integration of Foot-Mounted Inertial Sensors > Bernhard Krach > 06.05.2008

Folie 8

Experimental Results

IKN Building TE02Stride Rest, ZUPT

Meeting Room

Page 9: Cascaded Estimation Architecture for Integration of …...Integration of Foot-Mounted Inertial Sensors > Bernhard Krach > 06.05.2008 Folie 13 The Step-Measurement Inertial sensor platform

Integration of Foot-Mounted Inertial Sensors > Bernhard Krach > 06.05.2008

Folie 9

StrapdownInertial

Computer

Extended

Kalman Filter

(INS Error Space)

AccelerometerTriad Outputs

GyroscopeTriad Outputs

“Foot still” – Detector

Triggers ZUPT

+

Calibration Feedback

INS Errors PDF

-

INS PVA PVA Output

Sensors

~100-500 Hz

Conventional Integration of Inertial Sensors

• Fusion via Bayesian filtering: Extended Kalman filter• Measurements are not incorporated via likelihood functions• Movement model doesn’t take dynamic constraints into account

Problem: How to get things together ?

Page 10: Cascaded Estimation Architecture for Integration of …...Integration of Foot-Mounted Inertial Sensors > Bernhard Krach > 06.05.2008 Folie 13 The Step-Measurement Inertial sensor platform

Integration of Foot-Mounted Inertial Sensors > Bernhard Krach > 06.05.2008

Folie 10

LikelihoodFunctions:

GNSS,Altimeter,

RFIDCompass

FusionFilter

(PF, RBPF)Particles

PedestrianMovement

Model

GNSSPseudoranges& Carriers

Particles,PVT, Sensor errors

3D MapDatabase

Sensors

PVT Output

~1 Hz

Altimeter Outputs

Compass Outputs

Solution 1

RFID Detections

Inertial Sensors

Drawback: Increases filter rate, requires extension of state space to foot accelerations and turn rates, movement models become complex

~100-500 Hz

Page 11: Cascaded Estimation Architecture for Integration of …...Integration of Foot-Mounted Inertial Sensors > Bernhard Krach > 06.05.2008 Folie 13 The Step-Measurement Inertial sensor platform

Integration of Foot-Mounted Inertial Sensors > Bernhard Krach > 06.05.2008

Folie 11

StrapdownInertial

Computer

Extended

Kalman Filter

(INS Error Space)

AccelerometerTriad Outputs

GyroscopeTriad Outputs

“Foot still” – Detector

Triggers ZUPT

+

Calibration Feedback

INS Errors PDF

-

INS PVA PVA Output

Sensors

~100-500 Hz

Solution 2

Further Sensors:GNSS,

Altimeter,RFID

Compass

Drawback: Use of highly nonlinear movement models and sensors not possible (e.g. maps)

~1 Hz

Page 12: Cascaded Estimation Architecture for Integration of …...Integration of Foot-Mounted Inertial Sensors > Bernhard Krach > 06.05.2008 Folie 13 The Step-Measurement Inertial sensor platform

Integration of Foot-Mounted Inertial Sensors > Bernhard Krach > 06.05.2008

Folie 12

Solution 3: Our Approach

StrapdownInertial

Computer

Extended

Kalman Filter

(INS Error Space)

AccelerometerTriad Outputs

GyroscopeTriad Outputs

“Foot still” – Detector

Triggers ZUPT

+

Calibration Feedback

INS Errors PDF

-

INS PVA

INS PVA PDFStep Displacement (delta P)

Computerdelta P PDF (Gaussian)

LikelihoodFunctions:

GNSS,Altimeter,

RFIDCompass,Step/INS

FusionFilter

(PF, RBPF)Particles

PedestrianMovement

Model

GNSSPseudoranges& Carriers

Particles,PVT, Sensor errors

3D MapDatabase

Sensors

PVT Output

~1 Hz

~100-500 Hz

Altimeter Outputs

Compass Outputs

RFID Detections

Use the lower filter to provide “step-measurements” to the upper filter

Fusion Trigger

Page 13: Cascaded Estimation Architecture for Integration of …...Integration of Foot-Mounted Inertial Sensors > Bernhard Krach > 06.05.2008 Folie 13 The Step-Measurement Inertial sensor platform

Integration of Foot-Mounted Inertial Sensors > Bernhard Krach > 06.05.2008

Folie 13

The Step-Measurement

Inertial sensor platform

Pedestrian bodycoordinate systemNavigation coordinate system

Strapdown calculationscoordinate system

Strapdown calculationscoordinate system

Inertial sensors coordinate system

Page 14: Cascaded Estimation Architecture for Integration of …...Integration of Foot-Mounted Inertial Sensors > Bernhard Krach > 06.05.2008 Folie 13 The Step-Measurement Inertial sensor platform

Integration of Foot-Mounted Inertial Sensors > Bernhard Krach > 06.05.2008

Folie 14

The Step-Measurement

αβ

Strapdown calculationscoordinate system

The step is sensed with respectto the coordinate system of thestrapdown calculations

Transformation from the strapdown to the pedestrian body coordinate system by a rotation via:

α: Current heading accordingto strapdown calculations

β: Misalignment of sensoraxes with respect to the pedestrian body axes

Page 15: Cascaded Estimation Architecture for Integration of …...Integration of Foot-Mounted Inertial Sensors > Bernhard Krach > 06.05.2008 Folie 13 The Step-Measurement Inertial sensor platform

Integration of Foot-Mounted Inertial Sensors > Bernhard Krach > 06.05.2008

Folie 15

The Step-Measurement

: Change of heading during step

: Distance travelled during step(with respect to pedestrian body coordinate system)

Page 16: Cascaded Estimation Architecture for Integration of …...Integration of Foot-Mounted Inertial Sensors > Bernhard Krach > 06.05.2008 Folie 13 The Step-Measurement Inertial sensor platform

Integration of Foot-Mounted Inertial Sensors > Bernhard Krach > 06.05.2008

Folie 16

γ2

γ1

The Step-Measurement

Measurement reports movement in the body coordinate system.

Movement with respect to the navigation coordinate system is given by a rotation via γ.

γ : Heading of pedestrian with respect to navigationcoordinate system

Page 17: Cascaded Estimation Architecture for Integration of …...Integration of Foot-Mounted Inertial Sensors > Bernhard Krach > 06.05.2008 Folie 13 The Step-Measurement Inertial sensor platform

Integration of Foot-Mounted Inertial Sensors > Bernhard Krach > 06.05.2008

Folie 17

k k+1 k+2

Dynamic Bayesian Network

Measurements(Gaussian noise)

States

Temporal index

Movement:Probabilistic

movement model(including walls)

• Position• Heading

Page 18: Cascaded Estimation Architecture for Integration of …...Integration of Foot-Mounted Inertial Sensors > Bernhard Krach > 06.05.2008 Folie 13 The Step-Measurement Inertial sensor platform

Integration of Foot-Mounted Inertial Sensors > Bernhard Krach > 06.05.2008

Folie 18

Integration of a Pair of Platforms

Left foot

Right foot

Body center

Pedestrian body model:Body centered on connecting line of foot centers

Page 19: Cascaded Estimation Architecture for Integration of …...Integration of Foot-Mounted Inertial Sensors > Bernhard Krach > 06.05.2008 Folie 13 The Step-Measurement Inertial sensor platform

Integration of Foot-Mounted Inertial Sensors > Bernhard Krach > 06.05.2008

Folie 19

Integration of a Pair of Platforms

Left foot

Right foot

Body center

Foot movement is 2x body movement:

Page 20: Cascaded Estimation Architecture for Integration of …...Integration of Foot-Mounted Inertial Sensors > Bernhard Krach > 06.05.2008 Folie 13 The Step-Measurement Inertial sensor platform

Integration of Foot-Mounted Inertial Sensors > Bernhard Krach > 06.05.2008

Folie 20

Performance Analysis

Simulation: Particle filter, 2000 particles, linear Gaussian movement model

Error Analysis: Covariance analysis based on Kalmanfilter framework

Page 21: Cascaded Estimation Architecture for Integration of …...Integration of Foot-Mounted Inertial Sensors > Bernhard Krach > 06.05.2008 Folie 13 The Step-Measurement Inertial sensor platform

Integration of Foot-Mounted Inertial Sensors > Bernhard Krach > 06.05.2008

Folie 21

Experimental Results

True trackLocation hypotheses having crossed a wall during the recent step(forbidden by movement model)

Location hypotheses

Scenario: Office building layout, initial position and heading unknown

Page 22: Cascaded Estimation Architecture for Integration of …...Integration of Foot-Mounted Inertial Sensors > Bernhard Krach > 06.05.2008 Folie 13 The Step-Measurement Inertial sensor platform

Integration of Foot-Mounted Inertial Sensors > Bernhard Krach > 06.05.2008

Folie 22

Conclusions

Kalman filter for foot-mounted inertial sensorsLow-cost MEMS inertial sensors become highly valuableComputational efficient for high rate INS ( ~ 100 Hz )

Main fusion algorithm based on Particle filteringMakes use of the provided step-measurementsLow rate fusion (~ 1 Hz) takes nonlinearities into accountIntegration of a pair of platforms (right & left foot equipped) based on pedestrian model doubles PDR performance

Page 23: Cascaded Estimation Architecture for Integration of …...Integration of Foot-Mounted Inertial Sensors > Bernhard Krach > 06.05.2008 Folie 13 The Step-Measurement Inertial sensor platform

Integration of Foot-Mounted Inertial Sensors > Bernhard Krach > 06.05.2008

Folie 23

Thank you & questions