introduction to vectors and frames part 2• e.g.: optotrak, pixsys • current “standard” •...

32
Laboratory for Percutaneous Surgery The Perk Lab Copyright © Gabor Fichtinger, October 17, 2018 Tracking Gabor Fichtinger

Upload: others

Post on 24-Mar-2021

3 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Introduction to Vectors and Frames Part 2• E.g.: Optotrak, Pixsys • Current “standard” • Advantages – very accurate – multiple rigid bodies – versatile – reasonably

Laboratory for Percutaneous Surgery – The Perk Lab Copyright © Gabor Fichtinger, October 17, 2018

Tracking

Gabor Fichtinger

Page 2: Introduction to Vectors and Frames Part 2• E.g.: Optotrak, Pixsys • Current “standard” • Advantages – very accurate – multiple rigid bodies – versatile – reasonably

Laboratory for Percutaneous Surgery – The Perk Lab Copyright © Gabor Fichtinger, October 17, 2018

Tracked Navigation

• The target anatomy is known in FCT

• The head markers were found in FCT

• The head markers are tracked in Ftrac

• The tool is tracked in Ftrac

• The tool (tip/axis/etc) is known in FTool

• model of tool

• real tool

• Tracked navigation = paint the model of the

tool over the CT on the computer screen as the

real tool is moving over/on/inside the patient in

the operating room

• For this we need to compute the transformation

from Tool to CT coordinates

FCTTool = FCTMar * FMarTrac * FTracTool

FTrac

FTracToolFMarTrac

A

B

C

v1

v2

v3

FMar

FCT

FMar

FTool

FCTMar

Tool

FTool

Operating room

Computer

FTool

Page 3: Introduction to Vectors and Frames Part 2• E.g.: Optotrak, Pixsys • Current “standard” • Advantages – very accurate – multiple rigid bodies – versatile – reasonably

Laboratory for Percutaneous Surgery – The Perk Lab Copyright © Gabor Fichtinger, October 17, 2018

Tracking/localizer Devices

• Determine 3D positions of some markers in space relative to some base coordinate system

• Also called “3D digitizers” or “localizers”, etc.

• Many uses

• Many technologies

• Typically work like some “GPS system”

• We will review a few technologies, identify pros and cons

Page 4: Introduction to Vectors and Frames Part 2• E.g.: Optotrak, Pixsys • Current “standard” • Advantages – very accurate – multiple rigid bodies – versatile – reasonably

Laboratory for Percutaneous Surgery – The Perk Lab Copyright © Gabor Fichtinger, October 17, 2018

Some localizer technologies

• Encoded passive manipulator

• Active manipulator

• Ultrasound

• Electromagnetic

• Optical active

• Optical passive

Page 5: Introduction to Vectors and Frames Part 2• E.g.: Optotrak, Pixsys • Current “standard” • Advantages – very accurate – multiple rigid bodies – versatile – reasonably

Laboratory for Percutaneous Surgery – The Perk Lab Copyright © Gabor Fichtinger, October 17, 2018

Passive mechanical linkages

• Encoders & linkage

• Advantages

– ???

• Drawbacks

– ???

Encoded linkages

Probe, pointer or

active device

(scalpel,ectrode…)

Patient

OR table

Common reference

coord. system

Page 6: Introduction to Vectors and Frames Part 2• E.g.: Optotrak, Pixsys • Current “standard” • Advantages – very accurate – multiple rigid bodies – versatile – reasonably

Laboratory for Percutaneous Surgery – The Perk Lab Copyright © Gabor Fichtinger, October 17, 2018

Page 7: Introduction to Vectors and Frames Part 2• E.g.: Optotrak, Pixsys • Current “standard” • Advantages – very accurate – multiple rigid bodies – versatile – reasonably

Laboratory for Percutaneous Surgery – The Perk Lab Copyright © Gabor Fichtinger, October 17, 2018

Page 8: Introduction to Vectors and Frames Part 2• E.g.: Optotrak, Pixsys • Current “standard” • Advantages – very accurate – multiple rigid bodies – versatile – reasonably

Laboratory for Percutaneous Surgery – The Perk Lab Copyright © Gabor Fichtinger, October 17, 2018

Page 9: Introduction to Vectors and Frames Part 2• E.g.: Optotrak, Pixsys • Current “standard” • Advantages – very accurate – multiple rigid bodies – versatile – reasonably

Laboratory for Percutaneous Surgery – The Perk Lab Copyright © Gabor Fichtinger, October 17, 2018

Page 10: Introduction to Vectors and Frames Part 2• E.g.: Optotrak, Pixsys • Current “standard” • Advantages – very accurate – multiple rigid bodies – versatile – reasonably

Laboratory for Percutaneous Surgery – The Perk Lab Copyright © Gabor Fichtinger, October 17, 2018

Page 11: Introduction to Vectors and Frames Part 2• E.g.: Optotrak, Pixsys • Current “standard” • Advantages – very accurate – multiple rigid bodies – versatile – reasonably

Laboratory for Percutaneous Surgery – The Perk Lab Copyright © Gabor Fichtinger, October 17, 2018

Page 12: Introduction to Vectors and Frames Part 2• E.g.: Optotrak, Pixsys • Current “standard” • Advantages – very accurate – multiple rigid bodies – versatile – reasonably

Laboratory for Percutaneous Surgery – The Perk Lab Copyright © Gabor Fichtinger, October 17, 2018

Page 13: Introduction to Vectors and Frames Part 2• E.g.: Optotrak, Pixsys • Current “standard” • Advantages – very accurate – multiple rigid bodies – versatile – reasonably

Laboratory for Percutaneous Surgery – The Perk Lab Copyright © Gabor Fichtinger, October 17, 2018

Computational Issues

1. Composition of

reference frame

transformations

2. Computational issues

3. Error analysis

Page 14: Introduction to Vectors and Frames Part 2• E.g.: Optotrak, Pixsys • Current “standard” • Advantages – very accurate – multiple rigid bodies – versatile – reasonably

Laboratory for Percutaneous Surgery – The Perk Lab Copyright © Gabor Fichtinger, October 17, 2018

BAT for 3D tracked ultrasound

http://www.nomos.com

Page 15: Introduction to Vectors and Frames Part 2• E.g.: Optotrak, Pixsys • Current “standard” • Advantages – very accurate – multiple rigid bodies – versatile – reasonably

Laboratory for Percutaneous Surgery – The Perk Lab Copyright © Gabor Fichtinger, October 17, 2018

Passive mechanical linkages

• Encoders & linkage

• Advantages:

– Simple concept

– No line-of-sight problems

• Drawbacks

– Clumsy

– Confined range

– Single reference frame

– Error aggregation

– Need for electronic encoder

– Need for calibration of EACH joint

– Reference base (head-ring) is very

invasive

Page 16: Introduction to Vectors and Frames Part 2• E.g.: Optotrak, Pixsys • Current “standard” • Advantages – very accurate – multiple rigid bodies – versatile – reasonably

Laboratory for Percutaneous Surgery – The Perk Lab Copyright © Gabor Fichtinger, October 17, 2018

Ultrasound

• “Clickers”+microphones

• time delays give distances

• multiple distances give pos.

• Advantages– ???

• Drawbacks– ???

Page 17: Introduction to Vectors and Frames Part 2• E.g.: Optotrak, Pixsys • Current “standard” • Advantages – very accurate – multiple rigid bodies – versatile – reasonably

Laboratory for Percutaneous Surgery – The Perk Lab Copyright © Gabor Fichtinger, October 17, 2018

Page 18: Introduction to Vectors and Frames Part 2• E.g.: Optotrak, Pixsys • Current “standard” • Advantages – very accurate – multiple rigid bodies – versatile – reasonably

Laboratory for Percutaneous Surgery – The Perk Lab Copyright © Gabor Fichtinger, October 17, 2018

Page 19: Introduction to Vectors and Frames Part 2• E.g.: Optotrak, Pixsys • Current “standard” • Advantages – very accurate – multiple rigid bodies – versatile – reasonably

Laboratory for Percutaneous Surgery – The Perk Lab Copyright © Gabor Fichtinger, October 17, 2018

Page 20: Introduction to Vectors and Frames Part 2• E.g.: Optotrak, Pixsys • Current “standard” • Advantages – very accurate – multiple rigid bodies – versatile – reasonably

Laboratory for Percutaneous Surgery – The Perk Lab Copyright © Gabor Fichtinger, October 17, 2018

Ultrasound

• “Clickers”+microphones

• Time delays give distances

• Multiple distances give pos.

• Advantages– Inexpensive

– Unobtrusive

– Multiple rigid bodies

• Drawbacks– Accuracy drifts (e.g., temperature)

– Speed of sound in diff. media

– Lack of self-evident warning

– Line of sight problems

Page 21: Introduction to Vectors and Frames Part 2• E.g.: Optotrak, Pixsys • Current “standard” • Advantages – very accurate – multiple rigid bodies – versatile – reasonably

Laboratory for Percutaneous Surgery – The Perk Lab Copyright © Gabor Fichtinger, October 17, 2018

Optical passive

• Triangulate markers in standard video or infrared images

• Advantages– Standard components– Fairly fail-safe– Multiple devices tracked

• Drawbacks– Line-of-sight– Field of view– Focus/depth issues– Illumination-dependent– Camera resolution is limited– Differentiation between markers?

Page 22: Introduction to Vectors and Frames Part 2• E.g.: Optotrak, Pixsys • Current “standard” • Advantages – very accurate – multiple rigid bodies – versatile – reasonably

Laboratory for Percutaneous Surgery – The Perk Lab Copyright © Gabor Fichtinger, October 17, 2018

Optical passive

• Triangulate markers in standard video or infrared images

• Advantages– Standard components– Fairly fail-safe– Multiple devices tracked

• Drawbacks– Line-of-sight– Field of view– Focus/depth issues– Illumination-dependent– Camera resolution is limited– Differentiation between markers?

Page 23: Introduction to Vectors and Frames Part 2• E.g.: Optotrak, Pixsys • Current “standard” • Advantages – very accurate – multiple rigid bodies – versatile – reasonably

Laboratory for Percutaneous Surgery – The Perk Lab Copyright © Gabor Fichtinger, October 17, 2018

Markers

Passive Reflective Targets Active Markers

Accuracy: 0.35 mm

Polaris Optical Tracker

Page 24: Introduction to Vectors and Frames Part 2• E.g.: Optotrak, Pixsys • Current “standard” • Advantages – very accurate – multiple rigid bodies – versatile – reasonably

Laboratory for Percutaneous Surgery – The Perk Lab Copyright © Gabor Fichtinger, October 17, 2018

Newer Optical Trackers

Page 25: Introduction to Vectors and Frames Part 2• E.g.: Optotrak, Pixsys • Current “standard” • Advantages – very accurate – multiple rigid bodies – versatile – reasonably

Laboratory for Percutaneous Surgery – The Perk Lab Copyright © Gabor Fichtinger, October 17, 2018

Optical active

• Track LED markers• Triangulate to locate 3D• E.g.: Optotrak, Pixsys• Current “standard”• Advantages

– ???

• Drawbacks– ???

Page 26: Introduction to Vectors and Frames Part 2• E.g.: Optotrak, Pixsys • Current “standard” • Advantages – very accurate – multiple rigid bodies – versatile – reasonably

Laboratory for Percutaneous Surgery – The Perk Lab Copyright © Gabor Fichtinger, October 17, 2018

RMS Accuracy at 2.5 m distance

0.1 mm for x, y coordinates

0.15 mm for z coordinate

Field of View (34x34 in)

Certus Optical Tracker

Page 27: Introduction to Vectors and Frames Part 2• E.g.: Optotrak, Pixsys • Current “standard” • Advantages – very accurate – multiple rigid bodies – versatile – reasonably

Laboratory for Percutaneous Surgery – The Perk Lab Copyright © Gabor Fichtinger, October 17, 2018

Optical active

• Track LED markers• Triangulate to locate 3D• E.g.: Optotrak, Pixsys• Current “standard”• Advantages

– very accurate– multiple rigid bodies– versatile– reasonably fail-safe– Often obtrusive

• Drawbacks– line-of-sight restrictions– Large– Expensive

Page 28: Introduction to Vectors and Frames Part 2• E.g.: Optotrak, Pixsys • Current “standard” • Advantages – very accurate – multiple rigid bodies – versatile – reasonably

Laboratory for Percutaneous Surgery – The Perk Lab Copyright © Gabor Fichtinger, October 17, 2018

Electromagnetic

• Originally developed for fighter pilot head tracking

• Reasonably accurate 6 dof

• E.g., Polhemus, Ascension, Aurora, Flock of Birds

• Advantages– ???

• Drawbacks– ???

Page 29: Introduction to Vectors and Frames Part 2• E.g.: Optotrak, Pixsys • Current “standard” • Advantages – very accurate – multiple rigid bodies – versatile – reasonably

Laboratory for Percutaneous Surgery – The Perk Lab Copyright © Gabor Fichtinger, October 17, 2018

Electromagnetic Trackers

NDI Ascension (DC) NDI Aurora (AC)

Field generator

Sensors

Page 30: Introduction to Vectors and Frames Part 2• E.g.: Optotrak, Pixsys • Current “standard” • Advantages – very accurate – multiple rigid bodies – versatile – reasonably

Laboratory for Percutaneous Surgery – The Perk Lab Copyright © Gabor Fichtinger, October 17, 2018

First EM localizer: Bell & Garfield, 1881

Page 31: Introduction to Vectors and Frames Part 2• E.g.: Optotrak, Pixsys • Current “standard” • Advantages – very accurate – multiple rigid bodies – versatile – reasonably

Laboratory for Percutaneous Surgery – The Perk Lab Copyright © Gabor Fichtinger, October 17, 2018

Newest EM localizer: Implanted wireless beacon

Calypso®

Page 32: Introduction to Vectors and Frames Part 2• E.g.: Optotrak, Pixsys • Current “standard” • Advantages – very accurate – multiple rigid bodies – versatile – reasonably

Laboratory for Percutaneous Surgery – The Perk Lab Copyright © Gabor Fichtinger, October 17, 2018

Calypso® frames and frame transformations

FT

FL

FP

FC

FTL

FBC

FLP