tomographic reconstructionvda.univie.ac.at/teaching/3dip/13w/lecturenotes/06...• reconstruction...

47
© Torsten Möller Tomographic Reconstruction 3D Image Processing Torsten Möller

Upload: others

Post on 25-Oct-2020

3 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Tomographic Reconstructionvda.univie.ac.at/Teaching/3DIP/13w/LectureNotes/06...• Reconstruction — basic idea • Radon transform • Fourier-Slice theorem • (Parallel-beam) filtered

© Torsten Möller

Tomographic Reconstruction

3D Image ProcessingTorsten Möller

Page 2: Tomographic Reconstructionvda.univie.ac.at/Teaching/3DIP/13w/LectureNotes/06...• Reconstruction — basic idea • Radon transform • Fourier-Slice theorem • (Parallel-beam) filtered

© Torsten Möller

Reading

• Gonzales + Woods, Chapter 5.11

2

Page 3: Tomographic Reconstructionvda.univie.ac.at/Teaching/3DIP/13w/LectureNotes/06...• Reconstruction — basic idea • Radon transform • Fourier-Slice theorem • (Parallel-beam) filtered

© Torsten Möller

Overview

• Physics• History• Reconstruction — basic idea• Radon transform• Fourier-Slice theorem• (Parallel-beam) filtered backprojection• Fan-beam filtered backprojection• Algebraic reconstruction technique (ART)

3

Page 4: Tomographic Reconstructionvda.univie.ac.at/Teaching/3DIP/13w/LectureNotes/06...• Reconstruction — basic idea • Radon transform • Fourier-Slice theorem • (Parallel-beam) filtered

© Torsten Möller 4

X-Rays

• photons produced by an electron beam

• similar to visible light, but higher energy!

Page 5: Tomographic Reconstructionvda.univie.ac.at/Teaching/3DIP/13w/LectureNotes/06...• Reconstruction — basic idea • Radon transform • Fourier-Slice theorem • (Parallel-beam) filtered

© Torsten Möller 5

X-Rays - Physics• associated with inner shell electrons• as the electrons decelerate in the target

through interaction, they emit electromagnetic radiation in the form of X-rays.

• patient between an X-ray source and a film -> radiograph

• cheap and relatively easy to use• potentially damaging to biological tissue

Page 6: Tomographic Reconstructionvda.univie.ac.at/Teaching/3DIP/13w/LectureNotes/06...• Reconstruction — basic idea • Radon transform • Fourier-Slice theorem • (Parallel-beam) filtered

© Torsten Möller 6

X-Rays - Visibility• bones contain heavy atoms -> with many

electrons, which act as an absorber of X-rays

• commonly used to image gross bone structure and lungs

• excellent for detecting foreign metal objects• main disadvantage -> lack of anatomical

structure • all other tissue has very similar absorption

coefficient for X-rays

Page 7: Tomographic Reconstructionvda.univie.ac.at/Teaching/3DIP/13w/LectureNotes/06...• Reconstruction — basic idea • Radon transform • Fourier-Slice theorem • (Parallel-beam) filtered

© Torsten Möller 7

X-Rays - Angiography

• inject contrast medium (electron dense dye)

• used to image vasculature (blood vessels)

• angiocardiography (heart)• cholecystography (gall bladder)• myelography (spinal cord)• urography (urinary tract)

Page 8: Tomographic Reconstructionvda.univie.ac.at/Teaching/3DIP/13w/LectureNotes/06...• Reconstruction — basic idea • Radon transform • Fourier-Slice theorem • (Parallel-beam) filtered

© Torsten Möller 8

X-Rays - Images

Page 9: Tomographic Reconstructionvda.univie.ac.at/Teaching/3DIP/13w/LectureNotes/06...• Reconstruction — basic idea • Radon transform • Fourier-Slice theorem • (Parallel-beam) filtered

© Torsten Möller 9

CT or CAT - Principles• Computerized (Axial) Tomography• introduced in 1963/1972 by Hounsfield and

Cormack (1979 Noble prize in medicine)• natural progression from X-rays• based on the principle that a three-

dimensional object can be reconstructed from its two dimensional projections

• based on the Radon transform (a map from an n-dimensional space to an (n-1)-dimensional space)

Page 10: Tomographic Reconstructionvda.univie.ac.at/Teaching/3DIP/13w/LectureNotes/06...• Reconstruction — basic idea • Radon transform • Fourier-Slice theorem • (Parallel-beam) filtered

© Torsten Möller 10

CT or CAT - Methods

• measures the attenuation of X-rays from many different angles

• a computer reconstructs the organ under study in a series of cross sections or planes

• combine X-ray pictures from various angles to reconstruct 3D structures

video

Page 11: Tomographic Reconstructionvda.univie.ac.at/Teaching/3DIP/13w/LectureNotes/06...• Reconstruction — basic idea • Radon transform • Fourier-Slice theorem • (Parallel-beam) filtered

© Torsten Möller

CAT

11

Page 12: Tomographic Reconstructionvda.univie.ac.at/Teaching/3DIP/13w/LectureNotes/06...• Reconstruction — basic idea • Radon transform • Fourier-Slice theorem • (Parallel-beam) filtered

© Torsten Möller

Overview

• Physics• History• Reconstruction — basic idea• Radon transform• Fourier-Slice theorem• (Parallel-beam) filtered backprojection• Fan-beam filtered backprojection• Algebraic reconstruction technique (ART)

12

Page 13: Tomographic Reconstructionvda.univie.ac.at/Teaching/3DIP/13w/LectureNotes/06...• Reconstruction — basic idea • Radon transform • Fourier-Slice theorem • (Parallel-beam) filtered

© Torsten Möller

History

• G1 (first gen) CT:– employ “pencil” X-ray beam– single detector– linear translation of

source/detector pair• G2 CT:

– same as G1, but– beam is shaped as a fan– allows multiple detectors

13

Page 14: Tomographic Reconstructionvda.univie.ac.at/Teaching/3DIP/13w/LectureNotes/06...• Reconstruction — basic idea • Radon transform • Fourier-Slice theorem • (Parallel-beam) filtered

© Torsten Möller

History• G3 CT:

– great improvement withbank of detectors (~1000 detectors)

– no need for translation• G4 CT:

– circular ring of detectors (~5000 detectors)

• G3+G4: – higher speed– higher dose and higher cost

14

Page 15: Tomographic Reconstructionvda.univie.ac.at/Teaching/3DIP/13w/LectureNotes/06...• Reconstruction — basic idea • Radon transform • Fourier-Slice theorem • (Parallel-beam) filtered

© Torsten Möller

Modern scanners

• G5 CT (EBCT — electron beam CT)– eliminate mechanical motion– beams controlled electromagnetically

• G1-G5: one image at a time, then patient is moved.

• Patient must hold breath for lung CT

15

Page 16: Tomographic Reconstructionvda.univie.ac.at/Teaching/3DIP/13w/LectureNotes/06...• Reconstruction — basic idea • Radon transform • Fourier-Slice theorem • (Parallel-beam) filtered

© Torsten Möller

Modern scanners

• G6 CT (helical CT):– continuous movement of patient and

source/detector• G7 CT (multi-slice CT):

– thick fan-beams, collecting multiple slices at once

– reducing cost + dosage

16

Page 17: Tomographic Reconstructionvda.univie.ac.at/Teaching/3DIP/13w/LectureNotes/06...• Reconstruction — basic idea • Radon transform • Fourier-Slice theorem • (Parallel-beam) filtered

© Torsten Möller 17

CT - 2D vs. 3D• Linear advancement (slice by

slice)– typical method– tumor might fall between ‘cracks’– takes long time

• helical movement– 5-8 times faster– under-utilization of cone beam– heart synchronization difficult

• 2D projections– enhanced speed

Page 18: Tomographic Reconstructionvda.univie.ac.at/Teaching/3DIP/13w/LectureNotes/06...• Reconstruction — basic idea • Radon transform • Fourier-Slice theorem • (Parallel-beam) filtered

© Torsten Möller 18

CT - Beating Heart?• Noise if body parts move!• Heart - synchronize imaging

with heart beat– can’t capture beating well– need faster techniques

• Dynamic Spatial Reconstructor– has 14 X-ray/camera pairs– but turns slower– 2D projections seem more

plausible– and cheaper

University Of Iowa

Page 19: Tomographic Reconstructionvda.univie.ac.at/Teaching/3DIP/13w/LectureNotes/06...• Reconstruction — basic idea • Radon transform • Fourier-Slice theorem • (Parallel-beam) filtered

© Torsten Möller 19

CT or CAT - Advantages• significantly more data is collected• superior to single X-ray scans• far easier to separate soft tissues other than

bone from one another (e.g. liver, kidney)• data exist in digital form -> can be analyzed

quantitatively• adds enormously to the diagnostic information• used in many large hospitals and medical

centers throughout the world

Page 20: Tomographic Reconstructionvda.univie.ac.at/Teaching/3DIP/13w/LectureNotes/06...• Reconstruction — basic idea • Radon transform • Fourier-Slice theorem • (Parallel-beam) filtered

© Torsten Möller 20

CT or CAT - Disadvantages

• significantly more data is collected• soft tissue X-ray absorption still relatively

similar• still a health risk• MRI is used for a detailed imaging of

anatomy

Page 21: Tomographic Reconstructionvda.univie.ac.at/Teaching/3DIP/13w/LectureNotes/06...• Reconstruction — basic idea • Radon transform • Fourier-Slice theorem • (Parallel-beam) filtered

© Torsten Möller

Overview

• Physics• History• Reconstruction — basic idea• Radon transform• Fourier-Slice theorem• (Parallel-beam) filtered backprojection• Fan-beam filtered backprojection• Algebraic reconstruction technique (ART)

21

Page 22: Tomographic Reconstructionvda.univie.ac.at/Teaching/3DIP/13w/LectureNotes/06...• Reconstruction — basic idea • Radon transform • Fourier-Slice theorem • (Parallel-beam) filtered

© Torsten Möller

Basics: Projection vs. backprojection

22

Projection Back-projection

Page 23: Tomographic Reconstructionvda.univie.ac.at/Teaching/3DIP/13w/LectureNotes/06...• Reconstruction — basic idea • Radon transform • Fourier-Slice theorem • (Parallel-beam) filtered

© Torsten Möller 23

1 2

3 4 32

Page 24: Tomographic Reconstructionvda.univie.ac.at/Teaching/3DIP/13w/LectureNotes/06...• Reconstruction — basic idea • Radon transform • Fourier-Slice theorem • (Parallel-beam) filtered

© Torsten Möller 24

1 2

4 32 64

Page 25: Tomographic Reconstructionvda.univie.ac.at/Teaching/3DIP/13w/LectureNotes/06...• Reconstruction — basic idea • Radon transform • Fourier-Slice theorem • (Parallel-beam) filtered

© Torsten Möller

Overview

• Physics• History• Reconstruction — basic idea• Radon transform• Fourier-Slice theorem• (Parallel-beam) filtered backprojection• Fan-beam filtered backprojection• Algebraic reconstruction technique (ART)

25

Page 26: Tomographic Reconstructionvda.univie.ac.at/Teaching/3DIP/13w/LectureNotes/06...• Reconstruction — basic idea • Radon transform • Fourier-Slice theorem • (Parallel-beam) filtered

© Torsten Möller

Math. principles

• Expression of a simple line:

• computing projections:

• Also known asRadon Transform

26

x cos ✓ + y sin ✓ = ⇢

g(⇢j , ✓k) =

Z Zf(x, y)�(x cos ✓k + y sin ✓k � ⇢j)dxdy

Page 27: Tomographic Reconstructionvda.univie.ac.at/Teaching/3DIP/13w/LectureNotes/06...• Reconstruction — basic idea • Radon transform • Fourier-Slice theorem • (Parallel-beam) filtered

© Torsten Möller

Sinogram

• Radon transform written as simple images

27

Page 28: Tomographic Reconstructionvda.univie.ac.at/Teaching/3DIP/13w/LectureNotes/06...• Reconstruction — basic idea • Radon transform • Fourier-Slice theorem • (Parallel-beam) filtered

© Torsten Möller

Simple reconstruction

• mathematically “smearing” is:

• simply summing it all up:

28

f(x, y) =

Z ⇡

0f✓(x, y)d✓

f✓k(x, y) = g(⇢, ✓k)

= g(x cos ✓k + y sin ✓k, ✓k)

Page 29: Tomographic Reconstructionvda.univie.ac.at/Teaching/3DIP/13w/LectureNotes/06...• Reconstruction — basic idea • Radon transform • Fourier-Slice theorem • (Parallel-beam) filtered

© Torsten Möller

Simple reconstruction

• leads to lots of blurring

• proper reconstruction — projection slice29

Page 30: Tomographic Reconstructionvda.univie.ac.at/Teaching/3DIP/13w/LectureNotes/06...• Reconstruction — basic idea • Radon transform • Fourier-Slice theorem • (Parallel-beam) filtered

© Torsten Möller

Overview

• Physics• History• Reconstruction — basic idea• Radon transform• Fourier-Slice theorem• (Parallel-beam) filtered backprojection• Fan-beam filtered backprojection• Algebraic reconstruction technique (ART)

30

Page 31: Tomographic Reconstructionvda.univie.ac.at/Teaching/3DIP/13w/LectureNotes/06...• Reconstruction — basic idea • Radon transform • Fourier-Slice theorem • (Parallel-beam) filtered

G(!, ✓) =

Z 1

�1g(⇢, ✓)e�j2⇡!⇢d⇢

© Torsten Möller

Projection-slice theorem

31

Page 32: Tomographic Reconstructionvda.univie.ac.at/Teaching/3DIP/13w/LectureNotes/06...• Reconstruction — basic idea • Radon transform • Fourier-Slice theorem • (Parallel-beam) filtered

© Torsten Möller

Projection-slice theorem

• mathematically

• meaning:

32

G(!, ✓) =

Z Z Zf(x, y)�(x cos ✓ + y sin ✓ � ⇢)e

�j2⇡!⇢

dxdyd⇢

=

Z Zf(x, y)

Z�(x cos ✓ + y sin ✓ � ⇢)e

�j2⇡!⇢

d⇢

�dxdy

=

Z Zf(x, y)e

�j2⇡!(x cos ✓+y sin ✓)

dxdy

G(!, ✓) =

Z Zf(x, y)e

�j2⇡(ux+vy)

dxdy

u=! cos ✓;v=! sin ✓

= F (! cos ✓,! sin ✓)

Page 33: Tomographic Reconstructionvda.univie.ac.at/Teaching/3DIP/13w/LectureNotes/06...• Reconstruction — basic idea • Radon transform • Fourier-Slice theorem • (Parallel-beam) filtered

© Torsten Möller

Overview

• Physics• History• Reconstruction — basic idea• Radon transform• Fourier-Slice theorem• (Parallel-beam) filtered backprojection• Fan-beam filtered backprojection• Algebraic reconstruction technique (ART)

33

Page 34: Tomographic Reconstructionvda.univie.ac.at/Teaching/3DIP/13w/LectureNotes/06...• Reconstruction — basic idea • Radon transform • Fourier-Slice theorem • (Parallel-beam) filtered

f(x, y) =

Z ZF (x, y)e

j2⇡(ux+vy)

dudv

=

Z2⇡

0

Z 1

0

F (! cos ✓,! sin ✓)e

j2⇡!(x cos ✓+y sin ✓)

!d!d✓

=

Z2⇡

0

Z 1

0

G(!, ✓)e

j2⇡!(x cos ✓+y sin ✓)

!d!d✓

=

Z⇡

0

Z 1

�1|!|G(!, ✓)e

j2⇡!(x cos ✓+y sin ✓)

d!d✓

=

Z⇡

0

Z 1

�1|!|G(!, ✓)e

j2⇡!⇢

d!

⇢=x cos ✓+y sin ✓

d✓

G(!, ✓ + ⇡) = G(�!, ✓)

© Torsten Möller

some math

34

dudv = !d!d✓

Page 35: Tomographic Reconstructionvda.univie.ac.at/Teaching/3DIP/13w/LectureNotes/06...• Reconstruction — basic idea • Radon transform • Fourier-Slice theorem • (Parallel-beam) filtered

© Torsten Möller

Multiplication with a ramp

• sharp cut-off, yields ringing!

35

Page 36: Tomographic Reconstructionvda.univie.ac.at/Teaching/3DIP/13w/LectureNotes/06...• Reconstruction — basic idea • Radon transform • Fourier-Slice theorem • (Parallel-beam) filtered

© Torsten Möller

Multiplication with a ramp

36

Page 37: Tomographic Reconstructionvda.univie.ac.at/Teaching/3DIP/13w/LectureNotes/06...• Reconstruction — basic idea • Radon transform • Fourier-Slice theorem • (Parallel-beam) filtered

© Torsten Möller

Multiplication with a ramp

37

Page 38: Tomographic Reconstructionvda.univie.ac.at/Teaching/3DIP/13w/LectureNotes/06...• Reconstruction — basic idea • Radon transform • Fourier-Slice theorem • (Parallel-beam) filtered

© Torsten Möller

Overview

• Physics• History• Reconstruction — basic idea• Radon transform• Fourier-Slice theorem• (Parallel-beam) filtered backprojection• Fan-beam filtered backprojection• Algebraic reconstruction technique (ART)

38

Page 39: Tomographic Reconstructionvda.univie.ac.at/Teaching/3DIP/13w/LectureNotes/06...• Reconstruction — basic idea • Radon transform • Fourier-Slice theorem • (Parallel-beam) filtered

✓ = ↵+ �

⇢ = D sin↵

© Torsten Möller

Principle idea

• simple: just untangle all the beams from the fan into the right parallel beam reconstruction

• more direct:

39

Page 40: Tomographic Reconstructionvda.univie.ac.at/Teaching/3DIP/13w/LectureNotes/06...• Reconstruction — basic idea • Radon transform • Fourier-Slice theorem • (Parallel-beam) filtered

✓ = ↵+ �

⇢ = D sin↵

f(r,�) =

Z 2⇡

0

1

R2

Z ↵m

�↵m

q(↵,�)h(↵0 � ↵)d↵

�d�

h(↵) =1

2

⇣ ↵

sin↵

⌘2s(↵)

© Torsten Möller

Principle idea

• simple: just untangle all the beams from the fan into the right parallel beam reconstruction

• more direct:

40

Page 41: Tomographic Reconstructionvda.univie.ac.at/Teaching/3DIP/13w/LectureNotes/06...• Reconstruction — basic idea • Radon transform • Fourier-Slice theorem • (Parallel-beam) filtered

© Torsten Möller

Results

• typically need more projections!

41

Page 42: Tomographic Reconstructionvda.univie.ac.at/Teaching/3DIP/13w/LectureNotes/06...• Reconstruction — basic idea • Radon transform • Fourier-Slice theorem • (Parallel-beam) filtered

© Torsten Möller

Results

• typically need more projections!

42

Page 43: Tomographic Reconstructionvda.univie.ac.at/Teaching/3DIP/13w/LectureNotes/06...• Reconstruction — basic idea • Radon transform • Fourier-Slice theorem • (Parallel-beam) filtered

© Torsten Möller

Overview

• Physics• History• Reconstruction — basic idea• Radon transform• Fourier-Slice theorem• (Parallel-beam) filtered backprojection• Fan-beam filtered backprojection• Algebraic reconstruction technique (ART)

43

Page 44: Tomographic Reconstructionvda.univie.ac.at/Teaching/3DIP/13w/LectureNotes/06...• Reconstruction — basic idea • Radon transform • Fourier-Slice theorem • (Parallel-beam) filtered

© Torsten Möller 44

CT - Reconstruction: ART/EM

• Algebraic Reconstruction Technique• Expectation Maximization (EM)• iterative technique• attributed to Gordon

Reconstructedmodel

Actual DataSlices

ProjectionBack-

Projection

Initial Guess

Page 45: Tomographic Reconstructionvda.univie.ac.at/Teaching/3DIP/13w/LectureNotes/06...• Reconstruction — basic idea • Radon transform • Fourier-Slice theorem • (Parallel-beam) filtered

© Torsten Möller 45

CT - Reconstruction: ART (2)

pi-1

pi

pi+1v1v2v3

wj=

Page 46: Tomographic Reconstructionvda.univie.ac.at/Teaching/3DIP/13w/LectureNotes/06...• Reconstruction — basic idea • Radon transform • Fourier-Slice theorem • (Parallel-beam) filtered

© Torsten Möller 46

CT - Reconstruction: ART (3)• object reconstructed on a discrete grid by a

sequence of alternating grid projections and correction back-projections.

• Projection: measures how close the current state of the reconstructed object matches one of the scanner projections

• Back-projection: corrective factor is distributed back onto the grid

• many projection/back-projection steps needed for a certain tolerance margin

Page 47: Tomographic Reconstructionvda.univie.ac.at/Teaching/3DIP/13w/LectureNotes/06...• Reconstruction — basic idea • Radon transform • Fourier-Slice theorem • (Parallel-beam) filtered

© Torsten Möller 47

CT - FBP vs. ART

• Computationally cheap

• Clinically usually 500 projections per slice

• problematic for noisy projections

FBP ART• Still slow• better quality for

fewer projections• better quality for

non-uniform project.• “guided” reconstruct.

(initial guess!)