msc geodetic engineering msr-02: advanced techniques …

44
01: MOBILE LASER SCANNING MSC GEODETIC ENGINEERING MSR-02: ADVANCED TECHNIQUES FOR MOBILE SENSING AND ROBOTICS (GEODESY TRACK) DR. LASSE KLINGBEIL INSTITUTE FOR GEODESY AND GEOINFORMATION UNIVERSITY OF BONN

Upload: others

Post on 18-Dec-2021

5 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: MSC GEODETIC ENGINEERING MSR-02: ADVANCED TECHNIQUES …

01: MOBILE LASER SCANNING

MSC GEODETIC ENGINEERING

MSR-02: ADVANCED TECHNIQUES FOR MOBILE SENSING AND ROBOTICS (GEODESY TRACK)

DR. LASSE KLINGBEIL

INSTITUTE FOR GEODESY AND GEOINFORMATIONUNIVERSITY OF BONN

Page 2: MSC GEODETIC ENGINEERING MSR-02: ADVANCED TECHNIQUES …

MOBILE MAPPING

Klingbeil: Advanced Techniques for Mobile Sensing and Robotics - Geodesy - 01 - Mobile Laser Scanning

Environment

TrajectoryMoving Platform

with Sensors

Spatial Information about the

Environment

s

g

( )gs tT

2

Page 3: MSC GEODETIC ENGINEERING MSR-02: ADVANCED TECHNIQUES …

EXAMPLESCITY MODELS

Klingbeil: Advanced Techniques for Mobile Sensing and Robotics - Geodesy - 01 - Mobile Laser Scanning

Leica Pegasus

3

Page 4: MSC GEODETIC ENGINEERING MSR-02: ADVANCED TECHNIQUES …

EXAMPLESAIRBORNE LIDAR

Klingbeil: Advanced Techniques for Mobile Sensing and Robotics - Geodesy - 01 - Mobile Laser Scanning 4

Page 5: MSC GEODETIC ENGINEERING MSR-02: ADVANCED TECHNIQUES …

EXAMPLEPRECISION AGRICULTURE

Klingbeil: Advanced Techniques for Mobile Sensing and Robotics - Geodesy - 01 - Mobile Laser Scanning 5

Page 6: MSC GEODETIC ENGINEERING MSR-02: ADVANCED TECHNIQUES …

MOBILE MAPPING

Klingbeil: Advanced Techniques for Mobile Sensing and Robotics - Geodesy - 01 - Mobile Laser Scanning

Topcon

Finnish Geodetic Institute

Google

Sinning

Finnish Geodetic Institute p3dsystems

Leica

Topcon Finnish Geodetic Institute

6

Page 7: MSC GEODETIC ENGINEERING MSR-02: ADVANCED TECHNIQUES …

IGG MOBILE LASER SCANNING SYSTEM

Klingbeil: Advanced Techniques for Mobile Sensing and Robotics - Geodesy - 01 - Mobile Laser Scanning 7

Page 8: MSC GEODETIC ENGINEERING MSR-02: ADVANCED TECHNIQUES …

MOBILE LASER SCANNING PRINCIPLE

Klingbeil: Advanced Techniques for Mobile Sensing and Robotics - Geodesy - 01 - Mobile Laser Scanning 8

Page 9: MSC GEODETIC ENGINEERING MSR-02: ADVANCED TECHNIQUES …

MOBILE LASER SCANNING RESULTS

Klingbeil: Advanced Techniques for Mobile Sensing and Robotics - Geodesy - 01 - Mobile Laser Scanning 9

Page 10: MSC GEODETIC ENGINEERING MSR-02: ADVANCED TECHNIQUES …

MOBILE LASER SCANNING TRANSFORMATIONS

Klingbeil: Advanced Techniques for Mobile Sensing and Robotics - Geodesy - 01 - Mobile Laser Scanning

Trajectory of the vehicle

System Calibration

T consists of a rotation R and a translation t(similarity transform without scale: 6 DOF)

Environment

TrajectoryMoving Platform

with Sensors

Spatial Information about the

Environment

s

g

( )gs tT

10

Page 11: MSC GEODETIC ENGINEERING MSR-02: ADVANCED TECHNIQUES …

MOBILE LASER SCANNING

Klingbeil: Advanced Techniques for Mobile Sensing and Robotics - Geodesy - 01 - Mobile Laser Scanning

object coordinateIn the global coordinate system

object coordinate in the sensor (e.g. scanner ) coordinate system

position und orientierungof the sensor (e.g.scanner) in the global coordinatesystem

System calibration

Sensor Synchronisation

11

Page 12: MSC GEODETIC ENGINEERING MSR-02: ADVANCED TECHNIQUES …

MOBILE LASER SCANNING – CONTEXT

Klingbeil: Advanced Techniques for Mobile Sensing and Robotics - Geodesy - 01 - Mobile Laser Scanning

object coordinateIn the global coordinate system

object coordinate in the sensor (e.g. scanner ) coordinate system

position und orientierungof the sensor (e.g.scanner) in the global coordinatesystem

System calibration

Sensor Synchronisation this course

this course Sensors & State

Estimation (MSR-01) Sensors & State Estimation (MSR-01) GNSS (MGE-02) this course

Sensors & State Estimation (MSR-01) Coordinate Systems

(MGE-01) this course

12

Page 13: MSC GEODETIC ENGINEERING MSR-02: ADVANCED TECHNIQUES …

ADVANCED TECHNIQUES FOR MOBILE SENSINGAND ROBOTICS – LECTURE CONTENT

(1) Mobile Laser Scanning

(2) Trajectory Estimation

(3) System Calibration

(4) Sensor Synchronisation

(5) From Images to Point Clouds (SfM)

(6) Accuracy of Point Clouds I

(7) Accuracy of Point Clouds II

(8) Deformation Analysis with Point Clouds I

(9) Deformation Analysis with Point Clouds II

Klingbeil: Advanced Techniques for Mobile Sensing and Robotics - Geodesy - 01 - Mobile Laser Scanning 13

Page 14: MSC GEODETIC ENGINEERING MSR-02: ADVANCED TECHNIQUES …

CHAPTER 1: MOBILE LASER SCANNING CONTENT

• Review of involved coordinate systems /frames

• Derivation of detailed georeferencing equation for the example of mobile laser scanning

Klingbeil: Advanced Techniques for Mobile Sensing and Robotics - Geodesy - 01 - Mobile Laser Scanning

Attention: Usage of „frame“ and „coordinate system“ equivalent in this lecture

14

Page 15: MSC GEODETIC ENGINEERING MSR-02: ADVANCED TECHNIQUES …

SENSOR FRAMELASER SCANNER

• Frame, which is fixed to the sensor and in which theobservations are given

Klingbeil: Advanced Techniques for Mobile Sensing and Robotics - Geodesy - 01 - Mobile Laser Scanning 15

Page 16: MSC GEODETIC ENGINEERING MSR-02: ADVANCED TECHNIQUES …

SENSOR FRAMELASER SCANNER

Klingbeil: Advanced Techniques for Mobile Sensing and Robotics - Geodesy - 01 - Mobile Laser Scanning

P•

••

z

y

x

b d

a

s

s

s

x d sin b sin ay d sin b cos az d cos b

⋅ ⋅ = ⋅ ⋅ ⋅

( )( )

2 2 2s s s

s

s s

d x y zb arccos z da arctan y x

+ + =

Slide by C.Holst

Cartesian Coordinates Polar Coordinates

16

Page 17: MSC GEODETIC ENGINEERING MSR-02: ADVANCED TECHNIQUES …

SENSOR FRAMEPROFILE SCANNER

Klingbeil: Advanced Techniques for Mobile Sensing and Robotics - Geodesy - 01 - Mobile Laser Scanning

Rotational mirror

Horizontal axis

17

Page 18: MSC GEODETIC ENGINEERING MSR-02: ADVANCED TECHNIQUES …

SENSOR FRAMEPROFILE SCANNER

• No rotation around the vertical axis (a=0)

Klingbeil: Advanced Techniques for Mobile Sensing and Robotics - Geodesy - 01 - Mobile Laser Scanning

s

s

s

x d sin b sin a 0y d sin b cos a d sin bz d cos b d cos b

⋅ ⋅ = ⋅ ⋅ = ⋅ ⋅ ⋅

18

Page 19: MSC GEODETIC ENGINEERING MSR-02: ADVANCED TECHNIQUES …

BODY/VEHICLE/PLATFORM FRAME

• Frame which is fixed to themoving platform

• Usually the origin and the axisof this system are known in some ‚world frame‘ (see later)

• Usually the body frame is not the same as the sensor frame

Klingbeil: Advanced Techniques for Mobile Sensing and Robotics - Geodesy - 01 - Mobile Laser Scanning

Matlab Autonomous Driving Toolbox

19

Page 20: MSC GEODETIC ENGINEERING MSR-02: ADVANCED TECHNIQUES …

BODY FRAMEKINEMATIC LASER SCANNING

Klingbeil: Advanced Techniques for Mobile Sensing and Robotics - Geodesy - 01 - Mobile Laser Scanning

Boresight angles

Lever arm20

Page 21: MSC GEODETIC ENGINEERING MSR-02: ADVANCED TECHNIQUES …

SYSTEM CALIBRATION

• System Calibration: Determination of thetransformation (lever arm and boresight angles) betweensensor frame and body/platform/vehicle frame

Chapter System Calibration

Klingbeil: Advanced Techniques for Mobile Sensing and Robotics - Geodesy - 01 - Mobile Laser Scanning 21

Page 22: MSC GEODETIC ENGINEERING MSR-02: ADVANCED TECHNIQUES …

EXAMPLE AERIAL IMAGING

Klingbeil: Advanced Techniques for Mobile Sensing and Robotics - Geodesy - 01 - Mobile Laser Scanning

From: Chiang, K.-W.; Tsai, M.-L.; Naser, E.-S.; Habib, A.; Chu, C.-H. New Calibration Method Using Low Cost MEM IMUs to Verify the Performance of UAV-Borne MMS Payloads. Sensors 2015, 15, 6560-6585.

22

Page 23: MSC GEODETIC ENGINEERING MSR-02: ADVANCED TECHNIQUES …

BODY FRAME TO GLOBAL FRAME (TRAJECTORY)

Klingbeil: Advanced Techniques for Mobile Sensing and Robotics - Geodesy - 01 - Mobile Laser Scanning

Object point in bodyframe

Transformations from body frameto global frame Body is moving with respect to the global frame Transformation parameters are changing Trajectory estimation ( Trajectory Estimation)

23

Page 24: MSC GEODETIC ENGINEERING MSR-02: ADVANCED TECHNIQUES …

NAVIGATION FRAME

• Navigation frame:

Origin: origin of body frameAxis: North-East-Down (NED) orEast-North-Up (ENU)

• The Navigation frame is usually thereference frame for attitudes

Klingbeil: Advanced Techniques for Mobile Sensing and Robotics - Geodesy - 01 - Mobile Laser Scanning

Rotation from body to navigation frame, parametrized by 3 angles

24

Page 25: MSC GEODETIC ENGINEERING MSR-02: ADVANCED TECHNIQUES …

NAVIGATION FRAME

• Euler angles

oRoll: (Phi)

oPitch: (Theta)

oYaw: (Psi), also called heading

Klingbeil: Advanced Techniques for Mobile Sensing and Robotics - Geodesy - 01 - Mobile Laser Scanning

Wikipedia

Direction Cosine Matrix

Euler Angles rotate from Navigation to body frame

25

Page 26: MSC GEODETIC ENGINEERING MSR-02: ADVANCED TECHNIQUES …

NAVIGATION/BODY FRAME

Klingbeil: Advanced Techniques for Mobile Sensing and Robotics - Geodesy - 01 - Mobile Laser Scanning

GROUND BASED VEHICLES

n-frame: East-North-Up b-frame: forward-left-upHeading towards North: Phi = Yaw = Heading = 90°

Wikipedia Navigation frame

𝐱𝐱𝑏𝑏𝐲𝐲𝑏𝑏

Yaw = 315°

𝐱𝐱𝑏𝑏

Yaw = 45°

𝐲𝐲𝑏𝑏

26

Page 27: MSC GEODETIC ENGINEERING MSR-02: ADVANCED TECHNIQUES …

NAVIGATION/BODY FRAME

Klingbeil: Advanced Techniques for Mobile Sensing and Robotics - Geodesy - 01 - Mobile Laser Scanning

AERIAL VEHICLES

n-frame: North-East-Down b-frame: forward-right-downHeading towards East: Phi = Yaw = Heading = 90°

Wikipedia Navigation frame

27

Page 28: MSC GEODETIC ENGINEERING MSR-02: ADVANCED TECHNIQUES …

NAVIGATION FRAME TO EARTH FRAME

Klingbeil: Advanced Techniques for Mobile Sensing and Robotics - Geodesy - 01 - Mobile Laser Scanning

Latitude L Longitude B

Does not need to be calculatedevery time within a local area. Only Every 100-200m

28

Page 29: MSC GEODETIC ENGINEERING MSR-02: ADVANCED TECHNIQUES …

EARTH FRAME COORDINATES

Klingbeil: Advanced Techniques for Mobile Sensing and Robotics - Geodesy - 01 - Mobile Laser Scanning

• ECEF (Earth Centred Earth Fixed)Xe, Ye, Ze

cartesian, but not withreference to the Earth surface, good for calculations

• Geodetic /ellipsoidalB, L, h useful on a global scale,reference surface is the ellipsoid, not cartesian,need information about ellipsoid

Hofmann-Wellenhof et al. (2008), Fig.8.1

L

B

longitude

latitude

Ellipsoidicheight

Greenwich meridianL = 0

29

Page 30: MSC GEODETIC ENGINEERING MSR-02: ADVANCED TECHNIQUES …

*CONVERSION TO ELLIPSOIDAL COORDINATES

• Ellipsoidal coordinates are easier to interpret on earth• Ellipsoidal coordinates need the definition of an reference ellipsoid (e.g. GRS80,

WGS84, Bessel)• 𝜆𝜆… longitude, 𝜑𝜑… latitude, ℎ… ellipsoidal height

• 𝝀𝝀,𝝋𝝋,𝒉𝒉 ⇒ 𝑿𝑿,𝒀𝒀,𝒁𝒁

𝑋𝑋𝑌𝑌𝑍𝑍

=

(𝑁𝑁(𝜑𝜑) + ℎ) � cos𝜑𝜑 � cos 𝜆𝜆(𝑁𝑁(𝜑𝜑) + ℎ) � cos𝜑𝜑 � sin 𝜆𝜆𝑏𝑏2

𝑎𝑎2 𝑁𝑁(𝜑𝜑) + ℎ � sin𝜑𝜑

𝑁𝑁(𝜑𝜑) =𝑎𝑎2

𝑎𝑎2 � cos2 𝜑𝜑 + 𝑏𝑏2 � sin2 𝜑𝜑… transverse radius of curvature

Klingbeil: Advanced Techniques for Mobile Sensing and Robotics - Geodesy - 01 - Mobile Laser Scanning

Hofmann-Wellenhof et al. (2008), Fig.8.1

Slide by C.Holst

30

Page 31: MSC GEODETIC ENGINEERING MSR-02: ADVANCED TECHNIQUES …

*CONVERSION TO ELLIPSOIDAL COORDINATES

• Ellipsoidal coordinates are easier to interpret on earth• Ellipsoidal coordinates need the definition of an reference ellipsoid (e.g. GRS80,

WGS84, Bessel)• 𝜆𝜆… longitude, 𝜑𝜑… latitude, ℎ… ellipsoidal height

• 𝑿𝑿,𝒀𝒀,𝒁𝒁 ⇒ 𝝀𝝀,𝝋𝝋,𝒉𝒉

𝜑𝜑𝜆𝜆ℎ

=

tan−1𝑍𝑍

𝑋𝑋2 + 𝑌𝑌2� 1 −

𝑎𝑎2 − 𝑏𝑏2

𝑎𝑎2�

𝑁𝑁(𝜑𝜑)𝑁𝑁(𝜑𝜑) + ℎ

−1

tan−1𝑌𝑌𝑋𝑋

𝑋𝑋2 + 𝑌𝑌2

cos𝜑𝜑− 𝑁𝑁(𝜑𝜑)

• Iterate: 𝑁𝑁(𝜑𝜑) = 𝑎𝑎2

𝑎𝑎2�𝑐𝑐𝑐𝑐𝑐𝑐2 𝜑𝜑+𝑏𝑏2�𝑐𝑐𝑠𝑠𝑠𝑠2 𝜑𝜑

Klingbeil: Advanced Techniques for Mobile Sensing and Robotics - Geodesy - 01 - Mobile Laser Scanning

Hofmann-Wellenhof et al. (2008), Fig.8.1

Slide by C.Holst

31

Page 32: MSC GEODETIC ENGINEERING MSR-02: ADVANCED TECHNIQUES …

*REFERENCE ELLIPSOIDS

• A reference ellipsoid has to be definied in combination with a reference frame

• 𝑒𝑒2 = 𝑎𝑎2−𝑏𝑏2

𝑎𝑎2; 𝑓𝑓 = 𝑎𝑎−𝑏𝑏

𝑎𝑎• e... eccentricity

• f… flattening

• a… semi-major axis

• b… semi-minor axis

Klingbeil: Advanced Techniques for Mobile Sensing and Robotics - Geodesy - 01 - Mobile Laser Scanning

a 1/fWGS84 6378137.000 298.25722356300GRS80 6378137.000 298.25722210088Bessel 6377387.155 299.15281285000PZ90.11 6378136.000 298.25783930300

Misra und Enge (2001), Fig. 3.3

Slide by C.Holst

32

Page 33: MSC GEODETIC ENGINEERING MSR-02: ADVANCED TECHNIQUES …

*EARTH FRAME COORDINATES

Klingbeil: Advanced Techniques for Mobile Sensing and Robotics - Geodesy - 01 - Mobile Laser Scanning

• ECEF (Earth Centred Earth Fixed)Xe, Ye, Ze

cartesian, but not withreference to the Earth surface, good for calculations

• Geodetic /ellipsoidalB, L, h useful on a global scale,reference surface is the ellipsoid, not cartesian,need information about ellipsoid

Hofmann-Wellenhof et al. (2008), Fig.8.1

L

B

longitude

latitude

Ellipsoidicheight

Greenwich meridianL = 0

33

Page 34: MSC GEODETIC ENGINEERING MSR-02: ADVANCED TECHNIQUES …

EARTH FRAME COORDINATES

• Wanted:

oMetric coordinates (no longitude/latitude)

oLevelled local reference plane

oSeparation of 2D-positions and heights

o Intuitive ‚coordinates‘ (a map plus heights)

Klingbeil: Advanced Techniques for Mobile Sensing and Robotics - Geodesy - 01 - Mobile Laser Scanning

http://libguides.library.arizona.edu/GIS/about-gis

34

Page 35: MSC GEODETIC ENGINEERING MSR-02: ADVANCED TECHNIQUES …

HOW TO FLATEN THE EARTH?

Projection of 3D coordinates in 2D plane =>

Not applicable without distortion

Klingbeil: Advanced Techniques for Mobile Sensing and Robotics - Geodesy - 01 - Mobile Laser Scanning

Slide by C.Holst

35

Page 36: MSC GEODETIC ENGINEERING MSR-02: ADVANCED TECHNIQUES …

REALIZATION OF MAP PROJECTION

Klingbeil: Advanced Techniques for Mobile Sensing and Robotics - Geodesy - 01 - Mobile Laser Scanning

Above: Gauß-Krüger => tangential Below: Universal transveral mercator (UTM) => intersectional

Slide by C.Holst

36

Page 37: MSC GEODETIC ENGINEERING MSR-02: ADVANCED TECHNIQUES …

UTM PROJECTION: SCALE

Klingbeil: Advanced Techniques for Mobile Sensing and Robotics - Geodesy - 01 - Mobile Laser Scanning

Source: Kavanagh(2014)

Slide by C.Holst

37

Page 38: MSC GEODETIC ENGINEERING MSR-02: ADVANCED TECHNIQUES …

DISTORTION DUE TO PROJECTION

Klingbeil: Advanced Techniques for Mobile Sensing and Robotics - Geodesy - 01 - Mobile Laser Scanning

Offset to central meridian [km]

Offset to central meridian[km]

Distortion in distance [mm] (distance 100 m, height = 0 m above GRS80 ellipsoid)

0 - 40100 - 28180 0200 + 9

Source: Benning (2009)

Slide by C.Holst

38

Page 39: MSC GEODETIC ENGINEERING MSR-02: ADVANCED TECHNIQUES …

UTM CHARACTERISTICS

• Zone is 6° wide

• Projection is isogonal / equal of angle

• Northing value of the equator: N = 0 m

• Easting value of each central meridian: E = 500‘000 m

• Scale factor at central meridian: 0.9996

• Zone numbering commences with 1 in the zone 180°W to 174°W and increases eastward to zone 60 at the zone 174°E to 180°E

• Projection limits of latitude 80°S to 80°N

Klingbeil: Advanced Techniques for Mobile Sensing and Robotics - Geodesy - 01 - Mobile Laser Scanning

N

E

0 Equator

Fact

or0,

9996

ca. 400 kmLatitudeca. 50°

Offset 500 km

East [m] 32 364939

North [m] 5621299

Slide by C.Holst

39

Page 40: MSC GEODETIC ENGINEERING MSR-02: ADVANCED TECHNIQUES …

WRAP UP – GEOREFERENCING EQUATION

Klingbeil: Advanced Techniques for Mobile Sensing and Robotics - Geodesy - 01 - Mobile Laser Scanning

Sensor observations of an object point

System calibrationusually constantover time

Trajectory parameters(position and orientation)

Global coordinates of an object point

Transformation to „useful“ coordinates(e.g. UTM)

optional

East

North

40

Page 41: MSC GEODETIC ENGINEERING MSR-02: ADVANCED TECHNIQUES …

TRAJECTORY DATA ARE GIVEN IN UTM COORDINATES?

• Navigation frame and global frame already have the same axis directions global frame serves as reference frame for roll, pitch yaw Navigation to Earth Rotation is not necessary

• Distance measurements of the scanner has to be scaledalong their East component (according to the distance to thecentral meridian)

Klingbeil: Advanced Techniques for Mobile Sensing and Robotics - Geodesy - 01 - Mobile Laser Scanning 41

Page 42: MSC GEODETIC ENGINEERING MSR-02: ADVANCED TECHNIQUES …

WHAT YOU HAVE LEARNED TODAY

• What is mobile mapping, especially mobile laserscanning

• How is the transformation chain from a localsensor observation in the sensors coordinatesystem to a global coordinate system(georeferencing equation)

• What coordinates systems are involved?

• What parameters are needed in this chain and where do they come from?

Klingbeil: Advanced Techniques for Mobile Sensing and Robotics - Geodesy - 01 - Mobile Laser Scanning 42

Page 43: MSC GEODETIC ENGINEERING MSR-02: ADVANCED TECHNIQUES …

WHAT YOU WILL LEARN IN THE REST OF THE COURSE

• How are trajectory parameters calculated and howaccurate are they (repetition + smoothing and accuracies)?

• How are system calibration parameters derived?

• How can sensors can be synchronized?

• How are point clouds derived from images?

• How accurate are point clouds?

• How can you do deformation analysis with pointclouds?

Klingbeil: Advanced Techniques for Mobile Sensing and Robotics - Geodesy - 01 - Mobile Laser Scanning 43

Page 44: MSC GEODETIC ENGINEERING MSR-02: ADVANCED TECHNIQUES …

THANKS