the new iso standard for a field-testing procedure of ......π₯5 beam tilt component along n...
TRANSCRIPT
β¦
The New ISO Standard for a Field-Testing Procedure of Terrestrial Laser Scanners and its
Practical Performance
Presented at th
e FIG W
orking Week 2020,
10-14 May 2020 in
Amsterdam, th
e Netherlands
The New ISO Standard for a Field-Testing Procedure of Terrestrial Laser Scanners and its Practical Performance
Ingo Neumann, Franziska Altemeier, Hamza Alkhatib (Leibniz University Hannover, Germany)
Bianca Gordon (Leica Geosystems AG, Heerbrugg, Switzerland)
Altemeier (2018)
2
General information
Focus of this collection of ideas / proposals
β’ Simple, fast, reliable checking of the instrument specifications
β’ Within a few hours
β’ (Measurement) Uncertainty
β’ Detection of non acceptable (systematic) deviations
β’ The procedure(s) must be independent (manufacturer)
β’ No laboratory procedures
β’ No calibration
β’ Methods which fit into the testing philosophy of IS0 17123 (DIN 18723)
β’ Simplified and full test procedure
β’ Independent procedure with standard equipment
3
Agenda
1. General Information
2. Test procedure
i. Simplified Test Procedure(s)
ii. Full Test Procedure(s)
3. Sensitivity of the test procedure(s)
4. Measurement uncertainty (thresholds)
5. Conclusions
4
General information
2011 Proposal for a full/extended test procedure (Feldmann, Petersen, Staiger)
Reference distances (coordinates) for full procedure to consider the scale of the TLS measurements.
2012 - 2014: DVW - technical Bulletin for a test procedure: (F. Neitzel; B. Gordon; D. Wujanz; WG 3 of DVW)
mainly following the ideas of Heister / Staiger (2009)
2014 - 2018 ISO WIP for a simple and full test procedure: (17123-9; under the lead from the DIN Working group)
mainly following the ideas of the DVW - technical Bulletin
Future Extend and/or translate the ISO 17123-9 for DIN 18723
5
General information
6
DVW Bulletin
https://www.dvw.de/veroeffentlichungen/merkblaetterβ TLS
General information
7
ISO 17123-9Optics and optical instruments β Field procedures for testing geodetic and surveying instruments
Part 9: Terrestrial laser scanners
Project leader: Ingo Neumann (DIN, Germany)
https://www.iso.org/standard/68382.html
General information
Overview on the actual test procedure(s)
8
Procedure DVW BulletinISO-Group
(ISO 17123-9)DIN Working Group
(DIN 18723)
Proposal ofFeldmann et al.
(2011)
Simple --- Yes Yes (Yes)
Full (Yes) Yes Yes Yes
Extended(reference distances)
---- --- Under discussionYes (with fix
installed targets)
MeasurementUncertainty
Partly Yes Yes partly
Translation
Simple: Red / Green decision without statistical treatment Full: Repeated observations with statistical checking/judgement of the resultsExtended: Introduction of reference distances
fix installation
Agenda
1. General Information
2. Test procedure
i. Simplified Test Procedure(s)
ii. Full Test Procedure(s)
3. Sensitivity of the test procedure(s)
4. Measurement uncertainty (thresholds)
5. Conclusions
9
ISO 17123-9: Configuration of the βsimplified and full test procedureβ
ISO 17123-9
Test procedure
10
- 4 Targets (Tj)- 2 Instrument stations (Si)
- 1 measurement on Si (simple procedure)
- 3 independent measurement on Si
βAll 4 targets are determined 3 x 2 (full procedure)
ISO 17123-9
ISO 17123-9: Configuration of the βsimplified and full test procedureβ
Test procedure
11
Altemeier (2018)
ISO 17123-9
ISO 17123-9
Test procedure
ISO 17123-9: Configuration of the βsimplified and full test procedureβ
12
Altemeier (2018)
Station 1 (S1) Station 2 (S2)
(T1 β T2)(1) Ξ1 (T1 β T2)(2)
2 x additional constant
(T1 β T4)(1) Ξ3 (T1 β T4)(2)
(T2 β T3)(1) Ξ4 (T2 β T3)(2)
(T1 β T3)(1) Ξ2 (T1 β T3)(2)
(T2 β T4)(1) Ξ5 (T2 β T4)(2)
(T3 β T4)(1) Ξ6 (T3 β T4)(2)
Most important for angle errors
Test procedure β summary
13ISO 17123-9
SIM
PLE
FULL
Agenda
1. General Information
2. Test procedure
i. Simplified Test Procedure(s)
ii. Full Test Procedure(s)
3. Sensitivity of the test procedure(s)
4. Measurement uncertainty (thresholds)
5. Conclusions
14
Simulation of most important calibration parameters (Altemeier, 2018)Geometric model according to Muralikrishnan et al. (2015) (selected parameters)
Sensitivity of the procedure
Parameter Description Influence on
π₯4 Vertical index offset Ξππ
π₯5π Beam tilt component along n Ξπ»π, Ξππ
π₯5π§ Beam tilt component along z Ξπ»π, Ξππ
π₯6 Mirror tilt Ξπ»π
π₯7 Transit tilt Ξπ»π
π₯10 Zero-offset (Bird-bath error) Ξπ π
15
π₯4 π₯5 π₯6
Muralikrishnan et al. (2015)
Sensitivity of the procedure
Simulation of most important calibration parameters (Altemeier, 2018)
16
Selection of the simulationparameters
Simulation of reference values
Adding the systematic error
Randomize the observations
Apply testing procedureISO 17123-9
β’ Selected instrumentβ’ Configuration of the test fieldβ’ Magnitude of the systematic deviations (ππ, πππ, πππ, ππ, ππ, πππ)
β’ Polar elements: Distance (πΉ), Horizontal direction (π―), Vertical angle (π½)
β’ Geometric model after Muralikrishnan et al. (2015): π«πΉπ,ππ―π,ππ½π
β’ Generate random deviations (according to the instruments data sheet)β’ β 3 observation sets: measurement values πΉπ,π―π,π½π
β’ Transformation to the cartesian coordinates of the target centers: πΏ, π, π
β’ Calculation and testing of the distance deviations: ΰ΄₯ππ,π > πΌπ/ π
Analysis of 10000 Monte-Carlo-Runs
Sensitivity of the procedure
Simulation of most important calibration parameters (Altemeier, 2018)
β’ Influence of the measurement configuration
β’ Variation of the test field size ππβ’ Variation of the height of target T4
β’ Violation of the test field configuration (X and Y)
β’ Deviation of other criteria (Perpendicularity, 5 m, β¦)
β’ Influence of the systematic deviations under
β’ Variation of individual parameters
β’ Combination of minimum two parameters
β’ Determination of the threshold for the judgement of the TLS
17
See next slides
See next slides
Small influence
Small influence
Not treated in this presentation
Sensitivity of the procedure
Simulation of most important calibration parameters (Altemeier, 2018)Influence of the measurement configuration
18
Altemeier (2018)
Dis
tan
ce d
iffe
ren
ce [
mm
]
permissible deviation
threshold: 4.62 mm
x4 [mgon] (vertical index offset)
Sensitivity of the procedure
Simulation of most important calibration parameters (Altemeier, 2018)Influence of the measurement configuration
19
Altemeier (2018)
Dis
tan
ce d
iffe
ren
ce [
mm
]
permissible deviation
threshold: 4.62 mm
x4 [mgon] (vertical index offset)
π₯4 π₯5π π₯5π§ π₯6 π₯7 π₯10T1-T2 - - - - - +
T1-T3 - - - - - +
T1-T4 - + + - - +
T2-T3 - - - - - +
T2-T4 - + - - - +
T3-T4 + + + + - +
legend: Influence of the parameters: - no / + significant / + dominant
Sensitivity of the procedure
Simulation of most important calibration parameters (Altemeier, 2018)Identification of sensitive distances
20
Negligence of the testfield configuration (X,Y):β’ less sensitiveβ’ less specificβ’ π₯10 not influenced
T4 height dependent
Sensitivity of the procedure
Simulation of most important calibration parameters (Altemeier, 2018)Combination of parameters
e.g. parameter π₯4 with π₯7:
21
Result:
β’ Compensation/ amplification of the influences
β’ Sensitivity of distance differences changes
β’ Depending on the magnitude and sign of the parameters
β Inference difficult
Percentageinstrument βokβ
Sensitivity of the procedure
Empiricial evaluation and validation of the results
Evaluation of real measurements (Leica Geosystems AG)
β’ Measurements according to ISO 17123-9 (full test procedure)
β’ Systematically manipulated calibration parameters (π₯4, π₯5π, π₯5π§, π₯6, π₯7)
Results:
β’ Sensitivity proofed
β’ Inference on manipulated parameterspossible (for individual parameters)
22
Altemeier (2018)
Agenda
1. General Information
2. Test procedure
i. Simplified Test Procedure(s)
ii. Full Test Procedure(s)
3. Sensitivity of the test procedure(s)
4. Measurement uncertainty (thresholds)
5. Conclusions
23
(Measurement) uncertainty
Quantification for the measurement uncertainty (MU)
Guide to the Expression of Uncertainty in Measurements (GUM)
β’ ISO [1995]: Evaluation of Measurement Data - Guide to the Expression of Uncertainty in Measurement (GUM). Eds: BIPM, IEC, IFCC, ILAC, ISO, IUPAC, IUPAP and OIML.
β’ Detection of all significant influence factors on the MU is requested
β’ For random, systematic (and non modelled) effects
β’ Consideration of type βAβ and type βBβ uncertainties
Thresholds for the comparison of the distance differences
β’ A) Based on manufacturer / project requirements
β’ B) Based on the measurements itself (only if no other information is available)
β’ C) Combination of B) and numerical calculation of MU
24
Quantification for the measurement uncertainty
Characteristics of type βAβ and type βBβ uncertainties
β’ Type A:
β’ Uncertainties that can be obtained from repeated measurements with the aid of statistical methods
β’ Approximation of the distribution
β’ Often a simple mean and the standard deviation of a measurand
β’ Type B:
β’ Uncertainty that is obtained by other methods (as statistical analysis)
β’ e.g. values from previous measurements, expert knowledge, manufacturer information, calibration certificates, books, β¦.
β’ The consideration of this type of uncertainty need a (very) good knowledge about the sensors and the underlying measurement process
(Measurement) uncertainty
25
π’ = π’π΄2 + π’π΅
2 Simple case: From manufacturer
Agenda
1. General Information
2. Test procedure
i. Simplified Test Procedure(s)
ii. Full Test Procedure(s)
3. Sensitivity of the test procedure(s)
4. Measurement uncertainty (thresholds)
5. Conclusions
26
Conclusions
β’ Summary
β’ Reversal of the burden of proof β high relevanceβ’ ISO 17123-9 is recommended (but DVW Bulletin still ok)
β’ DVW only uses 3 important distances as decision criterionβ’ DVW has not a detailed uncertainty treatment
β’ Very high sensitivity with respect to typical calibration modelsβ’ Very fast measurements and analysis procedure (2h β 3h)
β’ Further comments:
β’ DIN and ISO will maybe have different content of the documentsβ difference lies mainly only in the βextendedβ version
β’ The collaboration between the different institutions is beneficial
β’ DVW Bulletin will most probably be updated
27Thanks a lot for the attention and contributions!
References
β’ Altemeier, F. (2018). SensitivitΓ€tsanalyse zur geometrischen Untersuchung des Unsicherheitsmodells von TLS-Messungen. Master thesis, Leibniz UniversitΓ€t Hannover, GeodΓ€tisches Institut, unpublished.
β’ Feldmann, E., Petersen, M., Staiger, R. (2011). Erste Erfahrungen mit FeldprΓΌfverfahren fΓΌr terrestrische Laserscanner. In Terrestrisches Laserscanning β TLS 2011 mit TLS-Challenge. Schriftenreihe des DVW, WiΓner-Verlag, Augsburg (66), pp. 77-94.
β’ ISO 17123-9 (2018). Optics and optical instruments β Field procedures for testing geodetic and surveying instruments β Part 9: Terrestrial laser scanners. β International Organization for Standardization. https://www.iso.org/standard/68382.html.
β’ Muralikrishnan, B., Ferrucci, M., Sawyer, D., Gerner, G., Lee, V., Blackburn, C., Phillips, S., Petrov, P. ; Yakovlev, Y., Astrelin, A., Milligan, S., Palmateer, J. (2015). Volumetric Performance Evaluation of a Laser Scanner Based on Geometric Error Model. In Precision Engineering β Journal of the International Societies for Precision Engineering and Nanotechnology (40), pp. 139β150.
β’ Neitzel, F., Gordon, B., Wujanz, D. (2014). Verfahren zur standardisierten ΓberprΓΌfung von terrestrischen Laserscannern (TLS). In DVW-Merkblatt 7-2014. https://www.dvw.de/veroeffentlichungen/merkblaetter.
β’ Staiger, R., Heister, H. (2013). Praxisnahe PrΓΌfung terrestrischer Laserscanner. In QualitΓ€tssicherung geodΓ€tischer Mess- und Auswerteverfahren. Schriftenreihe des DVW, WiΓner-Verlag, Augsburg (71), pp. 65-88.
Prof. Dr.-Ing. Ingo Neumann
Geodetic Institute Leibniz University Hannover
Nienburger Str. 1
30167 Hannover, GERMANY
Tel. +49 5117622461
Email: [email protected]
Website: www.gih.uni-hannover.de
Dr.-Ing. Hamza Alkhatib
Geodetic Institute Leibniz University Hannover
Nienburger Str. 1
30167 Hannover, GERMANY
Tel. +49 5117622464
Email: [email protected]
Website: www.gih.uni-hannover.de
Franziska Altemeier M.Sc.
Geodetic Institute Leibniz University Hannover
Nienburger Str. 1
30167 Hannover, GERMANY
Tel. +49 5117622468
Email: [email protected]
Website: www.gih.uni-hannover.de
Dr.-Ing. Bianca Gordon
Senior Systems Engineer
Leica Geosystems AG
Heinrich-Wild-Str.
9435 Heerbrugg, SWITZERLAND
Email: [email protected]
Website: https://leica-geosystems.com/
The New ISO Standard for a Field-Testing Procedure of Terrestrial Laser Scanners and its Practical Performance
Contacts
29