SMB

Use of MS Hololens to survey and visualize buried networks

22-Sept-17 2Y.Robert / SMB-SE - EDMS: 1846530

IT Lightning Talks #14

SMB

22-Sept-17 3

CTI Project CTI : Commission pour la Technologie et l’Innovation is financing 50 % of the project

Started : May 2017

Duration : 24 months

Budget :

CHF 475K UNIGE

(financed by CTI)

CHF 475K ARXIT SA

PROBLEMS

Surveying tasks require complex equipment and specialized personnel. Before excavation work, it is difficult to accurately locate the existinginfrastructure.

SOLUTION

Execute surveying tasks and visualize buriedinfrastructure (ex. pipes) by using a head-worn holographic computer.

SMB

22-Sept-17 4

Scheduled timeline

SMBMS Hololens device

22-Sept-17 5

▪H o l o g raphic computer running Windows 10

▪V1 Announced in 2015, V2 scheduled in 2019

▪S e l f-contained, head-worn

▪M u l t i p l e sensors, advanced optics, customchips

▪D i splays mixed reality (holograms)

▪L e arns about the environment (spatialmapping)

▪Recognizes gestures, voice

▪C o st $3000 - $5000 per unit

SMBMS Hololens device

22-Sept-17 6

The sensors track where the wearerand its hands are and adjust the display in order to interact

SMBMapping with MS Hololens

22-Sept-17 7

Scanning with Hololens

Spatial mapping provides a detailed representation of

real-world surfaces in the environment around the HoloLens

SMBGeneral principle

22-Sept-17 8

1- Geolocation with DGPS device or by mapping Hololens coordinates to reference points

2- Scan with Hololens

3- Automatic recognition of pipes and drawing into the geographic database

4- 3D Visualisation with augmented reality of buried networks + additional informations (diameter, voltage,…)

SMBOTHER FIELDS OF APPLICATION

30-juin-17 9

Marketing & Sales

Quality Control

Assembly Line

And many more…

Product Design Education

Architecture Remote Services Research

Games & Entertainment Semi-Virtual Construction

SMB

22-Sept-17 10

Conclusions

MS Hololens has the advantage to combine Scan of theenvironment and augmented reality.

The system is compact and easy to use for everyone.

It now looks mature enough to start building prototypes ofapplications.

Augmented reality has a potential use in manyprofessional fields.

SMB

22-Sept-17 11

Questions

Thanks for your attention…!!!

Any Question ?

SMBForeseen Architecture:

22-Sept-17 13

MRC re cordings

Visualization AppUWP / Unity

SMBMapping with MS Hololens

22-Sept-17 14

MAPPING TECHNOLOGY

Spatial mapping provides a 3D triangle

meshes representation of real-world

surfaces around HoloLens, by using

depth sensing cameras.

Generated spatial meshes are commonly

used for occlusion and physics, and can

be stored and reworked in a 3D

modeling software.

We can use spatial meshes to calculate

coordinates of the point where the user is

looking (gaze cursor), which is important

for geolocation.

▪ Spatial mapping on HoloLens

is NOT a high-precision tool

▪ Camera range is limited to 3.1m

▪ Generated meshes may be

inconsistent (holes, deformations)

▪ It may be difficult to understand

raw 3D triangle meshes off-site

LIMITATIONS