cwin16 tls cnes-realite_augmentee_eng_v1 2

How can Augmented Reality

accelerate and secure the assembly

of satellitesToulouse, 29/09/2016, V. DENYS

How can Augmented Reality accelerate and secure the assembly of satellites | 2016, 29th September

Copyright © 2016 Capgemini and Sogeti. All rights reserved. 2

Table of Contents

Start with some definitions

Context of the project

Approach and organization

Characterization of Augmented Reality

solution

Prototyping and comparison

Vuforia solution

Diota solution

Outputs and conclusion



Virtual EnvironmentReal Environment Augmented Reality Virtual Reality

Virtual and Augmented Reality

From real environment to virtual world

Mixed Reality Continuum



Project Context

Today there is a concern of process maturity between

the engineering and manufacturing teams working on the

project TARANIS

Mainly manual processes

Lots of paper documents

Loss of continuity between As

Design and As Built

Today the Assembly Integration Testing (AIT) teams seek to demonstrate the

relevance of RA techniques to optimize and secure the work of technicians and

operators.

Taranis is the first satellite dedicated to the

observation of lightning that explode between

20 and 100 km altitude.

Ready to be launched in 2018, is eagerly

awaited by scientists around the world



Project organization – Overall approach

Technological State of the art

Business needs and business context

AR Solution characterization

Prototyping and benchmark

Advanced prototyping

Iterative and collaborative approach Interviews

Co-design workshops

Progress meetings: visibility, anticipation, adaptation



Business context

CNES always works on a prototype (= one specimen) therefore material

evolution is permanent.

They don’t work on an assembly line with an established configuration.

The specimen will have its configuration evolving through time:

% of integrated equipment

Opened or closed panels configuration state

Integration or not of ground systems, etc.



Use Cases identified

Tasks can be eligible to the use of augmented reality, with a measurable ROI:

• Quality control in the integration phase

• Help in finding the location of a fixture, reservations and

fastening elements during an assembly task

Immediate benefits identified :

• Securing and optimizing task

• Securing associated schedules

• Facilitation and simplification of the task



Technical challenge

Determine the best physical device that will support augmented reality and fit the context of

the AIT teams in their work environment (a camera, a tablet, connected glasses, the

combination of multiple physical devices, etc.)

The technological solution which is based on augmented reality, whose entry point is the digital

model.



State of the art of physical devices

Comparison of physical devices

The retinal devices are the most effective but the technology is not mature enough

Head-up devices have some issues for industrial use (autonomy, field of vision,

etc.)

The devices carried by hand are the most suitable and most efficient in industry

Head-Up display

Worn displays

Fixed displays

Display worn

on the head

Pico projector

Object of

interest

Retinal display

Display worn by hand

Worn pico projector

Fixed display

Projector

User



Characterization of the solution: chosen solutionsP

hysic

al d

evic

e •Diota Surface Pro 4 customized Tablet

•HD Camera with ergonomic handle

•WireLess Display Adapter

Te

chn

olo

gic

al so

lution •Unity 3D

•Diota technology (Diotaplayer, DiotaStudio)

Diota Solution Vuforia Solution

Ph

ysic

al d

evic

e • Android Sony Xperia Z3 Tablet

• Integrated HD camera

• WireLessDisplay Adapter

Te

chn

olo

gic

al so

lution • Unity 3D

• VuforiaFramework

• SLAM Constraint (Simultaneous Localization And

Mapping)

• No marker (direct object recognition)

• Need for an initialization phase

• Hybrid method

• Marker for detection

• 3D map dynamic creation after detection (=

no need to always see the marker)



REX Solution Vuforia

Issues related to the definition and positioning of the marker:

Positioning on the frame: need to have the frame modeled into CAD

Issues with shadows

Gaps between CAD and real position of the opened panels

Shadows



REX Solution Vuforia

Issues related to the definition and positioning of the marker:

Positioning small markers directly on the panels

Tape thickness Small marker on the panel

1cm drift

Reality

Augmentation

of reality

Substantial efforts to characterize industrialized solution based on markers that can easily adapt to

different configurations and different satellites;We couldn’t go through all tests cases



REX Solution Diota

Owner solution

Need to learn about using the development

tools and the specific environment

Sometimes tedious initialization phase,

between 2 and 5 min

V1 of the product

Unable to select certain elements in touch

mode: Need for a tree product

Conformity Check native module unsuited to

AIT context

Need to create and configure JobCards

(requires knowing how to use Unity3D)

Need to buy licenses



REX Diota Solution

We could run through all the tests cases

We could easily find a workaround regarding the issue with panels not being exactly

90° opened

Example with a screw:

CAD Reality Augmented reality



REX Diota Solution

Need to develop a specific add-on to meet business needs

Product tree

Chose item to display

Help localization

tools

Quality check:

Chose

configuration,

state,

Technical issue

Choose

transparency

Change item color

Chose depth mask



Solutions comparison synthesis

Covered

Partially

covered

Not covered

Today Augmented Reality technology is quite mature.

The question is not whether it works, but how can I instantiate it into

my Information System and what is the added value (ROI)?



Outputs and conclusion

No universal and out-of-the-box solution in terms of physical device and technology

Configuration and settings needed (it’s not magic )

Very strong link with the environment

Brightness

Shapes and sizes

Materials

Dimensions / Accessibility

CAD Adequacy vs real object

Constraints resulting from the business context

Need to have a representative environment to develop, ideally to be directly on site

next to the object of interest in the environment

Stakes related to User eXperience (UX)

Augmented reality can bring productivity gains, with

measurable ROI.

This is one brick of DIGITAL MANUFACTURING



Contact information

Vincent

DENYSArchitect/Project Manager

[email protected]

Capgemini109 avenue du Général

Eisenhower 31000 Toulouse

Richard

BARRECommercial

[email protected]

Capgemini109 avenue du Général

Eisenhower 31000 Toulouse

mailto:[email protected]

mailto:[email protected]

www.capgemini.com

The information contained in this presentation is proprietary.

Copyright © 2016 Capgemini and Sogeti. All rights reserved.

Rightshore® is a trademark belonging to Capgemini.

www.sogeti.com

About Capgemini and Sogeti

With more than 180,000 people in over 40 countries, Capgemini is a

global leader in consulting, technology and outsourcing services. The

Group reported 2015 global revenues of EUR 11.9 billion. Together

with its clients, Capgemini creates and delivers business, technology

and digital solutions that fit their needs, enabling them to achieve

innovation and competitiveness. A deeply multicultural organization,

Capgemini has developed its own way of working, the Collaborative

Business Experience™, and draws on Rightshore®, its worldwide

delivery model.

Sogeti is a leading provider of technology and software testing,

specializing in Application, Infrastructure and Engineering

Services. Sogeti offers cutting-edge solutions around Testing,

Business Intelligence & Analytics, Mobile, Cloud and Cyber

Security. Sogeti brings together more than 23,000 professionals in

15 countries and has a strong local presence in over 100 locations

in Europe, USA and India. Sogeti is a wholly-owned subsidiary of

Cap Gemini S.A., listed on the Paris Stock Exchange.

http://www.capgemini.com/

http://www.sogeti.com/

http://www.capgemini.com/about/how-we-work/the-collaborative-business-experiencetm


http://www.capgemini.com/about/how-we-work/rightshorer

http://www.capgemini.com/about/how-we-work/rightshorer



cwin16 tls cnes-realite_augmentee_eng_v1 2

Presentations & Public Speaking