d2.2 market, innovation and aplicability watchaccept-project.com/downloadfiles/d2.2 - market,...

Assistant for Quality Check during Construction Execution

Processes for Energy-efficienT buildings

WP2 – Concepts, Requirements and Specification

D2.2 Market, Innovation and Applicability Watch

Deliverable Lead: EPI

Contributing Partners: ASC, CYPE, ANS, INGL, EJD, FER, IDS, IEC

Delivery Date: 06/2015

Dissemination Level: Public

Version: 1.0

The purpose of this deliverable is to identify the current state of the market, its challenges, opportunities and competing technologies and deliver an initial description of products in alignment with the ACCEPT vision. This definition will be used to specify the scope of the RTD and the goal of the prototypes and also to ensure that ACCEPT develops technical solutions and services that have high commercial exploitation potentials.

ACCEPT WP2 Public Market, Innovation and

Applicability Watch

D2.2 - Market, Innovation and Applicability

Watch Document Version: 1.0

Date: 2015-06-30

Status: For Approval Page: 2 / 106

http://www.accept-project.com/ Copyright © ACCEPT Project Consortium. All Rights Reserved. Grant Agreement No.: 636895

Deliverable Lead George Georgiou, EPI

Internal Reviewer 1 Michael Krummen, ASC

Internal Reviewer 2 Edward Godden, INGL

Type Deliverable

Work Package WP2: Concept, Requirements and Specification

ID D2.2: Market, Innovation and Applicability Watch

Due Date 30.06.2015

Delivery Date 30.06.2015

Status For Approval

Note

This deliverable is subject to final acceptance by the European Commission.

Disclaimer

The views represented in this document only reflect the views of the authors and not the views of the European Union. The European Union is not liable for any use that may be made of the information contained in this document.

Furthermore, the information is provided “as is” and no guarantee or warranty is given that the information is fit for any particular purpose. The user of the information uses it at its sole risk and liability.

Document Status


Applicability Watch



Date: 2015-06-30



Project Partners

ASC – Ascora GmbH, Germany

ANS – AnswareTech S.L., Spain

IDS – University of Liege, Belgium

EPI – EPITESSERA Architects, Cyprus

CYPE – CYPE SOFT, S.L., Spain

INGL – Ingleton Wood LLP, United Kingdom

FER – Ferrovial Agroman, Spain

TIE – TIE Nederland N.V., The Netherlands

EJD – Entreprises Jacques Delens S.A., Belgium

IBP – Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V., Germany

IEC – Fraunhofer Italia Research Konsortialgesellschaft mbH, Italy


Applicability Watch



Date: 2015-06-30



Executive Summary

This report is delivered in the context of WP2, Task 2.2 Market, Innovation and Applicability Watch and its purpose is to identify and provide an initial description of benchmarking existing as well as under development products, which are in alignment with the ACCEPT objectives. Existing approaches, innovations and research projects have been researched and analysed, in order to provide a holistic view of the target marketplace, the challenges, opportunities, the competitors and incumbents but also to identify potentials for cooperation and synergies with emerging technologies.

The Market, Innovation and Applicability Watch is foreseen as a continuous task throughout the whole duration of the project, consisting of three deliverables in total: D2.2, D2.3 and D2.4 which are due on months 6, 24 and 36 respectively. Since this is the first of the three, one of the chapters is dedicated to defining the monitoring strategy for ensuring that there is a structured way of feeding new information into the project. This information will relate to state of the art solutions, interesting R&D projects, emerging technologies and innovative approaches in the field that ACCEPT also aims. This will allow the project to react to market variations in order to keep in sync with the outside world and exploit new opportunities which may arise. Therefore, this task is not intended to be a one-off static plan but will be active throughout the project by detecting and reporting possible market opportunities and threats and will develop dynamically with incremental input, which will be included in the subsequent deliverables.

The remainder of the report concerns the description of state of the art products from the point of view of the partners. A total number of 60 products were rigorously analysed and the results are presented in the current document. These products are divided into three major categories, stemming from their current market status: Existing commercial products, Innovations and Applicability. The first category, Existing Commercial Products, includes augmented reality (AR) solutions, construction Quality Control (QC), Field Management (FM) applications, Smart Materials and, as the title suggests, is focused on benchmarking products that are already in the market. The second category, Innovations, includes research projects and emerging technologies in the relevant fields of AR and QC/FM with a broader view, not limited only to the construction sector. Finally, the third category is about solutions, products or concepts that had been developed through research projects with high impact expectations at the time, however did not have the anticipated success in the market.

Then a synoptic presentation of the results is created from the market monitoring, in the form of a Concept Functionalities Checklist, where the features of the most interesting existing applications are appraised against the anticipated functional requirements of ACCEPT. This exercise will help to identify weaknesses where ACCEPT may have stronger opportunities in providing a solution and prioritize the goals of the project. Moreover, it will help to create a set of criteria for evaluating and prioritizing the functional requirements coming from the user stories of T2.4. The results will then be used in the context of T2.5, Architecture Definition and Functional Specifications, in order to define a framework for the development of the global architecture of ACCEPT.


Applicability Watch



Date: 2015-06-30



Table of Contents

1 Introduction .................................................................................................................... 9 1.1 ACCEPT Project Overview .................................................................................... 9 1.2 Deliverable Purpose, Scope and Context .............................................................. 9 1.3 Document Status and Target Audience ............................................................... 10 1.4 Abbreviations and Glossary ................................................................................. 10

1.5 Document Structure ............................................................................................. 10 2 Market Watch Strategy ................................................................................................ 12 3 Market Environment ..................................................................................................... 14

3.1 Existing Commercial Products ............................................................................. 14 3.1.1 Augmented Reality ........................................................................................... 14

3.1.1.1 ODG R-6 Smart Glasses ......................................................................... 14 3.1.1.2 Qualcomm Vuforia ................................................................................... 16 3.1.1.3 APX Skylight ............................................................................................ 18

3.1.1.4 Epson Moverio BT200 ............................................................................. 19 3.1.1.5 NGRAIN ................................................................................................... 21 3.1.1.6 Sony SmartEyeglass ............................................................................... 22

3.1.1.7 Vuzix M100 .............................................................................................. 23 3.1.1.8 Soluis Immersive Domes ......................................................................... 25 3.1.1.9 Visuartech ................................................................................................ 26

3.1.1.10 AR-media ................................................................................................ 27

3.1.1.11 RAAMAC - HD4AR ................................................................................. 28 3.1.1.12 VTT ALVAR ............................................................................................ 29 3.1.1.13 Junaio AR Browser App .......................................................................... 31

3.1.1.14 MagicMeasure ........................................................................................ 33 3.1.2 Applications ...................................................................................................... 35

3.1.2.1 Autodesk BIM 360 Field ........................................................................... 35 3.1.2.2 Latista ...................................................................................................... 37 3.1.2.3 Aconex ..................................................................................................... 39

3.1.2.4 iSnag2 ..................................................................................................... 41

3.1.2.5 FieldLens ................................................................................................. 43 3.1.2.6 Spike ........................................................................................................ 45

3.1.2.7 FLIR One ................................................................................................. 46 3.1.2.8 BIManywhere ........................................................................................... 47

3.1.2.9 Ubimax xBuild .......................................................................................... 49 3.1.2.10 MagicPlan ............................................................................................... 50 3.1.2.11 Bentley-ProjectWise® ............................................................................. 51

3.1.2.12 Chapoo ................................................................................................... 52 3.1.2.13 Siri ........................................................................................................... 53 3.1.2.14 ARCHline ................................................................................................ 54 3.1.2.15 Rapiere ................................................................................................... 54 3.1.2.16 Sefaira .................................................................................................... 56

3.1.2.17 Issman .................................................................................................... 57 3.1.2.18 Procore ................................................................................................... 58

3.1.3 Smart Materials ................................................................................................ 61 3.1.3.1 SCHUECO ............................................................................................... 61


Applicability Watch



Date: 2015-06-30



3.2 Innovation ............................................................................................................ 63 3.2.1 Augmented Reality ........................................................................................... 63

3.2.1.1 ODG R-7 Smart Glasses ......................................................................... 63

3.2.1.2 DAQRI Smart Helmet .............................................................................. 65 3.2.1.3 Digiglasses .............................................................................................. 67 3.2.1.4 Microsoft Hololens ................................................................................... 67 3.2.1.5 Topsky Smart Glasses Cloud 1 ............................................................... 69 3.2.1.6 Magic Leap .............................................................................................. 70

3.2.1.7 Scope AR ................................................................................................ 71 3.2.1.8 Atheer Air Platform .................................................................................. 72 3.2.1.9 Bentley – Augmented Reality Hypermodels ............................................ 73

3.2.1.10 D4AR - Automated Progress Monitoring Using Images and BIM ............ 74 3.2.2 Applications ...................................................................................................... 76

3.2.2.1 Sketsha-Real-time Graphical Sharing...................................................... 76 3.2.2.2 SpatioData ............................................................................................... 77

3.2.2.3 AUGMATE ............................................................................................... 79 3.2.2.4 SmartReality ............................................................................................ 80 3.2.2.5 AR4BC ..................................................................................................... 80 3.2.2.6 SMART Vidente ....................................................................................... 83

3.2.2.7 HOLISTEEC ............................................................................................ 84 3.3 Applicability.......................................................................................................... 85

3.3.1 Augmented Reality ........................................................................................... 85 3.3.1.1 Fraunhofer IGD - Life BC ......................................................................... 85

3.3.1.2 Google Glass ........................................................................................... 87 3.3.1.3 Ruhr-Universität Bochum - Augmented-Reality-basiertes Facility Management ........................................................................................................... 89

3.3.1.4 VTT - Augmented Assembly .................................................................... 90 3.3.2 Applications ...................................................................................................... 91

3.3.2.1 Fraunhofer IGD - Real time 3D Difference Detection with 3D Cameras .. 91 3.3.2.2 ManuVAR ................................................................................................ 92 3.3.2.3 RAAMAC lab at University of Illinois at Urbana-Champaign - Automated mapping of actual thermal properties to gbXML-based BIM elements .................... 94

3.3.2.4 RAMAAC-Automatic Semantic Models Generating and Materials Classification ........................................................................................................... 95

3.3.2.5 ConstructAide .......................................................................................... 97 3.3.2.6 RAMAAC - Crowdsourcing Construction Workface Assessment from Jobsite Videos ......................................................................................................... 98

4 ACCEPT Functionality Comparison ........................................................................... 100 5 Conclusion ................................................................................................................. 106


Applicability Watch



Date: 2015-06-30



List of Figures and Tables

List of Figures

Figure 1: Market Monitoring Schedule ............................................................................... 12 Figure 2: Monitoring Strategy Structure ............................................................................. 13 Figure 3: R-6 Smart Glasses ............................................................................................. 14 Figure 4: Vuforia Overview Diagram .................................................................................. 17

Figure 5: Epson Moverio BT200 ........................................................................................ 20

Figure 6: Sony SmartEye Hologram Optics Technology .................................................... 22

Figure 7: Vuzix M100 – Safety Glasses and over the Head Mount Options ...................... 24 Figure 8: Soluis Immersive Domes .................................................................................... 25 Figure 9: Visuartech ........................................................................................................... 26 Figure 10: Junaio Platforms ............................................................................................... 31 Figure 11: MagicMeasure Screenshot ............................................................................... 34

Figure 12: Document Markup ............................................................................................ 35 Figure 13: Document Markup and Checklist ...................................................................... 38 Figure 14: Aconex Platforms .............................................................................................. 40 Figure 15: Document Markup ............................................................................................ 42

Figure 16: FieldLens Markups ........................................................................................... 43 Figure 17: Spike Laser measurement tool ......................................................................... 45

Figure 18: FLIROne Thermal Camera ............................................................................... 47 Figure 19: BIManywhere .................................................................................................... 48

Figure 20: MagicPlan workflow diagram ............................................................................ 50 Figure 21: ProjectWise Workflow Diagram ........................................................................ 52 Figure 22: Siri .................................................................................................................... 53

Figure 23: Rapiere Carbon, Energy and Cost Analysis...................................................... 55 Figure 24: Sefaira Real-time Analysis ................................................................................ 56

Figure 25: Issman Photo Recording and Mark-Up ............................................................. 58 Figure 26: Procore Platforms ............................................................................................. 59 Figure 27: R-7 Smart Glasses ........................................................................................... 63 Figure 28: Daqri Smart Helmet .......................................................................................... 65

Figure 29: Microsoft HoloLens ........................................................................................... 68 Figure 30: Topsky Smart Glasses Cloud 1 ........................................................................ 69

Figure 31: Atheer Air Platform ........................................................................................... 72 Figure 32: Bentley-Augmented Reality Hypermodels ........................................................ 73 Figure 33: D4AR Workflow Diagram .................................................................................. 75 Figure 34: Sketcha Workflow Diagram............................................................................... 76 Figure 35: SpatioData Workflow Diagram .......................................................................... 78

Figure 36: AR4BC Interaction with BIM Models ................................................................. 81 Figure 37: SMART Vidente System Setup ......................................................................... 83 Figure 38: Holisteec Approach ........................................................................................... 84 Figure 39: Life-bc: Vision-based Tracking .......................................................................... 86

Figure 40: Google Glasses ................................................................................................ 87 Figure 41: Augmented-Reality-basiertes Facility Management .......................................... 89


Applicability Watch



Date: 2015-06-30



Figure 42: Augmented Assembly Framework .................................................................... 90 Figure 43: Real 3D Difference Detection ........................................................................... 91 Figure 44: Concept of AR-based Remote Maintenance Support ....................................... 93

Figure 45: EPAR Energy Performance Augmented Reality ............................................... 94 Figure 46: ConstructAide System ...................................................................................... 97

List of Tables

Table 1: ODG R-6 Features Checklist ............................................................................... 16

Table 2: Vuforia Functionalities .......................................................................................... 18 Table 3: Features Comparison Checklist ........................................................................... 19

Table 4: Moverio BT-200 Related Features Checklist........................................................ 21

Table 5: NGRAIN Features Checklist ................................................................................ 22 Table 6: Vuzix Compatible AR Features Checklist ............................................................ 24 Table 7: Features Comparison Checklist ........................................................................... 26 Table 8: HD4AR Features Checklist .................................................................................. 29 Table 9: Features Comparison Checklist ........................................................................... 30

Table 10: Junaio Features Checklist .................................................................................. 32 Table 11: BIM 360 Features Checklist ............................................................................... 36 Table 12: Latista Features Checklist .................................................................................. 39 Table 13: Aconex Features Checklist ................................................................................ 40

Table 14: iSnag Features Checklist ................................................................................... 42 Table 15: FieldLens Features Checklist ............................................................................. 44

Table 16: Spike Features Checklist ................................................................................... 46 Table 17: BIManywhere Features Checklist ...................................................................... 48

Table 18: Ubimax xBuild Features Checklist ..................................................................... 49 Table 19: Issman Features Checklist ................................................................................. 58

Table 20: Procore Features Checklist ................................................................................ 60 Table 21: Schueco Features Checklist .............................................................................. 62 Table 22: ODG R-7 Features Checklist ............................................................................. 64

Table 23: DAQRI Features Checklist ................................................................................. 66 Table 24: Features Comparison Checklist ......................................................................... 68

Table 25: Features Comparison Checklist ......................................................................... 70 Table 26: Features Comparison Checklist ......................................................................... 71

Table 27: SketSha Features Checklist ............................................................................... 77 Table 28: SpatioData Features Checklist ........................................................................... 79

Table 29: AR4BC Features Checklist ................................................................................ 82 Table 30: SMART Vidente Features Checklist ................................................................... 83 Table 31: Life-bc Features Checklist ................................................................................. 86 Table 32: Google Glass Features Checklist ....................................................................... 88 Table 33: Real-time 3D Features Checklist ....................................................................... 92

Table 34: ManuVAR Features Checklist ............................................................................ 94 Table 35: EPAR Features Checklist .................................................................................. 95 Table 36: Features Comparison Checklist ....................................................................... 100 Table 37: Product Ranking .............................................................................................. 102

Table 38: Functionalities Impact Strength ........................................................................ 103


Applicability Watch



Date: 2015-06-30



1 Introduction

ACCEPT – Assistant for Quality Check during Construction Execution Processes for Energy-efficienT buildings – is a project funded by the Horizon 2020 Framework Programme of the European Commission under Grant Agreement No. 636895. The ACCEPT system will run on Smart Glasses and unobtrusively guide workers during the construction on site. This provides a standardized and coordinated process for all workers, ensuring that all benefits of energy-efficient building components are maintained

The ACCEPT system consists of three pillars:

Advanced Knowledge Transfer for Energy-efficient Construction

Agile Project Coordination for Bridging Heterogeneities

Adaptive Quality Assurance with Self Inspection-Features

Within this deliverable, a first evaluation of the Market, Innovations and Applicability Watch is provided, from the point of view of the partners. An analysis of the market will be created by collecting existing approaches, products and research projects. This will allow the project to be synchronized with the outside world and will ensure that there is a structured way of feeding new information into the project.

1.1 ACCEPT Project Overview

One of the major problems in the construction sector today is the potential loss of benefits of energy-efficient building components because of the lack of knowledge or bad implementation during the construction processes. The outcomes of the ACCEPT project will help to overcome this problem with the following applications as a holistic platform:

The Construction Operator Assistant App (CoOpApp) running on Smart Glasses, which passively collects data and actively provides guidance to the worker on site during the building process. (Pillar I: Advanced Knowledge Transfer for Energy-efficient Construction)

A Site Manager App (SiMaApp) running on a mobile device, which allows to remotely coordinate the working process as well as collect additional data on site by different sensors. (Pillar II: Agile Project Coordination for Bridging Heterogeneity)

An interactive web-based Dashboard as a monitoring and quality assurance solution. The Dashboard will use self-inspection methods to determine important characteristics such as U-Values. (Pillar III: Adaptive Quality Assurance with Self-Inspection Features)

To achieve its goals, the project ACCEPT conducts original research from a user centred perspective and applies technologies from the fields of Ubiquitous Computing, Big Data, Cyber Physical Systems, the Internet of Services, and Human-Computer Interaction. For more information, please refer to the project website at http:/www.accept-project.com.

1.2 Deliverable Purpose, Scope and Context

The purpose of this document is to provide supplementary information related to the target audience and the target market and to provide some guidelines to the project to help

http://www.alfred.eu/


Applicability Watch



Date: 2015-06-30



specify the scope of what the RTD should serve and the goal of the prototypes and also to ensure that ACCEPT is going to develop a system that is actually needed – and used – by the target users.

In order to react to the market variations, this deliverable will be used by all partners as a snapshot of the market helping the Technical Tasks of the project to stay focused on the main ideas and goals of the project whilst introducing insights into Quality Control and Assessment technologies, which will maximise the potential for commercial exploitation.

This deliverable aims to provide the project with a comprehensive analysis of the market, by locating and presenting related products and technologies in line with ACCEPT objectives. This will ensure that by the end of the project, ACCEPT system will be well positioned to successfully launch into the market, contributing to reducing the gap between predicted and actual building energy performance, which arises from a lack of knowledge or bad implementation of energy-efficient components during the construction process.

1.3 Document Status and Target Audience

This document is listed in the Description of Action (DoA) as “public” since it provides general information about the target market sector relevant to ACCEPT. The information is presented from the consortium partners’ perspective, in order to verify and shape the project in its marketplace and to ensure exploitation opportunities are understood and maximised.

While the document is primarily aimed at the project partners, this public deliverable can also be useful for the wider scientific and industrial community. This includes other publicly funded projects, which may be interested in collaboration activities.

1.4 Abbreviations and Glossary

A definition of common terms and roles related to the realization of ACCEPT as well as a list of abbreviations is available in the supplementary document “Supplement: Abbreviations and Glossary”, which is provided in addition to this deliverable.

Further information can be found at http://www.accept-project.com.

1.5 Document Structure

This deliverable is broken down into the following sections:

Chapter 1 (Introduction): Includes a general overview of the project and an outline of the purpose, scope, context, status and target audience of ACCEPT.

Chapter 2 (Market Watch Strategy): Presents the Market Monitoring structure and explains how existing commercial products as well as new, innovative technologies will be gathered, reviewed and monitored in a streamlined way, in order to ensure a constant feed of new information into the project.

Chapter 3 (Market Environment): Provides information about the marketplace and existing commercial products, as well as innovations relevant to ACCEPT. It also examines innovative products which were proven to have high potential for market success during their development, however did not have the anticipated outcomes when they were tried in the real commercial environment (Applicability).

http://www.accept-project.com/


Applicability Watch



Date: 2015-06-30



Chapter 4 (ACCEPT Functionality Comparison): This chapter compares products and applications which were identified as state-of-the-art or benchmark technologies that have similar features as those anticipated from ACCEPT.

Chapter 5 (Conclusion): Provides a high-level view of where ACCEPT is most likely to have a stronger impact in the market and what opportunities exist in the current commercial field of relevance.


Applicability Watch



Date: 2015-06-30



2 Market Watch Strategy

Throughout the project development, a continuous analysis and evaluation of its different aspects will be performed, updated and embellished with new information, which will be provided in the subsequent deliverables, D2.3 and D2.4 (months 24 and 36). Information coming from D2.5 Business Model Canvas, Analysis and Definition will be integrated in the later reports, creating a bigger picture coupled by the Business Strategy, which will also be developed within T2.3.

After creating an initial “inventory” consisting of products that are related to each of the ACCEPT Pillars, a specific analysis of desktop, mobile and wearable solutions will also be provided. The technologies will be watched and related to other R&D projects, in line with this project, as well as commercially available solutions or others which may have been good results of R&D projects, however did not have the expected impact on the market at the time of their development.

In order for to provide to the consortium a streamlined and structured way of monitoring the market and feeding new and updated information into the project, Partner groups will be defined, consisting of three participants coming from each of one of the different domains (Users, ICT, Research). These small groups will be responsible for conducting iterative research throughout the whole project duration. Each partner in the group will have a fixed effort of half a day per four months, so that research flows continuously and it can be easily time managed by the partners. A schedule for this monitoring pattern is illustrated in Figure 1: Market Monitoring Schedule.

Figure 1: Market Monitoring Schedule

Each Partner group should be focusing on the domain of expertise that is in line with his capacity and will provide the information for each of the products on a standard data sheet. The information will follow a streamlined form and will cover the following data:

General information and product description

Strengths and special features

Weaknesses and opportunities for ACCEPT

Similar features in line with ACCEPT anticipated results

Potential integration with ACCEPT

Particular functionalities compared with the objectives of ACCEPT

This data will be collected quarterly by the Monitoring Manager, who will be responsible for conveying the information to the Impact, Technical and Innovation Managers, in order to

7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36

ASC

ANS

TIE

CYPE

EJD

INGL

EPI

FER

IBP

IEC

IDS

D 2

.3

D 2

.4


Applicability Watch



Date: 2015-06-30



assess likely impact of the products feeding into D8.1, D2.3 and D2.4. At the same time, he will fill the information in the Product List, which in fact will be a live document, updated continuously. The Impact, Technical and Innovation Managers will inform the project Coordinator of any new ground-breaking technologies, products or research projects which may influence the development of ACCEPT. The workflow described above is illustrated in Figure 2: Monitoring Strategy Structure.

The Innovation Manager will also be responsible for providing a deep understanding of market changes, with an overall goal to allow the consortium to respond to external conditions and opportunities. As such, the Innovation Manager will purposely be a disruptive element to the project in order to ensure that the project changes if the market and commercial environment change.

Figure 2: Monitoring Strategy Structure

Monitoring

Manager

Monitoring

groups Technical Manager

Coordinator

Impact

Manager

Innovation

Manager

Product List


Applicability Watch



Date: 2015-06-30



3 Market Environment

3.1 Existing Commercial Products

This chapter describes state-of-the-art products that are already in the market. These are divided in three categories, according to their relation with ACCEPT system. Augmented Reality includes devices, applications or developer platforms that have the ability to integrate digital data as an overlay to real world objects in real time. Applications category presents software products that have relevant features and functionalities with the ACCEPT anticipated results. Materials section, describes smart construction materials which are embedded with digital data or functions and could be integrated with applications or BIM objects.

3.1.1 Augmented Reality

3.1.1.1 ODG R-6 Smart Glasses

3.1.1.1.1 General Overview This product is designed and manufactured by Osterhout Design Group (ODG). It’s a pair of untethered AR glasses designed for demanding environment. The glasses use two displays, one for each eye, and cover a high portion of the user sight lines. There is also the ability to employ a stereoscopic 3D view, by projecting slightly different images to each eye. Figure 3 below shows a general description of the product.

Figure 3: R-6 Smart Glasses

R-6 runs a custom operating system, called ReticleOSTM atop Android® Jelly BeanTM which creates an interactive layer to handle the unique nature of the heads-up, see-


Applicability Watch



Date: 2015-06-30



through interface. The RecticleOS Development Center is currently open to authorized developers.

The company is currently working on a new prototype development with BMW-MINI on a project called MINI Augmented Vision, which aims to connect AR eyewear and the car and also with NASA to develop computerized glasses that can guide astronauts with experiments as well as in conducting flight operations and repairs on space.

Website: www.osterhoutgroup.com/products-r6-glasses

3.1.1.1.2 Strengths and Weaknesses ODG R-6 Smart Glasses come with a powerful list of specifications as well as a comprehensive list of accessories, which make the product suitable for a large variety of uses, including construction.

The following list summarizes some of the most important features of this product:

Dual 720p Stereoscopic see-thru displays at 30fps

Removable Photocromic Shields

Bluetooth and WiFi communication capabilities

GPS

Integrated Inertial Measuring Unit

Altitude Sensor

Ambient Light Sensor

720p 60fps Camera for Still and Video Capture

Digital microphones

Audio ports with ear buds

Based on Android OS

Developer program

Compatibility with prescription lenses

Designed to meet high safety standards for Hazardous Environments

External battery pack

The above list is not exhaustive and additional information can be found at the following link support.osterhoutgroup.com/hc/en-us/articles/203232969-R-6-Specifications .

Some weaknesses of the product are summarized in the following list:

Very high purchase cost, around $4.000 at the time of writing

The product is available only to pre-approved government customers

Unknown level of integration with other operating systems

Average run time for general use is limited to 2 hours with the built-in batteries

Bulkier than regular glasses

The top of the lenses is blocked by a plastic housing which contains the tiny projector that creates the virtual screen in front of the user

3.1.1.1.3 ACCEPT Integration Table 1 below, illustrates a list of this product’s features and capabilities that comply with the ACCEPT Concept Functionality Checklist. The comparison is done based on the core functions of the device, as much of the actual performance depends on the applications

http://www.osterhoutgroup.com/products-r6-glasses

https://support.osterhoutgroup.com/hc/en-us/articles/203232969-R-6-Specifications


Applicability Watch



Date: 2015-06-30



that are going to be installed. Therefore, one can presume that if a related application can run in an Android environment then it could also be compatible with this device.

Table 1: ODG R-6 Features Checklist

3.1.1.2 Qualcomm Vuforia

3.1.1.2.1 General Overview Vuforia is a platform that Qualcomm has developed for app developers to build vision based augmented reality applications on top of. It focuses on using images as the “targets” to launch an AR experience, rather than requiring consumers to scan QR codes or other glyphs. AS such, instead of scanning a barcode, you just scan a specific picture to start the AR experience on your mobile phone, tablet or even smart glasses (it could launch a video, or a 3D model, etc.) This system allows developers to build their own augmented reality apps for both tablets and smartphones and to use both local app storage of image targets as well as implement programmatic, API-based access using a cloud database system. Figure 4 below shows an overview diagram of the application development process with the platform.

Feature Feature

QR code reader √ Digital overlay atop real world objects

√

Barcode reader √ Taking photos √

Location GPS √ Taking videos √

Audio √ Wireless connectivity √

Email capabilities √


Applicability Watch



Date: 2015-06-30



Figure 4: Vuforia Overview Diagram

Website: www.qualcomm.com/products/vuforia

3.1.1.2.2 Strengths and Weaknesses The following list summarizes some of the most important features of this product:

Easy to use

Offline mode for faster local detection of targets

Cloud based image storage

User defined targets that can be created at runtime from camera frames selected by the end-user

Text recognition - recognition and tracking of printed text

Recognize and track a broad number of objects, including cylindrical surfaces, in order to bring digital features to consumer products

Images with sufficient detail including product packaging can be recognized

Extended tracking - a capability that delivers a continuous experience even when the target is out of view

Despite the impressive quality of the augmented reality features it offers, the Vuforia SDK also has some limitations, which are listed below:

On-device image recognition and tracking is currently limited to 100 images

The device has to be connected to the internet in order to use the “Cloud Recognition” that offers image recognition on larger amount of images

3.1.1.2.3 ACCEPT Integration ACCEPT could use the Qualcomm’s Vuforia platform in order to generate vision-based content for the CoOpApp and enable object recognition capabilities. The following Table 2, shows some of the functionalities of ACCEPT which could be implemented based on this platform.

http://www.qualcomm.com/products/vuforia


Applicability Watch



Date: 2015-06-30



Table 2: Vuforia Functionalities

3.1.1.3 APX Skylight

3.1.1.3.1 General Overview APX Skylight is a software platform for ”Smart Devices” like smart watches, tablets, and smart glasses. It can control the display, camera, sensors and all user input. Skylight connects many smart glasses, smart watches, sensors, systems and data together. It can run in the cloud or locally. It supports an app market and comes with an SDK for extending Skylight to meet specific user needs (Java, C#, Python).

Website: www.apx-labs.com/skylight/

3.1.1.3.2 Strengths and Weaknesses The following list describes the key features of this application:

Get up-to-date work orders, task instructions and checklists

Pull up reference materials, overlay guides, and help videos

Share your view on a live two way audio + video call with a colleague or remote expert

Receive instant text notifications and interactive questions from colleagues or external systems

Get a birds-eye view of objects around you and get indoor or outdoor navigation guides

Continuously monitor important data sent from back-end systems, sensors or your equipment

Interact with and control equipment hands-free

Capture images, audio and video to document best practices and record your work activities

Use a browser to make video calls, send tasks, and track progress with all your front-line employees

3.1.1.3.3 ACCEPT Integration Skylight can provide the necessary foundation for the development of a significant number of ACCEPT functionalities, as listed in Table 3 below:

Feature Feature


√

Barcode reader √ Wireless connectivity √

Current design overlay √ Mobile devices integration √

Visual reminders √ Object recognition √

BIM metadata assignment √ Taking photos √

http://www.apx-labs.com/skylight/


Applicability Watch



Date: 2015-06-30



Table 3: Features Comparison Checklist

3.1.1.4 Epson Moverio BT200

3.1.1.4.1 General Overview The Epson Moverio BT 200 is a SmartGlass device which consists of the glasses and a second device, the controller. There is no need for another smart phone or something alike because the controller has the Android Operating System integrated and a touchpad for navigation.

It contains two screens (one for each eye) and it can be used to display AR data on both eyes, as can be seen in Figure 5 below:

Feature Feature

QR code reader √ Personnel competencies √

Barcode reader √ Digital overlay atop real world objects

√

Weather sensors integration √ Infrared (Thermal Imaging) sensor integration

√

Location GPS √ Feedback/ratings √

Object tagging √ Current design overlay √

Checklists √ Installation tutorials √

Audio √ Email capabilities √

Documents library (including drawings)

√ Taking photos √

Real time data sync √ Taking videos √

Materials and equipment data base √ Task lists √


Applicability Watch



Date: 2015-06-30



Figure 5: Epson Moverio BT200

Website:www.epson.com/cgi-bin/Store/jsp/Landing/moverio-bt-200-smart-glasses.do?ref =van_moverio_2014


Two screens

Extra controller (device) – smart phone isn’t required

High quality camera

qHD resolution

Reasonable battery life

Relatively affordable price

However innovative, there isn’t currently no real consumer purpose, unless for developers or dedicated gadgeteers. This product is not considered to be stylish enough for the normal end user and also feels uncomfortable when worn with regular glasses, due to its heavy weight. The glasses’ durability against the hostile conditions of a construction site should be carefully evaluated. Furthermore, the use of the controller in order to navigate through the interface, prevents the user from unobtrusively executing tasks.

3.1.1.4.3 ACCEPT Integration Epson Moverio BT-200 functionalities rely almost completely on the application package that would be installed on them. In that respect, taking into account that their Operating System is based on Android platform, it’s expected that a variety of applications targeted to augmented reality, user interaction, object recognition, audio and video communication and information display could be serviced by this device. The following Table 4 includes some of ACCEPT core functionalities that can be implemented on this device:

http://www.epson.com/cgi-bin/Store/jsp/Landing/moverio-bt-200-smart-glasses.do?ref%20=van_moverio_2014

http://www.epson.com/cgi-bin/Store/jsp/Landing/moverio-bt-200-smart-glasses.do?ref%20=van_moverio_2014


Applicability Watch



Date: 2015-06-30



Table 4: Moverio BT-200 Related Features Checklist

3.1.1.5 NGRAIN

3.1.1.5.1 General Overview NGRAIN Augmented Reality enables the development, without coding, of industrial augmented reality (AR) applications for complex equipment and deploys them across the enterprise in a streamlined and fairly easy way.

Website: www.ngrain.com/


Codeless development of AR applications.

3D data digital overlay on top of real world objects.

Instruction notes display.

Analytics trough real time data analysis from various sensors.

3.1.1.5.3 ACCEPT Integration Although NGRAIN is currently targeted only at mobile devices, without Smart Glass support, it could become a useful reference for some of the ACCEPT features, especially for the SiMaApp, as listed in Table 5 below:

Feature Feature

QR Code reader √ Digital overlay atop real world objects

√

Barcode reader √ Real time sketching/amendments √

Weather sensors integration √ Installation tutorials √

Infrared (thermal imaging) sensor integration

√ Object recognition √

3D sensing technologies √ Taking photos √

Photo real world measurement (photogrammetry)

√ Taking videos √

Location GPS √ Wireless connectivity √

Mobile devices Integration √ Email capabilities √

Audio √

http://www.ngrain.com/


Applicability Watch



Date: 2015-06-30



Table 5: NGRAIN Features Checklist

3.1.1.6 Sony SmartEyeglass

3.1.1.6.1 General Overview SmartEyeglass is lightweight, binocular eyewear that enables true augmented reality experiences. Text, symbols and images are superimposed onto your natural field of view. SmartEyeglass is equipped with a thin, lightweight display module designed specifically for transparent lens glasses. The module is made up of two parts: the optical engine, which projects images and text using micro display (µDisplay) technology, and a holographic waveguide, an extremely thin transparent plate of glass measuring 1mm, as displayed in Figure 6 below.

Figure 6: Sony SmartEye Hologram Optics Technology

Website: http://developer.sonymobile.com/products/smarteyeglass/

3.1.1.6.2 Strengths and Weaknesses

Feature Feature

Weather sensors integration √ Digital overlay atop real world objects

√

Infrared (thermal imaging) sensor integration

√ Current design overlay √

Mobile devices integration √ Installation tutorials √


√ Wireless connectivity √

Reports √ Task lists √

Materials and equipment data base √ √

http://developer.sonymobile.com/products/smarteyeglass/


Applicability Watch



Date: 2015-06-30



Super thin lenses with high transparency and excellent brightness.

Utilizes a natural field of view onto which text, symbols and images are sumperimposed.

The waveguide is a unique Sony technology that takes the light created in the optical engine and projects a virtual image through the holographic optical elements to the eyes of the wearer. Together with the protective plating, this technology enables more than 85% outside light transmittance, with lenses that are only 3mm thick in total.

Developers can combine the SmartEyeglass sensors and camera with the powerful features of the smartphone to create unique hands-free use cases.

The downside is that they are pretty bulky and the cumbersome remote controller that is used to navigate through the interface reduces the ability of hands-free usage.

It's only a prototype, and Sony does say that eventually the glasses will scan your eye movements to scroll through the information on the screen.

3.1.1.6.3 ACCEPT Integration ACCEPT could benefit from the SmartEyeglass SDK which can be used in combination with the Android SDK in order to develop applications related to the core functionalities, especially of the CoOpApp.

The SmartEyeglass API enables the developed apps to show text and bitmaps on the display. Numerous sensor data can also be accessed, as well as the built-in camera, and use the sensors available on the phone.

3.1.1.7 Vuzix M100

3.1.1.7.1 General Overview The Vuzix M100 Smart Glasses, displayed in Figure 7, are an Android-based wearable computer, enhanced with a wearable monocular display and computer, recording features and wireless connectivity capabilities designed for commercial, professional, and prosumer users. Its pre-installed apps can be used to record and playback still pictures and video, track timed events, manage your calendar, link to your phone and more. The M100 is compatible with thousands of existing Android apps and easy access to developer resources enables the creation of custom apps to suit virtually any need.


Applicability Watch



Date: 2015-06-30



Figure 7: Vuzix M100 – Safety Glasses and over the Head Mount Options

Website: www.vuzix.com/consumer/products_m100


Features and capabilities of a modern smartphone, without a cellular radio, in a hands-free wearable device

HD camera for still picture and video capture and enables the user to store their content in expandable onboard memory or stream it live

Bluetooth 4.0 connectivity allows it to pair with another Android device or connect wirelessly with Wi-Fi to the Internet

An integrated head tracking and GPS system can not only provide apps with your location but even the direction and angle of your current view

Hands free access to data, direct and remote video capabilities, direct on-board processing of video capture for lag-free augmented reality (AR) are some of the core advantages to the Vuzix M100.

However, the small field of view, the plethora of buttons to be managed by a construction worker, the high price and the lack of demonstration videos, in order to see what you can do with this product, are some weaknesses.

3.1.1.7.3 ACCEPT Integration ACCEPT could benefit from the voice navigation and gesture control features of the product. The Vuzix Developer Center provides access to a M100 SDK and other important resources designed to assist developers in developing and customizing apps designed to empower users. This could be exploited by the consortium in order to achieve the AR functionalities anticipated for the CoOpApp, which are listed in Table 6 below.

Table 6: Vuzix Compatible AR Features Checklist

Feature Feature


√

Barcode reader √ Current design overlay √


√ Installation tutorials √

Location GPS √ Object recognition √

Object tagging √ Taking photos √

Mobile devices integration √ Taking videos √

Audio √ Email capabilities √

Visual reminders √ Wireless connectivity √

http://www.vuzix.com/consumer/products_m100


Applicability Watch



Date: 2015-06-30



3.1.1.8 Soluis Immersive Domes

3.1.1.8.1 General Overview Soluis Immersive Domes correspond to fully immersive interactive environments. These environments are delivered across a range of platforms, providing users with the ability to publish and present interactive content using a variety of easily accessible devices and interfaces, as can be seen in Figure 8 below.

Figure 8: Soluis Immersive Domes

Website: www.soluis.com

3.1.1.8.2 Strengths and Weaknesses Soluis has pioneered the use of familiar interfaces for delivering accessible, professional quality presentations using commercial games engines.

The full dome experience offers a particularly rich proposition to the design and built environment sectors, providing viewers the opportunity to experience and engage with three dimensional spaces and scale at an unprecedented level through immersive film and interactive media.

This kind of technology could create a full AR experience, quite useful to provide global information to different professionals who are visiting the worksite.

However, obviously the system needs a dedicated area to be installed and is not a mobile device.

3.1.1.8.3 ACCEPT Integration ACCEPT could create synergies with this technology in order to provide data, info and models (in this case, regarding building construction) to this innovative, interactive environment and a new point of view related to architecture and engineering.

This technology could be considered as a complement of CoOpApp, SiMaApp and Dashboard. This technology could probably be used in emblematic works with many visitors (professionals, institutional visitors, etc.).

http://www.soluis.com/


Applicability Watch



Date: 2015-06-30



3.1.1.9 Visuartech

3.1.1.9.1 General Overview Visuartech has been mainly developed for Architecture, Engineering, Design, Constructor-Builders, Promoters, Decorators, Interior Designers, PLV, etc. This generic augmented reality App enables the user to display a 3D representation of a plan by scanning a 2D document with a smart-phone, running Visuartech application. The digital model can include all construction details, materials, finishing options and different view angles. Visuartech is available for mobile devices such as iOS and Android, as can be seen in Figure 9 below.

Figure 9: Visuartech

Website:http://www.visuartech.com/en/visuartech-realidad-aumentada-arquitectura-ingenieria


3D representation of 2D plans

Detail data integration, such as construction details, materials, finishing options

Various angles of view

Low maturity level

Slow response while downloading model data

Can work only with WiFi connection

The model is not displayed unless you keep the 2D target in the camera viewfinder

3.1.1.9.3 ACCEPT Integration Visuartech could be considered as an example for inspiration for some of the ACCEPT functionalities, as listed in Table 7 below:


Feature Feature

http://www.visuartech.com/en/visuartech-realidad-aumentada-arquitectura-ingenieria

http://www.visuartech.com/en/visuartech-realidad-aumentada-arquitectura-ingenieria


Applicability Watch



Date: 2015-06-30



3.1.1.10 AR-media

3.1.1.10.1 General Overview AR-media platform is a structured and modular development framework that includes different software modules arranged according to a specific architecture. Modules include:

Real time tracking

Real time rendering

Interfaces

The framework is independent of both the real-time tracking engine and the rendering engine. AR-media framework is implemented in C/C++. It is cross-platform, this meaning that it is available for desktop development environments (Windows, Mac and also Linux) and for mobile environments (iOS, Android and Windows) by means of suitable wrappers written in Objective-C and JavaScript. The framework can be easily packed into a SDK.

The framework can modularly integrate different tracking algorithms and different 3D engines. To date the framework includes different tracking libraries (we started by including ARToolKit). Other methods include OpenCV based methods, specific natural feature trackers, OpenNI (supporting gesture recognition with depth cameras) and the latest Inglobe Tracker, a powerful 3D tracker developed in a recent research project. Regarding the real time rendering libraries, the platform supports several extensions of OpenGL.

Website: www.armedia.it


Full development SDK

Recognizes planar images and also complex 3D objects independently of their size and geometry

Subscription Fees

Modular integration with game engines like Unity3D

Hasn’t been updated since 2013

3.1.1.10.3 ACCEPT Integration ACCEPT could utilize AR-media’s modular capacities for quicker and easier development compared to other technologies.


√


Weather sensors integration √ Taking photos √

Object tagging √

http://www.armedia.it/


Applicability Watch



Date: 2015-06-30



3.1.1.11 RAAMAC - HD4AR

3.1.1.11.1 General Overview RAAMAC presents Hybrid 4-Dimensional Augmented Reality (HD4AR), a mobile augmented reality system for construction projects that provides high-precision visualization of semantically-rich 3D cyber-information over real-world imagery.

HD4AR allows construction field personnel to use mobile devices, such as a smart phones or tablet, to take pictures that include a specific construction element, see BIM elements visually overlaid on top of the real-world imagery, touch or click on a BIM element in the image, and be presented with a detailed list of cyber-information, such as plan information (e.g., budget, specifications, architectural/structural details) or actual information (e.g., cost, safety provisions, physical progress) related to the physical element.

HD4AR allows field personnel to query and access 3D cyber-information on-site by using photographs taken from standard mobile devices. The system does not require any location tracking modules, external hardware attachments, and/or optical fiducial markers for localizing a user’s position. Rather, the user’s location and orientation are purely derived by comparing images from the user’s mobile device to a 3D point cloud model generated from a set of pre-collected site photographs.

Website: http://raamac.cee.illinois.edu/hd4ar/

3.1.1.11.2 Strengths and Weaknesses The following list summarizes some of the key features of the system:

Allows construction field personnel to use mobile devices to take pictures for accurate localization

Allows field personnel to automatically access the latest plan and, as-built information, visually document progress, and communicate information with other personnel involved in the project on or off site.

Accuracy of image-based localization is 95.38% (in worst case); It takes 3–6 seconds for localization and less than an hour for point cloud generation

The localization speed and empirical accuracy of the system provides the ability to use the system on real-world construction sites.

Speed of localization could be improved by such things as a phones GPS module

Images could be compressed to increase matching speed

3D reconstruction is imperfect

3.1.1.11.3 ACCEPT Integration ACCEPT can include this system into the profile for workflows (Pillar II) to visualize information about the physical objects in construction site that will help to guarantee the quality of work execution and to share information between workers on the site.

The following Table 8 presents a set of HD4AR features which are related to ACCEPT concept functionalities checklist:

http://raamac.cee.illinois.edu/hd4ar/


Applicability Watch



Date: 2015-06-30



Table 8: HD4AR Features Checklist

3.1.1.12 VTT ALVAR

3.1.1.12.1 General Overview ALVAR is a software library for creating virtual and augmented reality (AR) applications. ALVAR has been developed by the VTT Technical Research Centre of Finland. ALVAR is released under the terms of the GNU Lesser General Public License, version 2.1, or (optionally) any later version.

ALVAR is designed to be as flexible as possible. It offers high-level tools and methods for creating augmented reality applications with just a few lines of code. The library also includes interfaces for all of the low-level tools and methods, which makes it possible for the user to develop their own solutions using alternative approaches or completely new algorithms.

ALVAR is currently provided on Windows and Linux operating systems and only depends on one third party library (OpenCV). ALVAR is independent of any graphical libraries and can be easily integrated into existing applications. The sample applications use GLUT and the demo applications use OpenSceneGraph.

The VTT augmented reality team also continues to develop advanced computer vision algorithms independently of ALVAR, applying these in its customer project work. Furthermore, the ALVAR Mobile SDK for iOS, Android, Symbian, Maemo, Flash and Silverlight platforms, as well as the ALVAR Render engine, are available for internal use and selected partners.

Website: http://virtual.vtt.fi/virtual/proj2/multimedia/alvar/

Feature Feature

Location GPS √ Digital overlay atop real world objects

√

Cloud surveys √ Feedback/ratings √


Mobile devices integration √ Clash detections √

Checklists √ 3D visualisation of as built and as planned on site

√

Visual reminders √ BIM integration √

Email capabilities √ BIM metadata assignment √

Wireless connectivity √ Taking photos √

Taking videos √

http://virtual.vtt.fi/virtual/proj2/multimedia/alvar/


Applicability Watch



Date: 2015-06-30



3.1.1.12.2 Strengths and Weaknesses Some of the features of VTT-ALVAR are:

Marker based tracking

Accurate marker pose estimation

Two types of square matrix markers

Future marker types are easy to add

Recovering from occlusions

Using multiple markers for pose detection

The marker setup coordinates can be set manually or they can be automatically deduced by auto calibration

Markerless tracking

Feature-based (tracking features from the environment)

Template-based (matching against predefined images or objects)

Hiding markers from view

Tools for calibrating cameras

Several methods for tracking optical flow

Distorting /undistorting points, projecting points

Finding exterior orientation using point-sets

Kalman library and several other filters

Currently it’s available only for Windows and Linux systems, which somewhat limits its exploitation potentials.

3.1.1.12.3 ACCEPT Integration ALVAR can be applied to the building and construction domain through seamless integration between architectural and BIM systems:

Compare project plans (4D BIM) with situation on-site

Provide real-time mobile feedback from site to BIM-system

Construction site web cameras can be attached for public 4D demonstrations

ACCEPT could use ALVAR to create AR applications for desktop and mobile platforms. The following Table 9 presents a set of ALVAR features which are related to ACCEPT concept functionalities checklist:


Feature Feature

Location GPS √ Digital overlay atop real world

objects

√

Cloud surveys √ Feedback/ratings √



√ Clash detections √


Applicability Watch



Date: 2015-06-30



3.1.1.13 Junaio AR Browser App

3.1.1.13.1 General Overview Junaio is the most advanced mobile augmented reality browser. It's a free, fast and easy way to enhance augmented reality experiences based on well-known web technologies such as XML and HTML5, as can be seen in Figure 10 below.

Junaio is based on more than 10 years of research and development of Metaio core technology, offering nearly all tracking technologies of the Metaio SDK like location based services, simple QR-Code, Barcode and ID marker detection, 2D image tracking and even advanced 3D tracking technologies.

Junaio supports markerless 2-D tracking, 3-D tracking, hybrid tracking, face recognition (beta) and location-based 'AR', with the ability to add text, videos, hyperlinks, social media buttons, 3-D animations and 360 experiences.

Figure 10: Junaio Platforms

The augmented reality tool, with a graphical user interface, offers drag-and-drop creation of 'AR' scenarios. Augmented magazines, books, flyers, toys, furniture, buildings, or even faces (beta) can be tracked thanks to Metaio 6.

Email capabilities √ Real time sketching/amendments √

Wireless connectivity √ Installation tutorials

Real time data sync √ Object recognition √

BIM metadata assignment √ BIM integration √


Applicability Watch



Date: 2015-06-30



CompatiMetaio POI Creator is a plugin for Excel® 2013 software allowing the creation of location-based augmented reality directly from Excel® software for free. Customized Points of Interest (POIs) can be created and customized with descriptions, hyperlinks, videos and more.

Website: www.junaio.com

3.1.1.13.2 Strengths and Weaknesses The following list summarizes some of the key features of the application:

Augmented images, objects, buildings, faces and geo-located points of interest

Supports markerless 2-D tracking, 3-D tracking, hybrid tracking, face recognition (beta) and location-based AR

Can add text, videos, hyperlinks, social media buttons, 3-D animations, and 360 experiences; the AR scenarios are published as channels which are browsable by users.

Publishing AR is unlimited and available for both iOS and Android

Mobile and wearable devices compatibility for both iOS and Android

Available for smart glasses like the Epson Moverio BT-200, Vuzix M100 and Google Glass, as Junaio Mirage

It may have limitations for developing customized 'AR' scenarios

Images scanned have to be stored in the Junaio database in order to provide interaction with users

On the Android App, due to device limitations Junaio is disabled on devices which use ARM 6 chipset like HTC Hero Magic, Wildfire and Tatoo, Samsung Ace and similar devices

A big challenge is acquiring relevant information on every location or point of interest upon which you might happen to cast your lens. You might get information about a popular POI, but you might come up empty for the building next to it. There is also a challenge with the interface for this type of app. You need to be able to see everything you are looking at through the camera without having the image obscured by the informational overlay.

Providing the information in such a way that the fonts is large enough to read at a glance had proven to be quite challenging

3.1.1.13.3 ACCEPT Integration Creation and Visualization of AR objects, manuals/books and Geo-Referenced objects are some of the features that could be used in ACEEPT. The Smart Glasses could be used as the display device for 'AR' scenario and since this is a relatively new application for the construction section, ACCEPT has the opportunity to benefit by creating synergies.

The following Table 10 presents a set of Junaio’s features which are related to ACCEPT concept functionalities checklist:

Table 10: Junaio Features Checklist

Feature Feature

Barcode reader √ QR code reader √

http://www.junaio.com/


Applicability Watch



Date: 2015-06-30



3.1.1.14 MagicMeasure

3.1.1.14.1 General Overview MagicMeasure is an AR tape measure for mobile devices. You do not always have a laser or tape measure in your pocket, but you always have your phone with you. Take a picture and just mark the picture with the distances, surfaces or volumes you want to know, as in the example shown in Figure 11. Each measure is saved, and a PDF or JPG with the annotated measures can be generated. A MagicMeasure user can also share a photo annotated to another MagicMeasure user. Magic Measure can be used in various use cases such as furniture fitting, distance/size/volume calculations, as a planning tool, in shipping for size estimations and as a quick photo annotation application.

MagicMeasure functions are divided in three distinct modes:

Indoor: This mode allows the measurement of objects on a wall or on the floor. MagicMeasure can only operate from photos where the floor is visible. Aiming at the ceiling and trying to measure something on the ceiling will not work. However measuring a frame placed on a wall, as long as a piece of the floor is visible will work.

Outdoor: This mode allows the measurement of elements such as a building facade surface.

Macro: This mode allows the measurement of small objects placed on a table.

Location GPS √ Feedback/ratings √

Cloud surveys √ Current design overlay √

Object tagging √ Installation tutorials √

Mobile devices integration √ Taking photos √

Audio √ Taking videos √

Email capabilities √ Wireless connectivity √

Translation √ Real time data sync √


Applicability Watch



Date: 2015-06-30



Figure 11: MagicMeasure Screenshot

Website: http://www.sensopia.com/english/pricing.html


Take photos and measure: o Distances between 2 points (floor or wall) o Surfaces (floor or wall) o Volumes (3D objects)

Duplicate photo to create new measurements

Name picture and add comments

Add text annotation

Share results with other MagicMeasure users

Export annotated pictures in PDF

Only available for iOS platforms

Measurements on 1 picture can be made at no charge; purchasing unlocks all features

Requires constant visibility of floor plane within screenshot to enable measuring features

3.1.1.14.3 ACCEPT Integration ACCEPT can use this application as part of the CoOpApp, in order to enable the workers to take measurements of the constructed structure in the site, by using their Smart Glasses.

http://www.sensopia.com/english/pricing.html


Applicability Watch



Date: 2015-06-30



3.1.2 Applications

3.1.2.1 Autodesk BIM 360 Field

3.1.2.1.1 General Overview BIM 360TM is the Autodesk field management software for 2D and 3D environments that combines mobile technologies at the construction site with cloud-based collaboration and reporting and bringing documents to the field, including BIM (Building Information Models).

It contains one place where all quality, safety, commissioning, punch listing and other field issues are gathered and managed by area, responsible company or any other way the user would like. The user can manage construction issues as well as checklists and build checklist libraries for reuse across projects. The library feature can also be used to manage documents of any type, including BIM and distribute them to project users in the office and in the field.

In the field the user can use the mobile app Library feature to get field access and mark-up plans and documents on the iPad, as can be seen in Figure 12. Also the iPad app can be used to execute field quality, safety and other programs, even conduct punch lists. There is also the option to view models on the job site, without necessarily having internet access on site, because it works with or without it.

Figure 12: Document Markup

In addition to iPads, Autodesk BIM 360TM Field enables anyone with a smartphone or other email compatible device to take pictures and email them into the website, so that quality, safety and any other to-do list items go into the master-list on the website, where they can be accessible to all job site participants.

Website: www.autodesk.com/products/bim-360-field/overview

3.1.2.1.2 Strengths and Weaknesses BIM 360 Field has a versatile interface and Dashboard which can give a comprehensive overview of the whole project. The following list summarizes some of the most important strengths of this product:

http://www.autodesk.com/products/bim-360-field/overview


Applicability Watch



Date: 2015-06-30



Cloud based collaboration and reporting

Combine mobile technologies for on-site use

Ability to create and manage field processes

Distribution of plans and drawings

Mobile 2D and BIM construction document access

On-site document mark-up

The mobile app can work with or without internet access

Standardized checklist templates

Create and automatically distribute work-to-complete lists for trades and other parties

Develop and deploy standardized safety inspection programs

Dashboards aggregate safety performance to help avoid incidents

Dynamic reporting shows the statuses of systems and equipment

Use commissioning information and linked documents from BIM 360 Field as the deliverable for handover and facility operations

Interactive project website

Integration with other Autodesk products to provide BIM object data in the field

Automatically reads weather data from the internet

Additional information can be found at the following link www.autodesk.com/products/bim-360-field/features .

Although Autodesk BIM 360 field establishes a benchmark in the domain of field management software, there are some weaknesses which the consortium feels that ACCEPT has the opportunity to cover. Those are summarized as follows:

The mobile app is available only for iPads

The integration with BIM is achieved only with the BIM 360 Glue® plug-in, which requires a separate subscription

The extensive list of reports and work-to-complete lists can become a bit confusing, especially when viewed in the “hostile” conditions of a construction site.

Lack of integration with passive data gathering on-site sensors

No integration with wearable devices, such as Smart Glasses, at the moment

Lack of augmented reality and object recognition capabilities.

3.1.2.1.3 ACCEPT Integration Table 11, below, illustrates a comparison of this product’s features and capabilities with the ACCEPT concept Functionality Checklist.

Table 11: BIM 360 Features Checklist

Feature Feature

QR code reader √ Job scheduling √

Barcode reader √ Feedback/ratings √

Object tagging √ Crew assignment √

http://www.autodesk.com/products/bim-360-field/features

http://www.autodesk.com/products/bim-360-field/features


Applicability Watch



Date: 2015-06-30



3.1.2.2 Latista

3.1.2.2.1 General Overview Latista Field is a cloud-based construction management software, which helps to reduce costly rework, delays and paperwork and increases efficiencies in the construction industry. It is designed to meet the unique needs of people in the field. The app uses a cloud based platform to facilitate seamless interaction between the office and the field. Figure 13 below, illustrates a screenshot showing the document markup and checklist capabilities of the application.

Website: www.latista.com

Checklists √ Installation tutorials √

Audio √ Document mark-ups √


√ BIM integration √

Email capabilities √ Taking photos √


Wireless connectivity √ Materials and equipment data base √

Real time data sync √ Project calendar √

Personnel attendance √ Mobile devices integration (only iPad)

√

Roles and duties definition √

http://www.latista.com/


Applicability Watch



Date: 2015-06-30



Figure 13: Document Markup and Checklist

Website: www.latista.com/features

3.1.2.2.2 Strengths and Weaknesses The following list includes some of the key features of the application:

Configuration of inspection workflows and issues

Different levels of user permissions

Set up and control the interaction between subcontractors, contractors and owners

Progress Management by area or equipment

Notices scheduling when resolution of work is overdue

Drawing mark ups to create issues

Project or company-wide safety program online management

Digital completion of inspections on a mobile device

Control who can view and approve issues on a punch list

Provide users with detailed 3D models with BIM app integration

Interaction with the model from a mobile device is currently supported only for iPad. Android support is expected in the near future.

Equipment/properties import from Autodesk Navisworks

Equipment barcode scanning in the field

Link between marked-up BIM snapshot and the model

Attachment of marked up drawings, photos, sketches, or other reference material directly to issues

Work orders dispatch to expedite resolution

Issue statistics Tracking such as time to close, issue by responsible party, and remaining open issues

Status tracking using a real time updated dashboard

Integration with schedule management solutions, like Oracle Primavera and Microsoft Project

http://www.latista.com/features


Applicability Watch



Date: 2015-06-30



3.1.2.2.3 ACCEPT Integration

The following Table 12 presents features of the applications that are related with the ACCEPT concept functionality checklist:

Table 12: Latista Features Checklist

3.1.2.3 Aconex

3.1.2.3.1 General Overview Aconex is a cloud-based, construction project management software that provides efficiency to the industry. Leading construction firms, including 9 of the top 10 global EPCs (Engineering, Procurement and Construction companies), are compressing timelines and optimizing budgets thanks to the application that lets them control information and processes across every organization on their project. Aconex provides transparency and control from the beginning of a project through close-out, handover and operations. Figure 14 below, demonstrates the three platforms of the application, desktop, iPad and smartphone.

Feature Feature

Mobile devices integration √ Job scheduling √

Checklists √ Crew assignment √


√ BIM integration √

Reports √ Taking photos √

Wireless connectivity √ Task lists √


Email capabilities √ Document mark-ups √

Barcode reader √


Applicability Watch



Date: 2015-06-30



Figure 14: Aconex Platforms

Website: www.aconex.com


Distribute documents and models instantly inside the company and with external members of the project team

Manage documents and models without limits on data or participants

Each organization gets a secure data store and only information that is explicitly shared is available to other project members.

Access and manage documents via the web, Outlook or mobile app continue to work when offline.

Every aspect of projects can be accessed through the browser

Control of the messages that get exchanged during the course of a project and help to avoid cost overruns and delays

Centralizes email, drawings, 3D models, drawing revisions, bids & tenders, contracts, change orders, etc; automatically tracking every interaction

Additional information and more features can be found at the following link: www.aconex.com/solutions

3.1.2.3.3 ACCEPT Integration The following Table 13 presents a set of Aconex features which are related to ACCEPT concept functionalities checklist:

Table 13: Aconex Features Checklist

Feature Feature

Mobile devices integration √ Job costing √

Checklists √ Job scheduling √

http://www.aconex.com/

http://www.aconex.com/solutions


Applicability Watch



Date: 2015-06-30



3.1.2.4 iSnag2

3.1.2.4.1 General Overview iSnag2 is a mobile snagging and defect management software service that is comprised of a securely-hosted, fully backed-up web application, called Dome Connect and native mobile apps for tablets and smartphones. iSnag2 provides the ability to digitise any of the existing workflows and forms, e.g. defect management, permit control, void closures, area handovers, surveys, inspections, health & safety, testing & commissioning and more, enabling the project to become paperless and mobile. iSnag2 is available for iOS and Android, as well as an online platform accessible through any browser. Figure 15 below, shows the Document Markup functionality of the application.


√ Feedback/ratings √

Email capabilities √ Crew assignment √

Reports √ Document mark-ups √

Wireless connectivity √ BIM integration √


BIM metadata assignment √ Budget deviation alert due to delays and unexpected occurrence

√

Object tagging √


Applicability Watch



Date: 2015-06-30



Figure 15: Document Markup

Website: http://isnag.info/


Allows the user to pinpoint the location of “snags” via drawings, plans or elevations

Provide rich contextual information including photos, video and voice recordings; the user can markup the photos to further describe snags, defects and other site issues

Interrogates the status of the entire snagging and inspection process with live Dashboard reports; monitor contractor and inspection team performance via league tables and s-curve reports; report on overdue actions, recurring issues, areas for improvement and bottlenecks.

Subcontractors and package managers are notified when new snags are raised or existing inspections are failed or completed

Capability for offline works with no reliance on internet connectivity and synchronizes records when a connection is available.

3.1.2.4.3 ACCEPT Integration

Table 14 below shows some of the ACCEPT concept functionalities that are similar to iSnag’s features:

Table 14: iSnag Features Checklist

Feature Feature

Mobile devices integration √ Job scheduling √

Checklists √ Feedback/ratings √


√ Crew assignment √

Email capabilities √ Current design overlay √



Real time data sync √ Take photos √

Audio √ Take video √

BIM integration √ Project calendar √

BIM metadata assignment √ Object tagging √

http://isnag.info/


Applicability Watch



Date: 2015-06-30



3.1.2.5 FieldLens

3.1.2.5.1 General Overview FieldLens is designed to help construction professionals document, assign, and manage jobsite issues using any smartphone, tablet or the web. Their platform is the first and only social media technology developed specifically for the construction industry that enables entire project teams to instantly connect and collaborate with one another.

FieldLens is a cloud based construction software, used by the general contractor or a subcontractor, making communication between the Architect and client easier and is suitable for a small team or the whole project group. Figure 16 below shows two characteristic screenshots of the application.

Figure 16: FieldLens Markups

Website: http://fieldlens.com/tour

3.1.2.5.2 Strengths and Weaknesses The following list summarizes some of the most important strengths of this product:

Compatible with iOS, Android and web browsers

Languages: English, French, German, Italian, Japanese, Portuguese, Simplified Chinese, Spanish, Traditional Chinese

Free and Pro versions

Cloud based storage

The app can be used offline and synchronised automatically later

Unlimited email and phone support

Onsite training

Virtual training webinars on demand

Collaborate instantly and anywhere: superintendents, subcontractors, general contractors, designers and owners

Post and react to build issues with status updates

Include photos, videos, comments, and voice notes

Assign and track tasks through to completion


Applicability Watch



Date: 2015-06-30



Work online or offline, securely, in the cloud

Share project updates with anyone

Make project assignments to non-FieldLens users with a simple email Cc.

Use FieldLens with Revit and Navisworks, Upload files directly from Dropbox, Box, and Google Drive.

Creates daily PDF reports and meeting minutes, including weather report

Attach drawings and mark them up on-site

Track hours worked on the project.

FieldLens can be used with the Android smartwatch

Although FieldLens field is a benchmarking application in the domain of field management software, there are some weaknesses which the consortium feels that ACCEPT has the opportunity to cover. Those are summarized as follows:

User rights

User profiles

Personnel competencies

AR interface

3D visualisation as-built and as-planned on site

3.1.2.5.3 ACCEPT Integration Table 15 below, illustrates a comparison of this product’s features and capabilities with the ACCEPT concept Functionality Checklist.

Table 15: FieldLens Features Checklist

Feature Feature

Weather sensors integration √ Personnel availability √

Mobile device integration √ Notifications √

Checklists √ Roles and duties definition √



Email capabilities √ Crew assignment √



Real time data sync √ Taking videos √

Personnel attendance √ Task lists √

Personnel competencies √ Materials and equipment data base √


Applicability Watch



Date: 2015-06-30



3.1.2.6 Spike

3.1.2.6.1 General Overview The Spike device, Spike mobile app and a Smartphone, work together in order to take and share measurements, by using Laser accurate technology. Spike allows measuring an object simply with a snap from the Smartphone or Tablet. From that photo the user can capture real time measurements including height, width, area, length, and target location, as can be seen in Figure 17 below. Measurements and location are saved with the picture, and can be shared via email as a PDF, Spike File (XML), and KMZ. The Spike device pairs with the Smartphone or Tablet via Bluetooth. Spike’s laser rangefinder works together with the Smartphone’s camera, GPS, compass, and Internet connection.

Figure 17: Spike Laser measurement tool

Website: www.ikegps.com/spike/


Share captured photos and data

Capture real time measurements from a photo: main area, cutout area, and line measurement features to determine: height, width, area, and length. Additionally, capture target location — including latitude, longitude, and altitude — and distance from target

Decrease time of survey and measurements

iOS and Android devices

Take a photo of an object up to 200m away with ± 3% accuracy

Spike device connects with your Smartphone or Tablet via Bluetooth

Unit settings may be changed at any time via the Spike app settings

Battery life is limited to 4 hours of continuous use

Smartphone, tablet must support Bluetooth Smart 4.0

Measurements are stored with the photo and can be shared as a PDF, Spike File (XML), or KMZ

The Spike doesn’t give accurate results when you shoot at angle and does not adjust for converging lines that result from increased distance or height

Project calendar √

http://www.ikegps.com/spike/


Applicability Watch



Date: 2015-06-30



Some users reported the accuracy to be between 93-95% that is not always enough.

3.1.2.6.3 ACCEPT Integration This product could be included in ACCEPT in order to provide workers with an easy and fast method to take measurements on site and check them with the drawings. Table 16 below presents other features which are also related to ACCEPT concept functionalities checklist:

Table 16: Spike Features Checklist

3.1.2.7 FLIR One

3.1.2.7.1 General Overview FLIR One is a compact, iOS compatible thermal imaging camera. This is essentially a snap-on device, which connects to the back of the phone like a protective case. The device includes dual-sensor array with both a visible spectrum VGA camera and a "Lepton" long-wave infrared sensor. This equipment enables the device to produce hybrid thermal images by merging the visual information from the VGA camera with the raw thermal data captured by FLIR's 80 pixel-by-60 pixel Lepton array. Figure 18 below shows a graphical representation of FLIR One’s function.

Feature Feature

3D sensing technologies (laser scanner)

√ Digital overlay atop real world objects

√


√ Location GPS √

Cloud surveys √ Current design overlay √

Mobile devices integration √ Clash detections √

Email capabilities √ 3D visualisation of as built and as planned on site

√



Applicability Watch



Date: 2015-06-30



Figure 18: FLIROne Thermal Camera

Website: www.flir.com


MSX blending brings physical detail to raw thermal data

Solid design with long-lasting dedicated internal battery

Powerful imaging software

Lepton sensor needs periodic calibration

Design specific to iPhone 5/5s

Apps need to be consolidated

Expensive (currently is sold at approximately €349)

Low resolution thermal image may result in degraded data precision

3.1.2.7.3 ACCEPT Integration This device and the technology that drives its functions could be used as part of ACCEPT’s self-inspection functionalities, especially in regards to locating underperforming energy components, in order to help safeguard the specified Energy Efficiency of the building.

3.1.2.8 BIManywhere

3.1.2.8.1 General Overview BIManywhere is a visual BIM collaboration platform for construction and facilities management. BIManywhere mobile app for Apple iPad mobile devices provides easy and intuitive access to BIM model information anywhere on the construction job site to streamline multidiscipline collaboration, reduce workflows, and improve project efficiency. Figure 19 below, shows an example of the application in action.

http://www.flir.com/


Applicability Watch



Date: 2015-06-30



Figure 19: BIManywhere

Website: http://bimanywhere.com/


Display 4D BIM Data anywhere

Barcode scanning

Generate, scan and navigate model via QR Codes

Locate and navigate to any location in the model by using the floorplan as a map

Locate issues by utilizing pushpins for tracking issues in 2D and 3D

Model location, RFI’s and photos are streamlined across the web, the iPad and Autodesk Navisworks

All 3D objects can be hyperlinked to allow access to submittals, Operation and Maintenance manuals, warranty information and shop drawings on the iPad

Measurement and markup tools

Autodesk Navisworks integration

3.1.2.8.3 ACCEPT Integration BIManywhere incorporates a significant number of functionalities that are relevant to ACCEPT objectives. As such, the consortium believes that this is something to monitor and inform the project about any future developments as part of the subsequent deliverables, D2.3 and D2.4. Table 17 below shows a number of ACCEPT concept features related to BIManywhere:

Table 17: BIManywhere Features Checklist

Feature Feature

http://bimanywhere.com/


Applicability Watch



Date: 2015-06-30



3.1.2.9 Ubimax xBuild

3.1.2.9.1 General Overview The xBuild solution supports construction managers, engineers, architects, and construction workers onsite by providing access to relevant information on a smart glass. xBuild allows for documenting work progress and construction defects along the way. Besides tracking work backlogs, step-by-step tutorials may guide through certain tasks. For temporary staff, xBuild holds a set of specific elements to train and guide new workers though their assigned tasks with high efficiency.

Website: www.ubimax.de/index.php/en/products#solutions


Gesture control

Voice recognition

Data code scan

Localization (indoor/outdoor)

Sensor integration

Image recognition

3.1.2.9.3 ACCEPT Integration Ubimax xBuild provides solutions to the marketplace which have some similarities to ACCEPT. Since the product is in development, it should be considered as a competitor; however the consortium could think about ways of partnering with this company in order to create synergies, based on a mutual benefit. Core functionalities of xBuild that can be found in ACCEPT are listed in Table 18 below:

Table 18: Ubimax xBuild Features Checklist

QR code reader √ BIM integration √

Barcode reader √ Taking photos √

Checklists √ Task lists √


√ Mobile devices integration (only iPad)

√

Email capabilities √ Real time data sync √

Reports √ Wireless connectivity √

Location GPS √ Document mark-ups √

Feature Feature

http://www.ubimax.de/index.php/en/products#solutions


Applicability Watch



Date: 2015-06-30



3.1.2.10 MagicPlan

3.1.2.10.1 General Overview MagicPlan draws plans of a house by taking a series of photographs of the room corners and then combining them in order to create a measured plan. The plan can also have documentation by adding objects, dimensions, attributes and annotations.

The plan can be shared for free with all MagicPlan users or by paying for different formats of the plan in PDF, JPG, PNG, SVG, CSV and DXF or publish an interactive map on the web as the diagram shows in Figure 20 below:

Figure 20: MagicPlan workflow diagram

Website: www.sensopia.com/english


Faster and more accurate sketching of built spaces


√


Weather sensors integration √ Object tagging √

Infrared (Thermal Imaging) sensor integration


Location GPS √ Checklists √

Audio √ Object recognition √


√ Reports √


http://www.sensopia.com/english


Applicability Watch



Date: 2015-06-30



Real dimensions are displayed

Customization capabilities

Publish all plans on the web as interactive web sites

Update and modify existing plans

Send plans to other partners

In some cases, this application is not very precise

Only works on devices with a gyroscope; today, there are only very few phones and Android tablets with gyroscope; for this reason, the base potential of MagicPlan is very limited.

3.1.2.10.3 ACCEPT Integration ACCEPT can use this application as part of the CoOpApp, in order to enable the workers to take measurements of the constructed structure in the site, by using their Smart Glasses and compare them with the plans, with a technology inspired of MagicPlan.

3.1.2.11 Bentley-ProjectWise®

3.1.2.11.1 General Overview ProjectWise is a project team collaboration and work-sharing platform for the design and construction of infrastructure projects that provides scalable, industry-proven, interoperable AECO (Architecture, Engineering, Construction and Operations) content management, content re-use and dynamic feedback capabilities, as the diagram shows in Figure 21 below. Today ProjectWise is the industry standard with 67 of the Engineering News Record Top 100 design firms, 234 of the Bentley Infrastructure 500 Global Owners, the largest owner-operators of infrastructure assets, and 25 of the 50 U.S. Departments of Transportation using this software.


Applicability Watch



Date: 2015-06-30



Figure 21: ProjectWise Workflow Diagram

Website:http://www.bentley.com/en-US/Products/projectwise+project+team+collaboration


Work sharing

Content reuse

Dynamic feedback

ProjectWise is designed with too many options that make the interface somewhat unclear, and the features on the website are relatively scattered.

Many participants can annotate documents in real time, but they can't annotate documents together at the same time.

3.1.2.11.3 ACCEPT Integration Even though it would be technically complex to integrate this technology into ACCEPT, the operation of ProjectWise may be worth considering because it has been tested on many construction sites, in order to provide some baseline information which could be later used in the development of ACCEPT.

3.1.2.12 Chapoo

3.1.2.12.1 General Overview Chapoo unites people with different roles in projects through communication, document management, assignment of tasks and automation of processes and manages live data in the cloud with forms and reports. The Chapoo service is delivered as a Software-as-a-Service solution, no server hardware needs to be acquired and no software needs to be licensed, installed or maintained.

Website: www.chapoo.com


Supports 70+ document types, from text to image to office formats, as well as CAD formats

View, zoom or rotate a document

Print the documents and add annotations to any part of them.

Team members are always assured to be working on the latest issued version of any document

Tracks all versions and logs all modifications, providing for a detailed audit trail

Documents can be locked (check-in / check-out) to prevent users from working on the same document simultaneously

Create roles for the different types of participants to the project

The role of project administrator can be assigned to one or several users. Project administrators provide the project details, set up folder structures, define users, roles and access rights, and generally manage the day-to-day operations of the project platform.

http://www.bentley.com/en-US/Products/projectwise+project+team+collaboration

http://www.chapoo.com/


Applicability Watch



Date: 2015-06-30



Workflow processes are easy to design with an intuitive drag-and-drop graphical workflow editor and can automatically generate required tasks for specific individuals or groups of users. The project leader can obtain project-wide reports to identify bottlenecks or view the current status of one or all of their projects.

The Chapoo service provides, as an optional module, a data repository that is straightforward to use for non-programmers. Forms and tables can be built with simple drag-and-drop wizards, and the database comes with connectors to many internal and external data sources.

AproPLAN can be also integrated in Chapoo.

3.1.2.12.3 ACCEPT Integration Chapoo could be used as a foundation or as part of the Dashboard ACCEPT, in order to address the issues of interoperability, document management and sharing, cost management and improve productivity and coordination.

3.1.2.13 Siri

3.1.2.13.1 General Overview Siri is an intelligent personal assistant and knowledge navigator. The feature uses a natural language user interface to answer questions, make recommendations, and perform actions by delegating requests to a set of Web services. The software, both in its original version and as an iOS feature, adapts to the user's individual language usage and individual searches (preferences) with continuing use, and returns results that are individualized, as can be seen in Figure 22 below.

Figure 22: Siri

Website: www.apple.com/ios/siri/

3.1.2.13.2 Strengths and Weaknesses A key feature is its artificial intelligence programming aimed at allowing Sire to adapt to the user's individual language usage and individual searches (preferences); with continuing

http://www.apple.com/ios/siri/


Applicability Watch



Date: 2015-06-30



use, the return of results that are therefore individualized. Furthermore, Siri works hands-free.

3.1.2.13.3 ACCEPT Integration This product could be integrated into ACCEPT in order to provide a natural language user interface which would help to bridge heterogeneity issues and improve the communication between different people who speak different languages. The artificial intelligence feature could also be used in ACCEPT and those functionalities could be transferred to the Smart Glasses through the CoOpApp.

3.1.2.14 ARCHline

3.1.2.14.1 General Overview ARCHLine.XP is a CAD software for architects and interior designers, being used in various fields, from new building and reconstruction design, to residential and commercial interior design projects, photorealistic visualization, terrain modelling, etc.

Website: www.archlinexp.com/product-info/archline-xp-architect


An improved modern user interface that increases the speed at which someone can work around the drawing; the interface combines interactive menus, buttons and other UI elements, making it simple to switch between individual drawing and OpenGL. DirectX graphic engines are also supported

3D models can be exported into IFC format based on the IFC2x3-TC1 version; the IFC model export format generated by ARCHLine.XP is the way in which the 3D architectural model information can be transmitted to Structural, Quantity take-off or similar applications

ARCHLine.XP comes with a Floor Manager application that can be used to define the level structure of the building and the heights associated with floors. It means that if the floor named Ground Floor is activated in the building structure and walls, slabs, stairs, columns and furniture are placed the elements will automatically get their base elevations and optionally their heights from the Floor Manager settings. To move or copy to another floor, the floor needs to be activated and the elements inserted. The inserted elements will be correctly placed at the right elevation of the new current floor. This way the building is designed as it would be built in reality. The height property of any elements could be modified if a column or a window needs to cross through multiple floors. The model will automatically be updated to follow the change.

3.1.2.14.3 ACCEPT Integration ACCEPT could benefit from the room design in CAD feature as well as photorealistic renders, terrain modelling etc.

3.1.2.15 Rapiere

3.1.2.15.1 General Overview

http://www.archlinexp.com/product-info/archline-xp-architect


Applicability Watch



Date: 2015-06-30



Rapiere Software Ltd, is a company created by its four founder partners; GreenspaceLive, Architype, ChapmanBDSP and Sweett Group. It has developed a web-based building simulation platform, that will save construction practitioners time and asset owners money by running multiple building simulation scenarios of cost, carbon and energy to optimise the sustainability of the design.

Construction practitioners who may have a use for Rapiere are: architects, cost consultants and services engineers, building surveyors, agents, contractors, developer/contractors, construction clients, local authorities, estate owners and managers.

Rapiere is a Technology Strategy Board-funded project. Rapier has received seed funding from LCIF.

The platform is unique in combining all three elements of cost, energy and carbon emissions analysis for any scenario, and its capacity to synchronize with a large range of existing computer-based building design tools, as demonstrated in Figure 23 below:

Figure 23: Rapiere Carbon, Energy and Cost Analysis

Website: rapiere.net/

Strengths and Weaknesses


The following list summarizes some of the key features of the application:

The calculation of actual embodied carbon rather than current sustainability analysis which takes energy-in-use consumption as a proxy for carbon, ignoring the significant emissions associated with the actual construction of new buildings

The ability to calculate a project’s whole life energy consumption using only minimal ‘concept design stage’ information about the project

The integration of a live cost model, giving instant cost impact comparisons; present work practices require separate manual off-line costing

Reporting on the ability to create reports required by new developments to show compliance with required levels of sustainability. eg. BREEAM-LEED reporting

Rapiere Software came out of a research project. Designed by the AEC industry for the industry, it is the only next-generation, early design stage, BIM compatible solution that simultaneously performs cost, energy and carbon analysis in the cloud.

http://rapiere.net/


Applicability Watch



Date: 2015-06-30



3.1.2.15.3 ACCEPT Integration Rapiere uses early stage design data to generate a 3D Building Information Model (BIM), attribute it with specification data and use that data to calculate whole-life costs, plus determine and help reduce embodied and operational carbon. In that respect, it could be used in ACCEPT as a costing information platform for the Dashboard and used also for updating the energy and cost models as changes occur on site (fast update possibilities).

3.1.2.16 Sefaira

3.1.2.16.1 General Overview Sefaira is a web-based sustainability analysis platform specifically built for conceptual design. Sefaira is targeted towards architects, engineers, consultants and building designers. It performs whole-building physics-based analysis of water, carbon and renewable energy potential allowing designers and architects to explore design options. The software includes support for SketchUp. In 2013, Sefaira released a new plugin for SketchUp that connects energy analysis and daylight to building design. In 2014, Sefaira also released a new plugin for Autodesk Revit. In 2015, Sefaira released Sefaira Systems, a product designed for HVAC (Heating Ventilation Air Conditioning) designers to undertake system sizing and energy analysis using SketchUp and Revit models, as can be seen in Figure 24 below.

Figure 24: Sefaira Real-time Analysis

Website: sefaira.com/sefaira-architecture


Intuitive user interface

Real-time analysis plugins provide constant feedback on both energy & daylighting metrics while working

DAYSIM and Radiance-based rapid daylight analysis

Visualization and presentation of daylight graphics

The web-based functionality of the software could prove as a disadvantage if needing to be connected all the time, especially in rural locations

http://sefaira.com/sefaira-architecture/


Applicability Watch



Date: 2015-06-30



Sefaira Architecture provides performance analysis where it’s needed, inside the 3D modelling environment. Sefaira interprets models on the fly, delivering results while the design develops.

3.1.2.16.3 ACCEPT Integration Since this product is in fact a Revit or SketchUp plugin, it could be used with Revit based BIM models, in order to be applied through the system thermal analysis changes and their effect on daylighting and energy performance. ACCEPT could also use the real time feedback aspect of this program.

3.1.2.17 Issman

3.1.2.17.1 General Overview IssMan is an inexpensive system for punch (snag) list making and supports on-site issue and defect management with photo documentation. IssMan enables the tracking of issues and defects by taking photos and adding mark-ups and notes directly on a mobile device, as can be seen in Figure 25 below:

Communication and coordination between team members is an integrated function, so that the punch lists are solved in the shortest time possible. One can send e-mails, reports and assign tasks and receive instant notifications when the tasks are solved and issues are fixed.

Word, Excel or PDF reports can be sent to the team and persons involved. The user can decide whether they contain only photo documentation with some notes, or a more detailed report with all information available, to which the user can add their company logo.

All the information is safely backed up in the cloud, and the user can access it from any device at any time. IssMan is fully functional on iOS (both iPhone and iPad), Android and Web.

https://itunes.apple.com/dk/app/issman/id616626069?mt=8

https://play.google.com/store/apps/details?id=com.android1.issman.app


Applicability Watch



Date: 2015-06-30



Figure 25: Issman Photo Recording and Mark-Up

Website: issman.com/home.aspx


Take photos of issues and write notes on them

Organize issues easily in projects and reports

Assign tasks to anyone in your team

Receive instant notifications when issues are fixed

Share projects and reports with your team or clients and let them edit inside your app

Send reports in PDF, Word or Excel to team members and clients

Punch lists on iPad Mini

Mobile quality assurance

Currently only two different languages are supported, English and Danish

3.1.2.17.3 ACCEPT Integration The snagging list procedure could be translated for onsite communication through CoOpApp (or SiMaApp). The workflow system is good and could potentially be replicated. ACCEPT could also develop the functionality of taking photos and making notes to taking voice notes and benefit from the notifications and document markup capabilities of this software. The following Table 19 shows a list of other ACCEPT similar concept functionalities.

Table 19: Issman Features Checklist

3.1.2.18 Procore

3.1.2.18.1 General Overview Procore is a cloud-based construction project management software built for the industry professional. Review, create, edit, and share actionable project data with team members from any location with Procore's mobile app. Monitor deadlines and anticipate delays in

Feature Feature

Mobile Devices Integration Job Scheduling √

Checklists √ Crew assignment √

Documents Library (Including Drawings)

√ Document mark-ups √



Wireless connectivity √

http://issman.com/home.aspx


Applicability Watch



Date: 2015-06-30



permitting, inspection, or obtaining equipment as they occur. Diagnose problems as they arise and collaborate to resolve them quickly to reduce wasted time.

Project Management: Bidding, Change Orders, Contract Management, Cost Management, Daily Log, Document Management, Punch List, RFIs/Submittals, Scheduling, Timecard

Estimating: Bid Comparison, Conceptual Estimates, Proposal Generator

Accounting: Accounts Payable, Accounts Receivable, Inventory Management, JobThe following Figure 26 displays some screenshots of Procore’s interface on different devices.

Figure 26: Procore Platforms

Website: www.procore.com

3.1.2.18.2 Strengths and Weaknesses The following list describes the main functionalities of the application:

Cost, Materials Management, Purchase Order, Time & Materials Billing

Manage RFIs and submittals as soon as they require attention—cut your turnaround time in half

Mark up drawings, link RFIs, (coming soon-submittals, documents) and drop punch list items to create Real Time As-Built plans

Prioritize the most recent drawing set with automatic version tracking

Access your project directory, schedule, and record meeting minutes

Take photos and attach them to drawings and punch items

Scan QR codes to quickly locate relevant submittals in Procore

Record and view daily job site activities, weather, labour, and labour productivity

Available on iPad, iPhone, or on Android device

http://www.procore.com/mobile


Applicability Watch



Date: 2015-06-30



The product cannot be easily customized at the project level

Procore doesn’t link directly to all construction accounting software

Annual subscription-based pricing is quite high and varies by number of Active projects.

The average price is between €10,000 to €20,000 per year for unlimited licenses

Procore gives instant access to project information. It provides individual role-based permission levels to protect confidential project data and manages projects from any location with any Internet-connected device, with an easy to use interface.

3.1.2.18.3 ACCEPT Integration Procore's platform provides users with a comprehensive suite of tools to maximize project collaboration and efficiency and as such it could be considered as a competitor to ACCEPT.

However, there is an opportunity for ACCEPT concerning the Smart Glasses integration to enhance Knowledge Transfer and Quality Assurance. Furthermore, the work frame of the Procore’s platforms could provide an adequate framework for inspiration for the development of ACCEPT.

The following Table 20 presents a set of Procore features which are related to ACCEPT concept functionalities checklist:

Table 20: Procore Features Checklist

Feature Feature

Weather sensors integration √ Personnel Competencies √

Mobile Devices Integration √ Feedback/ratings √

Checklists √ Document mark-ups √



Email capabilities √ Taking videos √


Wireless connectivity √ Materials and Equipment data base √

Real Time Data sync √ Variations’ costing

Personnel Attendance √ Project calendar √

User profiles √ Budget deviation alert due to delays and unexpected occurrence

√

User access rights √ Job Scheduling √


Applicability Watch



Date: 2015-06-30



3.1.3 Smart Materials

3.1.3.1 SCHUECO

3.1.3.1.1 General Overview Schüco is one of the leading suppliers of high-quality window, door and façade systems made from aluminium, PVC-U and steel. Millions of Schüco products are used all over the world.

SchüCal is the calculation software for quotation and order processing and for job planning of Schüco window, door, façade and conservatory systems – available in the three configuration levels: basic, advanced and enterprise. The standard outputs of SchüCal include quotation, order, fabrication, delivery and billing. There is also the option to create section detail drawings, section detail transfers to CAD, fabrication time calculations as well as data transfers to ERP / PPS systems.

The SchüCal App, which is optional, is for measurements and access to latest design information and makes all such information available on site. Photos of the current attachment situation can be added or the latest partial dimensions changed directly in the mobile end device. SchüCal is automatically updated in the office through communication with the server.

Website: http://www.schueco.com/web/uk

3.1.3.1.2 Strengths and Weaknesses Product benefits

Quotation and order processing software for aluminium and steel systems

Modular system support and extension of functions in three configuration levels

2D and 3D design for windows, doors, façades and conservatories

Transfer the unit and the profile section drawings to SchüCad / S-Cad

Interface to PPS and ERP systems to transfer the calculation results

3D illustration of profile preparations and transfer to machine control

Fabrication benefits

Software support from acquisition through to fabrication and assembly

Quick and easy to use for standard units and special constructions

Full support for Schüco products with current technical and commercial data

Time saving for estimators and technicians due to concurrent calculation for statics, U value and price

Easy to change the profile system due to intelligent templates

Training, consultancy and service for software and fabrication from single source

Roles and duties definition √ Job costing √

Notifications √

http://www.schueco.com/web/uk


Applicability Watch



Date: 2015-06-30



User Interface: The menu ribbon allows for the operation of standard units and special constructions to be accelerated and simplified. The software also records the last selection made and suggests this next time. The price of the concrete unit, including all supplements, and the U value are permanently displayed.

All SchuCal project data, documents and calculations are available online and offline, for example, attachments details, cad drawings.

Laser measuring device: convenient entry of measurements

SchuCal gateway for secure access

Access to all current project data / documents in the office and the go, for example, in discussions with Architects and customers

Simple operation, optimized for mobile devices, android and ios.

Paper free project management.

Saw barcode on the profile can be scanned.

The SchüCal App for measurements and latest information on the building site makes all the information available on site. Photos of the current attachment situation can be added or the latest partial dimensions changed directly in the mobile end device. SchüCal is automatically updated in the office through communication with the server.

SchüCal offers the option of a CAD export to Autodesk products. SchüCad allows for the sections and units to be completed with attachments to building structures.

3D constructions are processed with SchüCad Inventor.

SchüCad Revit supports the digital building model (BIM) and allows for communication with architects.

3.1.3.1.3 ACCEPT Integration Table 21 below, illustrates a list of this product’s features and capabilities that comply with the ACCEPT Concept Functionality Checklist.

Table 21: Schueco Features Checklist

Feature Feature

Barcode Reader √ Job costing √

Object Tagging √ Job Scheduling √



Reports √ Clash detections √

Wireless connectivity √ Installation tutorials √

Materials and Equipment data base √ BIM integration √


Applicability Watch



Date: 2015-06-30



3.2 Innovation

This chapter describes products that are part of research programs or other innovation activities and are expected to be released in the market at a later stage. These are divided in three categories, according to their relation with ACCEPT system. Augmented reality includes devices that have the ability to integrate digital data with the real world objects in real time. Applications category presents software products that have relevant features and functionalities with the ACCEPT anticipated results. Materials section, describes smart construction materials which are embedded with digital data or functions and could be integrated with applications or BIM objects.


3.2.1.1 ODG R-7 Smart Glasses

3.2.1.1.1 General Overview This product is designed and manufactured by ODG (Osterhout Design Group). R-7 is a totally new device and is targeted towards Enterprise customers. This product is expected to be released later in 2015 or early 2016. The product delivers similar features and functions to the R-6 while being smaller, lighter and with a tighter profile. ODG R-7 supports Qualcomm's Vuforia Mobile Vision and augmented reality platform, which can be used to recognize objects, images and text. Qualcomm has already announced a Vuforia SDK (Software Development Kit) for smart glasses in order to attract developers who will create new types of applications. Figure 27 below illustrates a general overview of the product.

Figure 27: R-7 Smart Glasses

Website: www.osterhoutgroup.com/products-r7-glasses

3.2.1.1.2 Strengths and Weaknesses ODG R-7 Smart Glasses come with a powerful list of specifications as well as a comprehensive list of accessories, which make the product suitable for a large variety of uses, including construction.

http://www.osterhoutgroup.com/products-r7-glasses


Applicability Watch



Date: 2015-06-30



The following list summarizes some of the most important features of this product:

Dual 720p Stereoscopic see-thru displays at 80fps

Magnetic Removable Photocromic Shields

Bluetooth and WiFi communication capabilities

GNSS

Integrated Inertial Measuring Unit

Altitude Sensor

Humidity Sensor

Ambient Light Sensor

720p 60fps Autofocus Camera

Digital microphones

Magnetic stereo Audio ports with ear buds

ReticleOSS

Qualcomm Technologies Inc.'s VuforiaTM SDK for Digital Eyewear

Developer program

Compatibility with prescription lenses

Designed to meet high safety standards for Hazardous Environments

External battery pack

As this product is expected to launch later this year or early 2016 in the market, there is currently no information available about additional features or any weaknesses. Those will be presented as part of the next deliverable, D2.3 which is due on month 24.

3.2.1.1.3 ACCEPT Integration Table 22 below, illustrates a list of this product’s features and capabilities that comply with the ACCEPT Concept Functionality Checklist. The comparison is done based on the core functions of the device, as much of the actual performance depends on the applications that are going to be developed.

Table 22: ODG R-7 Features Checklist

Feature Feature

QR Code Reader √ Digital overlay atop real world objects

√

Barcode Reader √ Taking photos √

Location GPS √ Taking videos √


Email capabilities √ Humidity sensor √


Applicability Watch



Date: 2015-06-30



3.2.1.2 DAQRI Smart Helmet

3.2.1.2.1 General Overview DAQRI Smart Helmet, which is illustrated in Figure 28 below, is a “heads up display” safety helmet with integrated augmented reality capabilities, which can enhance human abilities in many industries by seamlessly connecting the human being to the work environment and providing relevant information instantaneously. A world class sensor package has been fused with an intuitive user experience, driven by native augmented reality software and DAQRI’s Intellitrack system for precise display and tracking.

Figure 28: Daqri Smart Helmet

Website: hardware.daqri.com/smarthelmet/

3.2.1.2.2 Strenghts and Weaknesses Some of the major product strengths and main features are listed below:

Real-time, contextual 4D content display

Protective visor

Fully transparent optics that provide always-on functionality, readable in both low light and bright ambient conditions

Integration capability with smart watches

Industrial-grade inertial measurement unit

High resolution 3D depth camera

360o navigation cameras

HD video recording support

Photography

3D mapping

http://hardware.daqri.com/smarthelmet/


Applicability Watch



Date: 2015-06-30



Reading and understanding signage and instrument data functionalities

Inellitrack tracking technology that uses the data from Daqri’s 360o navigation cameras and industrial-grade inertial measurement unit in order to avoid spatial placement errors and maintain contextual tracking anywhere.

Object recognition and tracking, using Intellitrack to build apps for Daqri Smart Helmet.

Thermal imaging (infrared) vision

Pattern recognition

Real-time video capture system

Electroencephalography sensors that will analyze stress levels to detect if a person is tired and can initiate a notification letting him know that he should probably take a break, is expected to be integrated in future versions.

At the time of writing this product is a prototype that has not yet been tested in real world conditions, although, according to the vendor company, is already available for purchase. Therefore, no safe conclusions can be derived as far as any weaknesses are concerned, however some issues may arise in the future which have to do with the following nodes:

Health and safety concerns

Battery life of the original design last about 2 hours, but newer version is expected to last closer to 12 hours

Eye site obstructions

Using pattern recognition may be somewhat limited if it relies on customized graphics from a local database, since currently there is no standard for the AR markers as a whole.

Visual cues, such as AR-ready barcodes, have to be developed in real-world components and equipment, in order for the AR functionalities to be exploited in their full potential

3.2.1.2.3 ACCEPT Integration Daqri Smart Helmet realizes the true potential of augmented reality and 4D for work environments. Applications such as those anticipated from ACCEPT can be built with the Daqri SDK and published to the Industrial App Marketplace for immediate deployment to the Daqri Smart Helmet. The functionalities that could be deployed under this procedure are summarized in Table 23 below:

Table 23: DAQRI Features Checklist

Feature Feature

QR Code Reader √ Object Tagging √

Barcode Reader √ Location GPS √

Weather sensors integration √ Current design overlay √



√


Applicability Watch



Date: 2015-06-30



3.2.1.3 Digiglasses

3.2.1.3.1 General Overview DIGIGLASSES is a research project co-funded by the European Commission through the Seventh Framework Programme (FP7/2007-2013) managed by REA1 (Research Executive Agency) through the funding scheme “Research for the Benefit of SME-s” under Grant Agreement No.315127. The project aims to develop a marketable digital tool for the visually impaired, which will be able to provide 3D vision for the users, corrected and customized for the special symptoms of the user’s eye disease. The DigiGlasses project aims to help this group of visually impaired people by providing them with a glasses like digital tool to convert the real view of the environment to a sharper, more focused picture by increasing contrast and using edge detection.

Website: http://www.digiglasses.eu/home

3.2.1.3.2 Strengths and Weaknesses This project can be monitored by the consortium in order to be informed about the developments in digital view corrections. Those features are listed below:

Image contrast corrections

Object edge detection, which will enhance object recognition

Motion detection

Colour recognition

3.2.1.3.3 ACCEPT Integration Although this research project is targeting at a different user group than ACCEPT, it is worth monitoring the developments in the field of head mounted display. In that respect, there is no direct relation as far as the concept functionalities are concerned; however there could be one in the future.

As this is an ongoing report throughout the whole ACCEPT project duration, any new information will be captured by the monitoring groups and brought into the next Market, Innovation and Applicability Watch deliverable, which is due on month 24.

3.2.1.4 Microsoft Hololens

3.2.1.4.1 General Overview

1 http://ec.europa.eu/research/rea

Mobile Devices Integration √ Installation tutorials √

Audio √ Object recognition √

Visual reminders √ Taking photos √

Wireless connectivity √ Taking videos √

http://www.digiglasses.eu/home

http://ec.europa.eu/research/rea


Applicability Watch



Date: 2015-06-30



The device for Windows Holographic, Microsoft HoloLens, which is displayed in Figure 29 below, is a smart glasses unit that is a cordless, self-contained Windows 10 computer. It uses advanced sensors, a high-definition 3D optical head-mounted display, and spatial sound to allow for augmented reality applications, with a natural user interface that the user interacts with through gaze, voice, and hand gestures.

Figure 29: Microsoft HoloLens

Website: www.microsoft.com/microsoft-hololens/en-us

3.2.1.4.2 Strenghts and Weaknesses Microsoft Hololens is a wearable device that fuses the most sophisticated display and sensor hardware with next-generation computer vision. Some of the major product strengths and main features are listed below:

Easy integration because it’s based on Windows 10

Voice, hand and eye gestures recognition

Cutting-edge fidelity

Health and safety concerns

It may be problematic with eye glasses

3.2.1.4.3 ACCEPT Integration ACCEPT could benefit from the HoloLens augmented reality capabilities, voice, hand and eye gestures recognition capabilities and bring the whole experience on the construction site in order to display 3D data in real world conditions. Other ACCEPT concept functionalities that could also be serviced are summarized in Table 24 below:


Feature Feature


√

Barcode Reader √ Current design overlay √

http://www.microsoft.com/microsoft-hololens/en-us


Applicability Watch



Date: 2015-06-30



3.2.1.5 Topsky Smart Glasses Cloud 1

3.2.1.5.1 General Overview Augmented Realtiy display Device bound to android smart Phone with integrated speakers and camera. Figure 30 below shows a graphical representation of the Smart Glasses and a snapshot of their AR functionalities.

Figure 30: Topsky Smart Glasses Cloud 1

Website: www.smartglasses-topsky.com/smartglasses-cloud.html

3.2.1.5.2 Strenghts and Weaknesses Some of the major product strengths and main features are listed below:

Weather sensors integration √ Clash detections √


√ Real time sketching/amendments √

3D sensing technologies (Laser scanner)



√ 3D visualisation of as built and as planned on site

√


Cloud surveys √ Object recognition √

Object Tagging √ Taking photos √

Mobile Devices Integration √ Taking videos √


Visual reminders √ Email capabilities √

http://www.smartglasses-topsky.com/smartglasses-cloud.html


Applicability Watch



Date: 2015-06-30



Interactive mobile

Remote control camera

Data recording

Consult weather

Consult map

Voice control

Voice dial

Based on Android Operating System

3.2.1.5.3 ACCEPT Integration Topsky Cloud 1 Smart Glasses could be used as a foundation for ACCEPT’s AR functionalities, such as digital representations overlay, animated instructions and any other feature that could actually be developed as an Android application. Other ACCEPT concept functionalities that could also be services are summarized in Table 25 below:


3.2.1.6 Magic Leap

3.2.1.6.1 General Overview Magic Leap may end up replacing most of the other SmartGlasses because it's more feature rich and has superior hardware.

Currently, this device is under development, therefore the amount of information is limited. The consortium intends to monitor this product and update the information in the subsequent deliverables D2.3 and D2.4.

Website: www.magicleap.com

Feature Feature


√









http://www.magicleap.com/


Applicability Watch



Date: 2015-06-30



3.2.1.6.2 ACCEPT Integration MagicLeap technology could be used as a foundation for ACCEPT’s AR functionalities, such as digital representations overlay, animated instructions and any other feature that is based on 3D data.

3.2.1.7 Scope AR

3.2.1.7.1 General Overview Scope AR custom-designed training and maintenance solutions allow the user to see complex procedures animated directly as overlays on the actual equipment they are using.

Website: www.scopear.com/

3.2.1.7.2 Strengths and Weaknesses Some of the major product strengths and main features are listed below:

Precise object recognition and 3D projection over existing objects

High performance animations of projected objects

Object recognition

3D model overlay over real world objects.

Animated assembly instructions

Despite the above listed advantages of this product, there are also some weaknesses that have to do mainly with a somewhat laggy interface, probably because the 3D space is being calculated by analysing the image, which depends on the light, quality etc.

3.2.1.7.3 ACCEPT Integration ACCEPT could benefit from this product by adopting the object recognition and 3D projection technology, in order to implement the functionalities based on this feature. Other ACCEPT concept functionalities that could also be benefit are summarized in Table 26 below:


Feature Feature


√







http://www.scopear.com/


Applicability Watch



Date: 2015-06-30



3.2.1.8 Atheer Air Platform

3.2.1.8.1 General Overview The Atheer AiR is a gesture based 3D Augmented Interactive Reality platform from the enterprise. It consists of the Atheer AiR Smart Glasses and the Atheer AiR OS, which are powered by benchmarking industry precision in mobile gesture recognition, comfortable visual ergonomics, and contextual augmented reality, as can be seen in the examples illustrated in Figure 31 below.

Figure 31: Atheer Air Platform

Website: www.atheerlabs.com


“Augmented interactive Reality” (AiR), combining the power of 3D augmented reality with natural interaction to unlock human productivity

Natural, gesture-based interaction

Large display area where workers can see and interact with their digital information without having to hold a physical device in their hands

Gesture recognition provides workers with an intuitive way to interact with information

Backwards compatibility with over 1 million Android applications, as well as remote desktop support, which allows access to existing enterprise applications

Atheer’s SDK is built upon the Android APIs and provides support for common 3rd party toolkits such as Qualcomm’s Vuforia SDK and the Unity 3D engine



http://www.atheerlabs.com/


Applicability Watch



Date: 2015-06-30



3.2.1.8.3 ACCEPT Integration ACCEPT could develop applications by using the platforms SDK in order to provide the foreseen functionalities of the CoOpApp and support augmented reality integration.

3.2.1.9 Bentley – Augmented Reality Hypermodels

3.2.1.9.1 General Overview The scope of the project was to examine how augmented reality could make 2D drawings easier to use on site. Special concern was given in finding the physical location that a 2D section drawing represents. It would be interesting, for instance, to display drawings at 1:1 scale, inside the physical world, at the exact position they represent. This is an interesting problem to study, as section drawings often represent wall sections, which are quickly hidden (by the wall surface) as the construction progresses. Therefore, by putting the drawing at exactly the right scale and location in the physical world, it would actually be hidden by the wall itself. Figure 32 below illustrates an example of the application in action.

Figure 32: Bentley-Augmented Reality Hypermodels

Website:http://www.bentley.com/en-US/Engineering+Architecture+Construction+Software+%20Resources/Bentley+Innovations+Portfolio/Augmented+Reality/Augmented+Reality+Hypermodels.html


Attribute display related to visible elements such as section (2D drawings) and 3D models in 1:1 scale through AR

Mobile Device integration and compatibility

Visualization of 2D section drawings easier in an location specific Augmented context using techniques such as “sliding-plane” and 2D section representation as an overlay, revealing the inside of the building (the model).

Currently the software can display only 2D drawings and 3D models at a relatively low quality of the rendering. However, the project is under development so some more updates are expected in the future. This will be monitored by the consortium and any new information will be presented in the subsequent deliverables, D2.3 and D2.4.

http://www.bentley.com/en-US/Engineering+Architecture+Construction+Software+%20Resources/Bentley+Innovations+Portfolio/Augmented+Reality/Augmented+Reality+Hypermodels.html




Applicability Watch



Date: 2015-06-30



3.2.1.9.3 ACCEPT Integration ACCEPT could use the techniques of “sliding-plane” and 2D section overlay as part of the CoOpApp and SiMaApp functionalities. 2D drawing can be displayed using an animated sliding plane that shows it being "inserted" into the real building, or a clipping technique that displays the drawing inside a clipped 3D model which in turn is inside the real building.

ACCEPT could aslo add new features in this system such as visualization of guidelines, description of technologies, materials, as well as technical workflow - to provide information about installation process of a building component and display drawings at 1:1 scale, inside the physical world, at the exact position they represent.

This project is expected to become a competitor of ACCEPT in the future, since it also targets the AEC (Architecture Engineering Construction) and FM (Field Management) domain. Therefore any developments should be closely monitored in order to pick-up any new information that could influence the development of ACCEPT

3.2.1.10 D4AR - Automated Progress Monitoring Using Images and BIM

3.2.1.10.1 General Overview D4AR is the result of a research project, carried out by the RAMAAC lab at the University of Illinois at Urbana-Champaign. D4AR models have been generated for seven ongoing construction projects, ranging from 18 to 326 million US dollars, spanning over one to three years while geographically spread from Chicago area to Kansas City.

The D4AR is commercializing by Eng. Golparvar-Fard through a spinoff company, which was started with Pea-mora and Silvio Savarese of the University of Michigan.

This research proposes a fully automated approach for construction progress tracking and as-built model visualization using unordered daily construction images collections as well as Building Information Models (BIM). Such a task currently requires manual data collection and extensive as-planned data extraction, is infrequent and error prone; automation can significantly impact the management of a project. Given a set of unordered and uncalibrated site photographs, the approach first reconstructs the building scene, traverses and labels the scene for occupancy. The BIM is subsequently fused into the reconstructed scene by a control based registration-step and is traversed and labelled for expected progress visibility. A machine learning scheme built upon a Bayesian model is proposed that automatically detects physical components in presence of occlusions and demonstrates that component-based tracking at schedule activity level could be fully automated. The resulting D4AR (4 dimensional augmented reality) model enables the as-planned and as-built models to be jointly explored with an interactive, image-based 3D viewer where deviations are automatically color-coded over the BIM. The D4AR model minimizes challenges of current progress monitoring practice and enables AEC/FM professionals to conduct various decision-enabling tasks in the virtual environment rather than the real world where is time consuming and costly.

Figure 33 below illustrates a diagram of the D4AR workflow concept.


Applicability Watch



Date: 2015-06-30



Figure 33: D4AR Workflow Diagram

Website: http://raamac.cee.illinois.edu/progressmonitoring


This systematic approach allows data to be collected easily, processing the information automatically and reporting back in a format useful for all project participants

Early detection of actual or potential performance deviations in field construction activities

Methods for operation-level monitoring of construction progress using image-based 3D point clouds and 4D Building Information Model (BIM)

4D AR- model enables the as-planned and as-built models to be jointly explored with an interactive, image-based 3D viewer where deviations are automatically color-coded over the BIM.

Visualization of progress through augmenting the as-built photograph with the as-planned data

Interoperability

The system has not been fully developed: the team still needs to perform some research in the following fields: 4D volumetric reconstruction; Progress monitoring detection; Progress sequence knowledge; construction progress monitoring for interior spaces as well as MEP (Mechanical Electrical Plumbing) and Field Management elements.

3.2.1.10.3 ACCEPT Integration The main goal of this system is to monitor construction process and communicate discrepancies between as-built and as-planned performances as soon as possible. The following features could be integrated into ACCEPT, in order to provide a foundation for some of the concept functionalities:

3D viewer where deviations are automatically color-coded over the BIM

4D Simulation as the as-planned progress information

User approach based on structure-from-motion technique to to reconstruct an as-built 4D point cloud from a set of daily images

Currently D4AR doesn't have other features such as crew management, task rescheduling etc. Therefore the consortium believes that there is an opportunity for ACCEPT within the framework of Pillar II to fill this gap.

http://raamac.cee.illinois.edu/progressmonitoring


Applicability Watch



Date: 2015-06-30



The automated progress monitoring enables different stakeholders from the construction site to conduct various decision-enabling tasks in the virtual environment in advance. As such, this approach could be integrated into ACCEPT system and embellished with additional features, in order to provide a comprehensive Field Management system.

3.2.2 Applications

3.2.2.1 Sketsha-Real-time Graphical Sharing

3.2.2.1.1 General Overview The SketSha software offers an electronic pen-box, filled with pencils, markers and highlighters for use on a graphic and digital surface displaying the usual working documents. This dematerialized pen interaction provides access to new space-time configurations: graphically interacting in a large group, sharing ideas in real-time and remotely on documents annotated together. When connected to the Internet, SketSha enables to hold meetings or work in virtual co-presence by sharing the same documents and allowing each participant to manipulate and annotate them in real-time, as the diagram shows in Figure 34 below:

Figure 34: Sketcha Workflow Diagram

Website: www.sketsha.be


Intuitive interface

Real-time distant collaboration based on hand-drawn sketches and annotations

Collaborative reviewing document

Availability on desktops or windows tablets

There is no standard vectorial export available yet.

DXF import could be improved

http://www.sketsha.be/


Applicability Watch



Date: 2015-06-30



SketSha is only relevant during a work-session, but is no yet integrated in a large process.

Requires WiFi on site

Currently is available only for Windows and Wacom tablets.

3.2.2.1.3 ACCEPT Integration ACCEPT can provide some new scenarios for SketSha, on a larger scale, always useful for improving an application and can assure graphic interaction for a site meeting with distant participants. In addition, Site Managers will be able to annotate various formats of drawings and documents in situ. Table 27 below presents other features which are also related to ACCEPT concept functionalities checklist:

Table 27: SketSha Features Checklist

3.2.2.2 SpatioData

3.2.2.2.1 General Overview SpatioData is a research project aimed at the development of a collaborative platform for the effective sharing of building-related data and supporting different activities. SpatioData hosts every relevant information in the cloud and allows authorized people to access them rapidly and easily. Figure 35 shows a typical workflow by using SpatioData.

Feature Feature

Mobile Devices Integration Real time sketching/amendments √


√ Document mark-ups √

Email capabilities √ Real Time Data sync √



Applicability Watch



Date: 2015-06-30



Figure 35: SpatioData Workflow Diagram

Website: http://spatiodata.com/


Real time activity monitoring

Events History

Different datatype in the database

Cloud storage for easier access from multiple locations and devices

As this platform is currently under development there is no information about known weaknesses. However, as already mentioned, this is a continuous task in ACCEPT project and where all information is not already available, it will presented in the subsequent deliverables, D2.3 and D2.4.

3.2.2.2.3 ACCEPT Integration Even though the development of this platform is not completely finished yet, ACCEPT could use Spatiodata to benefit from the QR code recognition and the geolocation of objects in situ (for example construction materials, some type of walls or equipment), to store and keep the information in the cloud and allow authorized people to access them. Table 28 below presents other features which are also related to ACCEPT concept functionalities checklist:

http://spatiodata.com/


Applicability Watch



Date: 2015-06-30



Table 28: SpatioData Features Checklist

3.2.2.3 AUGMATE

3.2.2.3.1 General Overview Augmate is a software development environment for Smart Glasses applications. Augmate is the first wearable platform that accelerates the development of cloud-based smart eyewear applications. The development environment allows building applications that integrate with enterprise backend services and a variety of API plug-ins. These capabilities enhance the user experience for the deskless workers that utilize the applications. It Supports Google Glass, Vuzix, Epson Moverio, Optinvent, Recon Instruments and more in progress.

Website: http://www.augmate.com/

3.2.2.3.2 Strengths and Weaknesses The following list describes the key functions of the application:

Cloud based application platform

Enterprise database plug-in capabilities for seamless integration

Enterprise level security

Connect with third party API providers to optimize user experience

Device agnostic software that maximizes hardware capabilities

3.2.2.3.3 ACCEPT Integration ACCEPT could be made public on the App Store or Augmate could be used (as a SDK) to develop parts of ACCEPT. The platform’s environment could be used for construction site application and to speed up the development of ACCEPT functionalities by using existing code and tools. Augmate is a standalone application platform, therefore it cannot be

Feature Feature

QR Code Reader √ Feedback/ratings √

Barcode Reader √ Current design overlay

Location GPS Object Tagging √

Mobile Devices Integration Document mark-ups √

Checklists √ Visual reminders





http://www.augmate.com/


Applicability Watch



Date: 2015-06-30



integrated in ACCEPT, however it could be used as a foundation for the system development.

3.2.2.4 SmartReality

3.2.2.4.1 General Overview SmartReality is an augmented reality Mobile App for Construction Projects. It can interactively display your BIM data in 3D over real objects. So far, the company has mostly shown prototypes using full VR with the Oculus Rift meant to demonstrate how the product would work with AR.

Website: http://smartreality.co/


Gesture controls

Both 3D and planar (documents) AR

Video and sound recording

Interaction with virtual models

Compatible with Epson Moverio smart glasses

From the user account dashboard, there is the ability to upload 2D plans and matching 3D models directly, on a pay-by-project basis. The system developers will then match each of the plans and models and notify the user when they are done. The user can then open up the mobile app and point it at the 2D plan in order to see a 3D representation as overlay.

3.2.2.4.3 ACCEPT Integration ACCEPT could benefit from the 3D display of BIM data as overlay on real world objects.

3.2.2.5 AR4BC

3.2.2.5.1 General Overview The project AR4BC (Augmented Reality for Building and Construction Industry) develops mobile augmented reality tools based on 4D BIM models, as illustrated in Figure 36. The applications enable real time visualization and comparison of scheduled plans with the actual situation at construction sites, as well as multimedia feedback to the BIM system using the mobile terminal. Research challenges include feature/model based markerless tracking, together with wireless transmission and interaction with large 4D BIM models.

http://smartreality.co/


Applicability Watch



Date: 2015-06-30



Figure 36: AR4BC Interaction with BIM Models

Website:www.vttresearch.com/services/digital-society/data-driven-solutions/user-interfaces/augmented-reality-and-3d-tracking

3.2.2.5.2 Strengths and Weaknesses The following list describes the core functionalities of this product:

Augmented on-site visualization

Link project plans with actual situation on-site

Augmented site journaling

Feedback to system: sign(tag) installed parts in 4D model

Attach images to 4D model, with links to the parts they show

Construction log book

Tool for building inspector during and after construction

Augmented 4D models, including virtual walkthrough inside BIM model

Vision based tracking, matching with 4D model (orientation)

GPS and position information

Interaction with BIM models

Visualization on mobile devices

WLAN and 3G data transmission

Markerless tracking based on 3D model of room

The system is currently on prototype level and the project has focused mainly on authoring and interaction aspects. Further implementation will include:

Integration into existing tools and data

Communication between the software modules

Linking the time schedules to the BIMs

Interaction and visualization of with 4D BIMs

http://www.vttresearch.com/services/digital-society/data-driven-solutions/user-interfaces/augmented-reality-and-3d-tracking

http://www.vttresearch.com/services/digital-society/data-driven-solutions/user-interfaces/augmented-reality-and-3d-tracking


Applicability Watch



Date: 2015-06-30



Feedback mechanisms (reports)

Model placement in geo coordinates

Mobile user interface and interaction

Notes on tracking methods (combining model-based, feature based and sensor-based);

Client-server implementation;

Optimizations for mobility and notes for rendering of augmented building models.

3.2.2.5.3 ACCEPT Integration AR4BC could become a potential competitor of ACCEPT in the future, since it addresses the same market sector and incorporates quite a few similar functionalities. Table 29 below, include the concept functionalities of ACCEPT that are already implemented in AR4BC:

Table 29: AR4BC Features Checklist

Feature Feature

QR Code Reader √ Job Scheduling √

Barcode Reader √ Digital overlay atop real world objects

3D sensing technologies Feedback/ratings √

Location GPS Current design overlay

Object Tagging √ Clash detections

Mobile Devices Integration 3D visualisation of as built and as planned on site

Checklists √ Object recognition

Audio √ BIM integration √


√ BIM metadata assignment


Reports √ Taking videos


Real Time Data sync √ Project calendar √


Applicability Watch



Date: 2015-06-30



3.2.2.6 SMART Vidente

3.2.2.6.1 General Overview Smart Vidente is a solution for tracking, Geo-referenced 3D models and visualization. It consists of an application and a mobile device for visualization and tracking of underground infrastructure, using augmented reality, as can be seen in Figure 37. Smart Vidente provides an interactive 3D real-time visualization of the urban underground, city model as an overlay on the real-world situation in the field, on a mobile computing device. Therefore, real-world and digital information merge into a unified view.

Figure 37: SMART Vidente System Setup

Website: www.vidente.at


Display 4D Data (Mixed Reality)

Display notes/attachments

Track real-life data

3.2.2.6.3 ACCEPT Integration Table 30 below, illustrates a list of this product’s features and capabilities that comply with the ACCEPT Concept Functionality Checklist. The comparison is done based on the core functions of the app and device.

Table 30: SMART Vidente Features Checklist

Feature Feature

AR Reader √ 3D visualisation of as built and as planned on site

√


Object Tagging √ Object recognition √

Mobile Devices Integration √ BIM integration √

http://www.vidente.at/


Applicability Watch



Date: 2015-06-30



3.2.2.7 HOLISTEEC

3.2.2.7.1 General Overview The HOLISTEEC project aims at providing the European AEC/FM industry with a comprehensive design approach taking into account the whole building life-cycle and the influence of the neighbourhoods, with the objective to make a decisive contribution to built environment energy efficiency improvement. Figure 38 below shows a diagram of the Holisteec approach.

Figure 38: Holisteec Approach

Website: www.holisteecproject.eu

3.2.2.7.2 Strengths and Weaknesses The main objective of HOLISTEEC is thus to design, develop, and demonstrate a BIM-based, on-the-cloud, collaborative building design software platform, featuring advanced


Digital overlay atop real world objects

√ Taking videos √

Current design overlay √ Clash detections √

http://www.holisteecproject.eu/


Applicability Watch



Date: 2015-06-30



design support for multi-criteria building optimization. This platform will account for all physical phenomena at the building-level, while also taking into account external, neighbourhood-level influences. However, it’s still under development, therefore more information will be available as part of the subsequent deliverables D2.3 and D2.4.

3.2.2.7.3 ACCEPT Integration Communication between different professionals, connection with e-catalogue, BIM workflow integration and Innovative and flexible user interfaces are some of the benefits that ACCEPT could have by applying the concepts of this methodology to the system and bringing this approach more close to the field. A thorough analysis of the profile nexus, databases, simulation tools and regulations is required, in order to evaluate the impact of this approach on ACCEPT.

3.3 Applicability

This chapter describes products that had been developed as part of research programs or other innovation activities and at the time of their development were expected to create an important impact when they were going to be released in the market, but did not have the anticipated success or they were never released in the market. Those are divided in three categories, according to their relation with ACCEPT system. Augmented Reality includes devices that have the ability to integrate digital data with the real world objects in real time. Applications category presents software products that have relevant features and functionalities with the ACCEPT anticipated results. Materials section, describes smart construction materials which are embedded with digital data or functions and could be integrated with applications or BIM objects.


3.3.1.1 Fraunhofer IGD - Life BC

3.3.1.1.1 General Overview This project builds on the success of BIM with the scope to fuse Building Information Models and Virtual/Augmented Reality Systems. Furthermore the project aims:

To use Augmented Reality for the visualisation of BIM data, for annotation of requests, for lifecycle documentation and monitoring of building components throughout the deployment phase

To extend the BIM with user captured data and to semantically enrich objects, elements and information branches for intelligent concatenation and information filtering on request according to role and area

To use Computer Vision based tracking technologies for determination of the pose of building components and room equipment

To use Multi-Touch-Technologies as Virtual Reality Interaction Paradigm for the visualisation of 3D architectural data

To use open standards for a seamless integration of the developed technologies into established workflows.

Figure 39 below illustrates an example of the application in action.


Applicability Watch



Date: 2015-06-30



Figure 39: Life-bc: Vision-based Tracking

Website: http://life-bc.org/


Visualization of BIM data, virtual notes, documentations, monitoring of building components through AR

Information are filtered on request according to role and area of user

Vision-based tracking technology to define the correct pose of the building components

Integration of BIM mobile systems, and geo-referenced information structures

Creation of geo-referenced annotations and transfer into the BIM

Virtual Reality Interaction Paradigm for the visualization of 3D architectural data

Interoperability of data

Although this product has a significant number of useful functionalities, it didn’t have the anticipated impact in the market. The reasons for this will be researched through the ongoing Market monitoring process and any findings will be presented as part of the next deliverables (D2.3 and D2.4).

3.3.1.1.3 ACCEPT Integration This technology can still be utilized in ACCEPT in order to implement some of the concept functionalities of ACCEPT, which are shown in Table 31 below:

Table 31: Life-bc Features Checklist

Feature Feature

3D sensing technologies √ Digital overlay atop real world objects

√

Location GPS √ Current design overlay √

http://life-bc.org/


Applicability Watch



Date: 2015-06-30



3.3.1.2 Google Glass

3.3.1.2.1 General Overview Google Glass is a type of wearable technology with an optical head-mounted display, as can be seen in Figure 40. It was developed by Google with the mission of producing a mass-market ubiquitous computer. Google Glass displays information in a smartphone-like hands-free format. However, it failed to make a great impact on the market, in terms of selling and didn't manage to establish a benchmark position in the wearable augmented reality market.

Figure 40: Google Glasses

Website: https://www.google.com/glass/start/


Great developer support

Slick and comfortable design

Easy-to-take hands-free photos

Object Tagging √ Clash detections √

Object recognition √ 3D visualisation of as built and as planned on site

√

Wireless connectivity √ BIM integration √

Materials and Equipment data base √ BIM metadata assignment

Taking videos √ Taking photos √

https://www.google.com/glass/start/


Applicability Watch



Date: 2015-06-30



Head tracking navigation

Weak security

Small field of view

Expensive

Limited battery life

Limited number of apps

Even though Google Glass has perhaps become the most sought-after, sci-fi-looking gadget that everyone wanted to wear at least once, this special characteristic had also worked against it. The high purchase cost for the normal end user, the limited practical use potentials and the somewhat unintuitive interface, prevented the mass uptake that Google was anticipating.

3.3.1.2.3 ACCEPT Integration A number of ACCEPT functionalities, especially those that would run as part of the CoOpApp could be implemented on this device as illustrated in Table 32 below:

Table 32: Google Glass Features Checklist

Feature Feature


√


Weather sensors integration √ Clash detections √


√ Real time sketching/amendments √




√ 3D visualisation of as built and as planned on site

√

Location GPS √ Object recognition √

Object Tagging √ BIM integration √

Mobile Devices Integration Taking photos √

Audio √ Taking videos √

Visual reminders Task lists √


√ User profiles √


Applicability Watch



Date: 2015-06-30



3.3.1.3 Ruhr-Universität Bochum - Augmented-Reality-basiertes Facility

Management

3.3.1.3.1 General Overview This research developed a conceptual framework that uses BIM and natural markers (e.g. exit signs) for AR-based facility maintenance support, as can be seen in Figure 41. The proposed workflow is comprised of three major activities: Digital Work Order Compilation, AR-based Indoor Navigation, and AR-based Maintenance Instructions. Experiments on campus and preliminary results indicate the feasibility and potential of combining BIM and natural markers for AR-based maintenance support.

Figure 41: Augmented-Reality-basiertes Facility Management

Website:https://www.inf.bi.ruhr-uni-bochum.de/index.php?option=com_ content&view=article&id=160&Itemid=279&lang=en

3.3.1.3.2 Strengths and Weaknesses Even though the system is not thoroughly developed, there are some core functionalities that could be used as a reference for some of the ACCEPT features, as listed below.

AR for assembly instructions on site

Use of BIM and natural markers

Results of experiments are prominent and confirm the feasibility of combining BIM and natural markers for AR-based maintenance support

3.3.1.3.3 ACCEPT Integration As already mentioned, this project did not reach full development, for reasons currently not known to the consortium, however there is the opportunity to use the approach used in this system as a framework for the development of relevant ACCEPT features, related to the use of augmented reality and the integration of BIM elements to natural markers on-site.


https://www.inf.bi.ruhr-uni-bochum.de/index.php?option=com_%20content&view=article&id=160&Itemid=279&lang=en

https://www.inf.bi.ruhr-uni-bochum.de/index.php?option=com_%20content&view=article&id=160&Itemid=279&lang=en


Applicability Watch



Date: 2015-06-30



3.3.1.4 VTT - Augmented Assembly

3.3.1.4.1 General Overview Augmented Assembly is a research project at VTT Technical Research Centre of Finland Ltd, where AR technology is applied to increase assembly efficiency. In augmenting assembly work, the assembly worker is guided with virtual objects for part models, assembly tools, and assembly instructions, as described in the Framework Diagram displayed in Figure 42. The worker sees the augmented view through light weight head mounted devices (e.g. data glasses), and sensors provide feedback from the performed operations. This research project has been launched in August 2006, and was scheduled to finish in September 2008. However, no additional information are available about its market uptake.

Figure 42: Augmented Assembly Framework

Website: http://www2.vtt.fi/proj/augasse/?lang=en


Development of the product design / manufacturing process to support AR

Integration of AR to production control systems

Content development for Augmented Assembly

Studying the use of AR equipment in assembly work

Inclusion of sensor feedback into AR information

Development of a demonstration system for Augmented Assembly

3.3.1.4.3 ACCEPT Integration Even though this project did not create marketable results, there is an opportunity for ACCEPT to use the concepts and framework developed as a foundation for the integration with assets as overlay. This will mainly be used for the CoOpApp to provide video overlay capabilities of complex CAD models above real world objects, in order to highlight specific information regarding a component.

http://www2.vtt.fi/proj/augasse/?lang=en


Applicability Watch



Date: 2015-06-30



3.3.2 Applications

3.3.2.1 Fraunhofer IGD - Real time 3D Difference Detection with 3D Cameras

3.3.2.1.1 General Overview 3D difference detection is the task to verify whether there are 3D differences between an object and a 3D model of this object. Detecting differences between a real object and a 3D model of this object is required for industrial tasks such as prototyping, manufacturing and assembly control. Stationary laser scanners provide a high measurement precision, but are very expensive. Furthermore, their positions need to be recalibrated after each repositioning.

Depth cameras measure 3D surfaces in real time. Thus, differences between an object and a 3D model can be detected on-the-fly. For example, 3D surfaces can be measured in real time with a hand-held Kinect or with a time-of-flight based depth camera. The advantage of such an approach is that the 3D camera can be moved around the object while differences are detected. This provides a better flexibility than approaches using stationary laser scanners.

The accuracy of real-time 3D difference detection is improved by on-the-fly 3D reconstruction. Furthermore, 3D depth cameras (such as a Kinect) can be combined with other sensors. For example, industrial measurement arms provide precise measurements of the position and orientation of depth cameras. Furthermore, 3D measurements acquired by depth cameras can be combined with 3D measurements of stationary laser scanners, as can be seen in Figure 43 below.

Figure 43: Real 3D Difference Detection

Website: www.igd.fraunhofer.de/en/Institut/Abteilungen/VRAR/Projekte/Real-time-3D-Difference-Detection-3D-Cameras


Real-time 3D differences detection for quality check

Low cost approach in comparison to stationary laser scanner

http://www.igd.fraunhofer.de/en/Institut/Abteilungen/VRAR/Projekte/Real-time-3D-Difference-Detection-3D-Cameras

http://www.igd.fraunhofer.de/en/Institut/Abteilungen/VRAR/Projekte/Real-time-3D-Difference-Detection-3D-Cameras


Applicability Watch



Date: 2015-06-30



Probably, this research project has not been commercialized because it still needs improvements and further research, the market would not be yet ready for that kind of application, and more funds are needed for technology transfer.

3.3.2.1.3 ACCEPT Integration This technology can still be utilized in ACCEPT in order to implement the functionalities shown in Table 33 below:

Table 33: Real-time 3D Features Checklist

3.3.2.2 ManuVAR

3.3.2.2.1 General Overview ManuVAR is a European 7th Framework project that ran from 2009 through 2012.The objective of ManuVAR was to develop an innovative technology platform and a framework to support high value manual work throughout the product lifecycle, through the use of virtual and augmented reality technology. The project is divided in five different clusters that correspond to different domains. Cluster 3 – Remote maintenance, utilizes augmented reality technologies in order to enhance remote online maintenance support in the railway sector. The solution consists of using a pair of augmented reality goggles and video streaming over the internet to connect the onsite worker with a central location, or “hub”. The concept of this procedure is demonstrated in Figure 44 below.

Feature Feature

3D sensing technologies √ Digital overlay atop real world objects

√

Clash detections √ Current design overlay √

Object recognition √ 3D visualisation of as built and as planned on site

√

Materials and Equipment data base √ Taking photos √

Roles and duties definition √ Budget deviation alert due to delays and unexpected occurrence

√


Applicability Watch



Date: 2015-06-30



Figure 44: Concept of AR-based Remote Maintenance Support

Website: http://www.manuvar.eu

3.3.2.2.2 Strengths and Weaknesses The project demonstrates how time and resource dedication to maintenance tasks can be reduced through the use of AR technology, asset availability can be increased and in addition AR footage can be used at a later date for training purposes or for feedback into the product or system lifecycle. Other advantages include the following:

Corrective maintenance can be undertaken swiftly

Documents and drawings are available to the user through the head mounted AR device

Ensures that the user gets all the detailed information about the work to be done

Risk mitigation of poor communication and faulty diagnostics

Real-time audio and visual support together with information fed from engineering models, equipment condition data and historical maintenance records

Although the ManuVAR project was completed in 2012, there is no evidence about the market exploitation of the results so far, therefore it is difficult to identify any weaknesses of this application yet. However, some key weaknesses are likely to affect the application’s performance and these are listed below:

The worker’s distance from the equipment varies from over 2m down to 20cm, so a careful calibration and positioning of markers and advanced tracking is required

A markerless or hybrid tracking system is needed in order to avoid the need to position temporary markers on the components

3.3.2.2.3 ACCEPT Integration As mentioned above, this application did not yet demonstrate a strong market presence; however there are some relevant features to ACCEPT concept functionalities that could be evaluated and potentially be used in ACCEPT. Those are listed in Table 34 below:

http://www.manuvar.eu/


Applicability Watch



Date: 2015-06-30



Table 34: ManuVAR Features Checklist

3.3.2.3 RAAMAC lab at University of Illinois at Urbana-Champaign - Automated

mapping of actual thermal properties to gbXML-based BIM elements

3.3.2.3.1 General Overview Given as-designed BIM, the goal of this research is to create and validate a new automated method for mapping thermography-based thermal property measurement to the associated BIM elements and updating the corresponding thermal property in gbXML schema. This shortens gaps between as-planned in BIM and the as-built in real conditions.

The system first produces a 3D thermal model for the building under inspection and then derives the actual thermal resistances of the building assemblies at the level of 3D vertexes. By associating these measurements with their corresponding elements in gbXML, thermal properties of the BIM elements are automatically updated, as can be seen in Figure 45 below.

Figure 45: EPAR Energy Performance Augmented Reality

Website: http://raamac.cee.illinois.edu/epar


Feature Feature

Mobile Devices Integration √ Digital overlay atop real world objects

√

Audio √ Installation tutorials √


Feedback/ratings √ Taking videos √

http://raamac.cee.illinois.edu/epar


Applicability Watch



Date: 2015-06-30



Methods for automated mapping of thermal properties of building components

Interoperability: through gbXML schema is possible to exchange building information between BIM and energy simulation tools

The system has not been fully developed: it still needs to perform some research and experiments to validate the applicability of the system for building environments at different levels of complexity. Some issues have to be investigated, e.g. how separated 3D thermal models – each representing a separate building space – can be integrated and leveraged to update thermal properties of their corresponding BIM elements.

This research is more address to existing buildings. Nevertheless, it could be used in new buildings as well. Once the building is finished, it is possible to map actual thermal properties and compare with as-planned model.

This research project has not been commercialized probably because it still needs improvements and further research, the market would not be yet ready for that kind of application and more fund are needed for technology transfer.

3.3.2.3.3 ACCEPT Integration The results of this project could be leveraged in ACCEPT, however an evaluation has to be made whether it would be feasible, considering that this system can be used when the building is completed. Table 35 below, shows some of ACCEPT functionalities that could be serviced by this application.

Table 35: EPAR Features Checklist

3.3.2.4 RAMAAC-Automatic Semantic Models Generating and Materials

Classification

3.3.2.4.1 General Overview The modelling process mainly consists of three sequential steps: data collection, modelling, and analysis. In current practice, these steps are performed manually by surveyors, designers, and engineers. Such manual tasks can be time-consuming, prohibitively expensive, and prone to errors. While the analysis stage is fairly quick, taking several hours to complete, data collection and modelling can be the bottlenecks of the process: the first can spread over a few days, and the latter can span over multiple weeks or even months. In consequence, the applicability of as-built modelling has been

Feature Feature



√

BIM integration √ Current design overlay √

Reports √ BIM metadata assignment √

Taking videos √ Taking photos √


Applicability Watch



Date: 2015-06-30



traditionally restricted to high latency analysis, where the model need not be updated frequently. In fast changing environments such as construction sites, due to the difficulty in rapidly updating 3D models, model-based assessment methods for purposes such as progress or quality monitoring have had very limited applications. There is a need for a low-cost, reliable, and automated method for as-built modelling. This method should quickly generate and update accurate and complete semantically-rich models in a master format that is translatable to any engineering scenario and can be widely applied across all construction projects.

Through ongoing research, RAAMAC identifies and addresses the three main problems in the automated production of semantically-rich SGM (Solid Geometric Models) compatible with the IFC (Industry Foundation Classes) format for BIM:

Data Segmentation: techniques in recognition are required to segment a 3D point cloud dataset based on geometric and appearance information into distinct subsets;

Surface Object Modeling: techniques in geometric modeling and recognition are needed to populate the scene with distinct surface objects based on the segmented subsets;

Semantic Object Placement: techniques in recognition are required to identify the physical relationships between surface objects and place IFC objects in the scene.

Methods for automatic generation and update of as-built modelling from laser scanning

Website: http://raamac.cee.illinois.edu/segmentation

http://raamac.cee.illinois.edu/material-classification


Semantic information associated with building elements

Vison-based method for material data assignments to BIM models

Available construction material library

Interoperability with IFC format

Low-cost, reliable, and automated methods

Improvement of existing systems that assist with semi-automated segmentation and placement of architectural and building elements.

Techniques for data segmentation have not been fully developed; they still need to perform some research and experiments.

Some aspects have to be investigated such as leveraging appearance data to minimize over-segmentation, NURBS fitting to minimize incompleteness and parallelized implementations to reduce computation time.

Methods for material classification have to be still improved.

3.3.2.4.3 ACCEPT Integration Even though this project did not create marketable results, there is an opportunity for integration with ACCEPT. But is it has not been properly validated through scientific methods yet.

http://raamac.cee.illinois.edu/segmentation

http://raamac.cee.illinois.edu/material-classification


Applicability Watch



Date: 2015-06-30



RAAMAC released the dataset: CML (Construction Materials Library) which contains more than 3,000 images for 20 different construction materials.

3.3.2.5 ConstructAide

3.3.2.5.1 General Overview This research describes a set of tools (ConstructAide System) for analysing, visualizing, and assessing architectural/construction progress with unordered photo collections and 3D building models. Using the interface, a user guides the registration of the model in one of the images, and the system automatically computes the alignment for the rest of the photos using a novel Structure-from-Motion (SfM) technique; images with nearby viewpoints are also brought into alignment with each other, as can be seen in Figure 46. After aligning the photo(s) and model(s), the system allows a user, such as a project manager or facility owner, to explore the construction site seamlessly in time, monitor the progress of construction, assess errors and deviations, and create photorealistic architectural visualizations. These interactions are facilitated by automatic reasoning performed by the system: static and dynamic occlusions are removed automatically, rendering information is collected, and semantic selection tools help guide user input. It has been demonstrated that the user-assisted SfM method outperforms existing techniques on both real-world construction data and established multi-view datasets.

Figure 46: ConstructAide System

Website: http://raamac.cee.illinois.edu/vision-based-quaility-monitoring/


SfM technique

Photorealistic visualization

Progress and performance monitoring (track the current state of construction to determine components which have been constructed late, on time, or constructed according to the building plan or not)

4D navigation through photos

Selectively view portions of a photographed scene at different times (past, present and future)

Creating 4D image sequence; detecting static and dynamic occlusions

http://raamac.cee.illinois.edu/vision-based-quaility-monitoring/


Applicability Watch



Date: 2015-06-30



System is based on BIM 4D and site photographs

3D point cloud model generation using a pipeline of Structure from Motion and Multi-view Stereo image-based 3D reconstruction algorithms

Any non-conformance detected is visualized in 3D on mobile devices to help inspectors identify any problems that need immediate attention

The system needs still some improvements, optimization and further development such as:

Mobile, real time implementation for field use

Better incorporation of mesh in SfM

Better error management: the system handles some tasks (occlusions and computing sun direction), but if errors occur, the user must correct these using the smart-selection tools provided by the interface.

System requires accurate and complete BIM data which are typically only available for commercial construction sites. To get the most out of this system, the BIMs must also contain semantic incomplete or inaccurate building models.

3.3.2.5.3 ACCEPT Integration ACCEPT can integrate the Vision-Based Quality Monitoring functionality in order to expedite the current practice of field inspection, which often time is labor intensive, time consuming and non-reliable.

Quality non-conformance for steel and concrete structures, clash detections, appraisal of as built against as planned drawings, video footage, 3D point cloud generation are only but a few concept functionalities that could be integrated in ACCEPT.

3.3.2.6 RAMAAC - Crowdsourcing Construction Workface Assessment from Jobsite

Videos

3.3.2.6.1 General Overview The project proposes crowd-sourcing the task of workface assessment from jobsite video streams in order to address current limitations of automated, camera-based, jobsite monitoring. By introducing an intuitive web-based platform for massive marketplaces such as AMT (Amazon Mechanical Turk) and several automated methods, the project engages the intelligence of the crowd for interpreting jobsite videos. The project aims to overcome the limitations of the current practices of workface assessment, and also provide significantly large empirical datasets together with their ground truth that can serve as the basis for developing video-based activity recognition methods. Through six extensive experiments, the project has shown that engaging non-experts on AMT to annotate construction activities in jobsite videos can provide complete and detailed workface assessment results with 85% accuracy. It shows that crowdsourcing has potential to minimize time needed for workface assessment, provides ground truth for algorithmic developments, and most importantly allows onsite professionals to focus their time on the more important task of root-cause analysis and performance improvements.

Website: http://raamac.cee.illinois.edu/new-page-2/

http://activityanalysis.cee.illinois.edu/

http://raamac.cee.illinois.edu/new-page-2/

http://activityanalysis.cee.illinois.edu/


Applicability Watch



Date: 2015-06-30



3.3.2.6.2 Strengths and Weaknesses This technology is a prototype that has been tested in six experiments. Therefore, it still needs improvements and further developments. The accuracy of workface assessment has to be improved (currently it is 85%). However, there are some core functionalities that provide solutions for the building industry such as:

Automated tracking of construction activities

Construction activity analysis

Assessment of construction activities (performance, productivity, etc.)

3.3.2.6.3 ACCEPT Integration Even though this project did not create marketable results, there is an opportunity for integration with ACCEPT as a framework for the construction management. However it has to be evaluated if it is feasible to integrate it within the ACCEPT project considering that probably it has not been properly validated through scientific methods yet.


Applicability Watch



Date: 2015-06-30



4 ACCEPT Functionality Comparison

During this Task, an initial research of the market was conducted which identified a number of products, especially applications, that already offer similar features as those anticipated in ACCEPT ecosystem. Each of these products was researched and analysed and the functionalities of the particular applications were placed in a comparison table to provide an easy visualisation of the available features, functions and solutions offered by each application. The results are shown in Table 36 below, where the available functions are marked in Green colour and the lacking options - which at the same time are the gaps that ACCEPT has the opportunity to fill - are marked in Red. Only state-of-the-art applications that already exist in the market were included in the Comparison Table. These are considered as benchmarking products for ACCEPT that may become a competitor in the future and also define a framework about the available solutions regarding digital implementation of Quality Assessment and Field Management on site, between different platforms, desktop or mobile.


ACCEPT Concept Functionalities

Auto

desk B

IM 3

60

Latis

ta

Aconex

iSn

ag

2

Fie

ldle

ns

Spik

e

FLIR

One

BIM

Anyw

here

Ubim

ax x

Bu

ild

Issm

an

Pro

core


3D visualisation of as built and as planned on site

Audio

Barcode Reader

BIM integration

BIM metadata assignment

Budget deviation alert due to delays and unexpected occurrence

Checklists

Clash detections

Cloud surveys


Applicability Watch



Date: 2015-06-30



Crew assignment

Current design overlay


Document mark-ups


Email capabilities

Feedback/ratings


Installation tutorials

Job costing

Job Scheduling

Location GPS

Materials and Equipment data base

Mobile Devices Integration

Notifications

Object recognition

Object Tagging

Personnel Attendance

Personnel Availability

Personnel Competencies

Photo real world measurement

Project calendar

QR Code Reader

Real Time Data sync


Applicability Watch



Date: 2015-06-30



Based on the above checklist and the number of ACCEPT related functionalities provided by each product, which are highlighted in green in Table 36, the compared products are ranked as shown in Table 37 below:

Table 37: Product Ranking

Real time sketching/amendments

Reports

Roles and duties definition

Taking photos

Taking videos

Task lists

Translation

User access rights

User profiles

Variations’ costing

Visual reminders

Weather sensors integration

Wireless connectivity

Product Name

Num

ber

of

rela

ted

functio

n

s

Rank

Procore 25/47 1

BIM 360 22/47 2

Fieldlens 22/47 3

iSnag 2 20/47 4

Aconex 17/47 5

Latista 15/47 6

BIM Anywhere 13/47 7

Ubimax xBuild 13/47 8


Applicability Watch



Date: 2015-06-30



Table 38 below shows the key concept functionalities that are most likely to have a greater impact opportunity. As such, they need to be considered as high priority key target functionalities. The ranking is based on the number of “gaps” of the compared products, which are marked in red in Table 36 and it can be used in order to strategically prioritize the functional and non-functional requirements of ACCEPT.

Table 38: Functionalities Impact Strength

Spike 12/47 9

Issman 11/47 10

FLIR One 2/47 11

ACCEPT Concept Functionalities 1 2 3 4 5 6 7 8 9 10 11


3D visualisation of as built and as planned on site

Audio

Barcode Reader

BIM integration

BIM metadata assignment

Budget deviation alert due to delays and unexpected occurrence

Checklists

Clash detections

Cloud surveys

Crew assignment

Current design overlay


Document mark-ups



Applicability Watch



Date: 2015-06-30



Email capabilities

Feedback/ratings


Installation tutorials

Job costing

Job Scheduling

Location GPS

Materials and Equipment data base

Mobile Devices Integration

Notifications

Object recognition

Object Tagging

Personnel Attendance

Personnel Availability

Personnel Competencies

Photo real world measurement

Project calendar

QR Code Reader

Real Time Data sync

Real time sketching/amendments

Reports

Roles and duties definition

Taking photos

Taking videos

Task lists


Applicability Watch



Date: 2015-06-30



Translation

User access rights

User profiles

Variations’ costing

Visual reminders

Weather sensors integration

Wireless connectivity


Applicability Watch



Date: 2015-06-30



5 Conclusion

This initial consideration of the marketplace and the current services being offered, as well as emerging technologies, shows that ACCEPT could provide a comprehensive solution for European SMEs in the construction sector that will make them more competitive. The research has also shown that no other solution is currently offering the holistic approach proposed in ACCEPT, especially as far as the integration of augmented reality on wearable devices, and the opportunities stemming from the exploitation of this technology, is concerned.

Nevertheless, many companies aim at providing competing solutions, so a careful watch is necessary, in order to ensure that ACCEPT meets the requirements of the users and is well positioned for commercial competitiveness and success in the QC/FM marketplace.

Procore, BIM 360 and Fieldlens seem to be currently the primary competitors of ACCEPT, since they have scored the higher number of ACCEPT related functionalities (Table 37). Therefore, the consortium needs to be aware of future developments around these products in order to establish a competitive advantage compared to what they have to offer.

Furthermore, this report documents that the functionalities of AR have opened new business possibilities in the field, offering innovative and completely different ways of engaging with construction workers, site managers and engineers. This will allow SMEs in the construction sector to make use of the advantages offered by the latest developments in wearable technologies and ubiquitous computing, in order to face market demands and competition, improve the quality and efficiency in their work and reduce costs, which in turn will improve their revenues.

The products’ functionalities comparison checklist, described in Table 36, showed that although an important number of competing products are already claiming a benchmarking position in the field, nearly none of them offers the augmented reality functionalities at such a significant scale, as it’s foreseen in ACCEPT. Therefore, this could become the key niche for ACCEPT.

This document D2.2 is the first version of the Market, Innovation and Applicability Watch for ACCEPT and it provides the framework to strengthen a common understanding of the market ecosystem, in order to help the partners to identify the challenges and market niches which provide the clearest potential for the commercialisation and sustainability of ACCEPT in the future.

The task will be active throughout the project by detecting and reporting possible market opportunities and threats. In this - first of three - deliverable, a strategy to tackle the continuous task of market monitoring is defined to ensure a streamlined and structured approach for feeding new information into the project. In the further course of the project, the subsequent deliverables will be used to update existing information about the products that have already been presented or include new technologies in an incremental way.

The results of this task will be used as a guideline to ensure that the partners are following the same goals and will help to synchronise ideas for the strategic prioritization of functional and non-functional requirements.