ar and big data: interoperable data repositories for collaborative work environments (cwes)
TRANSCRIPT
AR and BigData Interoperable Data Repositories for Collaborative Work Environments (CWEs) Jim Novack, Anand Gupta (TalentSwarm)
AR and Big DataInteroperable Data Repositories for Collaborative Work Environments (CWEs)
Jim Novack & Anand GuptaTalent Swarm
June 1, 2016
2
Rosetta StoneBritish MuseumUsed to communicate the royal cult of the young pharaoh in 196 BC to the maximum number of subjects. Same decree written 3 times:Hieroglyphic for the priestsDemotic which was the local script for daily useGreek, the language of the administration.
3
J.C.R. Licklider of MIT first envisioned his Galactic Network concept:
A set of globally interconnected computers which enable everyone to quickly access data and programs from any site.
3 different groups working in parallel presented papers:DARPA announcing ARPANETRAND proposing packet-switching networks for military voice communicationsNPL from UK apraising packet-switching over discrete point-to-point circuits.
Soon after, Email, the killer application introduced19621968
4
Big Data3D OnlineVideo Gaming& AR, VRTelecomWe contend that society is on the brink of another disruptive technology event brought about by the confluence of seemingly disparate advances
5
Big Data3D OnlineVideo Gaming& AR, VRTelecomWe contend that society is on the brink of another disruptive technology event brought about by the confluence of seemingly disparate advances
June 1, 2016
AR VR Market Projection 2025 June 1, 20167Enterprise AR at AWE 2016AR, VR and Big Data technologies enables new level of collaboration across many diverse fields.
The 5G technologies provide further boost to AR/VR adoption
Collaborate with Anyone, Anytime, Anywhere !
7
CWEs June 1, 20168Enterprise AR at AWE 2016
8
June 1, 20169Enterprise AR at AWE 2016
Key Components of CWEs
CWEs
9
Aircraft MaintenanceJune 1, 201610Enterprise AR at AWE 2016
Source: GE Industrial Internet Vision Paper
10
Large Construction projectsBuilding Information Modelling (BIM) is an open standard for full life cycle building management.
BIM is becoming standard during design phase.
CWE with BIM (Integrated BIM) through Interoperable data hub is the next level of evolution.
June 1, 2016Enterprise AR at AWE 201611INCREASES
Aircraft MaintenanceJune 1, 201612Enterprise AR at AWE 2016Aircraft Maintenance requires flight route info, maintenance history, part availability and location capability datasets
CWE Big Data repository stores the augmented reality based maintenance procedure.
Machine learning and predictive analytics algorithm computes the best time, place and maintenance company to perform the maintenance
Minimize the possibility of flight delay or cancellation due to mechanical failures. (May 2016 HBR Article)
~ 600 companies involved in Aircraft Maintenance, Repair and Overhaul Industry.
Companies can collaborate together to deliver the most efficient aircraft maintenance.
12
Military Use Global Military Simulation and training market is $9.3 bn
AR/VR technologies can drive the cost savings in flight and battleship simulation training.
Assuming 700K users (out of total 6.9m global military personnel) at annual AR/VR cost of $2000 means conservative estimate of Military spend in 2025 to $1.4 bnJune 1, 2016Enterprise AR at AWE 201613INCREASES
Traditional Databases vs Big DataData Structures: Traditional RDBMs databases are good at supporting structured data but not good at supporting semi-structured and unstructured data. Semi structured data does have a schema but it is not predefined. Video, and still images are unstructured data
Scalability: Traditional RDBMs system have predefined fixed size which is decided at the installation time. The big data repositories in contrast are distributed and scale to planet size without any upgrades.
Commercial Constraints: Most popular big data technologies are open source. Done right, a big data repository can be less onerous financially than traditional database one.
June 1, 2016Enterprise AR at AWE 201614INCREASES
CWE Big Data Repository ArchitectureJune 1, 2016Enterprise AR at AWE 201615INCREASES
AR/VR Big Data Repository Design - Object StorageWe recommend using more integrated offerings such as Apache Spark or MongoDb.
Use JSON format for structured and semi-structured data. Convert other file formats involved to json.
Clustered database such as MongoDb to store the json data objects.
For still image and video data use a distributed fault tolerant file system such as gluster, ceph etc. .
If using MongoDb, it comes with in-built GridFS to store the still image, video data and other entities which require file storage.June 1, 2016Enterprise AR at AWE 201616INCREASES
AR/VR Big Data Repository Design - SmartObjectThe Big Data Repository design is data driven
Smart Object is declarative specification of the attributes and behavior of a data item.The Create, Read, Update and Delete code as well as associated REST apis are auto generated at compile time. Smart object has associated state and versioning information. The Smart Object reports time series data for measurements it supports.
The command line bindings in different programming languages (such as C#) can be supported through Thrift/Yang.June 1 or 2, 2016Enterprise AR at AWE 201617INCREASES
AR/VR Big Data Repository Design - InterfacesMaster-Admin : web interface for the repository owner
Self-Serve : web interface to allow a company to subscribe
Company: web interface for company users to interact with the system
Company-product: web interface to a product owned by a company. There are interfaces to the contained information for bom-parts, suppliers, lead-times etc. to support MRP and ERP applications, such asCompany-projectCompany-LedgerCompany-AssetsCompany-InventoryJune 1 or 2, 2016Enterprise AR at AWE 201618INCREASES
AR/VR Big Data Repository Design - SecurityJune 1 or 2, 2016Enterprise AR at AWE 201619INCREASES
Security is a big concern for all software systems.
AR/VR Big Data Repository Design - SecurityAuthentication It is responsibility of the system to verify that users are indeed who they claim to be. Kerbaros like key based authentication or OpenId based authentication like oauth2 should be supported.AuthorizationThe user should have prior authorization setup by appropriate admin for access to any data element in the repository. Also it should be possible to specify access control list for each data element in the database. Further, Role Based Access Control (RBAC) should be supported.EncryptionThe entire data repository can be encrypted at rest. Also the repository will support encryption of application level data element.AuditingEvery changes to database configuration as well as read and writes to data will be recorded in an audit log.
June 1 or 2, 2016Enterprise AR at AWE 201620INCREASES
AR/VR Big Data Repository Design - Regulation
PCI DSS for managing cardholder information
HIPAA standards for managing healthcare information
NIST 80-53 catalogs security controls for all U.S. federal information systems except those related to national security
STIG for secure installation and maintenance of computer systems, defined for the US Department of Defense
European Union Data Protection Directive
Asia Pacific Economic Cooperation (APEC) data protection standardization
June 1 or 2, 2016Enterprise AR at AWE 201621INCREASES
CWE Software Platform
22
22
AR and Big DataInteroperable Data Repositories for Collaborative Work Environments (CWEs)Thank You!
June 1, [email protected]