vr/ar meetup frankfurt #1 cinematic vr analytics

VR Meetup Frankfurt #1

Sat. 23rd of January 2016

Chuck Ian Gordon

VR Meetup Frankfurt #1

Sat. 23rd of January 2016

Chuck Ian Gordon

3futurez holodeck musical - © 2014 by GordonsArca.de - Blender Conference Oct.2014, Amsterdam 2

how to wake the superhero inside youhow to wake the superhero inside you

"It seems that I've been living two "It seems that I've been living two lifes. lifes.

One life, I am an IT consultantOne life, I am an IT consultantfor a respectable software for a respectable software company.company.

I have a social security number,I have a social security number,pay my taxes and I ...pay my taxes and I ...

... am sent by my wife to carry ... am sent by my wife to carry out the garbage. out the garbage.

The other life is lived in my The other life is lived in my Gordon Cave where I go by the Gordon Cave where I go by the alias Chuck Ian Gordon trying to alias Chuck Ian Gordon trying to help mankind qualify for the 22nd help mankind qualify for the 22nd century. "century. "

background check: background check:

Science Fiction AuthorScience Fiction Author

Cinematic VRCinematic VR

Virtual Reality AnalyticsVirtual Reality Analytics

Immersive Technology Alliance (ITA3D.com)Immersive Technology Alliance (ITA3D.com)

ManagementManagement

IT-avant-gardeIT-avant-garde

Virtualization (VMware)Virtualization (VMware)

Oracle, LinuxOracle, Linux

Virtual Reality AnalyticsKeynote

by Joerg OsarekIT-avant-gardist, Business-IT-Architect

Skilltower Institute

Business Intelligence Streamat the DOAG Conference 2015

November 17th 2015, v1.LNuremberg, Germany

Virtual Reality AnalyticsKeynote

by Joerg OsarekIT-avant-gardist, Business-IT-Architect

Skilltower Institute

Business Intelligence Streamat the DOAG Conference 2015

November 17th 2015, v1.LNuremberg, Germany

5© Skilltower Institute, 2016

Virtual Reality: The power of Immersion

VR / MR puts tough guys under a spell unlike any other mediumranging from

delight to pure horror

Try it yourself after the keynoteor visit our VR Meetup in Frankfurt.


What is happening at VR / MR? - VR is not just headsets!

Display Technology

2015: Samsung Gear, Oculus DK2, 2015: Samsung Gear, Oculus DK2, Mobile VR, Google Cardboard, +++Mobile VR, Google Cardboard, +++

2016: Oculus Rift Consumer Version2016: Oculus Rift Consumer VersionPlaystation VR (Morpheus)Playstation VR (Morpheus)HTC Vive, FOVE (Eye Tracking)HTC Vive, FOVE (Eye Tracking)Microsoft Hololens for DevelopersMicrosoft Hololens for Developers



Display Technology



FulldomesFulldomes

Leia HolodisplayLeia Holodisplay

Magic LeapMagic Leap



Display Technology Recording



FulldomesFulldomes



Google Jump Google Jump + Youtube VR+ Youtube VR

JauntVR NeoJauntVR NeoLightfield CamLightfield Cam

Lytro ImmergeLytro Immerge



Display Technology Recording

Interacting 2015: Samsung Gear, Oculus DK2, 2015: Samsung Gear, Oculus DK2, Mobile VR, Google Cardboard, +++Mobile VR, Google Cardboard, +++


FulldomesFulldomes



Google Jump Google Jump + Youtube VR+ Youtube VR

JauntVR NeoJauntVR NeoLightfield CamLightfield Cam

LeapMotionLeapMotion

Fairy LightsFairy LightsTouchableTouchableHologramHologram

VR SculptingVR Sculpting

Google SoliGoogle SoliRadar ChipRadar Chip

Disney DISHDisney DISH

ILM X-LabsILM X-Labs

Lytro ImmergeLytro Immerge


What is happening next?

* Article at theverge.com from Rich McCormick on June 30, 2015.* http://www.theverge.com/2015/6/30/8873819/mark-zuckerberg-facebook-sending-emotions-soon

Mark Zuckerberg: „we'll be able to send emotions to each other soon“… could look like this:



Quelle: Woman and pan: combined of two public domain images from www.pixabay.com




Quelle: Woman and pan: combined of two public domain images from www.pixabay.com , Quelle: Angry driver: Vladimir Mucibabic/123rf.com #4554701_l


LIKE ?


VR Analytics comes in two flavours

a) Visualization of analytics data in VR


VR Analytics comes in two flavours

a) Visualization of analytics data in VR

We don't cover this today.

b) Analyze VR experiences in your DWH


Let's Play


Level 1: Your Mission

BUILD ME THE PERFECTVR ANALYTICS PLATFORM.

MUHAHAHA...


Level 3: Approaches for displaying VR in headsets

Hybrid Rendering

Nozon.com Presenz

some light field tech

Live 3D in Game engine

(Unity3D, CryengineUnreal Engine 4, ...).

Pre-rendered

YouTube VR or 360°

VR Player apps, ...


measurement data, e.g.:measurement data, e.g.:Position 5,3,1Position 5,3,1Rotation 23°left, 18°upRotation 23°left, 18°upSpeed of movementSpeed of movement(eye position, parallax)(eye position, parallax)......

Mapping:Mapping:Position in VRPosition in VRObjects watchedObjects watchedInteractionsInteractions……

Merging with otherMerging with other

Data WarehouseData WarehouseContentContent

Enriched AnalysisEnriched Analysis

determinedeterminemeaningmeaning

MeasureMeasureAnalyzeAnalyze

← ← (Interactive live return path) ←(Interactive live return path) ←

Level 4: How to build a semanticLevel 4: How to build a semantic Meta Layer for VR Analytics? Meta Layer for VR Analytics?


Level 5: add more data sources like heart rate, voice, ...

SmartWatch:SmartWatch:heart rateheart rate

voice and moodvoice and moodanalysisanalysis

facial expressionfacial expressionrecognitionrecognition

NLP* eye NLP* eye movementsmovements

*NLP = Neuro Linguistic Programming:*NLP = Neuro Linguistic Programming: an approach to communication, personal development, and psychotherapy an approach to communication, personal development, and psychotherapy

created by Richard Bandler and John Grinder in California, United States in the 1970s.created by Richard Bandler and John Grinder in California, United States in the 1970s.


Level 5: facial expression analysis

Science Fiction? Only for Headsets?

www.affectiva.comwww.affectiva.com

The video, that watches you.The video, that watches you.analysis of facial expressions and your moodanalysis of facial expressions and your moodwith a simple webcam → Emotion Database with APIwith a simple webcam → Emotion Database with API

http://www.affectiva.com/


Mission accomplishedMission accomplished

measurement data → semantic layer

combination withadditional data(heart rate, facial expressions,eye movement)

combination withclassic data warehousedata streams

enables (NLP)conclusionsclose to thought reading andprediction of behaviour

YES. YES.MUHAHAHA...


Level Up: Entering the USEMIR era

Q-GRINS technologies introduce artificial intelligence (strong AI) and hyper intelligence into our world. Corporations, organizations, countries, AIs and HIs will be able to read our thoughts.

Eventually we are confronted with U.SE.MIRU.SE.MIR –

UUbiquitiousbiquitious SESEnsiblensible MIMIxedxedRRealityeality

QuantumQuantumTechTech

GeneticsGenetics RoboticsRobotics ITIT Nano-TechNano-Tech Space-TechSpace-Tech


I have an idea.

Let's provide themwith technology

to read our thougts.

Quelle: Wikimedia.org – Erstellt 1590 – Public Domain

Who ought to know what about us? - a comparable encounterWho ought to know what about us? - a comparable encounter


LEVEL UP!LEVEL UP! INSERT COINSINSERT COINSTO CONTINUETO CONTINUE

With great power comes great responsibility (Stan Lee)

It is up to you now.

Make your choice and shape our future.

Insights into cinematic VR - © 2015 by www.GordonsArca.de 25

Chuck Ian Gordon

Immersed Europe3rd/4th of September 2015

Murcia, Spain


YOUR MISSION:

MAKE THE GREATESTCINEMATIC VR MOVIE

OF ALL TIMESAND EARN LOTS OF MONEY


LevelsLevels


I want to make the greatestI want to make the greatest

VR movie of all times.VR movie of all times.

Please fund my project.Please fund my project.

Nobody did before.Nobody did before.

Very risky to flop.Very risky to flop.

ROI guarantee?!ROI guarantee?!


- screen version + VR version- screen version + VR version = 1.5 x shooting/work/costs = 1.5 x shooting/work/costs

- budget splitting ratios change- budget splitting ratios change- VR analytics revenue stream- VR analytics revenue stream- crowd funding enrichment - crowd funding enrichment (build fan base first) (build fan base first)

...sounds ...sounds reasonable...reasonable...

...Deal!...Deal!


Story check: Lacking: importance, passion, fun, tension, mythologyMovie: failed, VR: failed


Story check: story is:great, important,VR-responsible.Movie: good, VR: good

recommended reading (not VR):recommended reading (not VR):Christopher Vogler: The writer's journeyChristopher Vogler: The writer's journey


VR is not just headsetsVR is not just headsets

Tech+standards evolveTech+standards evolve

focus on intermediate focus on intermediate resultsresults

recommended reading (standard pipeline, not VR):recommended reading (standard pipeline, not VR):Renee Dunlop: Production Pipeline Fundamentals for Film and GamesRenee Dunlop: Production Pipeline Fundamentals for Film and Games


To get this resultTo get this resultyou need to...you need to...


- Hide the crew physically or- Hide the crew physically or

- hide them digitally - hide them digitally (track, match, blend) (track, match, blend)

- or create many things- or create many things completely in 3D completely in 3D (actor scanning, rigging, (actor scanning, rigging, mocap/animating) mocap/animating)

- Tip: use VR for preproduction- Tip: use VR for preproductionrecommended reading (not VR):recommended reading (not VR):Steve Katz: Film Directing Shot by ShotSteve Katz: Film Directing Shot by Shot


Post ProductionPost Production

User testing/VR Analytics (unpredictable behaviour)User testing/VR Analytics (unpredictable behaviour)

spatial sound, air, temperature, ...spatial sound, air, temperature, ...

(No) Avatar and Frames of reference (cockpits...)(No) Avatar and Frames of reference (cockpits...)

moving cam, horizon, zooming, panning, trackingmoving cam, horizon, zooming, panning, tracking

guiding the eye, cutting in VR, behind tree trunk, ...guiding the eye, cutting in VR, behind tree trunk, ...

VR uncanny valley effectVR uncanny valley effect


YOU WIN!YOU WIN!

keep in mind...keep in mind...


YOU WIN!YOU WIN!

keep in mind...keep in mind...

standards are necessary and standards are necessary and evolve fast.evolve fast.

meanwhile focus on meanwhile focus on intermediate results to stay intermediate results to stay open and flexible.open and flexible.

VR as part of completely new VR as part of completely new mass market technology stack mass market technology stack gives us gives us GREAT POWERGREAT POWER and and GREAT RESPONSIBILITYGREAT RESPONSIBILITY..


Gordon's Arcade: Gordon's Arcade: we create amazing science fiction VR MOVIES.we create amazing science fiction VR MOVIES.currently working on:currently working on:

Gordon's ArcadeGordon's ArcadeVR MVR Movie ovie PProducers roducers ClubClub

Early Insights and TrainingEarly Insights and Training

Producing VR ShortsProducing VR Shorts

Test and enhance the formulaTest and enhance the formula

Want to be part of it? Write to Want to be part of it? Write to

the the book: book:

www.cinematic-vr-formula.comwww.cinematic-vr-formula.com

Insights into cinematic VR - © 2015 by www.GordonsArca.de 42www.GordonsArca.de – Triftstr. 30, 61350 Bad Homburg, Germany – www.skilltower.com www.GordonsArca.de – Triftstr. 30, 61350 Bad Homburg, Germany – www.skilltower.com

Your IT business scoutYour IT business scoutfor game changing technologiesfor game changing technologies

We create amazingWe create amazingscience fiction VR moviesscience fiction VR movies


www.GordonsArca.dewww.GordonsArca.de andand www.3futurez.comwww.3futurez.com andand www.GameW0rldz.comwww.GameW0rldz.com

3futurez3futurezTMTM, GameW0rldz, GameW0rldzTMTM and Gordon's Arcade and Gordon's ArcadeTMTM and their logos are trademarks of Go and their logos are trademarks of Gordon's Arcaderdon's Arcade ; ; Titelschutz accord. to Titelschutzanzeiger 03.2012 Titelschutz accord. to Titelschutzanzeiger 03.2012

Story: Story: © by Chuck Ian Gordon, Gordon's Arcade© by Chuck Ian Gordon, Gordon's Arcade

3D modeling:3D modeling:Fabian Schempp, Chuck Ian Gordon, David McDermottFabian Schempp, Chuck Ian Gordon, David McDermott

Images: Images: All postprocessing and all unmentioned work except public domain: © Chuck Ian GordonAll postprocessing and all unmentioned work except public domain: © Chuck Ian Gordon

Title image (Natasha Angel with 3 planets): © Chuck Ian Gordon, Title image (Natasha Angel with 3 planets): © Chuck Ian Gordon, © Tobias Roetsch - www.gtgraphics.de, © #23733237 CHEN, PAO-CHIN – fotolia.com.© Tobias Roetsch - www.gtgraphics.de, © #23733237 CHEN, PAO-CHIN – fotolia.com.

Main Font proudly purchased from Kevin Christopher: Main Font proudly purchased from Kevin Christopher: http://www.kcfonts.com/2011/12/my-girl-is-retro-font.htmlhttp://www.kcfonts.com/2011/12/my-girl-is-retro-font.html

All other trademarks used and not mentioned belong to their trademark holdersAll other trademarks used and not mentioned belong to their trademark holders

creditscredits

http://www.GordonsArca.de/

http://www.3futurez.com/

http://www.GameW0rldz.com/

http://www.kcfonts.com/2011/12/my-girl-is-retro-font.html

vr/ar meetup frankfurt #1 cinematic vr analytics

Data & Analytics