jim marggraff (ceo, eyefluence) the next frontier of ar/vr/mr and unlocking human potential
TRANSCRIPT
![Page 1: Jim Marggraff (CEO, Eyefluence) The Next Frontier of AR/VR/MR and Unlocking Human Potential](https://reader031.vdocuments.net/reader031/viewer/2022030317/587080cd1a28ab57368b6557/html5/thumbnails/1.jpg)
EYE-INTERACTION: THE NEXT FRONTIER OF AR/VR/MR AND UNLOCKING HUMAN POTENTIAL
Jim Marggraff, Founder & CEO @Eyefluence#AWE2016
![Page 2: Jim Marggraff (CEO, Eyefluence) The Next Frontier of AR/VR/MR and Unlocking Human Potential](https://reader031.vdocuments.net/reader031/viewer/2022030317/587080cd1a28ab57368b6557/html5/thumbnails/2.jpg)
Eyefluence Confidential
Jim Marggraff founds Eyefluence, in 2013 (StrataCom $4.5B, LeapFrog $2.5B, Livescribe) acquiring all assets (IP, technology & team) from Eye-Com.
1998 - 2012 20142013 2015
Series A Financing Led by Intel Capital, Dec 2013
Eyefluence advances core eye-tracking & eye-interaction technology with Fortune 50 partners
Dr. William Torch, neurologist, founds Eye-Com in 1998 raising $15M in NIH, DOT, DOD funding for research, technology, & prototype development.
Series B Financing Led by Motorola Solutions, July 2015
R&D GrantsNIH, DOT, DOD ‘98-’12
BACKGROUND
2016
![Page 3: Jim Marggraff (CEO, Eyefluence) The Next Frontier of AR/VR/MR and Unlocking Human Potential](https://reader031.vdocuments.net/reader031/viewer/2022030317/587080cd1a28ab57368b6557/html5/thumbnails/3.jpg)
OUR MISSION
Eyefluence transforms intent into action through your eyes
![Page 4: Jim Marggraff (CEO, Eyefluence) The Next Frontier of AR/VR/MR and Unlocking Human Potential](https://reader031.vdocuments.net/reader031/viewer/2022030317/587080cd1a28ab57368b6557/html5/thumbnails/4.jpg)
Human-Computer Interaction
Wearable Computing
Augmented & Virtual Reality
RealSense Perceptual Comp.Emotiv EEG headsetLeapMotion Hand controllerMyo Gesture controller...
HTC/Valve ViveMicrosoft HololensOculus RiftSamsung Gear VRSony MorpheusGoogle Glass VxSony GlassesEpson MoverioVuzix M100Magic LeapAvegantMeta
Interaction ModesEyesHeadHandsVoiceFaceMind
THE CENTER OF 3 HIGH GROWTH MARKETS
![Page 5: Jim Marggraff (CEO, Eyefluence) The Next Frontier of AR/VR/MR and Unlocking Human Potential](https://reader031.vdocuments.net/reader031/viewer/2022030317/587080cd1a28ab57368b6557/html5/thumbnails/5.jpg)
HMDS ARE INCOMPLETE...
![Page 6: Jim Marggraff (CEO, Eyefluence) The Next Frontier of AR/VR/MR and Unlocking Human Potential](https://reader031.vdocuments.net/reader031/viewer/2022030317/587080cd1a28ab57368b6557/html5/thumbnails/6.jpg)
...WITHOUT THE EYES
Eye-Tracking & Eye-Interaction in HMDs
NavigationActivationReadingPaging
SearchingZoomingPanning
Text Input ControlGame Interaction
Multimodal ControlMeasurementAR InteractionVR InteractionMR Interaction
![Page 7: Jim Marggraff (CEO, Eyefluence) The Next Frontier of AR/VR/MR and Unlocking Human Potential](https://reader031.vdocuments.net/reader031/viewer/2022030317/587080cd1a28ab57368b6557/html5/thumbnails/7.jpg)
IT’S ALL ABOUT THE UX
Transforming Intent Into Action...
...For Real Or Virtual Interaction
...On Any Device...
![Page 8: Jim Marggraff (CEO, Eyefluence) The Next Frontier of AR/VR/MR and Unlocking Human Potential](https://reader031.vdocuments.net/reader031/viewer/2022030317/587080cd1a28ab57368b6557/html5/thumbnails/8.jpg)
HMDs VariabilityUse Cases & Technical Requirements
![Page 9: Jim Marggraff (CEO, Eyefluence) The Next Frontier of AR/VR/MR and Unlocking Human Potential](https://reader031.vdocuments.net/reader031/viewer/2022030317/587080cd1a28ab57368b6557/html5/thumbnails/9.jpg)
RobustnessEnvironmental
User
Power
Low MIPS & mWs
Size & Placement
UI/UX
TECHNICAL CHALLENGES
Biology & Technology
![Page 10: Jim Marggraff (CEO, Eyefluence) The Next Frontier of AR/VR/MR and Unlocking Human Potential](https://reader031.vdocuments.net/reader031/viewer/2022030317/587080cd1a28ab57368b6557/html5/thumbnails/10.jpg)
SMALL, LOW POWER, LOW MIPS, ROBUSTEYE-TRACKING AND EYE-INTERACTION
![Page 11: Jim Marggraff (CEO, Eyefluence) The Next Frontier of AR/VR/MR and Unlocking Human Potential](https://reader031.vdocuments.net/reader031/viewer/2022030317/587080cd1a28ab57368b6557/html5/thumbnails/11.jpg)
THE EYE-BRAIN CONNECTION
![Page 12: Jim Marggraff (CEO, Eyefluence) The Next Frontier of AR/VR/MR and Unlocking Human Potential](https://reader031.vdocuments.net/reader031/viewer/2022030317/587080cd1a28ab57368b6557/html5/thumbnails/12.jpg)
Eyefluence Confidential
EnigmaLiteratures Warns of Visual/Cognitive
Collision: Controlling vs. Consuming
Conventional Eye Tracking “Control”
Dwell - Slow, fatiguing, frustrating, impeding thought
Winking and Blinking - Reflex, Difficult, Unnatural, Stigma
Eye-Interaction Challenge
![Page 13: Jim Marggraff (CEO, Eyefluence) The Next Frontier of AR/VR/MR and Unlocking Human Potential](https://reader031.vdocuments.net/reader031/viewer/2022030317/587080cd1a28ab57368b6557/html5/thumbnails/13.jpg)
TRANSFORMING INTENT INTO ACTIONTHE EYE-BRAIN CONNECTION
Primary visual cortex
Optic radiations
Lateral geniculate body
Optic tract
![Page 14: Jim Marggraff (CEO, Eyefluence) The Next Frontier of AR/VR/MR and Unlocking Human Potential](https://reader031.vdocuments.net/reader031/viewer/2022030317/587080cd1a28ab57368b6557/html5/thumbnails/14.jpg)
7. Gaze Anxiety
8. Movers
9. Tracking Feedback
10. Latency Fatigue
11. Multimodality
12. Improved Working Memory & Intelligence
EYEFLUENCE 12 LAWS FOR UX“LET YOUR EYES DO WHAT YOUR EYES DO”
1.Purposeful & Non-Purposeful Activation
2.Activation Context3.Gap Effect, Speed, &
Focus4.Non-Foveal
Distraction5.Transitions6.Foveal Indiscretion
![Page 15: Jim Marggraff (CEO, Eyefluence) The Next Frontier of AR/VR/MR and Unlocking Human Potential](https://reader031.vdocuments.net/reader031/viewer/2022030317/587080cd1a28ab57368b6557/html5/thumbnails/15.jpg)
Eyefluence Confidential
A NEW INTERACTION MODEL
The world’s firstuser interface for the eyes
![Page 16: Jim Marggraff (CEO, Eyefluence) The Next Frontier of AR/VR/MR and Unlocking Human Potential](https://reader031.vdocuments.net/reader031/viewer/2022030317/587080cd1a28ab57368b6557/html5/thumbnails/16.jpg)
Eyefluence Confidential
Look here
![Page 17: Jim Marggraff (CEO, Eyefluence) The Next Frontier of AR/VR/MR and Unlocking Human Potential](https://reader031.vdocuments.net/reader031/viewer/2022030317/587080cd1a28ab57368b6557/html5/thumbnails/17.jpg)
Eyefluence Confidential
![Page 18: Jim Marggraff (CEO, Eyefluence) The Next Frontier of AR/VR/MR and Unlocking Human Potential](https://reader031.vdocuments.net/reader031/viewer/2022030317/587080cd1a28ab57368b6557/html5/thumbnails/18.jpg)
VR COMMAND & CONTROL CENTER
Drones Body Cams Smart glasses
● Speed communication ● Reduce costs ● Increase response time● Improve mobile intelligence
Rapidly monitor multiple user views with bidirectional gaze overlay
![Page 19: Jim Marggraff (CEO, Eyefluence) The Next Frontier of AR/VR/MR and Unlocking Human Potential](https://reader031.vdocuments.net/reader031/viewer/2022030317/587080cd1a28ab57368b6557/html5/thumbnails/19.jpg)
AI AGENT IN AN EYE-INTERACTIVE DIALOGUE