IEEE Digital Senses Initiative (DSI)IntroductionYu Yuan, PhDChair, IEEE Digital Senses InitiativeEmail: y.yuan@ieee.orgLinkedIn: http://www.linkedin.com/in/DrYuYuan

11/16/2015

digitalsenses.ieee.org

Charlotte KobertProgram Manager, IEEE Digital Senses InitiativeEmail: ckobert@ieee.org

Origin and VisionFacilitating Disruptive Innovations for Virtual Reality, Augmented Reality, and Human Augmentation

IEEE TodayThe world’s largest professional association advancing technology for humanity

MEMBERS426,000+ members

CONFERENCES

1,600+ annual conferences

PUBLICATIONS3,700,000+ technical documents

180+ top-cited periodicals

STANDARDS1,100+ active standards

500+ active projects

COUNTRIES

160+ countries

IEEE Future Directions Initiatives

IEEE Future Directions (FDC), a committee of the Technical Activities Board, identifies technologies as primary focus areas. The FDC initiates and then incubates IEEE wide initiatives involving all the IEEE operating units.

IncubationPhase 1:

Coordinate across IEEE OUs

Phase 2: Position as “One

Face” to Customers

Phase 3: Position as

“Thought Leader”Operationalize

FD Maturity Model

Graduated Initiatives– Cloud Computing– Life Sciences– Smart Grid– Transportation Electrification

Current Initiatives– Big Data– Green ICT– Rebooting Computing– Software Defined Networks– Cyber Security– Internet of Things– Smart Cities– Internet Initiative– Brain– Digital Senses

Augmented Reality

Virtual Reality

Digital SensesConceptual diagram

Mental World(“World 2” [1])

Cyber World(“World 3” [1])

perceive

synthesize

reproduce capture

Physical World(“World 1” [1])

receive

[1] Karl Popper, Three Worlds - The Tanner Lecture on Human Values (Ann Arbor, University of Michigan, 1978).

react

react

react react

react

Human

Machine

Cyber World(“World 3” [1])

Physical World(“World 1” [1])

Cyber World(“World 3” [1])

perceive

react

D

E

A

B

C

= ( A + B ) and D

= ( B or C ) and D

IEEE Digital Senses InitiativeScopeWith deeper understanding of how human senses work, we would be able to bring disruptive innovationsinto the areas of virtual reality, augmented reality, and human augmentation. IEEE Digital Senses Initiativeis dedicated to advancing technologies that capture and reproduce, or synthesize the stimuli of varioussenses (sight, hearing, touch, smell, taste, etc.), combine the reproduced or synthesized stimuli with thenaturally received stimuli in various ways, and help humans or enable machines to perceive, understandand respond to the stimuli. Plans are under way to capture all the different perspectives via in depth cross-disciplinary discussions, and to drive to a set of results which will facilitate disruptive innovations andfoster cross-industry collaborations globally in three focus areas (virtual reality, augmented reality, humanaugmentation) and many other relevant areas (wearables, consumer healthcare, smart robots, etc.).

IEEE Digital Senses InitiativeFocus areas

Virtual Reality

IEEE Digital Senses InitiativeFocus areas (cont.)

Virtual Reality type 1: Experience another world

Applications in vertical industries: Entertainment Education …

Sci-fi movies as examples:

“The Matrix”(1999)

“The Thirteenth Floor”(1999)

IEEE Digital Senses InitiativeFocus areas (cont.)

Virtual Reality type 2: Experience another place in this world

Applications in vertical industries: Scientific exploration Defense Travel Healthcare …

Sci-fi movies as examples:

“Avatar”(2009)

“Surrogates”(2009)

IEEE Digital Senses InitiativeFocus areas (cont.)

Augmented Reality

IEEE Digital Senses InitiativeFocus areas (cont.)

Human Augmentation– Enhanced and/or extended senses Enhance: The enhancement of

current sensory experiences

Extend: The extension of our senses to different perceptual spectra (such as seeing in microwaves or x-ray frequencies)

These technologies will help perceptually impaired people regain their senses but also allow new sensory experiences for everyone.

Sci-fi movies as examples:

“Transcendence”(2014)

IEEE Digital Senses InitiativeFocus areas (cont.)

Human Augmentation– Machine-Aided Reactions

Machine-Aided Reactions:Machines offload or assist with some human senses and reactions to enhance human productivity or capability.

Sci-fi movies as examples:

“RoboCop”(1987)

“Iron Man”(2008)

IEEE Digital Senses InitiativeOther relevant areas

WearablesConsumer HealthcareSmart RobotsAutonomous VehiclesSmart Homeand more...

IEEE Digital Senses InitiativeCoverage model

Privacy

Identity

Security

Trust

Ethics

Public awareness

User acceptance

Content richness

Ecosystem readiness

Transforming industries

Digital Senses Related Technologies in Gartner’s Hype Cycle

Digital Senses enabling technologies

Digital Senses enabled technologies

Gartner’s 2015 Hype Cycle for Emerging Technologies

IEEE Digital Senses InitiativeTechnology Map and Gap Analysis

Reproduce

Synthesize

React

Other senses

Capture

Sight Hearing Touch Smell Taste

Enhance

Extend

Record

?

?

?

?

? ? ? ? ?

? ? ? ? ?

? ? ? ? ?

? ? ? ? ??

?

IEEE Digital Senses InitiativeWhere is this going in 2~5 years?

DSI should be recognized globally as a thought leader, technology leader, and business leader in DSI focus areas, especially VR and AR. To build the world's most influential community in DSI focus areas

IEEE Digital Senses Community (individual membership)

To build the world's most influential alliance in DSI focus areas IEEE Digital Senses Alliance (entity membership)

To establish globally-influential and well-attended DSI events Organize a series of workshops to identify gaps, plan actions, and create

collaborations in DSI focus areas Contribute speeches, panels, or sessions to existing conferences and exhibitions

To develop a series of globally adopted standards in DSI focus areas

To publish a highly-cited annual Digital Senses Technology Outlook Role models: Gartner's Hype Cycle, IBM Global Technology Outlook

Progress and ProgramsFostering Global Collaborations for Virtual Reality, Augmented Reality, and Human Augmentation

IEEE Digital Senses InitiativeConferences and Exhibitions

Invited speeches, panels, or sessions at existing conferences and exhibitions (especially the big ones and those in conjunction with big industry events):– IEEE ICCE/CES Jan 9-10, 2016, Las Vegas, NV, USA: Mini-TTM (Technology Time Machine)

sessions at IEEE ICCE 2016 and IEEE CCNC 2016 co-located with CES 2016

– IEEE ICCE-China/CITE– IEEE ICCE-Asia/CES Asia– IEEE ICCE-Berlin/IFA– IEEE GCCE/CEATEC– IEEE GHTCE/CHTF– IEEE GEM (Games Entertainment Media Conference)– Other events (MWC, AWE, SXSW, Web Summit, etc.)

IEEE Digital Senses InitiativeWorkshops

DSI 1st workshopBoston, MA, USASep 29-30, 2015 Team forming Vision and mission Strategy and planning

DSI 2nd workshopShenzhen, ChinaNov 16-17, 2015 Reach out to industry Build visibility Recruit entity participants

DSI 3rd workshopSan Jose, CA, USANov 30-Dec 1, 2015 Reach out to industry Build visibility Recruit entity participants

These DSI workshops consist of speeches, panels and round-table discussions with invited experts and entities to identify gaps, plan actions, and create collaborations in DSI focus areas. To extend an invitation, we need to know what you can contribute to the discussion. If you would like to participate in any of the DSI workshops, please contact the DSI program manager Charlotte Kobert (ckobert@ieee.org) and the DSI chair Yu Yuan (y.yuan@ieee.org).

More workshops in other regions in 2016 are being planned

IEEE Digital Senses InitiativeStandards

Harmonize existing standardsDevelop new standards to address gaps and white spacesProvide reference implementations for selected standardsFacilitate global adoption of selected standards

IEEE Digital Senses InitiativeMembership Development

IEEE Digital Senses Community (individual membership)– Strong presence and active participation in various social media

– Membership benefits include but are not limited to tool sets / data sets /platforms that facilitate research and development in DSI focus areas

IEEE Digital Senses Alliance (entity membership)– Leverage the IEEE-SA Industry Connections program

– Form a corporate advisory board consisting of all the major stakeholders in DSI focus areas

– Facilitate the global adoption and commercialization of DSI standards

– Facilitate disruptive innovations and foster cross-disciplinary / cross-industry collaborations globally in DSI focus areas

– Membership benefits include but are not limited to tool sets / data sets /platforms that facilitate research and development in DSI focus areas

– Probably leverage the IEEE-ISTO services

IEEE Digital Senses InitiativeOther Activities

Publications– Publish a highly-cited annual Digital Senses Technology Outlook Role models: Gartner's Hype Cycle, IBM Global Technology Outlook

– Contribute special sections, special issues, or columns to existing periodicals

– Explore the possibility of creating new periodicals IEEE Transactions on Digital Senses IEEE Digital Senses Magazine

Education– Distinguished Lecture series– Webinars– Student contests– Entrepreneurship competitions

And more to come...

digitalsenses.ieee.org

Contact us for participation and collaboration opportunities

Dr. Yu Yuan, Chair of IEEE Digital Senses InitiativeEmail: y.yuan@ieee.orgLinkedIn: http://www.linkedin.com/in/DrYuYuanFacebook: http://www.facebook.com/DrYuYuanTwitter: @DrYuYuan