virtual reality experience for creating and retrieving fluid knowledge

1 Mikhail Fominykh

Blue Sky Conference http://fet-eye.eu/bs-2014

Budapest, Hungary | June 17–19, 2014

Virtual Reality Experience for Creating and Retrieving Fluid

Knowledge Mikhail Fominykh Pietro Piazzolla Albena Turnina David Bertolo

Djordjije Dupljanin Jarno Vanne

Fridolin Wild Sebastian Kelle

Salvatore Distefano Victor Alvarez

Puneet Sharma Carl Smith

2 Mikhail Fominykh

Motivation

3 Mikhail Fominykh

Knowledge Preservation and Retrieval across Virtual and Real Spaces

Idea Capturing and wearing experience accessing fluid

knowledge, experience, talking, thinking, and feeling Challenges

Difficult to store and retrieve fluid knowledge Difficult to automate creation of fluid knowledge

Objective Capturing and retrieving activities in augmented and

mixed reality to facilitate training Impact

Training highly skilled workers, industry, health care

4 Mikhail Fominykh

Knowledge Preservation and Retrieval across Virtual and Real Spaces

Recording – Applying Storing - Accessing

5 Mikhail Fominykh

Knowledge Preservation and Retrieval across Virtual and Real Spaces

Recording o 3D scanning o Vision o Eye-tracking o Panoramic environment o Gestures o Voice

6 Mikhail Fominykh

7 Mikhail Fominykh

Knowledge Preservation and Retrieval across Virtual and Real Spaces

Applying o 3D scanning to match o Highlight vision area o Laser beam for Eye focus o Panoramic environment or reality o Gestures by ghost hands o Expert’s voice and ambient sound

8 Mikhail Fominykh

Knowledge Preservation and Retrieval across Virtual and Real Spaces

Evaluation Impact

Industry partners

9

10

Novice experience

11

Expert guide experience

12 Mikhail Fominykh

Knowledge Preservation and Retrieval across Virtual and Real Spaces

We can do it

13

14 Mikhail Fominykh

Blue Sky Conference http://fet-eye.eu/bs-2014

Budapest, Hungary | June 17–19, 2014

Infrastructure

Pietro Piazzolla Salvatore Distefano Politecnico di Milano

Italy

15 Mikhail Fominykh

Blue Sky Conference http://fet-eye.eu/bs-2014

Budapest, Hungary | June 17–19, 2014

Augmented Reality Learning

Sebastian Kelle Stuttgart Media University

Germany

Victor Alvarez Katholieke Universiteit Leuven

Belgium

16 Mikhail Fominykh

Blue Sky Conference http://fet-eye.eu/bs-2014

Budapest, Hungary | June 17–19, 2014

Personalization

Albena Turnina Sofia University

Bulgaria

17 Mikhail Fominykh

Blue Sky Conference http://fet-eye.eu/bs-2014

Budapest, Hungary | June 17–19, 2014

Creativity Context Engineering

Carl Smith London Metropolitan University

UK

18 Mikhail Fominykh

Blue Sky Conference http://fet-eye.eu/bs-2014

Budapest, Hungary | June 17–19, 2014

Image Processing EYE-Tracking

Puneet Sharma Norwegian University of Science and Technology

Norway

19 Mikhail Fominykh

Blue Sky Conference http://fet-eye.eu/bs-2014

Budapest, Hungary | June 17–19, 2014

Video and Compression

Jarno Vanne Tampere University of Technology

Finland

20 Mikhail Fominykh

Blue Sky Conference http://fet-eye.eu/bs-2014

Budapest, Hungary | June 17–19, 2014

Wide ICT research expertise Industry Application

Fridolin Wild Open University

UK

21 Mikhail Fominykh

Blue Sky Conference http://fet-eye.eu/bs-2014

Budapest, Hungary | June 17–19, 2014

Brokering Virtual Reality Training

Mikhail Fominykh Norwegian University of Science and Technology

Norway

22 Mikhail Fominykh

Knowledge Preservation and Retrieval across Virtual and Real Spaces

Yes, we can do it