ParaViewWeb + Kinect

Towards accessible immersive CFD results visualisation

Introduction

• Objective of the presentation:

• Provide a synopsis of the methodology used when developing proof-of-concept ParaViewWeb + Kinect.

The aim of the ParaViewWeb+Kinect project is to evaluate feasibility and demonstrate proof-of-concept of gesture based navigation for

CFD simulation visualisation, not to provide a final product.

Component Chart

Kinect Sensor

Kinect Driver

Kinect SDK

Adapter (C#)

pvpython + pv_web_visualizer.py

Geometry + CFD results files

Visualizer/index.html

index.html+ interpreter library (JavaScript)

WebSocket

WebSocket

MouseEvent

Components Details

• C# Adapter:

SkeletonFrame DepthImageFrame

InteractionFrame

UserInfo

Broadcast as JSON

Component Details

• HTML/JavaScript

Receive JSON

Create custom HandEvents:HandMove, HandGrip, HandRelease

Display hand "cursors"

Convert HandEvents into MouseEvents (move, over, enter,

leave, down, up, click)

Implementation

Pro• Allow kinect movement with no

modification of targeted web-page;

• Allow for kinect to be hosted on different computer/OS than client;

• Support hand interaction and skeleton movement;

• Small and simple.

Cons• No recognition of hand

gesture;• One hand is dominant when

mapping hand movement to mouse movement;

• Slow;• Not 100% web-based, and

requires distribution the local C# adapter;

• Based on kinect SDK, need porting to openNI for non-kinect sensors.

Demo

• The demo is based on ParaViewWeb, but we trying to make it work other web-based services

ParaViewWeb + Kinect demo: http://youtu.be/XHXqmQPqQNs

The End

This project is standing on the shoulders of giants such Microsoft & Kitware...

Special thanks to

The Edge

and

Hack-the-Evening

Contact details:

julien.decharentenay@gmail.com

Twitter: @FormerlyHibou

https://juliendecharentenay.appspot.com