using kinect (2) by edi
TRANSCRIPT
![Page 1: Using Kinect (2) by Edi](https://reader033.vdocuments.net/reader033/viewer/2022042714/5553a709b4c905d4448b4675/html5/thumbnails/1.jpg)
@agatestudio
Using Kinect for games
Maret, 2014
![Page 2: Using Kinect (2) by Edi](https://reader033.vdocuments.net/reader033/viewer/2022042714/5553a709b4c905d4448b4675/html5/thumbnails/2.jpg)
@agatestudio @agatestudio @agatestudio
Overview
• Kinect?
• Features
• How Kinect Works
• Using Kinect for Games
• Demo
![Page 3: Using Kinect (2) by Edi](https://reader033.vdocuments.net/reader033/viewer/2022042714/5553a709b4c905d4448b4675/html5/thumbnails/3.jpg)
@agatestudio @agatestudio @agatestudio
Kinect?
• Motion sensing device
• November 2010 – XBOX
• February 2012 – SDK for Windows
![Page 4: Using Kinect (2) by Edi](https://reader033.vdocuments.net/reader033/viewer/2022042714/5553a709b4c905d4448b4675/html5/thumbnails/4.jpg)
@agatestudio @agatestudio @agatestudio
Features
• Natural User Interface (NUI)
– Video input
– Audio input
• Kinect Fusion (object scanning and modelling)
![Page 5: Using Kinect (2) by Edi](https://reader033.vdocuments.net/reader033/viewer/2022042714/5553a709b4c905d4448b4675/html5/thumbnails/5.jpg)
@agatestudio @agatestudio @agatestudio
How Kinect Works
![Page 6: Using Kinect (2) by Edi](https://reader033.vdocuments.net/reader033/viewer/2022042714/5553a709b4c905d4448b4675/html5/thumbnails/6.jpg)
@agatestudio @agatestudio @agatestudio
How Kinect Works
• Compute Depth (using depth sensors)
– Structued Light Technique
– Stereo Images
• Get Body (and parts) data
– Machine Learning
– Get body parts from depth image
– Transform to skeleton
![Page 7: Using Kinect (2) by Edi](https://reader033.vdocuments.net/reader033/viewer/2022042714/5553a709b4c905d4448b4675/html5/thumbnails/7.jpg)
@agatestudio @agatestudio @agatestudio
How Kinect Works
Speckle-Pattern Infrared Light
![Page 8: Using Kinect (2) by Edi](https://reader033.vdocuments.net/reader033/viewer/2022042714/5553a709b4c905d4448b4675/html5/thumbnails/8.jpg)
@agatestudio @agatestudio @agatestudio
How Kinect Works
Speckle-Pattern Infrared Light
![Page 9: Using Kinect (2) by Edi](https://reader033.vdocuments.net/reader033/viewer/2022042714/5553a709b4c905d4448b4675/html5/thumbnails/9.jpg)
@agatestudio @agatestudio @agatestudio
How Kinect Works
Stereo Image (calculating depth with Parallax images)
![Page 10: Using Kinect (2) by Edi](https://reader033.vdocuments.net/reader033/viewer/2022042714/5553a709b4c905d4448b4675/html5/thumbnails/10.jpg)
@agatestudio @agatestudio @agatestudio
How Kinect Works
![Page 11: Using Kinect (2) by Edi](https://reader033.vdocuments.net/reader033/viewer/2022042714/5553a709b4c905d4448b4675/html5/thumbnails/11.jpg)
@agatestudio @agatestudio @agatestudio
Using Kinect
![Page 12: Using Kinect (2) by Edi](https://reader033.vdocuments.net/reader033/viewer/2022042714/5553a709b4c905d4448b4675/html5/thumbnails/12.jpg)
@agatestudio @agatestudio @agatestudio
Using Kinect For Games
![Page 13: Using Kinect (2) by Edi](https://reader033.vdocuments.net/reader033/viewer/2022042714/5553a709b4c905d4448b4675/html5/thumbnails/13.jpg)
@agatestudio @agatestudio @agatestudio
Using Kinect for Games
What you need :
• Kinect sensor device
• Kinect SDK
• Open area – One player: Stand back 6 feet (1.8 m).
– Two players: Stand back 8 feet (2.4 m).
– Make sure that the play space is at least 6 feet (1.8 m) wide, and not wider or longer than 12 feet (3.6 m).
![Page 14: Using Kinect (2) by Edi](https://reader033.vdocuments.net/reader033/viewer/2022042714/5553a709b4c905d4448b4675/html5/thumbnails/14.jpg)
@agatestudio @agatestudio @agatestudio
Using Kinect for Games
• Kinect SDK
– Microsoft SDK (Official for kinect)
– Open Source SDK (For other motion sensing devices : PrimeSense, Asus Xtion, etc) : OpenNI
![Page 15: Using Kinect (2) by Edi](https://reader033.vdocuments.net/reader033/viewer/2022042714/5553a709b4c905d4448b4675/html5/thumbnails/15.jpg)
@agatestudio @agatestudio @agatestudio
Using Kinect for Games
Official SDK supports only C, C++, and Visual Basic (Microsfot based)
Wrappers :
- AIR : AS3Kinect, as3NUI
- Unity : ZDK
- etc
![Page 16: Using Kinect (2) by Edi](https://reader033.vdocuments.net/reader033/viewer/2022042714/5553a709b4c905d4448b4675/html5/thumbnails/16.jpg)
@agatestudio @agatestudio @agatestudio
Using Kinect for Games
Example (using ZDK for unity)
![Page 17: Using Kinect (2) by Edi](https://reader033.vdocuments.net/reader033/viewer/2022042714/5553a709b4c905d4448b4675/html5/thumbnails/17.jpg)
@agatestudio @agatestudio @agatestudio
References
• http://gilotopia.blogspot.com/2010/11/how-does-
kinect-really-work.html • http://users.dickinson.edu/~jmac/selected-
talks/kinect.pdf • http://courses.engr.illinois.edu/cs498dh/fa2011/lectures
/Lecture%2025%20-%20How%20the%20Kinect%20Works%20-%20CP%20Fall%202011.pdf
• http://www.wisegeek.com/how-does-kinect-technology-work.htm
• http://msdn.microsoft.com/en-us/library/jj131023.aspx
![Page 18: Using Kinect (2) by Edi](https://reader033.vdocuments.net/reader033/viewer/2022042714/5553a709b4c905d4448b4675/html5/thumbnails/18.jpg)
@agatestudio @agatestudio @agatestudio
Demo