virtual painting project by: leetal gruper tsafrir kamelo supervisor: michael kolomenkin advisor...
TRANSCRIPT
![Page 1: Virtual painting project By: Leetal Gruper Tsafrir Kamelo Supervisor: Michael Kolomenkin Advisor from 3DV systems: Sagi Katz](https://reader034.vdocuments.net/reader034/viewer/2022052603/56649db55503460f94aa6a21/html5/thumbnails/1.jpg)
Virtual painting project
By: By: Leetal Gruper Leetal Gruper Tsafrir KameloTsafrir Kamelo
Supervisor: Michael KolomenkinSupervisor: Michael KolomenkinAdvisor from 3DV systems: Sagi Katz Advisor from 3DV systems: Sagi Katz
![Page 2: Virtual painting project By: Leetal Gruper Tsafrir Kamelo Supervisor: Michael Kolomenkin Advisor from 3DV systems: Sagi Katz](https://reader034.vdocuments.net/reader034/viewer/2022052603/56649db55503460f94aa6a21/html5/thumbnails/2.jpg)
• The following project introduces a new type of interface based on the user's hand and body movements as captured by the novel 3DV systems Zcam™
Introduction
![Page 3: Virtual painting project By: Leetal Gruper Tsafrir Kamelo Supervisor: Michael Kolomenkin Advisor from 3DV systems: Sagi Katz](https://reader034.vdocuments.net/reader034/viewer/2022052603/56649db55503460f94aa6a21/html5/thumbnails/3.jpg)
Project goal
• User will be able to paint on a virtual surface
• The program is intended for small children
• The user will stand in front of the camera, paint with any part of their body they wish, and see the painting on the computer screen
![Page 4: Virtual painting project By: Leetal Gruper Tsafrir Kamelo Supervisor: Michael Kolomenkin Advisor from 3DV systems: Sagi Katz](https://reader034.vdocuments.net/reader034/viewer/2022052603/56649db55503460f94aa6a21/html5/thumbnails/4.jpg)
System description
• The system consists of the 3DV systems Zcam™ and a program that runs on windows
• The program includes inside:– Ogre – a 3D engine.– Depth camera interface.– Upper body tracking interface.
![Page 5: Virtual painting project By: Leetal Gruper Tsafrir Kamelo Supervisor: Michael Kolomenkin Advisor from 3DV systems: Sagi Katz](https://reader034.vdocuments.net/reader034/viewer/2022052603/56649db55503460f94aa6a21/html5/thumbnails/5.jpg)
The virtual paint softwareThe virtual paint software
![Page 6: Virtual painting project By: Leetal Gruper Tsafrir Kamelo Supervisor: Michael Kolomenkin Advisor from 3DV systems: Sagi Katz](https://reader034.vdocuments.net/reader034/viewer/2022052603/56649db55503460f94aa6a21/html5/thumbnails/6.jpg)
The program flow
• The user stands in front of the Zcam™
• Selects a color to paint
• Starts painting with every part of his body that cross the depth threshold
![Page 7: Virtual painting project By: Leetal Gruper Tsafrir Kamelo Supervisor: Michael Kolomenkin Advisor from 3DV systems: Sagi Katz](https://reader034.vdocuments.net/reader034/viewer/2022052603/56649db55503460f94aa6a21/html5/thumbnails/7.jpg)
The program
• Starts with a configuration dialog to setup
![Page 8: Virtual painting project By: Leetal Gruper Tsafrir Kamelo Supervisor: Michael Kolomenkin Advisor from 3DV systems: Sagi Katz](https://reader034.vdocuments.net/reader034/viewer/2022052603/56649db55503460f94aa6a21/html5/thumbnails/8.jpg)
Modes of operation
• Painting mode• Color selection mode:
– Red, green and blue– Cyan, magenta and yellow– White, orange and brown
• The user can paint in both modes. The only difference is in the interface presented on the screen
![Page 9: Virtual painting project By: Leetal Gruper Tsafrir Kamelo Supervisor: Michael Kolomenkin Advisor from 3DV systems: Sagi Katz](https://reader034.vdocuments.net/reader034/viewer/2022052603/56649db55503460f94aa6a21/html5/thumbnails/9.jpg)
First color selection screenFirst color selection screen
![Page 10: Virtual painting project By: Leetal Gruper Tsafrir Kamelo Supervisor: Michael Kolomenkin Advisor from 3DV systems: Sagi Katz](https://reader034.vdocuments.net/reader034/viewer/2022052603/56649db55503460f94aa6a21/html5/thumbnails/10.jpg)
Second color selection screenSecond color selection screen
![Page 11: Virtual painting project By: Leetal Gruper Tsafrir Kamelo Supervisor: Michael Kolomenkin Advisor from 3DV systems: Sagi Katz](https://reader034.vdocuments.net/reader034/viewer/2022052603/56649db55503460f94aa6a21/html5/thumbnails/11.jpg)
Third color selection screenThird color selection screen
![Page 12: Virtual painting project By: Leetal Gruper Tsafrir Kamelo Supervisor: Michael Kolomenkin Advisor from 3DV systems: Sagi Katz](https://reader034.vdocuments.net/reader034/viewer/2022052603/56649db55503460f94aa6a21/html5/thumbnails/12.jpg)
Passing between modes
• To move from color selection mode to the painting mode, one needs only to select a color or the eraser
• To move from the painting mode to the color selection mode, one should just press the arrow button
• To move between different color options, one needs to press the 2 arrows appearing on each side
Press the
![Page 13: Virtual painting project By: Leetal Gruper Tsafrir Kamelo Supervisor: Michael Kolomenkin Advisor from 3DV systems: Sagi Katz](https://reader034.vdocuments.net/reader034/viewer/2022052603/56649db55503460f94aa6a21/html5/thumbnails/13.jpg)
![Page 14: Virtual painting project By: Leetal Gruper Tsafrir Kamelo Supervisor: Michael Kolomenkin Advisor from 3DV systems: Sagi Katz](https://reader034.vdocuments.net/reader034/viewer/2022052603/56649db55503460f94aa6a21/html5/thumbnails/14.jpg)
![Page 15: Virtual painting project By: Leetal Gruper Tsafrir Kamelo Supervisor: Michael Kolomenkin Advisor from 3DV systems: Sagi Katz](https://reader034.vdocuments.net/reader034/viewer/2022052603/56649db55503460f94aa6a21/html5/thumbnails/15.jpg)
Fine resolution painting
• An entire hand is to crude for fine painting
• Need for doing some pre-processing on the input depth image
![Page 16: Virtual painting project By: Leetal Gruper Tsafrir Kamelo Supervisor: Michael Kolomenkin Advisor from 3DV systems: Sagi Katz](https://reader034.vdocuments.net/reader034/viewer/2022052603/56649db55503460f94aa6a21/html5/thumbnails/16.jpg)
Fine resolution painting cont.
• The algorithm we finally used was based on the assumption that we mainly paint homogenous objects
• The number of layers removed (which translate to a more or less finer resolution) is controlled from the keyboard numbers. 9 is the finest resolution possible and 1 is not removing layers at all
![Page 17: Virtual painting project By: Leetal Gruper Tsafrir Kamelo Supervisor: Michael Kolomenkin Advisor from 3DV systems: Sagi Katz](https://reader034.vdocuments.net/reader034/viewer/2022052603/56649db55503460f94aa6a21/html5/thumbnails/17.jpg)
The algorithm
1. Scan the frame in an interlace order
2. For every pixel in depth range 1. Has at least one pixel from 4 surrounding
neighbors that are at a certain distance that isn't in our depth range? 1. Don’t paint the pixel
2. Else1. Paint the pixel
![Page 18: Virtual painting project By: Leetal Gruper Tsafrir Kamelo Supervisor: Michael Kolomenkin Advisor from 3DV systems: Sagi Katz](https://reader034.vdocuments.net/reader034/viewer/2022052603/56649db55503460f94aa6a21/html5/thumbnails/18.jpg)
![Page 19: Virtual painting project By: Leetal Gruper Tsafrir Kamelo Supervisor: Michael Kolomenkin Advisor from 3DV systems: Sagi Katz](https://reader034.vdocuments.net/reader034/viewer/2022052603/56649db55503460f94aa6a21/html5/thumbnails/19.jpg)
Conclusions
• We created software that uses an RGBD camera as an input interface and creates a fun game intended for children
• This project was our first encounter with computer graphics
• We have acquired knowledge in basic computer graphics • We have also learned how to use a rendering platform
as OGRE to create all our graphical needs• For the students that will follow us and want to use
OGRE, we have created a tutorial comprising all our knowledge
![Page 20: Virtual painting project By: Leetal Gruper Tsafrir Kamelo Supervisor: Michael Kolomenkin Advisor from 3DV systems: Sagi Katz](https://reader034.vdocuments.net/reader034/viewer/2022052603/56649db55503460f94aa6a21/html5/thumbnails/20.jpg)
Thank you Michael and SagiThank you Michael and Sagifor all your help and guidancefor all your help and guidance