my old 2002 thesis on hand gesture recognition using a web cam!
TRANSCRIPT
![Page 1: My old 2002 Thesis on Hand Gesture Recognition using a Web Cam!](https://reader035.vdocuments.net/reader035/viewer/2022070517/58cef8c71a28abab738b541d/html5/thumbnails/1.jpg)
Hand Gesture Recognition Hand Gesture Recognition Using a Web CamUsing a Web Cam
Chris GledhillChris Gledhill
![Page 2: My old 2002 Thesis on Hand Gesture Recognition using a Web Cam!](https://reader035.vdocuments.net/reader035/viewer/2022070517/58cef8c71a28abab738b541d/html5/thumbnails/2.jpg)
Project DemoProject Demo
BackgroundBackgroundProject goalsProject goalsImage CaptureImage CaptureImage ProcessingImage ProcessingImage InterpretationImage InterpretationGesture RecognitionGesture RecognitionGesture ModellingGesture ModellingProject ConclusionsProject Conclusions
![Page 3: My old 2002 Thesis on Hand Gesture Recognition using a Web Cam!](https://reader035.vdocuments.net/reader035/viewer/2022070517/58cef8c71a28abab738b541d/html5/thumbnails/3.jpg)
BackgroundBackground
Current user interfacesCurrent user interfaces– Keyboards, Rodents, Joysticks, TabletsKeyboards, Rodents, Joysticks, Tablets– 2D2D– RangeRange– Require physical contactRequire physical contactHand gesturesHand gestures– 3D3D– IntuitiveIntuitive– Virtual RealityVirtual Reality
![Page 4: My old 2002 Thesis on Hand Gesture Recognition using a Web Cam!](https://reader035.vdocuments.net/reader035/viewer/2022070517/58cef8c71a28abab738b541d/html5/thumbnails/4.jpg)
Background continued…Background continued…
Gesture recognitionGesture recognition– Mechanical glove based approachMechanical glove based approach– Optical approachOptical approach
Capture the imageCapture the imageProcessing the imageProcessing the imageInterpreting the imageInterpreting the imageGesture recognitionGesture recognition
![Page 5: My old 2002 Thesis on Hand Gesture Recognition using a Web Cam!](https://reader035.vdocuments.net/reader035/viewer/2022070517/58cef8c71a28abab738b541d/html5/thumbnails/5.jpg)
Project GoalsProject Goals
Research hand gesture recognition Research hand gesture recognition techniquestechniques– AlgorithmsAlgorithms– Present/future usesPresent/future uses– IssuesIssues
Develop a prototype gesture recognition Develop a prototype gesture recognition systemsystem– Optical spotty glove locationOptical spotty glove location
![Page 6: My old 2002 Thesis on Hand Gesture Recognition using a Web Cam!](https://reader035.vdocuments.net/reader035/viewer/2022070517/58cef8c71a28abab738b541d/html5/thumbnails/6.jpg)
Image CaptureImage Capture
Video Camera, Digital Camera, Web CamVideo Camera, Digital Camera, Web Cam– ResolutionResolution– Frame rateFrame rate– ColourColour
Logitech QuickCam Pro 3000Logitech QuickCam Pro 3000– 640x480640x480– 30 fps30 fps– 24bit colour24bit colour
![Page 7: My old 2002 Thesis on Hand Gesture Recognition using a Web Cam!](https://reader035.vdocuments.net/reader035/viewer/2022070517/58cef8c71a28abab738b541d/html5/thumbnails/7.jpg)
Image Capture continued…Image Capture continued…
Logitech SDK/Video for Windows/Direct Logitech SDK/Video for Windows/Direct Hardware/DirectXHardware/DirectX
DirectX SDKDirectX SDK– CompatibilityCompatibility– Windows componentWindows component– Useful librariesUseful libraries
Hand gesture recogniser
WindowsUSB
Controller
DirectShow
USB Port
![Page 8: My old 2002 Thesis on Hand Gesture Recognition using a Web Cam!](https://reader035.vdocuments.net/reader035/viewer/2022070517/58cef8c71a28abab738b541d/html5/thumbnails/8.jpg)
Image ProcessingImage Processing
Tidy up the imageTidy up the image– Resize (640x480 => 70x70)Resize (640x480 => 70x70)– Colour Reduction (16.7 million => 4)Colour Reduction (16.7 million => 4)– Noise ReductionNoise Reduction
Locate spotsLocate spots– Centre of massCentre of mass
![Page 9: My old 2002 Thesis on Hand Gesture Recognition using a Web Cam!](https://reader035.vdocuments.net/reader035/viewer/2022070517/58cef8c71a28abab738b541d/html5/thumbnails/9.jpg)
Image InterpretationImage Interpretation
Rule based 2DRule based 2D
Interpret Data
Interpret Data
![Page 10: My old 2002 Thesis on Hand Gesture Recognition using a Web Cam!](https://reader035.vdocuments.net/reader035/viewer/2022070517/58cef8c71a28abab738b541d/html5/thumbnails/10.jpg)
Gesture RecognitionGesture Recognition
3 gestures recognised3 gestures recognisedPalm down resting gesturePalm down resting gesture
2 click gestures2 click gestures
![Page 11: My old 2002 Thesis on Hand Gesture Recognition using a Web Cam!](https://reader035.vdocuments.net/reader035/viewer/2022070517/58cef8c71a28abab738b541d/html5/thumbnails/11.jpg)
Gesture modellingGesture modelling
3D model based analysis3D model based analysis
![Page 12: My old 2002 Thesis on Hand Gesture Recognition using a Web Cam!](https://reader035.vdocuments.net/reader035/viewer/2022070517/58cef8c71a28abab738b541d/html5/thumbnails/12.jpg)
Gesture modellingGesture modelling
3D Hand model developed in 3D Studio Max3D Hand model developed in 3D Studio Max
![Page 13: My old 2002 Thesis on Hand Gesture Recognition using a Web Cam!](https://reader035.vdocuments.net/reader035/viewer/2022070517/58cef8c71a28abab738b541d/html5/thumbnails/13.jpg)
Gesture modelling continued…Gesture modelling continued…
Converted to .X file formatConverted to .X file formatImported into application as Direct3D mesh Imported into application as Direct3D mesh objectobject
.3DS3D Studio Max 5 conv3ds.exe 3D ViewerApplication
textures
.X
![Page 14: My old 2002 Thesis on Hand Gesture Recognition using a Web Cam!](https://reader035.vdocuments.net/reader035/viewer/2022070517/58cef8c71a28abab738b541d/html5/thumbnails/14.jpg)
Gesture modelling continued…Gesture modelling continued…
Rendered using Rendered using Direct3DDirect3D
![Page 15: My old 2002 Thesis on Hand Gesture Recognition using a Web Cam!](https://reader035.vdocuments.net/reader035/viewer/2022070517/58cef8c71a28abab738b541d/html5/thumbnails/15.jpg)
Project ConclusionProject Conclusion
Researched hand gesture recognition Researched hand gesture recognition techniquestechniques– AlgorithmsAlgorithms– Present/future usesPresent/future uses– IssuesIssuesDeveloped a prototype gesture recognition Developed a prototype gesture recognition systemsystem– Optical spotty glove locaterOptical spotty glove locater– 3D Hand model3D Hand model
![Page 16: My old 2002 Thesis on Hand Gesture Recognition using a Web Cam!](https://reader035.vdocuments.net/reader035/viewer/2022070517/58cef8c71a28abab738b541d/html5/thumbnails/16.jpg)
Project Demo SummaryProject Demo SummaryBackgroundBackgroundProject goalsProject goals Image captureImage capture Image processingImage processing Image interpretingImage interpretingGesture recognitionGesture recognitionGesture modellingGesture modellingProject conclusionsProject conclusions
![Page 17: My old 2002 Thesis on Hand Gesture Recognition using a Web Cam!](https://reader035.vdocuments.net/reader035/viewer/2022070517/58cef8c71a28abab738b541d/html5/thumbnails/17.jpg)
Questions?Questions?