GESTURE RECOGNITION SYSTEM (GRS)

Group Partners:

Zain Bohri

Gargee Hiray

Gitesh Jethwa

Ashok Choudhary

Overview

• Introduction• Problem Statement• System Functional Requirement • Project Design• Testing • Costing • Applications and Limitations • Advantage and disadvantage • Future Enhancement

Introduction

• Gestures are a major form of human communication. Hence gestures are found to be an appealing way to interact with computers, as they are already a natural part of how we communicate.

Conceptual Diagram

Problem Statement

• The user needs to go under a long process to open any Application, Folder & Files which user uses frequently.

E.g. Opening WORD

• The any Application, Folder & Files which user require frequently which under goes this lengthy steps takes time

Principle Of Project

• The principle of our project is to provide a new

• Graphical User Interface (GUI)

• Make the system work efficiently

System Functional Requirements

• Software Requirements:

1. Java Development Kit

2. Java Media Framework

3. Operating System- Windows 9x onwards• Hardware Requirements:

1. Web Camera

2. RAM- 512 MB(minimum)

User

Normal User Physically Challenged User

Perform Action

Gesture RecognitionSystem

Check for Errors

Conversion to Binary Image

Noise Removal

Resizing Picture

Conversion to Grayscale Image

Identify Gesture

Zooming in Binary PictureCrop Image

«extend»

Update Background Picture«include»

Web Cam

Capture Image

Transmit Image to System

«extend»

Locate Hand in Picture

System Level Diagram

Important Modules Diagram

Grayscale

name: String

Convert_grayscale()

Normal UserPhysically Challenged

User

«powertype»UserType

1..*

Module Name

Gesture Identification

no_of_fingures : integer

Calculate_total_fingers()Identify_gesture()

Image capture

image_name : String

update_background()

Background

name : Stringtype : String

1..*

1

Binary

name : String

Convert_binary()

1uses

Image

width : integerheight : integersize : integer

User

name : String

perform_action()

«interface» Web Cam

Capture_image()Capture_background()

«powertype»imagetype

Error Checking

Check_errors()validate_picture()validate_no_of_hands()

Filter

perform_noise_reduction()check_noisy_pixels()set_intensities()

captures

recognizes

Gesture RecognitionSystem

1..* Updates

Image Designing• Our project is based totally on IMAGE PROCESSING.

• Java Media Framework is used for image and video processing by java.

Fig:- Image processing using JAVA MEDIA FRAMEWORK

• Algorithm used: EDGE CUTTING ALGORITHM • ZOOMING IN THE BINARY PICTURE.

• i.e. Converting Image 320*240 pixel size

• RECOGNIZING WHETHER THE HAND IS RIGHT OR LEFT.

• DETECTING WHETHER THE THUMB IS UP OR NOT.

Image Designing (contd..)

Image Designing (contd..) • EDGE COUNTING ANAYASIS .

• STORING THE IMAGE AT BACKEND.

• PERFORMING THE EVENT RELATED TO THE NUMBER OF EDGES OF IMAGE.

Input/output Design

USER

JMFInterface

PC

WebCamInterface

USB PORT

User Interface

The unit testing is performed for following modules:

• image capturing module.

• image processing module.

• gesture recognize module.

• event handling module.

Testing

1.Unit Testing

Re-engineering of following two modules was required.

• Binary conversion of image.

• Noise removal from image.

Different White Box Testing Methods Are Used Such As:

• Functional Testing for event handling module.

Testing (contd..)

• Compatibility Testing

Measures Expected Results Observed Results

Check number of fingers.

Execution of appropriate action.

Execution of appropriate action.

Measures Expected Results Observed Results

Windows XP

 Should Runs Properly 

Runs Properly

Windows 7 32-bit

Should Run Properly Runs Properly

Windows 7 64-bit Should run Properly Error of JMF

Re-engineering• JMF patches for Windows 7 (64-bit) is required

COSTINGNumber of Person = 4 Number of Computer = 2Total Number of Hours of per person = 100 hr *4 = 400Total Number of Hours of per Computer = 100 hr *2 = 200

 Cost of per Hours of person = 10RsCost of per Hours of Computer = 10Rs

 Total Cost of Person Hours = Cost per Hours * Total Hours of Person

= 10 * 400 Total = 4000

Cost of Computer Hours = 10 * 200 = 2000Rs   Cost of Camera = 1*1000= 1000Rs

Total Cost of Software = Total Cost Of Human Hour + Total Use of Computer Hours + Cost Of Camera + Extra cost

= 4,000+ 2,000 + 1000 +200 = 7,200Rs/- 

Total Cost Of Module = Rs7,200/- .

• Opening all basic applications merely on

gesture.• E.g. Paint, Word, PowerPoint

• Performing basic operations such as Refresh, Back, Enter

• Performing Cut, Copy & Paste operations on folders and files.

Application

Limitations

• Such systems are difficult to develop because of the complexity and the cost of implementation.

• Image Background should be kept black or of any constant color while running the application for proper functioning

• The gesture must be a hand gesture• There should be a reference point to recognize

the gesture

Advantage

• Provides a natural way of interfacing with the computers hence it is more users friendly.

• There is less wear and tear of the computer .• Carpal-tunnel syndrome is increasing because

of the repetitive use keyboard and mouse. Since this system does not use either of these as input device, it improves to be healthier way of interacting with the computers

Disadvantages

• The cost of implementation• Such systems are difficult to develop as each

gesture is assigned a specific control command, this system is not platform independent since certain control commands vary as the operating system varies.

• Eg windows7 open library where as xp opens my computer

Future Enhancement

• This system could further be used effectively and independently for different purposes such as follows :

• Control of consumer electronics • Interaction with visualization systems • Control of mechanical systems • Computer games • Security System• Television • In ATM’s

CONCLUSION

• Gesture Recognition System is a research and development project which performs the basic operations of the computer by detecting the human generated hand gestures and wit

• Finally we conclude that , This project has given us tremendous exposure to the industry working standards, which will definitely be useful in the future as working could be done without using any external equipments.

Web References

• http://www.javaworld.com• http://www.java.sun.com• http://sourceforge.net/projects/javaipl/• http://www.products.sun.com• http://www.javaguru.com• http://www.sunmicrosystems.com

Book References

• Taming Java Threads:

• The Complete Reference : Java

• Java Black Book :

• Matthew T. Nelson “ Java Foundation Classes “ ,

McGraw-Hill Publication.

Any Questions??.

Thank You !