touchless writer
DESCRIPTION
This presentation is about our project touchless writer which we developed as a part of my software development projects.TRANSCRIPT
![Page 1: Touchless writer](https://reader036.vdocuments.net/reader036/viewer/2022081507/5539bcfe4a7959b26f8b4a0a/html5/thumbnails/1.jpg)
Touchless Writer
Software Development Project-II Course No: CSE-3200
Developed By Supervised ByBikash Karmokar Dr. Kazi Md. Rokibul Alam0707019
&Md. Kibria Siddiquee0707024
Department of Computer Science and EngineeringKhulna University of Engineering & Technology
![Page 2: Touchless writer](https://reader036.vdocuments.net/reader036/viewer/2022081507/5539bcfe4a7959b26f8b4a0a/html5/thumbnails/2.jpg)
Inspiration
First of all we would like to pay glowing tribute to the Language Movement martyrs who sacrificed their lives for the mother tongue in 1952.
![Page 3: Touchless writer](https://reader036.vdocuments.net/reader036/viewer/2022081507/5539bcfe4a7959b26f8b4a0a/html5/thumbnails/3.jpg)
From that inspiration we developed a software for
Bengali language
![Page 4: Touchless writer](https://reader036.vdocuments.net/reader036/viewer/2022081507/5539bcfe4a7959b26f8b4a0a/html5/thumbnails/4.jpg)
TOUCHLESS WRITER
![Page 5: Touchless writer](https://reader036.vdocuments.net/reader036/viewer/2022081507/5539bcfe4a7959b26f8b4a0a/html5/thumbnails/5.jpg)
What is it ?
Touchless introduces a new way of interacting with the computers by means of object tracking through webcams for Bengali character writing.
![Page 6: Touchless writer](https://reader036.vdocuments.net/reader036/viewer/2022081507/5539bcfe4a7959b26f8b4a0a/html5/thumbnails/6.jpg)
What is it ?
Here data is inserted for writing purpose using webcam without use of keyboard or on-screen keyboard by mouse.
![Page 7: Touchless writer](https://reader036.vdocuments.net/reader036/viewer/2022081507/5539bcfe4a7959b26f8b4a0a/html5/thumbnails/7.jpg)
Needed Tools
Webcam Pen with a head of red color/any colored
object Windows Platform Avro Keyboard installed .Net Framework 3.5
![Page 8: Touchless writer](https://reader036.vdocuments.net/reader036/viewer/2022081507/5539bcfe4a7959b26f8b4a0a/html5/thumbnails/8.jpg)
Tracking Process
Capturing video using aforge .net From the tracking environment it first
detect the red colored object and mark it with a rectangle using EuclideanColorFiltering.
Getting (x , y) coordinate of the rectangle and putting pixel at that point on a white panel.
So finally we get 33*30 pixel bitmap image which is ready for neural network input.
![Page 9: Touchless writer](https://reader036.vdocuments.net/reader036/viewer/2022081507/5539bcfe4a7959b26f8b4a0a/html5/thumbnails/9.jpg)
Tracking Process
![Page 10: Touchless writer](https://reader036.vdocuments.net/reader036/viewer/2022081507/5539bcfe4a7959b26f8b4a0a/html5/thumbnails/10.jpg)
After writing
Training network Recognize character Speak out character
![Page 11: Touchless writer](https://reader036.vdocuments.net/reader036/viewer/2022081507/5539bcfe4a7959b26f8b4a0a/html5/thumbnails/11.jpg)
![Page 12: Touchless writer](https://reader036.vdocuments.net/reader036/viewer/2022081507/5539bcfe4a7959b26f8b4a0a/html5/thumbnails/12.jpg)
Training Completion
![Page 13: Touchless writer](https://reader036.vdocuments.net/reader036/viewer/2022081507/5539bcfe4a7959b26f8b4a0a/html5/thumbnails/13.jpg)
Recognized Result
![Page 14: Touchless writer](https://reader036.vdocuments.net/reader036/viewer/2022081507/5539bcfe4a7959b26f8b4a0a/html5/thumbnails/14.jpg)
Saving written letter
![Page 15: Touchless writer](https://reader036.vdocuments.net/reader036/viewer/2022081507/5539bcfe4a7959b26f8b4a0a/html5/thumbnails/15.jpg)
Mechanism of recognition
So how neural network works ?
![Page 16: Touchless writer](https://reader036.vdocuments.net/reader036/viewer/2022081507/5539bcfe4a7959b26f8b4a0a/html5/thumbnails/16.jpg)
Neural network phases
Retrieve data
Feature Extraction
Training
Testing
![Page 17: Touchless writer](https://reader036.vdocuments.net/reader036/viewer/2022081507/5539bcfe4a7959b26f8b4a0a/html5/thumbnails/17.jpg)
RETRIEVE DATA
Total number of input = 33*30 = 990 pixels
![Page 18: Touchless writer](https://reader036.vdocuments.net/reader036/viewer/2022081507/5539bcfe4a7959b26f8b4a0a/html5/thumbnails/18.jpg)
FEATURE EXTRACTION
In this method it scans the binary image until it finds the boundary. The searching follows according to the clockwise direction.
![Page 19: Touchless writer](https://reader036.vdocuments.net/reader036/viewer/2022081507/5539bcfe4a7959b26f8b4a0a/html5/thumbnails/19.jpg)
FEATURE EXTRACTION
For any foreground pixel p, the set of all foreground pixels connected to it is called connected component containing p.
![Page 20: Touchless writer](https://reader036.vdocuments.net/reader036/viewer/2022081507/5539bcfe4a7959b26f8b4a0a/html5/thumbnails/20.jpg)
FEATURE EXTRACTION
The pixel p and its 8-neighbors are shown in Figure 4. Once a white pixel is detected, it checks another new white pixel and so on.
![Page 21: Touchless writer](https://reader036.vdocuments.net/reader036/viewer/2022081507/5539bcfe4a7959b26f8b4a0a/html5/thumbnails/21.jpg)
FEATURE EXTRACTION
FIG: pixel p with its 8 adjacentAfter feature extraction our input will
approximately reduced to 67%
p
![Page 22: Touchless writer](https://reader036.vdocuments.net/reader036/viewer/2022081507/5539bcfe4a7959b26f8b4a0a/html5/thumbnails/22.jpg)
TRAINING PHASE
![Page 23: Touchless writer](https://reader036.vdocuments.net/reader036/viewer/2022081507/5539bcfe4a7959b26f8b4a0a/html5/thumbnails/23.jpg)
TESTING
In this phase we will test the network by giving some patterns. We match it with every trained pattern and find out the pattern that gives highest match and lowest match also.
![Page 24: Touchless writer](https://reader036.vdocuments.net/reader036/viewer/2022081507/5539bcfe4a7959b26f8b4a0a/html5/thumbnails/24.jpg)
Development Tools
Visual studio 2008 XML Avro Keyboard installed Aforge .Net
![Page 25: Touchless writer](https://reader036.vdocuments.net/reader036/viewer/2022081507/5539bcfe4a7959b26f8b4a0a/html5/thumbnails/25.jpg)
Limitations
Due to brightness and contrast sometimes webcam can hardly detect the expected color.
Because of the similarity of tracking environment background color and object color the writing panel gets unexpected pixels.
![Page 26: Touchless writer](https://reader036.vdocuments.net/reader036/viewer/2022081507/5539bcfe4a7959b26f8b4a0a/html5/thumbnails/26.jpg)
Limitations
As we draw character using object movement it is not properly drawn as like as original character, sometimes it becomes totally different from the original. For that reason neural network can’t understand or recognize the original character and it outputs wrong character as input value or character.
![Page 27: Touchless writer](https://reader036.vdocuments.net/reader036/viewer/2022081507/5539bcfe4a7959b26f8b4a0a/html5/thumbnails/27.jpg)
Future plan
Add facility for writing for both Bangla and English
Add facility to make the software capable of running without the help of keyboard and mouse.
Adding printing capabilities of written text.
![Page 28: Touchless writer](https://reader036.vdocuments.net/reader036/viewer/2022081507/5539bcfe4a7959b26f8b4a0a/html5/thumbnails/28.jpg)
Future plan
Adding written text reading capabilities in Bangla.
Adding capabilities of tracking more than one object and take several decisions depending on object combinations
![Page 29: Touchless writer](https://reader036.vdocuments.net/reader036/viewer/2022081507/5539bcfe4a7959b26f8b4a0a/html5/thumbnails/29.jpg)
References
Microsoft Press Microsoft Visual C Sharp 2008 Step by Step
Beginners C#.net 2005 Worx Publication Professional C#.net 2005 Wrox Publication MSDN Library www.c-sharpcorner.com www.codeproject.com www.aforgenet.com
![Page 30: Touchless writer](https://reader036.vdocuments.net/reader036/viewer/2022081507/5539bcfe4a7959b26f8b4a0a/html5/thumbnails/30.jpg)
Thanks to all