sst report
TRANSCRIPT
-
8/2/2019 Sst Report
1/3
SIXTH SENSE TECHNOLOGYRishiraj Singh Ranawat
Electronics And Communication,
Sir Padampat Singhania University
Bhatewar,Udaipur,Rajasthan.
AbstractThe paper covers a brief introduction of thesixth sense technology which is the revolution in the field
of technologies. 'Sixth Sense' is a wearable gestural
interface that augments the physical world around us with
digital information and lets us use natural hand gestures
to interact with that information. All of us are aware of the
five basic senses seeing, feeling, smelling, tasting and
hearing. But there is also another sense called the sixth
sense. It is basically a connection to something greater
than what their physical senses are able to perceive. To a
layman, it would be something supernatural. Some might
just consider it to be a superstition or somethingpsychological. But the invention of sixth sense technology
has completely shocked the world. Although it is not
widely known as of now but the time is not far when this
technology will change our perception of the world.
Keywords Sixth sense technology, hand gestural interface,wearable gestural interface, WUW
1. INTRODUCTION
Sixth Sense technology is the science of tomorrow with the
aim of connecting the digital world with the physical worldseamlessly, eliminating hardware devices.
Mistrys flirtations with the digital world began in the early
2000s when he pieced done is combine a number of standardgadgets including a webcam, projector together four mouse
rollers with pulleys and springs to give shape to a motion
sensing device. It is similar to Telepointer, a neck worn
projector/camera system developed by Media Lab student
Steve Mann (which Mann originally referred to as "Synthetic
Synesthesia of the Sixth Sense").
What the researchers have, and mobile phone, to form a
brand new interaction experience. In its current form the
battery-powered projector is attached to a hat, the webcam is
hung around the neck (or also positioned on a hat), and themobile phone provides the connection to the Internet.
The wearer uses hand gestures combined with the gadgets to
perform actions. So, for example, they could make a circle
over their wrist with the fingers of one hand. WUW would
recognize this action and project a clock face on to their wrist.Make a picture frame with both your hands and WUW will
take a picture as if it was a camera. Stand near a wall and you
can get a projected desktop allowing you to open applications,
view the pictures youve taken, or surf the Net.
2 THE PROTOTYPE
The WUW (Wear Ur World), Sixth Sense prototype isComprised of:
a pocket projector. a mirror.
a camera.
colored marker. Smartphone
The camera, mirror and projector is connected Wirelessly to
a bluetooth smart phone device that can easily fit into
the users pocket. A software then processes the data that is
collected by the capturing device and produces Analysis.
The software that is used in sixth sense device is open sourcetype.
Camera: It captures the image of the object in view andtrack the users hand gesture. The camera recognizesindividuals, images, pictures, gestures that user makes with his hand. The camera then sends this data to a smart phonefor processing. Basically the camera forms a digital eyewhich connects to the world of digital information.
-
8/2/2019 Sst Report
2/3
Colored Marker: There are color markers placed atthetip of users finger. Marking the users fingers with red,
Yellow green and blue coloured tape helps the webcam Torecognize the hand gestures. The movements andarrangement of these markers are interpreted into gesturesthat act as a interaction instruction for the projectedapplication interfaces.
Mobile Component: The Sixth Sense device consistsof aweb enabled smart phone which process the data send by thecamera. The smart phone searches the web and interpretsthe hand gestures with help of the coloured.
Projector: The information that is interpreted through The
smart phone can be projected into any surface. The projector
projects the visual information enabling surfaces and physical
objects to be used as interfaces The projector itself consists ofa battery which have 3 hours of battery life. A tiny LED
projector displays the data sent from the smart phone on any
surface in view-object, wall or person. The downward facingprojector projects the image on to a mirror.
Mirror:The usage of a mirror is important as the projectordangles pointing downwards from the neck. The mirrorreflects the image on to a desire surface. Thus finally thedigital image is freed from its confines and placed in the
physical world.
The hardware components are coupled in a pendant
likeMobile wearable device . Both the projector and the
camera are connected to the mobile computing device in the
users pocket. The device projects visual information,
enabling surfaces, walls and physical objects around the
wearer to be used as interfaces while the camera recognize
and tracks the users hand gestures and physical objects
using computer-vision based techniques.
The software program processes the video stream dataCaptured by the camera and tracks the locations of thecolored markers (visual tracking fiducials) at the tip of theusers fingers using simple computer-vision techniques.The movements and arrangements of these fiducials areinterpreted into gestures that act as interaction instructions forthe projected application interfaces. Sixth Sensealso supportsmulti-touch and multi-user interaction.
3.1. Augmented Reality
The augmented Reality is a visualization technology thatallows the user to experience the virtual experience addedover real world in real time. With the help of advancedARtechnology the information about the surrounding real
World of the user becomes interactive and digitally usable.Artificial information about the environment and the objects in it can be stored and retrieved as an information layer ontop of the real world view. When we compare the spectrum
between virtual reality, which creates immersive, computer-generated environments, and the real world, augmentedreality is closer to the real world.
Augmented reality adds graphics, sounds, hapticfeedbackand smell to the natural world as it exists. Both video gamesand cell phones are driving the development of augmentedreality. The augmented systems will also superimposegraphics for every perspective available and try adjust toevery movement of the users head and eyes.
The three basic components of an augmented realitysystem are the head-mounted display, tracking system andmobile computer for the hardware. The main goal of thisnew technology is to merge these three components into ahighly portable unit much like a combination of a high-techWalkman and an ordinary pair or eyeglasses. The head-
mounted display used in augmented reality systems willenable the user to view superimposed graphics and textcreated by the system. Another component of an augmentedreality system is its tracking and orientation system. Thissystem pinpoints the users location in reference to hissurroundings and additionally tracks the users eye and headmovements. Augmented reality systems will need highlymobile computers. As of now many computers arentthere tosatisfy to provide this option.
3.2. Gesture Recognition
It is a technology which is aimed at interpreting human
gestures with the help of mathematical algorithms. Gesturerecognition technique basically focuses on the emotionrecognition from the face and hand gesture recognition.Gender recognition technique enables humans to interact withcomputers in a more direct way without using any externalinterfacing devices. It can provide a much better alternative totext user interfaces and graphical user interface which requiresthe need of a keyboard or mouse to interact with the computer.Interfaces which solely depends on the gestures requires
precise hand pose tracking.
In the early versions of gesture recognition process specialtype of hand gloves which provide information about hand
position orientation and flux of the fingers. In the SixthSense devices coloured bands are used for this purpose. Oncehand pose has been captured the gestures can be recognizedusing different techniques. Neural network approaches orstatistical templates are the commonly used techniques usedfor the recognitionpurposes. This technique have an highaccuracy usually showing accuracy of more than 95%. Timedependentneural network will also be used for real time recognition ofthe gestures
3. TECHNOLOGIES THAT ARE RELATEDTO SIXTH SENSE DEVICES
-
8/2/2019 Sst Report
3/3
3.3. Computer Vision
Computer vision is the technology in which machines areableto interpret/extract necessary information from an image.Computer vision technology includes various fieldslike image
processing, image analysis and machine vision. It includescertain aspect of artificial intelligence techniques like pattern
recognition. The machines which implement Computer visiontechniques require image sensors which detectelectromagnetic radiation which are usually in the form ofultraviolet rays or light rays. The computer vision find itselfapplicable in varies field of interest. One such field is biomedical image processing. Its also used in autonomousvehicle like SUVs. The computer vision technique basicallyincludes four processes.
3.4. Radio Frequency Identification
Radio frequency identification systems transmit the identity of
an object wirelessly, using radio magnetic waves. The main
purpose of a radio frequency identification system is to enablethe transfer of a data via a portable device. The portable
device is commonly known as tag. The data send by the tag is
received and processed by a reader according to the needs of
the application.
4. APPLICATION
The Sixth Sense prototype contains a number of demon-striations applications.
4.1.Taking PicturesAnother application of sixth sense devices is the
implementation of a gestural camera. This camera takes thephoto of the location user is looking at by detecting the
framing gesture. After taking the desired number of photos we
can project them onto any surfaces and then use gestures to
sort through those photos and organize and resize them.4.2. Drawing ApplicationThe drawing application allows the user you to draw on anysurface by tracking the fingertip movements of the users
index finger. The pictures that are drawn by the user can be
stored and replaced on any other surface. The user can also
shuffle through various pictures and drawing by using the
hand gesture movements.
4.3. Making Calls
We can make calls with help of sixth sense device .The sixthsense device is used to project the keypad into your palm and
the using that virtual keypad we can make calls to anyone.4.4. Product InformationSixth sense technology uses marker technology or image
recognition techniques to recognize the objects we pick in our
hand and then provide information relating to that product.
4.5. Book InformationBy holding and shuffling through the book pages, the sixth
sense provides Amazon ratings on that book, other reviews
and other relevant things related to the book
4.6 Flight UpdatesWith the help of the sixth sense technology it is no longer
required to log into any sites for checking the status of the
flights. The system will recognize your boarding pass and let
you know whether the flight is on time or not.
4.7.Navigate MapsWith the help of a map application the user can call upon any
map of his/her choice and navigate through them by
projecting the map on to any surface. By using the thumb andindex fingers movements the user can zoom in, zoom out orpan the selected map.
4.8.NewspaperIt Searches the most appropriate video from the web by seeing
the headlines or the caption of the News report.
4.9. Virtual wristwatchWatches are ancient history now. With sixth sense technology,
it is just drawing a circle on the wrist away from catching
the current time.4.10.Personal infoSixth sense devices can be used for getting various
information regarding a person by scanning his face.
5.COST
The current prototype system costs approximately $350 tobuild, not including the computer but the micro-projector.Mistry had announced in Nov 2009 that the source code will
be released under Open Source. On September 5, 2011,Mistryadded a link to the Sixth Sense page on his personalwebsite toa Google Code Sixth Sense project. Manyproducts based onthis technology are available in themarket. According to therecent research, the sixth sense technology is the next bigthing which will create sensation.
REFERENCES
http://www.ted.com/talkspranav_mistry_the_ thrilling_potential_of_sixthsense_technology.html TED Talks -Pranav Mistry: The thrilling potential of Sixth SenseTechnology
http://www.pranavmistry.com/projects/sixthsense/
http://www.ted.com/talks/pranav_mistry_the_thrilling_potential_of_sixthsens
e_technology.html
https://www.google.com/search?q=SIXTH+SENSE+DEVICE+pics&btnG=S
earch&um=1&hl=en&biw=1366&bih=667&tbm=isch&ei=KBF8T7q7JIaV0
QHQ1rT-Cw&sa=N
.
http://www.pranavmistry.com/projects/sixthsense/http://www.pranavmistry.com/projects/sixthsense/http://www.ted.com/talks/pranav_mistry_the_thrilling_potential_of_sixthsense_technology.htmlhttp://www.ted.com/talks/pranav_mistry_the_thrilling_potential_of_sixthsense_technology.htmlhttp://www.ted.com/talks/pranav_mistry_the_thrilling_potential_of_sixthsense_technology.htmlhttps://www.google.com/search?q=SIXTH+SENSE+DEVICE+pics&btnG=Search&um=1&hl=en&biw=1366&bih=667&tbm=isch&ei=KBF8T7q7JIaV0QHQ1rT-Cw&sa=Nhttps://www.google.com/search?q=SIXTH+SENSE+DEVICE+pics&btnG=Search&um=1&hl=en&biw=1366&bih=667&tbm=isch&ei=KBF8T7q7JIaV0QHQ1rT-Cw&sa=Nhttps://www.google.com/search?q=SIXTH+SENSE+DEVICE+pics&btnG=Search&um=1&hl=en&biw=1366&bih=667&tbm=isch&ei=KBF8T7q7JIaV0QHQ1rT-Cw&sa=Nhttps://www.google.com/search?q=SIXTH+SENSE+DEVICE+pics&btnG=Search&um=1&hl=en&biw=1366&bih=667&tbm=isch&ei=KBF8T7q7JIaV0QHQ1rT-Cw&sa=Nhttps://www.google.com/search?q=SIXTH+SENSE+DEVICE+pics&btnG=Search&um=1&hl=en&biw=1366&bih=667&tbm=isch&ei=KBF8T7q7JIaV0QHQ1rT-Cw&sa=Nhttps://www.google.com/search?q=SIXTH+SENSE+DEVICE+pics&btnG=Search&um=1&hl=en&biw=1366&bih=667&tbm=isch&ei=KBF8T7q7JIaV0QHQ1rT-Cw&sa=Nhttps://www.google.com/search?q=SIXTH+SENSE+DEVICE+pics&btnG=Search&um=1&hl=en&biw=1366&bih=667&tbm=isch&ei=KBF8T7q7JIaV0QHQ1rT-Cw&sa=Nhttp://www.ted.com/talks/pranav_mistry_the_thrilling_potential_of_sixthsense_technology.htmlhttp://www.ted.com/talks/pranav_mistry_the_thrilling_potential_of_sixthsense_technology.htmlhttp://www.pranavmistry.com/projects/sixthsense/