INTRODUCTION

Sixth sense is a wearable gestural interface device by Pranav Mistry, a PhD student in the Fluid Interfaces Group at the MIT Media Lab. The concept is similar to telepointer, a neckworn projector/camera system developed by Media Lab student Steve Mann. (which Mann originally referred to as "Synthetic Synesthesia of the Sixth Sense").

1.1 COMPONENTS

• CAMERA• PROJECTOR• MIRROR• COLOR MARKERS• MOBILE COMPONENTS

1.2Construction and workings

The SixthSense prototype comprises a pocket projector, a mirror and a camera contained in a pendant like, wearable device. Both the projector and the camera are connected to a mobile computingdevice in the user’s pocket.

CAMERA

a.)Captures an object in view and tracks the user’s hand gestures.b.)It sends tha data to smart phone.c.)It acts as a digital eye,connecting you to the world of digital information.

PROJECTOR

a.)The projector projects visual information enabling surfaces and physical objects to be used as interfaces.b.)The projector itself contains a battery inside, With 3 hours of battery life.c.)It displays the data sent from the smart phone on any surface in view - object,wall or person.

MOBILE COMPONENTS

A web-enabled smart phone In the user’s pocket processes the video data.

COLOR MARKERS

It is at the tip of the user’s fingers.b.)Marking the user’s fingers with red, yellow, green and blue tape helps the web cam recognise gestures.c.)The movements and arrangements of these markers are interpreted into gestures that act as interaction instructions for the projected application interfaces.

1.3 Cost and license

Sixth Sense prototypes cost approximately $350 to build (not including the computer), the main cost being the micro-projector. Mistry had announced in Nov 2009 that the source code

will be released under Open Source. On September 5th, 2011, Mistry added a link to the SixthSense page on his personal website to a Google Code SixthSense project.

1.4 Applications

TAKE PICTURE

• If you fashion your index fingers and thumbs into a square , the system will snap a photo.

• After taking the desired number of photos ,we can project them onto a surface, and use gestures to sort through the photos, and organise and realise them.

Make a call

• You can use a six sense to project a keypad onto your hand, then use that virtual keypad to make a call

Call up a map

• With the map application we can call up the map of your choice and then use thumb and index fingers to navigate the map

Check the time

• Draw a circle on your wrist to get a virtual watch that gives you a corect time .

Create multimedia reading experience

• Six sense can be programmed to project related videos onto newspaper articles you are reading

Drawing application

• The drawing application lets the user draw on any surface by tracking the finger tip movements of the user’s index fingers

Zooming features

• The user can use zoom in or zoom out using intuative hand movements.

Get book information

• The system can project rating of the book,its reviews and other relevant information.

Get flight updates

• The system will recognise your boarding pass and let you know whether your flight is on time and if the gate has changed.

1.5 ADVANTAGES

• Portable.

• Supports multi-touch and multi-user interaction.

• Cost effective.

• Saves time for sarching information.

• Mapping can also be done anywhere by zooming-in and zooming –out.

1.6 Limitations

• Software does support the ability to use real timevideo streams in order to produce augmented reality.

Hardware limitations of the devices, that wecurrently carry around with us.• For example many phones will not allow theexternal camera feed to be manipulated

in real time.• Post processing can occur however.

1.7 Future use of six sense

• Interactive Advertisements.

• 3d visualizations.

• Solar batteries via small solar panel.

• Camera can act as a third eye for the blind person

“According to researchers, after 10 years we will be here with the ultimate six-sense brain implant.”

1.8 CONCLUSION

• The potential of becoming the ultimate “transparent ’’ user interface for accessing information about everything around us.

• Six Sense recognizes the objects around us , displaying information automatically and letting us to access it in any way we need.

• Sixth Sense recognizes the objects around us,displaying information automatically and letting us to access it in any way we need.

• The Sixth Sense prototype implements severalapplications that demonstrate the usefulness,viability and flexibility of the system.

• Allowing us to interact with this information vianatural hand gestures.