Dr. K.N.Modi Institute Of Engg. & Technology

Department of ELECTRONICS & COMMUNICATION

SEMINAR ON :-

SIXTH SENSE TECHNOLOGY Presented By :-

MANISH MISHRA1207731046

CONTENTS:-

INTRODUCTION

COMPONENTS

WORKING

APPLICATIONS

INTRODUCTION

Sixth Sense is a wearable gesture interface that augments the physical worlds around us with digital information and lets us use natural hand gestures to interact with that information.

It was developed by PRANAV MISTRY, a PhD student in the Fluid Interfaces Group at the MIT Media Lab.

Sixth Sense bridges the gap by bringing intangible digital information out into the tangible world, and allowing us to interact with this information via natural hand

Sixth Sense comprises of a Pocket projector, a mirror and a camera. The hardware components are coupled in a pendant like mobile wearable device.

Origin of Sixth Sense Technology The idea of Sixth Sense Technology was first

developed in 1997 at MIT Media Lab by Steve Mann, as a head worn device. In 1998, it was made into an neck worn device.

The name Sixth Sense was coined and published in 2001.

Mann referred to this wearable computing technology as affording a "Synthetic Synesthesia of the Sixth Sense", believing that wearable computing and digital information could act in addition to the five traditional senses.

Later this idea was taken by Pranav Mistry who built on the concept of the Telepointer, a neck worn projector and camera combination.

Steve Mann

Pranav Mistry

WHY SIXTH SENSE TECHNOLOGY?

As we know and see by the picture here...

The five traditional Senses are: EYES, NOSE, TONGUE, EAR and SENSES.

The sixth sense added now is the PENDANT like MOBILE WEARABLE DEVICE.

The answer to WHY sixth sense technology is nothing more that a single line which is that:-

“SIXTH SENSE IS ALL ABOUT MAKING THE TECHNOLOGY MORE HUMAN”

COMPONENTSThe hardware components are arranged in a PENDANT like MOBILE WEARABLE DEVICE.

The hardware components are as follows:-

1. CAMERA

2. PROJECTOR

3. MIRROR

4. SMART PHONE5. COLOUR MARKERS

1. CAMERA The camera recognizes and

tracks users' hand gestures and physical objects using computer-vision based techniques.

It sends the data to the smart phone.

Thus, a camera acts as a digital eye connecting us to the world of digital communication.

2. PROJECTOR The projector projects visual

information enabling surfaces and physical objects to be used as interfaces.

It itself contains a battery inside with 3 hours of battery life.

A tiny LED projector displays data sent from the smart phone on any surface in view i.e. Object, wall, or person.

3. MIRROR The projector dangles

pointing downwards from the neck so the usage of mirror is significant.

It basically inverts and helps the projector to project the image erected.

4. SMART PHONE A Web-enabled smart phone in the user’s pocket processes the video data.

Other software searches the web and interprets the hand gestures.

5. COLOUR MARKERS These markers are present at the tip

of the user’s fingers.

Marking the user’s fingers with RED, YELLOW, GREEN AND BLUE tape helps the web camera recognize gestures.

The movements and arrangements of these markers are interpreted into gestures that act as interaction instructions for the projected application interfaces.

CONSTRUCTION AND WORKING

CONSTRUCTION SHOWN BY A BLOCK DIAGRAM

APPLICATIONS OF SIXTH SENSE TECHNOLOGY

Some applications are discussed below:

oMAKE A CALLoCALL UP A MAPoCHECK TIMEoCREATE

MULTIMEDIA READING EXPERIENCES

oZOOMING FEATURES

oTAKE PICTURES

MAKE A CALL

The SixthSense can be used to project the keypad (as on a phone) onto our hand and then make a call through the virtual keypad.

CALL UP A MAP

With this application we can call up the map of our choice and then use the thumb and index fingers to navigate through the map.

CHECK TIMEBy this application we can get to check time by drawing a circle on our wrist. This makes us get a virtual watch which gives us the correct time.

CREATE MULTIMEDIA READING

EXPERIENCESSixth sense can be programmed to project related videos onto newspaper articles being read.

ZOOM OUT

ZOOM IN

ZOOMING FEATURES

User can ZOOM IN & ZOOM OUT using intuitive hand movements.

TAKING PICTURES

If we fashion our index fingers and thumbs into a square(“FRAMING” gesture) , the system will snap a photo.

After taking a desired number of photos, we can project them onto a surface and use gestures to sort through the photos and organize and resize them.

Index fingers and thumbs in square(“framing” gesture)

ADVANTAGES PORTABLE

SUPPORTS MULTI -TOUCH AND MULTI-USER INTERACTIONS

CONNECTING WORLD AND INFORMATION

COST EFFECTIVE

DATA ACCESS DIRECTLY FROM MACHINE IN REAL TIME

MIND MAP THE IDEA ANYWHERE

IT IS AN OPEN SOURCE

SOME RELATED TECHNOLOGIES

CONCLUSION→ Sixth sense recognizes the objects around

us, displaying the information automatically and letting us access in any way we need.

→Sixth Sense prototype implements several applications that demonstrate the usefulness, viability and flexibility of the system.→Allows us to interact with the

information by hand gestures.→It has the potential of becoming the

ultimate “transparent user interface” for accessing information about everything around us.

REFERENCES

THANK

YOU !!!!