CONTENTCONTENT

FOCUSFOCUS INTRODUCTIONINTRODUCTIONCOMPONENTSCOMPONENTSTYPES OF GESTURESTYPES OF GESTURESADVANTAGESADVANTAGESCHALLENGESCHALLENGESREFERENCEREFERENCE

FOCUSFOCUSIntegration of informationIntegration of information

Providing “just-in-time” Providing “just-in-time” information information

What is Sixth Sense?What is Sixth Sense?

Wearable gestural interface that Wearable gestural interface that augments the physical world around us augments the physical world around us with digital information and lets us use with digital information and lets us use natural hand gestures to interact with natural hand gestures to interact with that informationthat information

INTRODUCTIONINTRODUCTION

Augmented RealityAugmented Reality..Wearable GesturalInterface.Wearable GesturalInterface.Converts intangible,digital information Converts intangible,digital information

out into tangible world.out into tangible world.

Interaction with the projected Interaction with the projected information.information.

No need of special glasses.No need of special glasses.

The Device……..The Device……..

Overview of Sixth Sense DeviceOverview of Sixth Sense Device

Integration of informationIntegration of information Gestural interfaceGestural interface Augmentation of informationAugmentation of information Wearable interfaceWearable interface

Technologies implementedTechnologies implemented

Augmented RealityAugmented RealityObject AugmentationObject AugmentationComputer vision based techniquesComputer vision based techniques

Augmented reality (AR) Augmented reality (AR) Term for a live direct or indirect view of a Term for a live direct or indirect view of a

physical real-world environment whose physical real-world environment whose elements are merged with virtual, computer elements are merged with virtual, computer generated images, creating a mixed realitygenerated images, creating a mixed reality

Object augmentation Object augmentation the camera recognizes and tracks physical the camera recognizes and tracks physical

objects such as a newspaper, a coffee cup, or objects such as a newspaper, a coffee cup, or a book and the projector projects relevant a book and the projector projects relevant visual information on them.visual information on them.

Computer-vision techniquesComputer-vision techniques track objects and align projected visual track objects and align projected visual

information by matching pre-printed static information by matching pre-printed static color markers (or patterns) on these objects color markers (or patterns) on these objects with the markers projected by the projector.with the markers projected by the projector.

ComponentsComponentsCameraCameraProjectorProjectorMobile PhoneMobile PhoneColoured markersColoured markers

How does the device work?How does the device work?

Camera-logitech quick camCamera-logitech quick cam recognizes and tracks user’s recognizes and tracks user’s

handgestures and physical objects using handgestures and physical objects using computer vision based techniquescomputer vision based techniques

Projector-3MM Pro110Projector-3MM Pro110 projects visual information enabling projects visual information enabling

surfaces walls and physical objects around surfaces walls and physical objects around us to be used as interfacesus to be used as interfaces

Mobile phoneMobile phone projector and camera are connected to projector and camera are connected to

the mobile computing device in the user’s the mobile computing device in the user’s pocketpocketColoured markersColoured markers

visual tracking fiducialsvisual tracking fiducials

Software RequirementsSoftware Requirements Microsoft Windows platform using Microsoft Windows platform using

C#,WPF and openCVC#,WPF and openCV

Internet ConnectionInternet ConnectionBenefits of having a networkBenefits of having a network

Access to the Internet.Access to the Internet. Communication.Communication.

Wireless network connection used:- Wireless network connection used:- reduces additional burden of wiring reduces additional burden of wiring

Gestural interactionGestural interaction

3 types of gestures3 types of gestures

Supported by multitouch systemsSupported by multitouch systemsFree hand gesturesFree hand gestures Iconic gesturesIconic gestures

FeaturesFeatures Implementation of augmented realityImplementation of augmented reality Allows the user to interact with the projected Allows the user to interact with the projected

information using hand gesturesinformation using hand gestures Informations projected on to any opacque surfaceInformations projected on to any opacque surface User does not need to wear any special glassesUser does not need to wear any special glasses Multitouch and moltiuserinterfaceMultitouch and moltiuserinterface

ApplicationsApplications

o Drawing applicationDrawing applicationo Defines a new perspective for human Defines a new perspective for human

machine relationshipmachine relationshipo Bridges the gap between digital and real Bridges the gap between digital and real

world environmentworld environment

VIDEO CLIPS SHOWING THE VIDEO CLIPS SHOWING THE APPLICATIONS OF THE APPLICATIONS OF THE

DEVICEDEVICE

AdvantagesAdvantagesPortable.Portable.

Uses commercially available Uses commercially available components.components.

No physical interaction with any No physical interaction with any hardwarehardware

ChallengesChallenges

Image Recognition.Image Recognition.

Surface is required.Surface is required.

Correctness and clarity of gestures.Correctness and clarity of gestures.

User profiling.User profiling.

SummarySummaryHighly relevant to a unique user and their Highly relevant to a unique user and their

current focus of attentioncurrent focus of attentionEasily accessibleEasily accessibleMay replace traditional keyboard or screen May replace traditional keyboard or screen

based interfacebased interface

Thank Thank You…….You…….