visual interactivity

27
Mobile … or mobile interactive services for normal people Geoff Ballinger http:// www.mobileacuity.com http://

Upload: geoff-ballinger

Post on 01-Sep-2014

1.557 views

Category:

Technology


0 download

DESCRIPTION

Wide ranging talk on visually interactive things for mobile given at Over The Air 2009. The related video clips are linked from: http://blog.geoffballinger.co.uk/2009/09/visual-interactivity-at-over-air-2009.html

TRANSCRIPT

Page 1: Visual Interactivity

Mobile

… or mobile interactive services for normal people

Geoff Ballingerhttp://www.mobileacuity.comhttp://blog.geoffballinger.co.uk

Page 2: Visual Interactivity

Overview• what is the problem?• some real world motivation• some fun examples• where does AR fit in?• visual search ...• how do developers engage?

Page 3: Visual Interactivity

Survey …• how many people here:– use a mobile phone for voice calls?– have sent a message from their phone?– have a camera on their phone?– have used the camera on their phone?– have visited a website from their phone?– have downloaded an app or a game?

• what do you think the answers would be for the typical “normob” on the street?

x x x x x x x

Page 4: Visual Interactivity

Brand Marketing

• mobile becoming a serious option• often combined with traditional

media• needs to be inclusive• mustn’t be off-putting

• actually all of this can be said in general about good mobile services …

x

Page 5: Visual Interactivity

The Camera• … has now arrived:

Page 6: Visual Interactivity

Some dull stats

• in 2008, 166.6m handsets (Western Europe) are registered as MMS-enabled. That is a 95% penetration!

• over 90% of all handsets currently being sold have a cameraphone.

• in the 11-19 demographic 53% regularly use picture messaging, with 85% having used it at least once.*

• in the 16-34 demographic 78% have used picture messaging with 48% using it regularly.* Source TGI Youth Q2 2008

x x x x

Page 7: Visual Interactivity

2D bar codes

Patent No. 6,999,573 31st Jan 2006

x

x

Page 8: Visual Interactivity

Recognition• the simplest form of interactivity• replaces SMS and keywords etc.

• but have to ask why bother …• … large number of media which can’t

necessarily be adapted?x x x x x

Page 9: Visual Interactivity

Who’s who

PixTo

Page 10: Visual Interactivity

Image Zoning

• activation of Vodafone’s Champions League sponsorship

• take penalties by taking a picture of where you want to aim the ball

• send in by MMS to see whether you score or not

• true user interaction

Page 11: Visual Interactivity

Aim with your camera phone See the outcome in your web browser

x

Page 12: Visual Interactivity

Colour• Nike PhotoiD by AKQA is a great

example

Page 13: Visual Interactivity

Videos• Shoot and Score• Darts• Nike PhotoID

Page 14: Visual Interactivity

Blue-screen• run as part of the

Vodafone Live! Music Awards

• think blackpool beach – users stick their heads through the display

• picture sent in by MMS, heads cut out, and incorporated into a music video

Page 15: Visual Interactivity

Snap your mates on a camera phone See them in a personalised video

x

Page 16: Visual Interactivity

Facefinder• think bluescreen without the screen• automatic detection and extraction

of the faces in any image• much more suitable for viral apps

• currently all face-likefeatures:

• in future will distinguishbetween these and real faces

x

Page 17: Visual Interactivity

Videos• You Rockstar!• Facefinder

Page 18: Visual Interactivity

AR• What actually is Augmented Reality?• Extra digital information overlaid on

the real world.• AR Toolkit – 3D shapes triggered by

2D codes in the environment.• Recently GPS and compass based

apps such as , Wikitude, and Bionic Eye.

Page 19: Visual Interactivity

AR Mobile Gaming

• Also “magic monstervision” game mentioned by Paul Coulton earlier!

Page 20: Visual Interactivity

Layar

Page 21: Visual Interactivity

Visual AR• Specific and accurate placement of

digital info into the video stream.

Page 22: Visual Interactivity

Videos• Arf video• snap2Win Live

Page 23: Visual Interactivity

Visual Search

• General Visual Search?• Recognise “all” images?• Make the world clickable?• Science Fiction?• Product Search is happening

now!

Page 24: Visual Interactivity

Product Search

• Snaptell Explorer for Amazon• Barnes and Noble store app• Mobile Acuity Visual Shopper

Page 25: Visual Interactivity

Visual Shopper

Page 26: Visual Interactivity

Web Services

• How does the developer get involved with this?

• Some related code out there – Haar classifiers and AR Toolkit etc

• Web service API prototypes from Kooaba and Mobile Acuity.

• Build into your apps.

Page 27: Visual Interactivity

Summary