itcamp 2013 - tim huckaby - the engaging user experience & natural user interface

itcampro@ itcamp13# Premium conference on Microsoft technologies

The Engaging User Experience& The Natural User Interface

Tim HuckabyInterKnowlogy Chairman/Founder

Actus Interactive Software Founder & CEO

Microsoft® Regional Director – Southern California

Microsoft® MVP – Kinect for Windows

E-mail: [email protected]@Actus-Software.com

Blog:team.interknowlogy.com/blogs/timhuckaby

FaceBook:www.facebook.com/Tim.Huckaby.Carlsbad

LinkedIn: www.linkedin.com/in/timhuckaby

Twitter: @TimHuckaby


KeynoteHuge thanks to our sponsors!


Keynote

A little bit about me and why I am here…

The Engaging User Experience & the Natural User Interface


KeynoteAbout Tim, InterKnowlogy & Actus…

InterKnowlogy (www.InterKnowlogy.com)

Tim Huckaby, Founder/Chairman ([email protected])

◦ 13+ year old services firm – Custom Application Development

◦ focused on building NUI solutions

◦ Web, mobile, and desktop

◦ Windows 7/8, PixelSense, WP7/8, Azure, Kinect, XAML stack

- Largest Client: Microsoft

Actus Interactive Software (www.Actus-Software.com)

Tim Huckaby, Founder/CEO ([email protected])

◦ Software Product Company

◦ Interactive Kiosk and Active Digital Signage

◦ Multi-Touch, Gesture, and Voice Driven Solutions

mailto:[email protected]


NUI enabled applications improve the communication, education and user experience across the software continuum.

Objectives And Agenda

There are a number of tenants of an engaging user interface that will last the test of time

The 4 Manifestations of NUI: Multi-Touch, Vocal, Gesture, Neural

Where We have Been and Where we are Going

Demos, Demos, Demos….

The Natural User Interface (NUI)


The Tenants of an Engaging UX

Use the Power of Faces – People love faces; We see faces where they don’t exist

– We have DNA with the sole purpose of recognizing faces

– Take advantage of this by putting faces on your App

• Have the faces to look at important part of your App

• People instinctively follow the eyes of the face.

Use Food, Sex and Danger– When someone sees something new, they place it into one of four

categories:

1. Can I Eat it?

2. Can it Eat Me?

3. Can I Mate with it?

4. …and everything else.

• If you want your App to be engaged and interesting, put it in one of the first three categories.


The Tenants of an Engaging UXTell a story

– We learn through stories. It’s how we teach our children. It’s the Bible; It’s what we see in movies.

– Stories are a big part of how information is conveyed to us. – If you have information to give to the user, put it in story form. – It doesn’t matter what medium you use (words, pictures, music), but

using a story narrative will help your user understand and retain your information.

Build commitment over time

– Let the user choose how they want to interact with you (RSS, Twitter, Facebook)

– Make sure that you don’t take advantage of the trust that is implicit in that interaction.

Use Natural Interactions of Objects

– Natural Movements– Fluidity– Animate / Exaggerate: Slow things down so the eye can follow


January 27, 2010


KeynoteThe “Cancer App” & The “Autocad App”

Tim HuckabyFounder / Chairman, InterKnowlogyFounder / CEO, Actus SoftwareMicrosoft RD & MVP


KeynoteEMN8



The “Green Screen”

We have come a long way…


Image Courtesy of Computer History Museum


KeynoteTouch Capable Computing Devices Are Not New

Past

1972: PLATO IV Touch Screen Terminal

The Samsung SUR40 for Microsoft PixelSense

Windows 8 - Metro

Apple iPad

Present Future (now)


KeynoteWhat is Relatively New is:

– Inexpensive Touch Capable, Non Proprietary Hardware

– A Operating Systems designed for Multi-Touch

– A Consistent Multi-Touch API for the major Hardware/Software Platforms

– Developer Productivity in Touch Capable Apps

– The Forecast of Multi-Touch Hardware Capability in Every New Computing Device in the Short Term


NUI: The Natural User Interface

Multi-Touch Capable•Common Gestures of Touch•Physical Object Interaction•Virtual Object Interaction

Gesture Capable•Motion Based Interface•Tracking of full-body movement, facial expression, and voice with precision

Voice Capable•Multi-array Microphone•Uniquely Distinguish Audio & Voices

Nueral Capable•Conscious and non-conscience interfaces•Non Invasive


KeynoteGrey’s Anatomy



KeynoteGesture Heart



HTML 5 Touch Events, Version 1W3C Working Draft 24 January 2013

Source: https://dvcs.w3.org/hg/webevents/raw-file/tip/touchevents.html

Defines a set of low-level events that represent one or more points of contact with a touch-sensitive surface

Changes of those points with respect to the surface and any DOM elements displayed upon it (e.g. for touch screens) or associated with it (e.g. for drawing tablets without displays).

Addresses pen-tablet devices, such as drawing tablets, with consideration toward stylus capabilities.

“This specification is the 24 January 2013 Last Call Working Draft. The comment period for this Last Call Working Draft ends 14 February 2013.”


Keynote


KeynoteDemocratic National Convention Voting App



KeynoteWhat is also Relatively New:User Experience with Naturally Behaving Objects

– Large Form Factors demand natural behaviors

– The User Experience is “never done”

– It can always be improved

– Tablet Computing paved the way

– Software Physics Engines are readily available in open source


KeynoteFluid Layout & Pixelsence Craps



“Game-ification” CultureUser Experiences that Enhance Learning

Learning made Fun / EntertainingProven as a learning tool beyond just ChildrenComputer based Games are a significant part of popular cultureEducational Video Game Curriculums

– MIT, UC Irvine, Minnesota, Michigan State, etc.


KeynoteNASA Marsbound



KeynoteKinect for Windows

World's Fastest-Selling Consumer Electronics Device

… a Future Beyond Gaming

Combination of RGB camera, depth sensor and multi-array microphone– RGB camera delivers three basic color components

– Depth sensors “sees” in 3-D

– Microphone locates voices by sound and excludes ambient noise

Consumer Priced: $249.99

Tracks full-body movement, facial expression, and voice with precision

Kinect sensor bar scans and monitors 1 million points on the body

Kinect for Windows SDK– Skeletal Tracking

– Face, Gesture Recognition

– Audio Echo cancellation

– Audio Beam Forming

– Speech Recognition

– Machine Learning


KeynoteActus Interactive Digital Content System (Kiosk), IK Physical Therapy, IK Touch-less Operating Room



Keynote3D Modeler



KeynoteKinect for Windows Competitors

Leap Motion– $70– https://leapmotion.com– Not available yet

SoftKinetic– http://www.softkinetic.com– $249– Distance and Near Mode– Multiple Products– In the space for over a decade

Panasonic– Works outside in broad daylight– $2,600

https://leapmotion.com/

http://www.softkinetic.com/


KeynoteNeural Interfaces:Conscious and Non-Conscious

High fidelity EG acquisition device

No conductive gel, etc.

Non-invasive

Use Case Examples:• Conscious: mind manipulation of objects

• Non-Conscious: Ranking music

• First target market: gaming

• $300!!!


KeynoteEmotiv



KeynoteWe are within a decade of building the Holodeck“The Ultimate NUI Application”


KeynoteHoloDesk - Direct 3D Interactions with a

Situated See-Through Display



Summary

We are at the cusp of a revolution in software & hardware

Using Natural User Interface (NUI) technologies improve the User

Experience

The hardware, tools, plumbing and platforms for NUI computing are

powerful and available now.…and will just continue to get better, cheaper, powerful and

more available

Within a realistic time frame NUI computing will be the norm

The concepts of NUI change the way we design and build software

There are a number of design tenants that can enhance User Experience


More info on InterKnowlogy:

www.InterKnowlogy.com www.vimeo.com/InterKnowlogy

More info on Actus Software:

◦www.Actus-Software.comAbout Tim Huckaby…

◦Founder/Chairman, InterKnowlogy

◦Founder/Chairman, Actus Software

◦Microsoft® Regional Director – Southern California

◦Microsoft® .NET Partner Advisory Council Founder / Member

◦Microsoft® MVP – Kinect for Windows

◦INETA Speaker – International .NET Users Group Association

◦Board Member: Association for Competitive Technology

◦Board Member: Microsoft Healthcare Partner Advisory Board

◦Author / Speaker

Contact me:E-mail:

[email protected]@Actus-Software.com

Phone: • Office: 760-444-8640• Mobile:: 619 990 9200

Blog:http://team.interknowlogy.com/blogs/timhuckaby

FaceBook:http://www.facebook.com/Tim.Huckaby.Carlsbad

LinkedIn:http://www.linkedin.com/in/timhuckaby

Twitter: @TimHuckaby

Tim Huckaby




Q & A

itcamp 2013 - tim huckaby - the engaging user experience & natural user interface

Technology

premium conference

microsoft technologiesnui

microsoft technologiesjanuary

engaging user interface

natural user interface

touch capable apps

inexpensive touch capable

consistent multitouch