Pervasive Gaming with Mobile Devices

Prepared By: Karnung Liang

Project Supervisor: Dr Brett Wilkinson

Outline

Background

Research Question

Motivation

Research Objective

Prototype Concept

Technology To Be Used

User Evaluation

Termination Criteria

Schedule

Questions

What is Pervasive Gaming?

Takes gaming away from computer screens and incorporates the physical and social aspects of the real world with the virtual world.

Different types of pervasive gaming Location Based Context Aware Augmented Reality

Why Mobile Devices? Makes use of GPS, Compass and Camera

Image Source From: http://www.girardin.org/fabien/catchbob/pervasive/human_pacman.jpg http://www.ercim.eu/publication/Ercim_News/enw57/lindt.html http://www.dcs.gla.ac.uk/~matthew/papers/CHIYoshiWithCopyright.pdf Human Pac-Man

Feeding Yoshii

Catch Bob

Research Question

To evaluate the benefits of using markerless augmented reality to improve location sensing accuracy within a pervasive gaming environment.

What is markerless augmented reality? Uses natural features instead of fiducial markers

What do I mean by location sensing accuracy? GPS Compass

Images Sourced From: http://www.arlab.com/blog/markerless-augmented-reality/

“To evaluate the benefits of using markerless augmented reality to improve location sensing accuracy within a pervasive gaming environment.”

Motivation Current augmented reality pervasive gaming

systems only make use of GPS and Compass

Not very accurate[8]

GPS - Up to 100 meters offset Compass – Up to 40 degrees offset. Due to

interfering magnetic fields.

Markerless AR uses previously defined position Object tracking accurate up to 20mm

SA = Selective AvailabilityWAAS = Wide Area Augmentation System

Images Sourced From: http://extension.usu.edu/nasa/htm/on-target/gps-tutorial http://www.augmentedplanet.com/2010/04/mixare-video-explains-mobile-compass-accuracy-issues/

Research Objective

To create a game that makes use of these technologies Minecraft like block game

Create and destroy objects

Test if using markerless AR tracking along with GPS can improve the positioning of virtual objects

Test if objects placed in the virtual world can be found easily in the same spot every time

Image sourced from: http://newuntitledpage.com/store/programmable-space-8.5x11.pdf

Prototype Concept

Natural Feature Markers

Images Sourced From: Flinders.edu.au & minecraft.com & Microsoft.com

GPS Location Overlayed AR

Locate Scan Play

Technology To Be Used

Windows Phone 7.5 / 8

Visual Studio 2010 IDE

XNA 4.0

Markerless Augmented Reality Libraries / SDK T-Immersion (AR SDK) Open CV (object tracking Library)

User Evaluation Questionnaire

User Testing Place an object walk away and come back

User Interface Testing Test usability of UI on mobile device

Scheduled Testing over certain time Place an object and come back another day

Termination Criteria

Positive Termination Criteria Every works as planned Smooth integration with GPS and AR tracking

Negative Termination Criteria Markerless AR does not work Unable to combine the two technologies

Schedule

Aug Sep Oct Nov Dec Jan Feb Mar Apr May Jun

Initial Research

Prototype Development

Prototype Design

User Evaluation /Testing

Literature Review

Thesis

References:1. Benford, S., et al. (2003). "Coping with uncertainty in a location-based game." Pervasive Computing, IEEE 2(3): 34-41.

2. Notes on the Methodology of Pervasive Gaming', in F. Kishino et al. (eds.): ICEC 2005, LNCS 3711 (2005b)

3.Bell, M., et al. (2006). Interweaving mobile games with everyday life. Proceedings of the SIGCHI conference on Human Factors in computing systems. Montreal, Quebec, Canada, ACM: 417-426.

4. Broll, W., et al. (2006). Meeting technology challenges of pervasive augmented reality games. Proceedings of 5th ACM SIGCOMM workshop on Network and system support for games. Singapore, ACM: 28.

5. Hwang, I., et al. (2012). Toward a mobile platform for pervasive games. Proceedings of the first ACM international workshop on Mobile gaming. Helsinki, Finland, ACM: 19-24.

6. Jacob, J. T. P. N. and A. F. Coelho (2011). "Issues in the Development of Location-Based Games." International Journal of Computer Games Technology 2011.

7. Walther, B. K. (2005). Reflections on the methodology of pervasive gaming. Proceedings of the 2005 ACM SIGCHI International Conference on Advances in computer entertainment technology. Valencia, Spain, ACM: 176-179.

8. http://extension.usu.edu/nasa/htm/on-target/gps-tutorial

9. Walther, B. K. (2005). Reflections on the methodology of pervasive gaming. Proceedings of the 2005 ACM SIGCHI International Conference on Advances in computer entertainment technology. Valencia, Spain, ACM : 176-179.

10. Comport, A., et al. "Real-time markerless tracking for augmented reality: the virtual visual servoing framework." IEEE Transactions on Visualization and Computer Graphics 12(4): 615-628.

Questions?