augmented presentation of animal and environmental data€¦ · augmented presentation of animal...

41
1 7th International Symposium on Digital Earth - Perth, Australia - August 2011 – M. Ehlers, C.Plass Augmented Presentation of Animal and Environmental Data Using Augmented Reality to Locate Species in the Zoo of Osnabrueck Christian Plass and Manfred Ehlers Institute for Geoinformatics and Remote Sensing University of Osnabrueck, Germany

Upload: others

Post on 21-May-2020

4 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Augmented Presentation of Animal and Environmental Data€¦ · Augmented Presentation of Animal and Environmental Data Using Augmented Reality to Locate Species in the Zoo of

17th International Symposium on Digital Earth - Perth, Australia - August 2011 – M. Ehlers, C.Plass

Augmented Presentation of Animal andEnvironmental Data

Using Augmented Reality to Locate Species in the Zoo ofOsnabrueck

Christian Plass and Manfred Ehlers

Institute for Geoinformatics and Remote SensingUniversity of Osnabrueck, Germany

Page 2: Augmented Presentation of Animal and Environmental Data€¦ · Augmented Presentation of Animal and Environmental Data Using Augmented Reality to Locate Species in the Zoo of

27th International Symposium on Digital Earth - Perth, Australia - August 2011 – M. Ehlers, C.Plass

Content

! The Project Zoowiso

! Where are the Tortoises?

! Augmented Reality

! Using Augmented Reality at the Osnabrueck Zoo

! Conclusion and Outlook

Page 3: Augmented Presentation of Animal and Environmental Data€¦ · Augmented Presentation of Animal and Environmental Data Using Augmented Reality to Locate Species in the Zoo of

37th International Symposium on Digital Earth - Perth, Australia - August 2011 – M. Ehlers, C.Plass

The Project Zoowiso

! General Information

! System components

! The project website

! Livestock

! 2D-maps

! 3D-views

! Games

! Geodata

! Zoo to go

Page 4: Augmented Presentation of Animal and Environmental Data€¦ · Augmented Presentation of Animal and Environmental Data Using Augmented Reality to Locate Species in the Zoo of

47th International Symposium on Digital Earth - Perth, Australia - August 2011 – M. Ehlers, C.Plass

The Project Zoowiso

! Funded by the DBU

! Start 2007 - “End” 2009

! Partners

! Institute for Geoinformatics and Remote Sensing

! Osnabrueck Zoo

General Information

Page 5: Augmented Presentation of Animal and Environmental Data€¦ · Augmented Presentation of Animal and Environmental Data Using Augmented Reality to Locate Species in the Zoo of

57th International Symposium on Digital Earth - Perth, Australia - August 2011 – M. Ehlers, C.Plass

www

Download (HTML via www)UMPC

PC

PDA

The Project Zoowiso

System Components

wlan

! All important data is storedin a spatial database

! Data maintenance via CMS

Page 6: Augmented Presentation of Animal and Environmental Data€¦ · Augmented Presentation of Animal and Environmental Data Using Augmented Reality to Locate Species in the Zoo of

67th International Symposium on Digital Earth - Perth, Australia - August 2011 – M. Ehlers, C.Plass

The Project Zoowiso - Website

! Project homepage – www.zoowiso-os.de

Start

Page 7: Augmented Presentation of Animal and Environmental Data€¦ · Augmented Presentation of Animal and Environmental Data Using Augmented Reality to Locate Species in the Zoo of

77th International Symposium on Digital Earth - Perth, Australia - August 2011 – M. Ehlers, C.Plass

The Project Zoowiso - Website

! Alphabetical and taxonomic overviews

Animals

Page 8: Augmented Presentation of Animal and Environmental Data€¦ · Augmented Presentation of Animal and Environmental Data Using Augmented Reality to Locate Species in the Zoo of

87th International Symposium on Digital Earth - Perth, Australia - August 2011 – M. Ehlers, C.Plass

The Project Zoowiso - Website

! Species by animal class on a high res. aerial photograph

2D Maps

Page 9: Augmented Presentation of Animal and Environmental Data€¦ · Augmented Presentation of Animal and Environmental Data Using Augmented Reality to Locate Species in the Zoo of

97th International Symposium on Digital Earth - Perth, Australia - August 2011 – M. Ehlers, C.Plass

The Project Zoowiso - Website

! Interactive panoramas linked with the database

3D Views

Page 10: Augmented Presentation of Animal and Environmental Data€¦ · Augmented Presentation of Animal and Environmental Data Using Augmented Reality to Locate Species in the Zoo of

107th International Symposium on Digital Earth - Perth, Australia - August 2011 – M. Ehlers, C.Plass

The Project Zoowiso - Website

! Memory in a different way – you have to know the name!

Games

Page 11: Augmented Presentation of Animal and Environmental Data€¦ · Augmented Presentation of Animal and Environmental Data Using Augmented Reality to Locate Species in the Zoo of

117th International Symposium on Digital Earth - Perth, Australia - August 2011 – M. Ehlers, C.Plass

The Project Zoowiso - Website

! Free geodata for GPS devices (gpx)

Geodata

Page 12: Augmented Presentation of Animal and Environmental Data€¦ · Augmented Presentation of Animal and Environmental Data Using Augmented Reality to Locate Species in the Zoo of

127th International Symposium on Digital Earth - Perth, Australia - August 2011 – M. Ehlers, C.Plass

The Project Zoowiso - Website

! (Public) mobile zoobook (server side generated)

Zoo to Go

Page 13: Augmented Presentation of Animal and Environmental Data€¦ · Augmented Presentation of Animal and Environmental Data Using Augmented Reality to Locate Species in the Zoo of

137th International Symposium on Digital Earth - Perth, Australia - August 2011 – M. Ehlers, C.Plass

Where are the Tortoises?

Orient Yourself in the Zoo

Common practice

Overview maps with

! generalized paths

! important buildings! locations of the most

well known species like

elephant, lion, giraffe...

Page 14: Augmented Presentation of Animal and Environmental Data€¦ · Augmented Presentation of Animal and Environmental Data Using Augmented Reality to Locate Species in the Zoo of

147th International Symposium on Digital Earth - Perth, Australia - August 2011 – M. Ehlers, C.Plass

Where are the Tortoises?

Locating a Species

The Website allows to locate a species before a visit.

Page 15: Augmented Presentation of Animal and Environmental Data€¦ · Augmented Presentation of Animal and Environmental Data Using Augmented Reality to Locate Species in the Zoo of

157th International Symposium on Digital Earth - Perth, Australia - August 2011 – M. Ehlers, C.Plass

Where are the Tortoises?

Locating a Species

Digital Zoobook

The digital (offline) zoobook provides

! animal data (digital photo, distribution, habitat...)

! shows the visitor’s position only indirectly

(when standing in front of a cage)

Page 16: Augmented Presentation of Animal and Environmental Data€¦ · Augmented Presentation of Animal and Environmental Data Using Augmented Reality to Locate Species in the Zoo of

167th International Symposium on Digital Earth - Perth, Australia - August 2011 – M. Ehlers, C.Plass

Where are the Tortoises?

Locating a Species

Digital Zoobook (WebOS)

The digital zoobook with WebOS (not yet completed)

! Ajax / Interactive Map / First attempts with GPS

Page 17: Augmented Presentation of Animal and Environmental Data€¦ · Augmented Presentation of Animal and Environmental Data Using Augmented Reality to Locate Species in the Zoo of

177th International Symposium on Digital Earth - Perth, Australia - August 2011 – M. Ehlers, C.Plass

Where are the Tortoises?

Locating a Species

Downloaded free GPS data and GPS tracks

Visitors with a GPS device can

! navigate to a species via line of sight

! walk along a track (i.e. track “animals of africa”)

Page 18: Augmented Presentation of Animal and Environmental Data€¦ · Augmented Presentation of Animal and Environmental Data Using Augmented Reality to Locate Species in the Zoo of

187th International Symposium on Digital Earth - Perth, Australia - August 2011 – M. Ehlers, C.Plass

Where are the Tortoises?

Locating a Species

What other possibilities exist???

Implemented1, not yet finished2, intended3

! Offline / online zoobook with aerial photographs1

! WebOS zoobook with interactive map2

! Android application with GPS3

! Augmented reality application2

Page 19: Augmented Presentation of Animal and Environmental Data€¦ · Augmented Presentation of Animal and Environmental Data Using Augmented Reality to Locate Species in the Zoo of

197th International Symposium on Digital Earth - Perth, Australia - August 2011 – M. Ehlers, C.Plass

Augmented Reality

! Definition

! Applications

! Potential Applications

! Wikitude and layar

! Example University of Osnabrueck

Content

Page 20: Augmented Presentation of Animal and Environmental Data€¦ · Augmented Presentation of Animal and Environmental Data Using Augmented Reality to Locate Species in the Zoo of

207th International Symposium on Digital Earth - Perth, Australia - August 2011 – M. Ehlers, C.Plass

Augmented Reality

Definition

Definition of Augmented Reality

! “Augmented reality is a technology which integrates the computer-generatedscene to the real world.

! It provides a mixed scene of virtual information and real scene for users

through the display devices such as head mounted display (HMD), glasses,

projectors, general displays and even mobile phone screens.

! It can make users interact in a more natural way with the real and virtual objects

in the environment.

! Augmented reality technology expands and supplements the real world rather

than substitutes the real world completely.”Yan, Yun, Liang, Yu and Zhang, 2011

Page 21: Augmented Presentation of Animal and Environmental Data€¦ · Augmented Presentation of Animal and Environmental Data Using Augmented Reality to Locate Species in the Zoo of

217th International Symposium on Digital Earth - Perth, Australia - August 2011 – M. Ehlers, C.Plass

Augmented Reality

Applications

Applications as of 2011

! Advertising: Usage of AR to promote products via interactive AR applications is becoming common now.

! Task support: Complex tasks such as assembly, maintenance, and surgery can be simplified by inserting additionalinformation into the field of view.

! Navigation: AR can augment the effectiveness of navigation devices.

! Industrial: AR can be used to compare digital mock-ups with physical mock-ups for efficiently finding discrepanciesbetween them.

! Military and emergency services: Wearable AR can provide information such as instructions, maps, enemy locations,and fire cells.

! Art: AR can help create art in real time integrating reality such as painting, drawing and modeling.

! Architecture: AR can simulate planned construction projects.

! Sightseeing: Guides can include labels or text related to the objects/places visited. With AR, users can rebuild ruins,buildings, or even landscapes as they previously existed.

! Collaboration: AR can help facilitate collaboration among distributed team members via conferences with real andvirtual participants.

! Entertainment and education: AR can create virtual objects in museums and exhibitions, theme park attractions,gamesand books.

! Performance: AR can enhance concert and theater performances.

! Translation: AR systems can provide dynamic subtitles in the user's language.

Extract from Wikipedia, 2011

Page 22: Augmented Presentation of Animal and Environmental Data€¦ · Augmented Presentation of Animal and Environmental Data Using Augmented Reality to Locate Species in the Zoo of

227th International Symposium on Digital Earth - Perth, Australia - August 2011 – M. Ehlers, C.Plass

Augmented Reality

Applications

Potential applications

! Devices: Create new applications that are physically impossible in "real" hardware, such as 3D objects interactivelychanging their shape and appearance based on the current task or need.

! Multi-screen simulation: Display multiple application windows as virtual monitors in real space and switch among themwith gestures and/or redirecting head and eyes. A single pair of glasses could "surround" a user with applicationwindows.

! Holodecks: Enhanced media applications, like pseudo holographic virtual screens and virtual surround cinema.

! Automotive: eye-dialing, navigation arrows on roadways

! "X-ray vision"

! Furnishings: plants, wallpapers, panoramic views, artwork, decorations, posters, illumination etc. For example, a virtualwindow could show a live feed of a camera placed on the exterior of the building, thus allowing the user to toggle a wall'stransparency.

! Public displays: Window dressings, traffic signs, Christmas decorations, advertisements.

! Gadgets: Clock, radio, PC, arrival/departure board at an airport, stock ticker, PDA, PMP, informationalposters/fliers/billboards.

! Group-specific feeds: For example, a construction manager could display instructions including diagrams at specificlocations. Patrons at a public event could subscribe to a feed of directions and/or program notes.

! Speech synthesis: Render location/context-specific information via spoken words.

! Prospecting: In hydrology, ecology, and geology, AR can be used to display an interactive analysis of terraincharacteristics. Users can collaboratively modify and analyze, interactive three-dimensional maps.

Extract from Wikipedia, 2011

Page 23: Augmented Presentation of Animal and Environmental Data€¦ · Augmented Presentation of Animal and Environmental Data Using Augmented Reality to Locate Species in the Zoo of

237th International Symposium on Digital Earth - Perth, Australia - August 2011 – M. Ehlers, C.Plass

Augmented Reality

Augmented Reality Browsers

Wikitude and layar

Most known AR browsers are Wikitude and layar

These browsers interact with the hardware of the mobiledevice and overlay the camera view with virtualinformation

Page 24: Augmented Presentation of Animal and Environmental Data€¦ · Augmented Presentation of Animal and Environmental Data Using Augmented Reality to Locate Species in the Zoo of

247th International Symposium on Digital Earth - Perth, Australia - August 2011 – M. Ehlers, C.Plass

Augmented Reality

Augmented Reality Browsers

Wikitude

“... Wikitude World Browser is a fun, innovative andinformative Augmented Reality ( AR ) platform allowingyou to discover what’s around you in a completely newway...

Wikitude will overlay the camera’s display and the objectsyou look at with additional interactive content andinformation – really cool!“

Extract from www.wikitude.com, 2011

Page 25: Augmented Presentation of Animal and Environmental Data€¦ · Augmented Presentation of Animal and Environmental Data Using Augmented Reality to Locate Species in the Zoo of

257th International Symposium on Digital Earth - Perth, Australia - August 2011 – M. Ehlers, C.Plass

Augmented Reality

Augmented Reality Browsers

layar

“A beautiful, fun augmented reality app that shows youthings you can't see“

Extract from www.wikitude.com, 2011

Page 26: Augmented Presentation of Animal and Environmental Data€¦ · Augmented Presentation of Animal and Environmental Data Using Augmented Reality to Locate Species in the Zoo of

267th International Symposium on Digital Earth - Perth, Australia - August 2011 – M. Ehlers, C.Plass

Augmented Reality

! Testing on the doorstep (layar)

Example University of Osnabrueck

Page 27: Augmented Presentation of Animal and Environmental Data€¦ · Augmented Presentation of Animal and Environmental Data Using Augmented Reality to Locate Species in the Zoo of

277th International Symposium on Digital Earth - Perth, Australia - August 2011 – M. Ehlers, C.Plass

! Goals

! Technical background

! Testing a layer in layar

! Testing layar at the zoo

Content

Using Augmented Reality at the Zoo

Page 28: Augmented Presentation of Animal and Environmental Data€¦ · Augmented Presentation of Animal and Environmental Data Using Augmented Reality to Locate Species in the Zoo of

287th International Symposium on Digital Earth - Perth, Australia - August 2011 – M. Ehlers, C.Plass

Goals

Using Augmented Reality at the Zoo

! Why using AR at the zoo?

! Increasing use of such mobile hardware and software

! Young people (mostly not very interested inenvironmental themes) use this technology

! AR is a modern way to present a company / zoo

! AR will bring more visitors to the zoo?

! AR to interest (the youth) in environmental themes?

Page 29: Augmented Presentation of Animal and Environmental Data€¦ · Augmented Presentation of Animal and Environmental Data Using Augmented Reality to Locate Species in the Zoo of

297th International Symposium on Digital Earth - Perth, Australia - August 2011 – M. Ehlers, C.Plass

Technical Background

Using Augmented Reality at the Zoo

! Prerequisites

MySQL database

! The structure of a table containing the data for an ARLayer is predefined

Webspace with PHP

! The access script is written in PHP and alsopredefined

! User fills the table and configures the script

! User creates layers in the (online) developer section

Page 30: Augmented Presentation of Animal and Environmental Data€¦ · Augmented Presentation of Animal and Environmental Data Using Augmented Reality to Locate Species in the Zoo of

307th International Symposium on Digital Earth - Perth, Australia - August 2011 – M. Ehlers, C.Plass

! Table in the MySQL database

Some important fields are “title”, “lat”, “lon” and imageURL.

Technical Background

Using Augmented Reality at the Zoo

Page 31: Augmented Presentation of Animal and Environmental Data€¦ · Augmented Presentation of Animal and Environmental Data Using Augmented Reality to Locate Species in the Zoo of

317th International Symposium on Digital Earth - Perth, Australia - August 2011 – M. Ehlers, C.Plass

! But the zoo data is stored in a PostgresSQL database

Coordinates are stored in a different format and coordinate system

Technical Background

Using Augmented Reality at the Zoo

Page 32: Augmented Presentation of Animal and Environmental Data€¦ · Augmented Presentation of Animal and Environmental Data Using Augmented Reality to Locate Species in the Zoo of

327th International Symposium on Digital Earth - Perth, Australia - August 2011 – M. Ehlers, C.Plass

! Solution: cronjob (with coordinate transformation)

The cronjob script (PHP) is an update script and periodically executed

Technical Background

Using Augmented Reality at the Zoo

Page 33: Augmented Presentation of Animal and Environmental Data€¦ · Augmented Presentation of Animal and Environmental Data Using Augmented Reality to Locate Species in the Zoo of

337th International Symposium on Digital Earth - Perth, Australia - August 2011 – M. Ehlers, C.Plass

Technical Background

Using Augmented Reality at the Zoo

! Process sequence

The AR Browser can integrate current animal data now

Page 34: Augmented Presentation of Animal and Environmental Data€¦ · Augmented Presentation of Animal and Environmental Data Using Augmented Reality to Locate Species in the Zoo of

347th International Symposium on Digital Earth - Perth, Australia - August 2011 – M. Ehlers, C.Plass

Testing a Layer in layar

Using Augmented Reality at the Zoo

! Video

Page 35: Augmented Presentation of Animal and Environmental Data€¦ · Augmented Presentation of Animal and Environmental Data Using Augmented Reality to Locate Species in the Zoo of

357th International Symposium on Digital Earth - Perth, Australia - August 2011 – M. Ehlers, C.Plass

Testing layar at the Zoo

Using Augmented Reality at the Zoo

! Layar on a (less powerful) device – here is the tortoise!

Page 36: Augmented Presentation of Animal and Environmental Data€¦ · Augmented Presentation of Animal and Environmental Data Using Augmented Reality to Locate Species in the Zoo of

367th International Symposium on Digital Earth - Perth, Australia - August 2011 – M. Ehlers, C.Plass

Testing layar at the Zoo

Using Augmented Reality at the Zoo

! Using layar for orientation during a zoo visit

Page 37: Augmented Presentation of Animal and Environmental Data€¦ · Augmented Presentation of Animal and Environmental Data Using Augmented Reality to Locate Species in the Zoo of

377th International Symposium on Digital Earth - Perth, Australia - August 2011 – M. Ehlers, C.Plass

Testing layar at the Zoo

Using Augmented Reality at the Zoo

! Seeing what's inside a building

Page 38: Augmented Presentation of Animal and Environmental Data€¦ · Augmented Presentation of Animal and Environmental Data Using Augmented Reality to Locate Species in the Zoo of

387th International Symposium on Digital Earth - Perth, Australia - August 2011 – M. Ehlers, C.Plass

Testing layar at the Zoo

Using Augmented Reality at the Zoo

! Seeing animals that are not there

Page 39: Augmented Presentation of Animal and Environmental Data€¦ · Augmented Presentation of Animal and Environmental Data Using Augmented Reality to Locate Species in the Zoo of

397th International Symposium on Digital Earth - Perth, Australia - August 2011 – M. Ehlers, C.Plass

! First attempts of using AR very promising

! AR is a modern way to present animal and environmental data

! AR seems to be suitable for the projects goals

Further Steps

! Publishing the layers

! Get a feedback

! Testing further functions of layar

! Testing Wikitude

! Integrating the results in the follow-up project “Expedition Moor”

Conclusion and Outlook

Page 40: Augmented Presentation of Animal and Environmental Data€¦ · Augmented Presentation of Animal and Environmental Data Using Augmented Reality to Locate Species in the Zoo of

407th International Symposium on Digital Earth - Perth, Australia - August 2011 – M. Ehlers, C.Plass

Contact and further Information

Manfred Ehlers

E-Mail:

[email protected]

Christian Plass

E-Mail:

[email protected]

Web:

www.zoowiso-os.de

Universität Osnabrück

Institut für Geoinformatik und Fernerkundung (IGF)

Barbarastr. 22 b

49076 Osnabrück

Page 41: Augmented Presentation of Animal and Environmental Data€¦ · Augmented Presentation of Animal and Environmental Data Using Augmented Reality to Locate Species in the Zoo of

417th International Symposium on Digital Earth - Perth, Australia - August 2011 – M. Ehlers, C.Plass

Thank You

for your attention!