mom-nocs: management of mobile multimedia nature observations using crowd sourcing

8/12/2019 MoM-NOCS: Management of Mobile Multimedia Nature Observations using Crowd Sourcing

1/49


2/49

Motivation

Citizen science: Involvement of interested casual users,informed outsiders and experts

Several scientific fields would benefit from citizen observation

Biodiversity, biology, agriculture, etc.

Important for domains with limited funding and slow capturing processe

Observation features:

Captured in Multimedia

Geo-locationand TimeInformation

Further annotation is possible

3/12/2013MoM-NOCS: Management of Mobile Multimedia Nature Observations using Crowd Sourcing 2


3/49

Motivation

Modern media capturing devices may:

Assist multimediaobservation capturing

Store the capturing parameters

including spatiotemporaland direction information

Need for user support to:

Easily capture, upload and annotate observations

Interact with other users in familiar ways (like social network

interaction)

Discuss on existing observations, argue on relevant issues (classification,

conclusions etc.)



4/49

Presentation Overview

Related Research

MoM-NOCS

Functionality

Conceptual Model

Architectural Overview MoM-NOCS in Action

Conclusions

Current & Future Work



5/49


Related Research

MoM-NOCS

Functionality

Conceptual Model


Conclusions




6/49

Related Research

Multimedia content and context capturing

Preference based multimedia content retrieval and filtering [17]

Context-based multimedia capturing of events [5][11][18]

Multimedia content annotation

Ontology-based approaches for annotations [1][7][15]

W3C working group Open annotation model standard [14]

Information Visualizationon top of maps and other spatial plans

Geovisualization of time series data [2]

Historical GIS [3]

Event geovisualization [16]

Urban planning facilitation [12]



7/49


Related Research

MoM-NOCS

Functionality

Conceptual Model

Architectural Overview

MoM-NOCS in Action

Conclusions




8/49

MoM-NOCS(Mobile Multimedia Nature

Observations using Crowd Sourcing)

MoM-NOCS: Framework & System for the Management of MobileNature Observations using Crowd Sourcing

Supports observation capturingin nature by mobile users

Extracts rich contextual data (location, direction, etc.) during capturing

Allows observation annotations

In real time or later

Identification and annotation of image parts using graphical overlays

Crowd participation in the identification of the observed species and events

Spatiotemporal visualizationsupport on top of maps



9/49

MoM-NOCS(Mobile Multimedia Nature

Observations using Crowd Sourcing)

MoM-NOCS is complementaryand interoperablewith

biodiversity metadata management systems

like BIOCASE [4] and GBIF [6]

and with systems managing collections of multimedia

objects owned by Natural History museums like MMAT [8]

These systems may linkto interesting observations in our

system

and use it for visualizingobservation statistics



10/49


Related Research

MoM-NOCS

Functionality

Conceptual Model


Conclusions




11/49

Functionality



12/49

Functionality



13/49


14/49

Functionality



15/49

Functionality



16/49


Related Research

MoM-NOCS

Functionality

Conceptual Model


MoM-NOCS in Action

Conclusions




17/49


18/49

3/12/2013 18

Conceptual Model

MoM-NOCS: Management of Mobile Multimedia Nature Observations using Crowd Sourcing


19/49

3/12/2013 19

Conceptual Model


hasBody


20/49

3/12/2013 20

Conceptual Model



21/49

3/12/2013 21

Conceptual Model



22/49

3/12/2013 22

Conceptual Model



23/49

3/12/2013 23

Conceptual Model



24/49

3/12/2013 24

Conceptual Model



25/49

3/12/2013 25

Conceptual Model



26/49

3/12/2013 26

Conceptual Model



27/49


Related Research

MoM-NOCS

Functionality

Conceptual Model


MoM-NOCS in Action

Conclusions




28/49




29/49




30/49




31/49


32/49

MoM-NOCS in Action


Ontology Annotation

Observation Annotation

Visualization


33/49

Ontology AnnotationMoM-NOCS in Action



34/49


35/49



FunctionalityMenu

SystemOntology


36/49



FunctionalityMenu

SystemOntology

Ontology ClassAnnotation


37/49

Observation AnnotationMoM-NOCS in Action


UserObservations


38/49



UserObservations

Annotations


39/49



UserObservations

Annotations

TaxonomicKeys


40/49

VisualizationMoM-NOCS in Action



41/49



Current Position& Direction


42/49



Arum ItalicumObservations

Current Position& Direction


43/49


Related Research MoM-NOCS

Functionality

Conceptual Model


MoM-NOCS in Action

Conclusions




44/49

Conclusions

MoM-NOCS: An integrated framework that supports: Mobile multimedia observation capturing by interested crowds

Further observation annotation by the crowd members

Advanced observation visualization on top of maps and otherspatial plans

Interoperable with: Existing metadata services in the biodiversity domain

Collection management systems in natural history museums

Prototype application in the biodiversity domain3/12/2013MoM-NOCS: Management of Mobile Multimedia Nature Observations using Crowd Sourcing 44


45/49


Related Research MoM-NOCS

Functionality

Conceptual Model


MoM-NOCS in Action

Conclusions



C & k


46/49


Mobile multimedia applications that use MoM-NOCS

Different user communities/domains

Survey to potential users, in order to get feedback

for:

The system functionality

The user interface design


Q i ?


47/49

Questions?


R f


48/49

References

[1] Bannour H., Hudelot C. 2011. Towards ontologies for image interpretation and annotation. In

Proceedings of the 9th Inter-national Workshop on Content-Based Multimedia Indexing (CBMI). IEEE 211-216.

[2] Becker T. 2009. Visualizing time series data using web map service time dimension and svg interactiveanimation. Master thesis, International Institute for Geo-Information Science and Earth Observation (ITC).

February 2009.

[3] Berman M. 2009. Modeling and Visualizing Historical GIS Data. In Proceedings of the Spatio-Temporal

Workshop, 2009.

[4] BioCASE, http://www.biocase.org/.

[5] Christodoulakis S., Foukarakis M., Ragia L., Uchiyama H., Imai T. 2010. Picture Context Capturing for

Mobile Data-bases. IEEE Multimedia. 17(2):34 41, April-June 2010.

[6] Global Biodiversity Information Facility (GBIF), http://www.gbif.org/.

[7] Kallergi A., Bei Y., Verbeek F.J. 2009. The Ontology Viewer: Facilitating Image Annotation with

Ontology Terms in the CSIDx Imaging Database Proceedings VISSW, CEUR-WS Proceedings Vol. 4430.

[8] Makris K., Skevakis G., Kalokyri V., Arapi P., Christodou-lakis S. 2013. Metadata Management and

Interoperability Support for Natural History Museums. In Proceedings of the 17th International Conference on

Theory and Practice of Digi-tal Libraries (TPDL13). 120-131. Valletta, Malta, September 2013.

[9] Natural Europe ICT PSP project, http://www.natural-europe.eu/en.


R f


49/49

References[10] Potel, M. 1996. MVP: Model-View-Presenter. The Taligent Programming Model for C++ and Java. Taligent Inchttp://www.wildcrest.com/Potel/Portfolio/mvp.pdf., 1996.

[11] Panteli A., Tsinaraki C., Ragia L., Kazasis F., Christodoulakis S.. 2011. MObile Multimedia Event Capturing a

Visualization (MOME). In the Proceedings of FTRA Conference Multimedia and Ubiquitous Engineering (MUE 2011)

101106, 2011.[12] Phan V.T., Choo S.Y. 2010. A Combination of Augmented Reality and Google Earths facilities for urban plan

idea stage. International Journal of Computer Applications (0975-8887) Vol. 4, No. 3, July 2010, pp. 26-34.

[13] PhoneGap, http://phonegap.com/

[14] Sanderson R., Ciccarese P., Van de Sompel H. (eds). 2013. Open Annotation Data Model. W3C community d

http://www.openannotation.org/spec/core/.

[15] Schreiber, A.Th., Dubbeldam, B., Wielemaker, J., Wielinga, B. Ontology-Based Photo Annotation. 2001. IEE

Intelligent Systems. 16(3) 66-74.

[16] Tarantilis N., Tsinaraki C., Kazasis F., Gioldasis N., Christodoulakis S. 2011. Evisuge: Event visualization on

earth. In Proc. of the 6th International Workshop on Semantic Media Adaptation and Personalization (SMAP). IEEE

[17] Tsinaraki C., Christodoulakis S.: "A Multimedia User Prefer-ence Model that Supports Se-mantics and its App

to MPEG 7/21". In the proc. of the IEEE Multimedia Modeling 2006 Conference (IEEE MMM 2006). IEEE 35-42. Janu

2006, Beijing, China.

[18] Volgin, O., Hung, W., Vakili, C., Flinn, J., Shin, K.G. 2005. Context-Aware Metadata Creation in a Heteroge

Mobile Environment. In proc. of the International Workshop on Network and Operating System Support for Digita

and Video. 75-80. ISBN:1-58113-987-X.3/12/2013MoM-NOCS: Management of Mobile Multimedia Nature Observations using Crowd Sourcing 49

mom-nocs: management of mobile multimedia nature observations using crowd sourcing

Documents