mobile multimedia cloud computing and the web

Lehrstuhl Informatik 5

(Informationssysteme)

Prof. Dr. M. Jarke

I5-KCKl-0911-1

Mobile Multimedia Cloud Computing

and the Web

September 8th, 2011

Informatik 5 (Information Systems), RWTH Aachen University

&

Bonn-Aachen International Center for Applied Information Technology

Graz, Austria

Dejan Kovachev, Yiwei Cao & Ralf Klamma

MMC Workshop on

Multimedia on the Web



Prof. Dr. M. Jarke

I5-KCKl-0911-2

Motivation

“By 2013, mobile phones will surpass PCs as the way most

people hop onto the Web” [Gartner report 2010]

“…two-thirds of the world's mobile data traffic will be video

by 2015” [Cisco Visual Networking Index 2010]

Mobile and web networks converge

– Asymmetry in multimedia material production and consumption

User/Community/Social Computing

– Movement from business-oriented to user/community-centric

applications

Increased exploration of the potential of cloud computing by

organizations and individuals



Prof. Dr. M. Jarke

I5-KCKl-0911-3

Agenda

Motivation

Experiences from previous works

Perspectives on mobile multimedia cloud computing

– Technology

– Mobile multimedia

– User and community perspective

I5 Multimedia cloud architecture

Use cases

Discussion and future work



Prof. Dr. M. Jarke

I5-KCKl-0911-4

Lightweight Application Server (LAS) [Spaniol et al. 2006]

– Community Middleware

– Platform for (Web-)Services

– Currently: ~30 Services

– E.g.: Usermanager, MPEG-7 Services

Applications using LAS:

– YouTell (Web)

– SeViAnno (Web)

– AnViAnno (Android)

– Mobile Campfire (iPhone)

– NMV (Desktop)

More recently: LAS XMPP Extension

Previous works:

LAS Server & Applications



Prof. Dr. M. Jarke

I5-KCKl-0911-5

Previous works:

SeViAnno

Interactive semantic annotation of videos [Cao et al. 2010]



Prof. Dr. M. Jarke

I5-KCKl-0911-6

Experiences from Building

Multimedia Web Applications

Design and implementation of alternative architecture

Factors Next-generation Mobile Web Services

Performance Low response time independent of requests

Scalability Scalable and distributed access to services

Development cost Enabling of a single person to design and run web-scale

multimedia applications

Availability Available services from anywhere at anytime

Interoperability Various mobile platforms

Protocols and

standards

Cloud-based multimedia framework using emerging protocols

and standards like XMPP and HTML5

Reduced data

communication

Improved mobile multimedia service quality



Prof. Dr. M. Jarke

I5-KCKl-0911-7

Mobile Multimedia Cloud Computing:

Technology Perspective

Data management

– Big data and NoSQL cloud storage for multimedia artifacts

– Amazon S3, Google BigTable, Hadoop HBase

– Traditional relational DBMS for metadata storage

Communication

– The mobile broadband Internet offers improved QoE,

more interactive applications

– Protocols like XMPP or SIP offer integrated social structures application-level

routing, resource discovery, extensibility, etc.

Computation

– Client server model and Web Services

– Automatic offloading of computation tasks into the cloud

or using nearby resources (home servers, base stations, kiosks)



Prof. Dr. M. Jarke

I5-KCKl-0911-8

Mobile Multimedia Perspective

Multimedia formats and transcoding

– Interoperability and adaptation via transcoding

services for different platforms

Multimedia semantics

– Analysis of low-level features

Multimedia modeling

– Multimedia context

(coming from the multimedia semantics)

– Mobile context inferred using sensors on devices

– Metadata standards and ontologies for knowledge

representation and processing



Prof. Dr. M. Jarke

I5-KCKl-0911-9

User and Community Perspective

Sharing and collaboration

– Driving force for mobile devices improvement

Ubiquitous multimedia services

– Accessibility on heterogeneous mobile

and desktop devices

– Seamless multimedia experience

Privacy and security

– Holistic trust models of devices, applications,

communication channels and cloud service providers



Prof. Dr. M. Jarke

I5-KCKl-0911-10

I5 Multimedia Cloud Architecture



Prof. Dr. M. Jarke

I5-KCKl-0911-11

I5 Cloud Resource Usage Monitoring



Prof. Dr. M. Jarke

I5-KCKl-0911-12

Use Case: Collaborative Metadata

Management and Multimedia Sharing

Historian

Architecture

Expert Local

Workforce

Third party Metadata Repository

Documentation

Expert

1- images and videos

Collaborative

Multimedia Cloud

2- tag basic metadata

XMPP is the main communication protocol to

support real-time collaboration

Captured time

Taken location Creation

time Provenance

….

Metadata



Prof. Dr. M. Jarke

I5-KCKl-0911-13

Use Case:

Mobile and Web Video Integration



Prof. Dr. M. Jarke

I5-KCKl-0911-14

Use Case: Improving UX of Mobile

Video Media Using Cloud Services

Improving user experience for mobile video by intelligent and fast video

processing cloud services

Mobile video browsing tedious

- Only time point as position clue

- Takes long time until preview image

available

Improvement of mobile

video browsing

- Segment-dependent

- Metadata-dependent



Prof. Dr. M. Jarke

I5-KCKl-0911-15

Discussion

Mobile networks are part of the Web now

Augmentation of resource-poor mobile devices through cloud services

Perspective Use cases’ features

Technology XMPP, Video streaming, Deltacloud API

Mobile multimedia Multi-platform video transcoding, MPEG-7 based metadata,

intelligent video adaptation

User/Community Enhanced mobile video UX, collaborative multimedia services via

metadata creation and sharing in real-time



Prof. Dr. M. Jarke

I5-KCKl-0911-16

Future Work

The XMPP protocol for metadata synchronization as XEP

extension

– Real-time collaboration and sharing of XML documents (i.e.

metadata documents)

Interoperability between MPEG-7 and other metadata

standards

– W3C Media Annotations Ontology and API

Three-tier cyber-foraging using offloading to nearby

(cloudlet) and remote resources (cloud)

– Reduced latency – better interactivity

– Goal-Cost-Metrics based model for resources scheduling



Prof. Dr. M. Jarke

I5-KCKl-0911-17

Feedback? Questions?

Thank You!

[email protected]

@dkovachev