empowering user participation with converged semantic services

www.sti-innsbruck.at © Copyright 2012 STI INNSBRUCK www.sti-innsbruck.at

Empowering user participation with converged semantic services

Dr. Anna Fensel

27 June, 2012; STI Innsbruck Summit

www.sti-innsbruck.at 2

Outline

• Motivation for the Research Agenda• About Participation• About Convergent Services• How Semantics and Convergence Foster Participation - Examples

– User Generated Mobile Services – Smart Buildings and Grid

• Conclusions

Disclaimer: The contents of this presentation are not necessarily reflecting opinions of any of my current, past or future employers.


Outline



• Conclusions


www.sti-innsbruck.at

Motivation

Aims:• Enabling efficient participation vs. current social network silos and groups

– More possible roles for an individual – More roles at a time for an individual– More matching and satisfying roles for an individual

=> Motivation, added value and revenue increase

Technologically that means:• Benefiting from data and services reuse at the maximum• Enabling participators to establish added value new and converged

services on top of the data– commercially re-applying them across platforms

=>There is a need to „understand“ and interlink content and objects coming from heterogeneous numerous sources

Converged Semantic Services For Empowering Participation


5

Motivation: From Heterogeneity to Convergence“Service Science is just ___<name your discipline>____”

OR/IEMS

CS/AIMultiagent Systems

Economics & LawGame Theory

MIS Anthropology& Psychology

OrganizationTheory

A ServiceSystem is Complex

ServiceOperationsMarketing

ManagementQuality

Supply ChainHuman Factors

DesignInnovation

EngineeringSystems

ComputingEconomics

ArtsScience

InformationScience

(i-schools)

GeneralSystemsTheory


Positive Example from the Web: Open Graph Protocol

• Open Graph Protocol - enables any web page to become a rich object in a social graph.

• Developed and used by Facebook– e.g. external “Like button”

• Keywords: semantics (RDFa) and simplicity

• Can be referred as a “converged service”


Outline



• Conclusions



Young People‘s Participation

• Psychology perspective:

„Child-Adult“


Participation in Terms of Social Media


90-9-1 Rule for Participation Inequality

• Web use follows a Zipf distribution• Also applicable to social media• Also to working groups?

• Is that wrong?– In some cases (e.g. inappropriate

match), yes.– In many cases (e.g.

dissemination effect), no.

Jakob Nielsen, http://www.useit.com/alertbox/participation_inequality.html


Participation is Linked to Value

• Participation level relates to the value one gets from participation• Participation also has a value in itself

Lurkers‘ Perspective


Participation is Linked to a Role

Äns - 1 person: gatherer or hunter

Zwo - 2 persons: gatherer and hunter?– Problem with the role choice starts from

the moment where there is a choice.

Having more persons implies:• fine-grained devision of labor and

service economy, • community as a regulator on which

roles are appropriate and which not, as well as their values.


Impact of Roles/Relations and their Weights on Ontology Evolution Dynamics

• People and relations are inherently associated with / connected to / can be decomposed into concepts and properties.

– See also: Peter Mika, „Ontologies are Us: A Unified Model of Social Networks and Semantics”. International Semantic Web Conference 2005: 522-536.

• Changing the roles drive social, ontology and market evolution.• One of the important drive factors are the quantity of concepts/people

relating to another concept/person via a specific property (hub vs. stub), e.g. a property spouse is stronger than friend. Thus, the networks are self-restructuring depending on the roles and weights put on them.

– See also: Zhdanova, A.V., Predoiu, L., Pellegrini, T., Fensel, D. "A Social Networking Model of a Web Community". In Proceedings of the 10th International Symposium on Social Communication, 22-26 January 2007, Santiago de Cuba, Cuba, ISBN: 959-7174-08-1, pp. 537-541 (2007).


Participation is Linked to a Role

• (Semantic) contentcreation, and thus,participation, is driven by a role

– „Role“ is a steadier

form of insentives

(as e.g. reputation vs.

yield management)

• Hence, in participation, people/companies are optimi-zing their roles by taking ones and drop-ping others

– Limited time and money

• Converged semantic services are to enable users performing in roles unavailable to them before & changing the roles faster when needed.

PICTURE FROM: Zhdanova, A.V., Shvaiko, P. "Community-Driven Ontology Matching". In Proceedings of the 3rd European Semantic Web Conference (ESWC'2006), 11-14 June 2006, Budva, Montenegro, Springer-Verlag, LNCS 4011, pp. 34-49 (2006).

http://www.eswc2006.org/


Outline



• Conclusions



Communication Media Development

• Technology Development List• The printed newspaper (1436)• The 'Silent Pictures (1888)• Radio (1896)• Telephone (1876)• Silicon Chip (1896)• Cellphone (1973)• Digital Camera (1981)• PDA (1981)• The Internet (1983)• Email (1965)• Wikis (1995)• Facebook (2004)• Twitter (2006)

– BG Creative, A Brief History of Media Convergence: 4000 BC to 2009 AD, August 20, 2009

Communication technollgies are a medium to participation.

To communicate though does not automatically imply to particiapte.


Convergence

• “Telecommunications convergence, network convergence or simply convergence are broad terms used to describe emerging telecommunications technologies, and network architecture used to migrate multiple communications services into a single network.[1] Specifically this involves the converging of previously distinct media such as telephony and data communications into common interfaces on single devices.”

– Wikipedia

• Convergent technologies/services include:– IP Multimedia Subsystem– Session Initiation Protocol– IPTV– Voice over IP– Voice call continuity– Digital video broadcasting - handheld

http://en.wikipedia.org/wiki/Telecommunications

http://en.wikipedia.org/wiki/Network_architecture

http://en.wikipedia.org/wiki/Convergence_(telecommunications)

http://en.wikipedia.org/wiki/Telephony

http://en.wikipedia.org/wiki/Data_communications

http://en.wikipedia.org/wiki/IP_Multimedia_Subsystem

http://en.wikipedia.org/wiki/Session_Initiation_Protocol

http://en.wikipedia.org/wiki/IPTV

http://en.wikipedia.org/wiki/Voice_over_IP

http://en.wikipedia.org/wiki/Voice_call_continuity

http://en.wikipedia.org/wiki/DVB-H


Link to Value - Mobile Operators‘ Use Case - Business Potential of Openness and Collaboration


Increasing Participation – From Static Social Network Silos to Pervasive Social Spaces

...where everyone benefits.

Semantic technologies

take you there.


Semantics in One Slide

• Larger markets are to come• Linked Open Data cloud

counts 25 billion triples• Open government initiatives• BBC, Facebook, Google,

Yahoo, etc. use semantics• SPARQL becomes W3C

recommendation• Life science and other

scientific communities use ontologies• RDF, OWL become W3C

recommedations• Research field on ontologies

and semantics appears• Term „Semantic Web“ has been „seeded“, Scientific American article,

Tim Berners-Lee et al.

2008

2001

2010

2004

Source: Open Knowledge Foundation


From Semantic Web to Semantic World: Data Challenges

• Large volumes of raw data to smaller volumes of „processed“ data– Streaming, new data acquisition infrastructures– Data modeling, mining, analysis, processing, distribution– Complex event processing (e.g. in-house behaviour identification)

• Data which is neither „free“ nor „open“– How to store, discover and link it– How to sell it– How to define and communicate its quality / provenance– How to get the stekeholders in the game, create marketplaces

• Establishment of radically new B2B and B2C services– „Tomorrow, your carton of milk will be on the Internet“ – J. da Silva,

referring to Internet of Things – But how would the services look like?


Outline



• Conclusions



Mobile Ontology

Villalonga, C., Strohbach, M., Snoeck, N., Sutterer, M., Belaunde, M., Kovacs, E., Zhdanova, A.V., Goix, L.W., Droegehorn, O. "Mobile Ontology: Towards a Standardized Semantic Model for the Mobile Domain". In Proceedings of the 1st International Workshop on Telecom Service Oriented Architectures (TSOA 2007) at the 5th International Conference on Service-Oriented Computing, 17 September 2007, Vienna, Austria (2007).

http://userver.ftw.at/~zhdanova/papers/MobileOntology_TSOA07.pdf

http://userver.ftw.at/~zhdanova/papers/MobileOntology_TSOA07.pdf

http://softeng.polito.it/TSOA/

http://softeng.polito.it/TSOA/

http://www.ece.cmu.edu/icsoc2007


Participation in Different Roles in Ontology Construction Actual Split – SPICE Integrated Project Example

Zhdanova, A.V., Li, N., Moessner, K. “Semantic Web in Ubiquitous Mobile Communications”. The Semantic Web for Knowledge and Data Management (Ed.: Ma, Z.), IGI Global (August 2008).


Participation in Collaborative Ontology Construction for „Newbies“ - Challenges

• Educational: people with no/little knowledge on ontologies require at least an introduction to the field;

• Methodology: yet no widely accepted or best practice solutions on how to acquire ontologies from people in such a setting;

• Basic technology: current ontology language standards (such as OWL) cause confusion and awkward modelling solutions;

• Tool support: better tools for ontology construction process coordination, documentation would help to avoid ad-hoc solutions and manual work.

Zhdanova, A.V., Li, N., Moessner, K. “Semantic Web in Ubiquitous Mobile Communications”. The Semantic Web for Knowledge and Data Management (Ed.: Ma, Z.), IGI Global (August 2008).

www.sti-innsbruck.at26

Microservices Scenario: Traffic Jam Killer

Motivation: Share knowledge about the fluidity of the traffic and presence of mobile radars with friends.

www.sti-innsbruck.at27

m:Ciudad – Underlying Magic

Operating System

Execution Environment

Services

ServiceCapabilities

CapabilitiesManagement

N E TW O R K

T E RM I N A L

Servicewarehouse

Knowledgewarehouse

Usermanagement


Architecture - detailed building blocks

m:Ciudad

Framework

Service provider enablersService Exec Env

My Service Registry

KW

Search engine

persistentDB

Recommender

Rule & Policy controller

Serv lifecycle & State Mgr

Service publisher

Metadata creation

SW

Authoring / SCK

Search engine client

AccountingAuthorization, access control

User & Group mgmt

Capabilities Mgr

mCiudad GUI / launcher

Overlay network

Embedded capab. Remote caps

Service storage (templates, SSEs)

service instances

Provider/service Matching table

SSEs

SEE backend view

Context & profile manager

Profile mgr

Notif. mgmt

Metadata ontology

Ontology parsing

Hosted communication capabilities

Service availability tracker

gateways

sensors


Microservice description language

mService

Backus-Naur &

XML-Schema

OperationalDescription

Rendering Description

SSE’sSemantic Description

Made of

XML-Schema

SemanticContentDescription

mServiceprofile

mService Content

DomainSSE

SemanticDescription

Semantic Characterization of mService and Capabilities

Operational Characterizationof mService

Ontology

Legend

SSE’sCapability

Profile(UDL-CP)

mService Content

(UDL-CD)

OperationalMetadata

SearchableMetadata

LocalMeta-data

mService Profile(UDL-SP)

Ont. Instances

mService Logic

(UDL-SL)

mService Rendering(UDL-SR)

XML doc


Architecture of Knowledge Warehouse


31

Service Creation Kit – First Mock-up and Approaches: “Block-based” and “Question Answering”

31

Version 1• Visual C++, Windows

Mobile• Goal: Study on Block

approach usability

Version 2• Flash Lite, Windows

Mobile• Goal: Wizzard approach,

Carroussel UI


User Survey – Study Set Up

• Goal: improve understanding of users' needs, experiences, and expectations on user-generated mobile services

– From a knowledge management point of view

• URI: http://survey.ftw.at/microservices • 38 questions, incl. video demonstrations• Distributed via professional and interest mailing lists, social

networks• Answers being collected since June 2009• Participants: 138 persons (52 fully completed)• Plus several face-to-face usability tests with persons (to confirm

the findings)

Danado, J., Davies, M., Ricca, P., Fensel, A. "An Authoring Tool for User Generated Mobile Services". In Proceedings of the 3rd Future Internet Symposium (FIS'10), 20-22 September 2010, Berlin, Germany; Springer Verlag, LNCS 6369, pp. 118-127 (2010).

http://survey.ftw.at/microservices

http://userver.ftw.at/~zhdanova/papers/mobile_services_FIS10.pdf

http://www.fis2010.org/


User Survey – Need for Our Technology

• Ca. 2/3 of users feel the need to adapt services or apps they use

• Ca. 1/3 of users feel the need to create their own services and apps

User profile: – Almost all between 20 and 50 years old, Europeans– ca. 70% male, 30% female– Majority is a researcher or engineer with a Master degree,

also large shares with a Bachelor or a PhD– Daily average internet usage is 5 hours– Half of the respondents access the internet via mobile


Evaluations – Mobile Service Creation

• Customisation – drag&drop (matching blocks) – end-user programming

• Davies, M., Carrez, F., Heinilä, J., Fensel, A., Narganes, M., Danado, J. "m:Ciudad -- Enabling End-User Mobile Service Creation", International Journal of Pervasive Computing and Communications,Emerald Group Publishing, Vol. 7 Iss: 4, pp. 384-414 (2011).

• Davies, M., Carrez, F., Urdiales, D., Fensel, A., Narganes, M., Danado, J. "Defining User-Generated Services in a Semantically-Enabled Mobile Platform". In Proceedings of 12th International Conference on Information Integration and Web-based Applications & Services (iiWAS2010), 8-10 November 2010, Paris, France, ACM (2010).

http://www.emeraldinsight.com/journals.htm?issn=1742-7371&volume=7&issue=4&articleid=17003976&show=abstract

http://www.emeraldinsight.com/journals.htm?issn=1742-7371&volume=7&issue=4&articleid=17003976&show=abstract

http://www.emeraldinsight.com/products/journals/journals.htm?id=ijpcc

http://www.emeraldinsight.com/products/journals/journals.htm?id=ijpcc

http://www.iiwas.org/conferences/iiwas2010/





Outline



• Conclusions



highmediumlow

Relevance

On market

Product concept

Applied Research

Basic Research

ICT

Tech

nolo

gies

In E

nerg

y

Innovative directions

Ex.StandardizationChange of Law

s/Ex.O

perator Services

End –User Services

Smart Grids - Technology Radar

Gaps/Opportunities/ChangesEx

. Disr

uptiv

e te

chno

logi

es

smart metering

EU 2050 nearly-zero goal

large-scale & stream data processing

(semantic) servicedescription, discovery, composiion

Internet of ThingsM2M services

energy control & monotoring

demand-response management

consumer „manipulation“

empowering renewableenergy „prosumers“

Web-Grid convergence

raising consumer awareness

CIM, OPC & other models

data-intensiveservices

automatisation


Market Situation

• Currently: fragmented offers, closed systems, low interoperability, information difficult to find or combine

– Information Services• E-Control, energy companies, energy consultancies

– Smart Metering & Home Automation• Still waiting to come, trials, closed systems, services offered by

energy companies

• Closed sniffer systems (optical sensors, clams) , no closed loop – no impact on energy management

• Specialized systems (security, heating), some open, most closed, some portal based , not part of energy management


Green Marketplace

• Information portal to disseminate in a personalized manner the information about available products and services

• RECOIL = Recommender Optimized via Identified Links for Renewable Energy

• E‐commerce platform combining an advertisement platform and an online shop, through which customers can purchase – Partner hardware

/ services– Mobile apps and games– Coupons for appliances– Add-value info services Portal

ServicesConsumer

Products

Context

EnergyData


Potential Customers / Partners & Their Benefits

Customer Group Benefit

Citizens and private households Facility managers (private and public) Construction companies and investors

Energy awareness and control -> cost and energy savings

Personalized recommendation of products and services

Large manufacturers of energy efficient appliances , home automation devices and renewable energy equipment,

Small manufacturers of appliances and specialized devices such as for smart home automation, retailers, especially those without strong Web presence, market holders

Targeted promotion of products, winning of new customers

“Green” PR Better benchmarking through

consumption data and information about energy efficiency of business processes

Municipalities and their utility companies who offer energy optimization services and energy consultancy agencies, ministries (energy, environment, spatial planning)

Energy supplier companies Tourism companies: hotels, tourism settlements Energy efficiency bodies

Advertisement of services, programs, solutions

Better customer management Better in-sector awareness


Background

2 FFG COIN Projects (sesame-s.ftw.at)• SESAME – Semantic Smart Metering,

Enablers for Energy Efficiency (9’09-11’10, 800k Euro)– Prototype, proof of concepts,

feasibility study

• SESAME-S – Services for Energy Efficiency (4’11-9’11, 770k Euro)– setting up usable smart home

hardware, a portal and repository– organizing a test installation in real

buildings: in a school (Kirchdorf, Austria) and a factory (Chernogolovka, Russia)

– developing specialized UIs and designing mobile apps for the school use case

• Consortium partner network of 6 organizations

http://sesame-s.ftw.at/


Data Acquisition


Extension to More Buildings

• Research challenge: moving logics components, such as building automation settings, user preferences.


• Ministries (Ministry of Infrastructure and Energetics, Ministry of Environment…)

• Provincial councils and centers• Energy efficiency bodies• Energy companies• Municipalities• Construction companies and Investors• Home-automation market holders• Home-appliance market holders• Tourism companies: hotels, tourism settlements• Telecommunication companies• Cloud service providers• …

Many Stakeholders - Same Data

© FTW 2011


• Over 50 users were interviewed f2f plus over a 100 online• Some outcomes

– „Saving costs“ is the strongest motivator, “reputation“ is the weakest– Main system cost expectation is 200 Euro per installation, plus up to 5

Euro as a monthly fee, with energy savings of 20%– Preference to delegate unobtrusive tasks (e.g. stand by device

management vs. lights control)– Every 4th user will choose the „fanciest“ and not the „easiest to use“

interface– 2/3rds of users are „absolutely sure“ or „sure“ they‘d use such or a

similar system in the future– 2/3rds of users would also share their home settings with „friends“

Energy Efficient Buildings –User Trials

• Fensel, A., Tomic, S., Kumar, V., Stefanovic, M., Aleshin, S., Novikov, D. "SESAME-S: Semantic Smart Home System for Energy Efficiency". In Proceedings of D-A-CH Energieinformatik 2012, 5-6 July 2012, Oldenburg, Germany. • Schwanzer, M., Fensel, A. "Energy Consumption Information Services for Smart Home Inhabitants". In Proceedings of the 3rd Future Internet Symposium (FIS'10), 20-22 September 2010, Berlin, Germany; Springer Verlag, LNCS 6369, pp. 78-87.


Smart Home Installation

School, Kirchdorf - AT• Several Smart Meters • Sensors (e.g. light,

temperature, humidity)• Smart plugs, for individual

sockets• Shutdown services for PCs• User interfaces and apps: Web,

tablet, smartphone (Android)

Factory, Chernogolovka - RU• Heating system regulation and

monitoring extension


Services Addressing Users @ School

• Energy awareness, monitoring

• Remote control - manual and programmed - e.g. scheduled activities and triggering rules

• How do we get the users?– By having workshops with

pupils: introduction to energy efficiency, building analysis, explaining the system and services


Demand Management@ Smart Building

Millions of triples collected in the semantic repository


How Green I Am@ www.alphaverda.com


Outline



• Conclusions



Conclusions

• Semantic technology as an enabler for the individuals and organisations to participate productively

– By getting new roles.– By changing existing roles easier.

• Examples have been shown:– Mobile prosumers creating mobile services– Energy prosumer in smart buildings

Possible future research aspects include data analytics e.g. for: • Scenarios involving heterogeneous multiple stakeholders.• Changing/steering behavior, engagement of users/customers.• Enabling participation vs. yield management / resilience.

– “Resilience is the ability to provide and maintain an acceptable level of service in the face of faults and challenges to normal operation.”, “A superset of survivability.” - Wikipedia

http://en.wikipedia.org/wiki/Service_(systems_architecture)

http://en.wikipedia.org/wiki/Fault_(technology)

http://en.wikipedia.org/w/index.php?title=Normal_operation&action=edit&redlink=1


Questions?

empowering user participation with converged semantic services

Technology

participation participation

empowering participation

efficient participation

empowering user participation

value participation

convergent services

social graph

services reuse