2010-03-04, 2009

Stuart Campbell TIE CTO

Stuart.Campbell@TIEGlobal.com

PLEASE VIEW ONLY IN FULL SCREEN MODE AS HEAVILY ANIMATED

Context: PLEASE READ THIS FIRST IF YOU DO NOT KNOW THE CONTEXT OF

PROJECTS….• The European Union Actively Sponsors Research to Increase European Competitiveness, Employment

and Social cohesion. • This funding is 32 Billion Euros over a 7 year period and includes large projects such as CERN (Large

Hadron Collider) to Science and Industry project.• The EU essentially pays for the majority of the research and organisations involved (Large Companies,

SMEs, Users, Researchers, Universities) keep the results• The EU through its ITEA2 program (www.itea2.org) have just launched a call for proposals (closes end

March)• The precise shape of any proposal is at the behest of those participating in the project but must fit into

the scope of the call and be a consortium of organisations around Europe• This PowerPoint is the vision of one project, SMASH. This project concept is lead by TIE (a Netherlands

based SME involved in ‘Connecting Businesses’)• The purpose of this PowerPoint is to present the project to parties to both visually describe it and to

present to other who we believe could both add value and benefit from being part of this proposal and funded consortium

• Once a proposal is constructed, it is then neutrally evaluated with many other proposals and if retained will go into a ‘phase ii’ where the full project plan needs to be elaborated. The overall process takes around one year

• Whilst this document takes a rather user-friendly approach to explain the SMASH-IT story for a range of audiences, this project will indeed be very serious to service a serious need. The project will submit around a 5-10 Million Euros costs, of which around 50% is funded dependent on country location of company, and involve approximately 15 parties around Europe with already big names in the ICT and Research World Committed

• More information available on request of the process

ITEA2: • See www.itea2.org)

• ITEA 2, the follow-up to the successful ITEA programme, is a strategic pan-European programme for advanced pre-competitive R&D in software for Software-intensive Systems and Services (SiS).

• Our ambition is to mobilise a total of 20,000 person-years over the full eight-year period of the programme, requiring a significant increase in investment . This ambition is based on experience in ITEA, the need to further close the gap in R&D investment (3% of GDP, Lisbon objective) and the ever growing importance of SiS.

• In the ITEA & ITEA 2 programme over 1000 partners from 27 countries work together on building crucial middleware and preparing standards for embedded and distributed software.

• Approximately one third of the partners are small companies, another third large companies and the final group are from research institutes and universities – Message for Project

•

ITEA2 / Call 5

SMASHSmart Mash-up

Nature of Project

•Type ITEA2•Budget: 5-10M€ Costs, 2.5-5M€ Funding 

•Timing Start mid-2011, 3 Year Duration

The Slogan“The no-mash-up mash-up project”

The bi-line:

Which user has ever heard of, or wants to hear of SOA, Services, Repositories, Annotation and

Context?“They have one aim – connecting what they see on

the web without THEM having to connect together what they see on the web!

Automatically. Without repositories, registries, service and process composition. It just does it”

Contents of slide set:• The objectives• The story

– Before SMASH– After SMASH

• The message• The science• The impact• The innovation• The architecture• The call coverage

The Objectives

SMASH Primary Objectives – Front End• Give users the (web) service frontend that they

understand and are able to handle• Define multimodal methods to capture the user’s

intention (e.g. drag and drop web sites, input text,…)• Determine user’s context, profile, and level of

experience (e.g. integrate iTunes information)• Adapt the service frontend accordingly (e.g. show one

integrated web site adapted to the device capabilities)• Provide a suitable means of interacting with the service;

user feedback methods (e.g. web browser, mobile application, natural language, surface computing…)

SMASH Primary objectives – A Future Internet Platform

• Enable a drag-and-drop like combination of services• Develop a meaningful and evolvable service description

format that can be automatically combined when the services are combined (i.e. the service combination description can be automatically generated)

• Define methods of interpreting the user’s intention in the right way (decide which services to merge and what data to combine – semantic interoperability)

• Enable effect-driven service combination to consider long tail services (e.g. weather information can be provided by a variety of services)

SMASH Primary objectives – Exploiting Research

• Re-use, cross-fertilize, integrate and extend existing research projects as well as add other technology:• STASIS: Enables semantic interoperability

between business objects• SOA4All: Service Composition on the web• ezWeb: Service Front End• Others?

SMASH Possible objectives

– Social communities could be also interesting here (i.e. integration of data stemming from social networks)

– Furthermore, privacy is an aspect that should be considered when dealing with user's profile or context information

The StoryOnce upon a time….

“Hey mum, how’s the booking going?”

The Scenario

The Story I - Before Smash• Case 1: Classic Scenario• Nadine is a busy lady. She works all day and dreams of travel all night.

Even a weekend away is very special to her and her family but if she travels its got to be nice – sunny, warm and no rain. She’s English after all. But this weekend is a good one and she decided to make a last minute holiday booking. She doesn’t care where but it has to be a cheap price and she must have good weather!

• That evening she goes to LastMinuteEasyRyan.com to explore those last minute deals. Theres several available but she needs to keep checking the CBB Weather site for the forecast on these place. Paris? – No rainy for next two weeks, Rome? – Possible but whats the weather on Sunday? She spends the time flipping between flight and weather sites trying to remember all the details and book that weekend away. Why is this so hard? Children can make joined-up writing

…what about a joined-up web to make her life easy!

• Case 2: Current Research Scenario• “Hey mum” says her IT-aware son. “Why are you wasting your time doing

all that flipping around? Havnt you heard there are some great technologies out there like the SOA4ALL project to make this easy for you. These sites are all about services and you just need to connect them together”. “Sounds good and simple – show me how” she says. “Yeh its easy, you just need to couple the context aware services, and you do this by opening the process editors to find the pre-requisite services from the distributed repository systems and its all based on SOA, aggregation ,federation, discovery and enabled all through a SaaS approach and you can even add new services by annotating them.

“It’s great - NOT! Only for nerds and geeks”

The Story II - Before Smash

• “Uulp. Do I need to wear a hoodie as well? I think I need to take a break…somewhere hot and sunny and cheap. Help!!!”

“Hey mum,

how’s the booking

going?”

“OK, Mum.

What you need is SMASH”

The Story…Happily Ever After

Note: This Story is an illustrative example only…the purpose will be to make this happen in a completely

generic way and not specific to anyone set of websites

“Hey mum, how’s the booking going?”

“Ive got the flight site…..

“…and weather site open - I just need to connect them ….”

“hold on a minute whilst a drag one website to the other”

“or” another example – this time only components

“Hold on, it’s now its asking me [something] I will select destination and it will remember this in my preferences”.

Hello Nadine, are you looking for weather during your trip or just at the destination?

Flight

Destination OK Cancel

Prague

Pragure

“Hey this is great, it knows where I am and the sites are synchronised together as I enter information

Manchester

Prague

““Ah, I see lots of others have made similar connection before and it’s asking if I want to auto-integrated information if I need a cheap broadband connection in that country when im there Let’s accept that as well. Hey neat. It just drops it in

Hello Nadine, lots of other people integrated hotels.com as well. Would you like to

Yes No

Hello Nadine, lots of other people integrated hotels.com as well. Would you like to

Yes No

“Hang on mum, what about the dog? You had best check Granny is at home that weekend to look after it – find and drag in her

Outlook calendar as well. Oh great she is free”.

“Lets search. Right Prague and Barcelona seem to match the criteria. This is so easy when you just use a single interface to do everything. “

SEARCH

Prague

Prague

“Hey, I remember you promised if we went that I won’t be bored and we could see a concert – let me access “DecentRockBandsOnTour.com” and drag that in – shame, no

good bands on that week”.

Prague

“Hold on, SMASH has detected my phone, good ideal let me drag in my music collection. Hey excellent, TheSMASHBand are playing that weekend in Barcelona –

Phone detected…Would you like to see if any events match your Music Collection

Yes No

SMASH Band

Prague

“Lets book the flights and tickets all in one go”. “OK, I will just drag in

my internet banking portal and we will be done”. “

SMASH Band

Outputs

E-LM-R Three Facebook Outlook Bank Phone

Just send all the info to my mobile when im done mum, im sure you will find a service on the SMASH network to do that. You know I live by that thing and also my social page to everyone know im going to that cool concert.”.

And your fridge as well I suppose?”.

“No, that’s SMASH2 – the Future Internet has its limits and besides thats in the

kitchen and I stay clear of there!”

“Hey mum,

how’s the booking

going?” SMASHing

The Message

The message:• SMASH makes a paradigm shift in service technology. From todays focus on

technology, processes, technical gadgets and what technicians see as a technical future to the Future Internet where the individual is in control. No technology, no acronyms just intuition and intelligence.

• A Future Internet of networked services composed together by real people without the need for composers and orchestrators but enabled by Service front end the truly empower the users. An internet composable by kids, mums and small business. An internet which integrates into your physical and software applications. But an internet which is realistic. SMASH is not intended to deliver academic bookshelves but to be real, inventive and look forward to 3-4 years time when this will happen and where it can be the exploitation basis for European Companies.

• The classic and already innovated service technologies related to description, discovery, composition are of course behind the scenes and there are many of them, and many interesting results, to take advantage of but the innovation of SMASH brings the service world to the next level of technology-free, process free, infrastructure-free interoperable connectivity.

• The Future Internet: Nadine is a busy lady, but no longer busy flipping web pages or learning how to mash up repository artefacts. She’s on the beach, her son is at the concert and they are both having a SMASHing time.

Or another Way

Again, one thing the proposal wants to make absolutely clear is that the story below, and in the other use cases, are ILLUSTRATIVE ONLY. SMASH is *NOT* specific to these websites or users partners. SMASH, by design, is for potential use on ’any’ website without further adaptation by users or developers. ONLY drag-and-drop. In the case of applications (eg Outlook, iTUNES etc) and devices, the specific templates (API to Service maps) will need to be written since these are proprietary in nature. SMASH will contribute several of these

The Story; Before SMASH. Case 1: The Classic Scenario

Once upon a time…. “Hey mum, how’s the booking going?”

Nadine is a busy lady. She works all day and dreams of travel all night. Even a weekend away is very special to her & her family but if she travels, it’s got to be

nice – sunny, warm and no rain. She’s English after all. This weekend she finally has two free days and she wants to make a last minute holiday booking. She doesn’t care where, but it has to be a cheap price and must be good weather!

That evening she goes to BARCELO.com hotel booking page to explore some last minute deals. There are several available, but she needs to keep checking

the BBC Weather site for the forecast in these places. Paris? – No rainy for next two weeks, Rome? – Possible but whats the weather on Sunday? She spends

the time flipping between travel and weather sites trying to remember all the details and book that weekend away.

Why is this so hard? Children can make joined-up writing

…what about a joined-up web to make her life easy!

The Story; Before SMASH. Case 2: Today’s Research Scenario

Hey mum” says her IT-aware son. “Why are you wasting your time doing all that flipping around? Haven’t you heard there are some great technologies out there like the SOA4ALL project to make this easy for you? These sites are all about

services and you just need to connect them together”. “Sounds good and simple son – show me how” she says. “Yeah, Cool man. It’s easy, you just need to

couple the context aware services, and you do this by opening the process editors to find the pre-requisite services from the distributed repository systems and its all

based on SOA, aggregation ,federation, discovery and enabled all through a SaaS approach and you can even add new services by annotating them.”

“It’s great - NOT! Only for nerds and geeks”

“Uulp. Do I need to wear a hoodie as well? I think I need to take a break…somewhere hot and sunny and cheap. Help!!!”

The Story; WITH SMASH. Case 3: Tomorrows Research Scenario

“OK, Mum, What you need is SMASH”

The Story…Happily Ever After

Note: This Story is an illustrative example only…the purpose will be to make this happen in a completely generic way and not specific to anyone set of websites

User Action SMASH Activities

Nadine

Nadine is in her UK office and opens the SMASH Studio website and enters :

“I want to book a hotel in a hot place”

SMASH Reconstruction engine processes the request and in conjunction with the recommendation resources suggests existing service memories

NB: Normally the use would start at the next step – but this helps illustrate a later step

This didn’t provide a result so Nadine simply selects the Barcelo travel website

SMASH Recognition Engine is triggered to examine service

SMASH storage memory is examined to see if the specific site/service is already known

SMASH Recommendation systems suggest other enabled sites or SMASHed sites

SMASH Context Sensors suggest adaptations of the specific service

Semantic Recognition is used to recognise individually service elements

SMASH service is autobuilt

Service Definition is created/established

User interaction to fine tune the service definition

Service definitions are entered on the federated storage for reuse

Since decides she might use this service elsewhere, such as on a dashboard or desktop

SMASH Auto gadget functionality adapts the service definition in to a Gadget for use in other systems

She then selects the BBC Weather website

SMASH Recognition and Autobuild Engine is triggered to provide service enablement [with a similar process to the Barcelo recognition]

She drags BBC Weather on to the Barcelo website

SMASH Mashup and Reconstruction engine is triggered to initiate the visual and service mapping process

SMASH storage memory is examined to see if the compound SMASHed services are already is already known

SMASH Recommendation systems suggest other SMASHed sites

SMASH Context Sensors suggest adaptations of the to-be composed services

Semantic Recognition is used to recognise and wire already semantically enabled services

A visually SMASHed service is made

And created in the SMASHed service description format

Reconstructed service is memorized via the repository

And then she is ready to make her hotel booking using the new SMASHed service and type pertinent context information, “Fly somewhere hot”, into the visually SMASHed site and hits ‘submit’

The SMASH Service Execution engine controls the interaction of the SMASHed services with the user data until all services report back success

Since all has worked perfectly, Nadine provides context data/feedback to SMASH allowing others to reutilise her work

SMASH feedback systems extracts context, usage and other feedback information and stores along with individual or SMASHed services as Service Memory recommendations of the repository

Some days later, whilst on business in France, Nadine now wonders if the recommendation system has really worked?

SMASH Context sensors detect here login is an IP address in France

So she speaks into the stand Microsoft standard ‘speech Recognition utility “I want to fly to somewhere hot”

SMASH Reconstruction engine processes the request and in conjunction with the recommendation resources suggests existing service memories. In this case it means the one above should be included on the ‘found’ list

While looking for next day’s weather, she’s pretty surprised when SMASH updated the parameters because Nadine’s now in France

The default information in the Sites/Services is adapted to fit her new context

She makes a call and her iPhone iTunes application is detected

SMASH Recognition Engine is triggered to examine service

A suitable template is found in conjunction with SMASH Resources

SMASH Context Sensors suggest adaptations of the specific service

SMASH Recommendation systems suggest other enabled sites or SMASHed sites

And then she is prompted to drag the iTunes on to the SMASHed website. Since Nadine wonders if there are any concerts for bands she likes that day she does so

SMASH Mashup and Reconstruction engine is triggered to initiate the visual and service mapping process

And then she is prompted to drag the iTunes on to the SMASHed website. Since Nadine wonders if there are any concerts for bands she likes that day she does so

SMASH Mashup and Reconstruction engine is triggered to initiate the visual and service mapping process

Where they become an ‘as one’ mashup Service with the Barcelo and BBC Weather site

There’s no bands she likes on so doesn’t bother dragging in the ticketing site.

Adapted and reconstructed service is memorized via the repository

Nadine also sees that SMASH suggests to use another recommended mashup-up service which already connects her windows media player with flight site Skycanner.net

Recommendation functionality, with input from context, is used to present other options

Some days later, when Nadine is on the system again

SMASH provides controlled access to a users space

She gets a notification that Barcelo Hotels has a special offer in Barcelona and with click she accepts the information of the SMASHed service and books that holiday!

SMASH process engine also supports long-tailed service and controls the interaction with existing SMASHed services and exiting context/entered data (whilst respecting privacy)

Technically Related

Service Adaptation As software changes SMASH will ensure an auto-upgrade of browser plug-ins

Software Integration

This will manage the overall interaction of all SMASH components

In Practice

RecognitionEngine

Website

Application

Device

Reconstruct Engine

ContextEngine

SemanticEngine

AutoGadget

SRRNFederated Repository

Memories

Individual Composed

Templates

Application

RecommendationsIndividual Composed

AutobuiltEnabled Services

TemplateEngine

Autobuilt enabled Services

External

SFE of Composed

Services

Updates

ProcessManagement

KEYRecommendationTemplateMemory

O41O42

O43

O44

O51

O52

Format

O45

O42

O46

O47

Device

O52

O53

O53

O54

O55

O61

O62

O63

Recommend Engine

O47

O55

O64

O65

Security / Privacy

O67

ContextEngine

O69

O610

O71

O72

Input Modalities

O73

O73

O74O75

O77

O78

O81O82

O43

CustomiszeIntegrate

O83

O84

The Science

SMASH Scientific Areas

• Semantics, rich descriptions– Meaningful, mergeable, and effect-driven service

descriptions– Context and profile descriptions, description of user

intents– Mash-up/web site template description (to

incorporate information from multiple sources and of multiple types)

• Web technologies, mash-ups– Mash-up technology as input of user requests– Instant creation of mash-ups and templates,

combination of inputs– Integrate social web information

SMASH Scientific Areas

• Multimodality, context sensors– Capture and combine context information to adapt the

service frontend– Prepare service frontend for user feedback– Provide context information (e.g. location) to service

frontend• Profiling, recommender systems

– Use profile information to recommend users particular services or inputs proactively

• Telecommunication– integration of telco features in web-apps/mash-ups such

as calling your friend or a web site contact from the mash-up, synchronize numbers from your mobile phone with the web application or capture location information from the mobile

Which Technologies•WSDL, WADL•SOA•WS-BPEL / BPEL•XUL (realization as a Firefox plug-in?)•WSMO (i.e. MicroWSMO and WSMO Light)•DSRN

•SparQL•RDF•OWL

Which Possible Project/standards/approaches assets•SOA4ALL

•Studio components (not UI)•STASIS

•Semantic (TIE)•DSRN (TIE / iSOFT)

•OpenInterface project (http://www.oi-project.org/)•Multimodal interaction

•OPUCE (http://www.opuce.tid.es/)•Easy service creation

•MobiLife•Context-awareness

•BONDI@OMTP•Mobile phone API for the Web

•W3C standards•HTML5•etc

The Impact

SMASH Impact• Future Internet Contribution

– SMASH will provide convergence by creating all devices as service containers and seamlessly integrating and interoperating as perceived by the following examples involving desktop, web and device applications

• Deep Technical Advices– SMASH will take the user experience from the technician to the user. To do

this will require state of the art MashUp3.0 technologies involving the SOA Stack but also inventing technologies to scrape the ‘hidden’ services of most web pages

• Lowered Barriers for Service Providers– By making services more useable, more people will use and mash which will

make the market more attractive. Equally by providing wisdom-of-crowds reutilisable Mashup repositories it will also encourage more use and thus more market. In addition SMASH interfaces and created technologies will all be entered into European standardisation and are expected to be open source.

SMASH Impact• Massive Uptake of Services

– The wholly user centric front end of SMASH will empower the users and this will be proven and driven by focus groups of real communities making their third party service mashups on the fly without recognition of the technology behind SMASH

• Strengthened EU industry– SMASH will leap-frog what is on the market today. The US providers have

currently not announced Mashup 3.0 as envisioned by SMASH with the likes of Yahoo still focusing on non User-centric process editors through the likes of Yahoo-pipes

– SMASH will also be contextualised for the EU service environment focusing on services from EU providers in the prototype linking services be able to catch up with the USA (eBay, Yahoo, Google, …)

The Innovation

• Innovation– User Point of View

• User can do what they have always done• Intuitive – drag and drop, no new skills• Looks to all their assets – not just the web, other devices• No more technology – process editors etc• No more terminology – Mashup, repositories etc• Reutilising existing information from repository – wisdom

of crowds• Adding your work to repository - prosumer

– Business Point of views• Innovative – appears not to exist now, exploitable• Exploitable – services will increase exponentially, SMASH is

ready• Open to any ‘service’/device. Right now service

connections are made bilaterally – eg Easy-LastMinute-Ryan mashes to the CBB, but then to CBC weather, then ABC weather – a n! situation

• Mashup are user driven – ie by market demands

• Innovation– Technical Point of view

• No competition right now– Things like Yahoo pipes is like case 2 (SOA4ALL Studio) and only

about connecting to Yahoo. Not generic, too technical• Existing Technologies/projects combined in user centric

way• Interface technology will be the key• Service formal definitions can be reutilised but must will

be processing unstructured website and creating services definition

• Website, Applications have many different technology so scraping them and neutralising them will be difficult

• Context must be generated….is it at take of, flight, landing or after you land that the weather is important

• Can link to interesting technologies available which will be hidden - eg projects STASIS, SOA4ALL, Linked Data and other ld, forth coming 1.2 technologies

The ArchitectureSimplistic

Recognition

Web

PC

BBC

LateJet

Outlook

Music

Device

Eg Structured:WSDL etc

Eg Non-Structured:WSDL etc

Eg Bespoke:Adapters / APIS

Storage

Known Services

Inputs

RockBand

Reconstruction

Adaptation & Context Hotels.com

Reutilised Services

Outputs

LateJet Hotels.com Facebook Outlook Bank

Bank

Phone

Simplistic Architecture

The ArchitectureDetailed

RecognitionEngine

Website

Application

Device

Reconstruct Engine

ContextEngine

SemanticEngine

AutoGadget

SRRNFederated Repository

Memories

Individual Composed

Templates

Application

RecommendationsIndividual Composed

AutobuiltEnabled Services

TemplateEngine

Autobuilt enabled Services

External

SFE of Composed

Services

Updates

ProcessManagement

KEYRecommendationTemplateMemory

O41O42

O43

O44

O51

O52

Format

O45

O42

O46

O47

Device

O52

O53

O53

O54

O55

O61

O62

O63

Recommend Engine

O47

O55

O64

O65

Security / Privacy

O67

ContextEngine

O69

O610

O71

O72

Input Modalities

O73

O73

O74O75

O77

O78

O81O82

O43

CustomiszeIntegrate

O83

O84

R

T

D

Requirements

Man

agem

ent

SMASH Service

Recognise & Autobuild

SMASH Housekeeping &

Management

SMASH Adaptation, & Context

SMASH Mashup

Resources

Qu

alit

y

Integration

SMASH Service Frontend Reconstruction

Vision Market

Demonstration Validation Pilot

Dissemination Discussion Impact

Exploitation Interworking

Functional View

SpecificationSOTA Architecture

WP2

WP

1

Requirements

Man

agem

ent

Qu

alit

y

Vision Market

WP9Use Case Verification

WP3

Workpackage View

WP10Dissemination Discussion Impact

Exploitation

SpecificationArchitecture

WP4SRASRA

SMASH Service

Recognise & Autobuild

WP8SHMSHM

SMASH Housekeeping & Management

WP6SCASCA

SMASH Adaptation & Context

WP5 SRPSRP

SMASH Mashup

Resources

WP7SRESRE

SMASH Service

FrontendReconstruction

Interworking

SOTA

Build

Pilot Demonstration

R

T

D

Workpackage View

RTD Workpackages

WP4SMASH Service

Recognise & Autobuild

•Website•Applications•Devices•Environment

WP8SMASH

Housekeeping & Management•Monitoring•Execution•Process•Integration

WP6SMASH

Adaptation & Context

•Context•Personalisation•Privacy•Recommendations

WP5SMASH Mashup

Resources•Federated Storage•Templates•Memory•Semantics

WP7SMASH

Service FrontendReconstruction

•User mashup•Gadget Making•HCI•Reuse

WP2

WP

1

WP9

WP3

WP10

WP4SS

WP8HH

WP6AA

WP5MM

WP7SS

Operational Board (lead TIE)

Partner Organisations

European Commission

Coordinator(TIE)

Executive Board (lead xxx)

Research (R) (Science) Management

(xxx)

Impact & ExploitationManagement

(xxx)

Technical & Development (T&D) Management

(TIE – Dr Sven Abels)

User Management

(xxx)

Task Leads Focus GroupsAdvisory Board

PartnerLeads

PartnerLeads

PartnerLeads

Project Management

(TIE – Stuart Campbell)

WP LeadsTask Members

PartnerLeads

WP1-2 WP leads: WP3-10 Research Forum : WP3-8

Tech/Dev Forum : WP4-8

User Forum: WP9

Impact Forum : WP10

Executive Board (lead TIE)

Partner Organisations

European Commission

Coordinator(TIE)

Board Of Partners (lead ATOS)

Research (R) (Science) Management

Impact & ExploitationManagement

Technical & Development (T&D) Management

User Management

Task Leads Focus GroupsAdvisory Board

PartnerLeads

PartnerLeads

PartnerLeads

Project Management

WP LeadsTask Members

PartnerLeads

END