epts/dagstuhl event processing grand challenge

epts event processing technical society

eptsevent processing technical society

Pedro Bizarro – University of CoimbraOn behalf of theGrand Challenge Working Group of theDagstuhl 2010 Event Processing Seminar

Event Processing Grand ChallengeMarch 24, 2011


2

Grand Challenge

Identify a single, though broad challenge that

impacts society

(measures progressof EP community)


3

Grand ChallengeGroup effort started at the

Dagstuhl 2010 Event Processing Seminar, May 2010


Event Processing Grand Challenge (EPGC)

• Event Processing Fabric

A decentralized, global, Internet-like infrastructure, built upon widely-accepted open standards

• Applications

The design, development, deployment, and management of life-changing, or society- changing applications that utilize the Event Processing Fabric

4


Event Processing Grand Challenge (EPGC)

• Requires new cutting-edge R&D results

• To help create a society that proactively exploits opportunities and guards against threats

5


The Event Processing

Fabric

• Infrastructure

• Widely-accepted open standards

• Enables plug-in of…

• …Time-driven or event-driven applications

• “on-the-fly-adaptive”

6


Precise and timely as the Global Positioning System

Distributed ownership and reach of the World Wide Web

Community-based, self-curated, constantly-updated of Wikipedia

Adaptive nature of complex adaptive systems

7


Fabric


8

Designed to be the highway of globalreal-time data, and the enabler of

applications for a proactive society.


Fabric


The Applications – a preview

• Wide-range of applications in scope and complexity

• From detecting incoming earthquakes

• To warnings of schedule changes in daily commutes

9


10

Challenges of building the Fabric (1)

• Thousands, millions of different sources

• From across the globe

• Filtering, aggregating, transforming, & detecting patterns

• Using real-time and historical data


11


• Manage subscriptions and locations of millions of users

• In a secure and anonymous way

• Across different geographic and administrative domains

• Sending alerts in a timely fashion

• Utilizing the most appropriate channels of communication.


12


Used by private and public agents

• Manufacturing industries can instrument production lines

• Energy providers can instrument their energy grids

• Airlines can inform users of changed schedule

• Health organizations can monitor check-in types and numbers, make predictions, and raise alarms of epidemics

• Schools can alert parents on local events.


13

Limitations

• May be inappropriate for highly secure applications

– such as military or homeland security.

• May be unsuitable for high-performance applications

– such as real-time stock trading.

• As with the Internet, extremely useful, but not the only way to connect components and systems


14

IMPLEMENTATION ISSUESAND QUALITY ATTRIBUTES

Event Processing Fabric


15

Privacy

Ensuring the confidentiality of published information


16

Security

Protection from hackers that attack the fabric


17

Interoperability

Plug-and-play standards necessary


18

Provenance

Should always be possible to trace back a chain of events


19

Elastic performance

Accommodating variable requirements


20

Energy-efficiency

Minimizing the energy consumptionof the devices connected to it


21

…

Autonomic computing support

Non-repudiation

Authentication

Anonymity

Availability

Quality-of-Service

…


22

THE APPLICATIONS


23

The Applications

• Extreme-scale disasters

Eg, hurricanes, earthquakes, or terrorist attacks.

Data sources managed by

government agencies (eg, meteorological services)

companies (eg, monitoring congestion in roads)

individuals (eg, images or videos from disaster)


24

The Applications

• Critical societal applications

Eg, smart-grid, or home-health care for the old

These systems are becoming increasingly event-driven


25

The Applications

• Personal applications

Eg, finding optimal commute using buses, metro, etc, based on location, availability, schedules

• Social “eventing”

Partially exists in some social networks (foursquare, Google Latitude, TripIt)


26

ELEMENTS OF THE CHALLENGE


27

Elements of the challenge

• Data acquisition components

• Event processing agents

• Responders or actuators that execute actions

• Communication networks

• Management components


28

Related work – www.Pachube.com

“Pachube is a data brokerage platform for the internet of things, managing millions of datapoints per day from thousands of individuals, organisations & companies around the world”


29

Members and acknowledgements

ORGANIZATION• Moderator: Bernhard Seeger

• Facilitator: Ronen Vaisenberg

• Organizors:– Mani Chandy

– Opher Etzion

– Rainer von Ammon

PARTICIPANTS• Stefan Appel , TU Darmstadt

• Pedro Bizarro , University of Coimbra

• Alejandro P. Buchmann , TU Darmstadt

• Sharma Chakravarthy, UT Arlington

• K. Mani Chandy , CalTech - Pasadena

• Kenneth Moody , University of Cambridge

• Tore Risch, Uppsala University, Sweden

• Plamen Simeonov, Berlin

• Nenad Stojanovic, FZI, Karlsruhe, Germany

• John Sutcliffe-Braithwaite, U Reading

• Richard Tibbetts, Streambase Systems Inc.

• Carlo Zaniolo , Univ. California - Los Angeles


eptsevent processing technical society

Q&A?

30

epts/dagstuhl event processing grand challenge

Documents