oracle cep – otn ace directors briefing update robin j. smith,...

<Insert Picture Here>

Oracle CEP – OTN ACE Directors Briefing Update

Robin J. Smith, [email protected] of Product Management/StrategyOracle Complex Event Processing (CEP)

The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions.The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.


Agenda

• Event Processing• Concepts, Market Landscape, Industries,

Packaging• Technology/Business Value Proposition• Oracle OpenWorld 2009

• Immerse yourselves in Oracle Event-driven Architecture Technology

• Resources

What are Event-Driven Applications?

Financial Services

Transportation & Logistics

Public Sector & Military

Manufacturing

Utilities & Insurance

Telecommunications & Services

Algorithmic trading

Asset management

Distributed order orchestration

‘Negative Working Capital’ inventory management

Grid Infrastructure ManagementReponses to calamities – earthquake, flooding

• Proximity/Location Tracking• Intrusion detection systems• Military asset allocation

Need to support one or more of:• High volume• Continuous streaming• Sub-millisecond latency• Disparate sources • Time window processing• Complex pattern matching

Why not use existing Technology?STREAMS: Oracle Complex Event Processing (CEP)

Streams Continuous input, often in high-volume Time ordered Does not end Impossible to process / analyze in real-

time with traditional relational database systems

Example: Raw Sensor Event streams, GPS, Market Data Feeds

BA BOEING D 77.575 800 20080305 10:03:02:78

DO DUPONT D 41.575 3000 20080305 10:03:04:12

AA ALCOA INC D 20.125 1000 20080305 10:03:01:55

AXP AMER EXPRESS CO D 45.875 500 20080305 10:03:02:10

BA BOEING D 77.575 800 20080305 10:03:02:78

C CITIGROUP D 34.125 2000 20080305 10:03:03:05

CAT CATERPILLAR D 22.5 600 20080305 10:03:03:46

DO DUPONT D 41.575 3000 20080305 10:03:04:12

AA ALCOA INC D 20.125 1000 20080305 10:03:01:55


BA BOEING D 77.575 800 20080305 10:03:02:78

C CITIGROUP D 34.125 2000 20080305 10:03:03:05


DO DUPONT D 41.575 3000 20080305 10:03:04:12

AA ALCOA INC D 20.125 1000 20080305 10:03:01:55


BA BOEING D 77.575 800 20080305 10:03:02:78

C CITIGROUP D 34.125 2000 20080305 10:03:03:05


DO DUPONT D 41.575 3000 20080305 10:03:04:12

AA ALCOA INC D 20.125 1000 20080305 10:03:01:55


BA BOEING D 77.575 800 20080305 10:03:02:78

Event Processing provides a new data management infrastructure to support and analyze Streams in real-time

Why not use existing Technology? In-Memory, Queries: Oracle Complex Event Processing (CEP)

Event Processing Output Filtering

New stream filtered for specific criteria, e.g. stock price > $22

Correlation & Aggregation Scrolling, time-based window metrics, e.g.

average # of stock trades in the last hour Pattern Matching

Notification of detected event patterns, e.g. price changes A, B and C occurred within 15 minute window


DO DUPONT D 41.575 3000 20080305 10:03:04:12

AA ALCOA INC D 20.125 1000 20080305 10:03:01:55


BA BOEING D 77.575 800 20080305 10:03:02:78

EP

Runs In-Memory (not in Database)***Logic is defined through Continuous Queries on the data

Example: Stock Trading “W” Pattern

1 9 12 19

minutes

XY W

Z

CQL Example - Aggregation

Calculates aggregate valuesover a sliding 1 second

window with output every half second

Calculates aggregate valuesover a sliding 1 second

window with output every half second

Processors• Set of queries applied

to the streams Listeners

• Handle triggers raised by the processors

Events• Implemented as

JavaBean or Map

Enriched Streams

• From any source: data streams, web services, Java, Database

Adapters

• Translate external events/data into java objects for processing

Enriched Streams

• From any source: data streams, web services, Java, Database

Adapters

• Translate external events/data into java objects for processing

Focus on Event-Driven Architecture (EDA)OSGi Lightweight, Low Latency, Extreme High Throughput, and Java-based Application Solution Container

Data/Msg.Feeds Listener/SINK:

User Code(Plain Java)

Data Feed Adapters

ProcessEvents(CEP)

Incoming Data Streams1M+ Messages/Sec

Aggregate, correlate, filter dataCan Handle Unlimited Queries

Resulting Data fed to vast business opportunities

with Java language

LatencyMicrosecond Latency (Avg.)

EDA Java Application ContainerEDA Java Application Container

Oracle Complex Event ProcessorOracle Complex Event Processor

Average Latency vs. Injection Rate (10 Connections)

0

10

20

30

40

50

60

70

80

0 200000 400000 600000 800000 1000000 1200000

Injection Rate (events/second)

Ave

rag

e L

aten

cy

(mic

rose

con

ds)

Distribution of Latency Values

20,136,515

3,054,550

131,5980

5,000,000

10,000,000

15,000,000

20,000,000

25,000,000

0 - 99 100 - 199 >=200

Latency Range (microseconds)

# of

Out

put E

vent

s

• Included in Oracle CEP install• Works with open hardware x86 hardware• Addresses the key latency issue with Java• Unique non-intrusive tooling to identify latency bottlenecks• Extension of the award winning JRockit JVM

0

50000

100000

150000

200000

250000

2P Opteron 2220 4P Opteron 885 2P Intel X5355

SP

EC

jbb

20

05

bo

ps

Sun JVM

JRockit JVM

CEP Performance Enhanced by JRockitJRockit Real-Time Provides High Throughput, Low Latency JVM

Oracle CEP 11g: A Complete Event-Driven Application Infrastructure Solution Platform (COTS)

• A Mature Complete Deterministic Java EDA focused Development & Deployment Platform for Complex Event Processing

• 100% JAVA• Built on OSGi, Powerfully Extensible, (Best of Breed bundles, WLS- Core)

• Solves low latency/Extreme through-put demands• Implements Event-Driven Architecture Application Model (EPN)

• Complete Visual Development , Web Platform Management & Monitoring Tools• Advanced Rich Formalized CQL- Oracle Complex Event Processing Processor

• Evolved from years of research by Oracle CEP team• Driving Industry Standards in this space – CQL – ANSI SQL Standards• SQL-99 Compliant solving complex event analysis

• Endless Integration Opportunities using AQ, JMS and HTTP Publish/Subscribe Connectivity, Coherence In-Memory Grid, SOA 11g EDN, Event Connect SDK

• On Standard Commercial Commodity Hardware

• Real Time Business In-sight & Pro-activity• Customers Pre-empt, React to, and win competitively addressing

immediate Business, Infrastructure Issues• Gain Business insight using previously untapped, raw event sources

• Real Time Business Analyst Oriented Development – BAM• Business Users create BAM Dashboards• Easily integrate with SOA – Alerts/BI

• Hot-pluggable world-class integration• Low latency Real Time JRockit JVM• In-memory Coherence Data Grid• Tight SOA portfolio inter-operability

Industries First and Only Enterprise Strength, Extreme Performance, Massively Scalable, Highly Available, OSGi™ Event Driven Application Solution Platform

Oracle CEP 11g: A Complete Event-Driven Application Infrastructure Solution Platform

Evolution of Oracle Event-Driven Architectures(Mature 3rd Generation Platform)

• 1992 Database: Oracle DML Triggers• 1997 Database: Oracle Advanced Queuing• 2002 Database: Oracle Data Streams• 2004 Middleware: Oracle Business Activity Monitoring• 2006 Middleware: Event-Driven Architecture Suite• 2008 Middleware: BEA WebLogic Event Server

• Oracle CEP 10gR3 Released October 2008

• NOW Available: Oracle Event Processing 11g• Oracle Business Activity Monitoring (BAM), java edition• Oracle Complex Event Processor

Apps

AdaptersAdapters B2BB2B

PartnersDB Legacy

CONNECTIVITY

Routing Transform DataQuality

ETL &Replication

Data IntegratorData IntegratorOracle Service BusOracle Service Bus

Mediation

ROUTING & DATA SERVICESNativeBPEL

Business Rules

Human Workflow

BPEL Process ManagerBPEL Process Manager

ORCHESTRATION

Coherence CacheJ2EE Application Server

(Oracle AS, WebLogic, WebSphere, JBoss)Messaging

Oracle SOA and Event Technologies

GOVERNANCESystem

Monitoring

Enterprise Enterprise ManagerManager

UDDI

WS PoliciesSecurity

Web Web Services Services ManagerManager

RegistryRegistry

GOVERNANCE

SOA lifecyclegovernance

EnterpriseEnterpriseRepositoryRepository

JRockit VM & RT

REAL-TIMEVISIBILITY

& PROCESSING AlertsBusiness Monitoring

BAMBAM

EventsData Streams

CEPCEP

ApplicationDevelopmentFramework

EnterpriseModeling

BPA SuiteBPA Suite

JDeveloperJDeveloper

Business UserModeling

BPM SuiteBPM Suite

1313

Oracle EDA SuiteComplete Suite for Industrial Event Processing

REAL-TIMEVISIBILITY

& PROCESSING

Event FeedsData Streams

Java-based EventServer

CEPCEP

CONNECTIVITY

ROUTING & DATA

SERVICES

CoherenceJRockit VMENTERPRISE PERFORMANCE & SCALABILITY

Socket

Routing Transform DataQuality

ETL &Replication

Data IntegratorData IntegratorOracle Service BusOracle Service Bus

Mediation

AlertsBusiness Monitoring

BAMBAM

DB File

Business Rules

J2EE Application Server(Oracle AS, WebLogic, WebSphere, JBoss)

Industry SpecificJMS

JRockit RT

AdaptersAdapters

CEP Market Landscape• Flurry of M&A activity

• Progress bought Apama• Aleri bought Coral8• IBM previously acquired Aptsoft• Microsoft Technical Preview – SQL Server Streamsight Lanched • Informatica Acquires Agent Logic • Mature - Oracle Complex Event Processing 11gR1 Released (July 2009)

• Gartner predicts huge growth area and other Industry analysts focusing on CEP

• CEP space will evolve & consolidate around major vendors• Oracle has mature offering available today• IBM will merge various acquisitions into in-house “System S” product, ETA 2010• Microsoft also planning to debut new product, ETA 2010

• Oracle Key Enabler for “Event-Driven SOA”• “Event Driven Networks” - Focal area for Oracle SOA Suite 11g

CEP Market Landscape

• Real Time Environmental Air Pollution/Traffic Flow• Real Time Systems Management & Fault mitigation, Real Time Manufacturing

Production line monitoring• Border Security, Transportation Logistics, Roadways Toll Management Systems,

Embedded Automotive Telematics• Real Time Online Fraud Detection• Smart Meters/Grid• Realtime Slot Machine Usage “persuasion”• Intelligent Cable Set-Top Management• Algorithmic Trading, Smart Order Routing• Emergency Services Real Time Location Proximity Tracking• Partners – OCEP Performance Tools, OCEP Adapters, EDA Packaged Vertical

Industry Solutions

EDA/CEP Customer Use Cases

Press Release

Oracle Financial Services Software Announces New Release of Oracle® Mantas Fraud

Release Strengthens Fraud Detection to Help Financial Institutions Defend Against Increasingly Sophisticated and Globalized Financial Crime Schemes

Redwood Shores, CA – September 1, 2009

Real-time payments and online fraud detection capabilities through integration with Oracle Adaptive Access Manager and Oracle Complex Event Processing

CEP Integration with Oracle Vertical Solutions

•S308677: Oracle Complex Event Processing Design Patterns

Hilton Hotel, Franciscan A/B

Sunday, Oct. 11: 2:30 PM

•S308688: Oracle Business Activity Monitoring and Oracle Complex Event Processing: Best Practices for EDA

Marriott Hotel, Golden Gate B3

Monday, Oct. 12: 5:30 PM

S311920: Protecting your business in tough Economic Times (CEP & MANTAS)

Westin Market Street Hotel, Olympic

Tuesday, Oct. 13: 11:30 AM

Related Sessions

•2622: Oracle Complex Event Processing

Oracle Complex Event Processing, a foundational product of the Oracle Event-Driven Architecture strategy, enables event-driven SOA for the real-time enterprise by providing tools to build, deploy, and manage event-driven applications. This demo highlights the product's capabilities through several vertical industry examples, including front-office event-driven applications and event-driven SOA implementations.

•S311678: Building Event-Driven Architecture Applications with Oracle CEP

Hilton Hotel, Continental Ballroom 5 (2 sessions)

Monday, Oct. 12: 10:15 AM

Tuesday, Oct. 13: 1:00 PM

Related Demos Related Labs

Oracle OpenWorld 2009Immerse yourselves in Oracle Event-driven Architecture Technology

CAB break-out Session for EDA – Short future looking presentation & Customer Survey

Solution Spotlight Theater Session – Showcase Primary Pavilion Demonstration (Advanced Retail Selling Powered by CEP)

CAB break-out Session for EDA – Short future looking presentation & Customer Survey

Solution Spotlight Theater Session – Showcase Primary Pavilion Demonstration (Advanced Retail Selling Powered by CEP)

AQ&


Resources

• People• Primary PM:

• Robin J. Smith

• Other Knowledgeable SOA PMs:• Lloyd Williams, Payal Srivastava, Peter Belknap,

Clemens Utschig-Utschig

• Development: • Shailendra Mishra, Eric Hsiao, John Huston, Thomas

Cook

• Links

http://cep.us.oracle.com (CEP internal PM site)

http://www.oracle.com/technologies/soa/eda/index.html (Oracle.com public)

http://www.oracle.com/technologies/soa/complex-event-processing.html (Oracle.com public)

http://www.oracle.com/technology/products/event-driven-architecture/index.html (OTN public)

• Links

http://cep.us.oracle.com (CEP internal PM site)

http://www.oracle.com/technologies/soa/eda/index.html (Oracle.com public)

http://www.oracle.com/technologies/soa/complex-event-processing.html (Oracle.com public)

http://www.oracle.com/technology/products/event-driven-architecture/index.html (OTN public)

•Oracle University Intensive Customer Technical Course available September 2009

•Oracle University Intensive Customer Technical Course available September 2009

oracle cep – otn ace directors briefing update robin j. smith,...

Documents

time event processing

realtime slide

low latency jvm slide

eventdriven applications

raw sensor event streams

data example

axpamer express cod45

aaalcoa incd20