enterprise model distributed real-time data mining advanced statistical theory ranked hypothesis...

9
Enterprise Model Distribut ed Real-Time Data Mining Advanced Statistical Theory Ranked Hypothes is Active RT Monitorin g Confirmed , Rejected Adaptive RT Workflow Programming Distributed Roles, Relations, Work Orders, Flow Management Confirmed Cases

Upload: phebe-lindsey

Post on 05-Jan-2016

214 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Enterprise Model Distributed Real-Time Data Mining Advanced Statistical Theory Ranked Hypothesis Active RT Monitoring Confirmed, Rejected Adaptive RT Workflow

Enterprise Model

Distributed

Real-Time

Data Mining

Advanced

Statistical Theory

Ranked

Hypothesis

Active RT

Monitoring

Confirmed,

Rejected

Adaptive RT Workflow Programming

• Distributed Roles, Relations, Work Orders, Flow Management

Confirmed

Cases

Page 2: Enterprise Model Distributed Real-Time Data Mining Advanced Statistical Theory Ranked Hypothesis Active RT Monitoring Confirmed, Rejected Adaptive RT Workflow

Workflow Active surveillance, data mining and statistical

learning is a complex real-time workflow problem. The workflow needs to be explicit so that processes are repeatable. It requires Meta-data: input, output, fielding, sequencing process Ontology, threat models and data models for data

interpretation and aggregation as each step Adaptive configuration of roles, relations, orders and

dataflow Model based feedback to home in on high value targets

Ref: Open source ontology-based reasoning on workflow

www.isi.edu/ikcap/wings

Page 3: Enterprise Model Distributed Real-Time Data Mining Advanced Statistical Theory Ranked Hypothesis Active RT Monitoring Confirmed, Rejected Adaptive RT Workflow

High-Level View

Network Analysis

Page 4: Enterprise Model Distributed Real-Time Data Mining Advanced Statistical Theory Ranked Hypothesis Active RT Monitoring Confirmed, Rejected Adaptive RT Workflow

Hierarchical Network Views

Location

Terror Event Fatalities

Date

Weapon

Group

Reason(political, religious, …)

Victim types(Police, civil., gov.,…)

Static View:Long-term statistics

WeaponDealer

Financer

Account

Transactions

Sales

Location

Sale Dates Trans.

Dates

Group

CommunicationTravel Spatio-Temporal Sequence View:

Intermediate-term sequence

Location

Toll booth eventsCamera events

Tripwire events

TicketCounterevents

Sensor Network Tracking View: End-game sequence

Page 5: Enterprise Model Distributed Real-Time Data Mining Advanced Statistical Theory Ranked Hypothesis Active RT Monitoring Confirmed, Rejected Adaptive RT Workflow

Sense/Act View

Location

Toll booth eventsCamera events

Tripwire events

TicketCounterevents

Sensor Network Tracking View: End-game sequence

Resource Network View

Police resources

Fire-fighter resources

Military

SurveillanceCameras

Tripwire sensors

Ambulance resources

Recon.

Municipal

ResponseTasks

Network reconfiguration,New data types

Page 6: Enterprise Model Distributed Real-Time Data Mining Advanced Statistical Theory Ranked Hypothesis Active RT Monitoring Confirmed, Rejected Adaptive RT Workflow

Sequence Extraction, Prediction, and Feedback

WeaponDealer

Financer

Account

Transactions

Sales

Location

Sale Date Trans.

Date

Group

Common Sequence Model: Sales, bank transacts., travel, comm. pattern event

CommunicationTravel Spatio-Temporal Sequence View

RT Monitored sequence

PredictionResponseTaskSequence

Page 7: Enterprise Model Distributed Real-Time Data Mining Advanced Statistical Theory Ranked Hypothesis Active RT Monitoring Confirmed, Rejected Adaptive RT Workflow

Sequence Extraction, Prediction, and Feedback

Location

Toll booth eventsCamera events

Tripwire events

TicketCounterevents

Sensor Network Tracking View

Common sequence (Tracking) Model: Sensor hits, reports, surveillance event

RT Monitored sequence

Prediction ResponseTaskSequence

Page 8: Enterprise Model Distributed Real-Time Data Mining Advanced Statistical Theory Ranked Hypothesis Active RT Monitoring Confirmed, Rejected Adaptive RT Workflow

Putting it Together

StaticView

Network- Network algebra (merging primitives)- Copula models (understanding dependencies)- Mining algorithms

StaticView

Network

StaticView

Network

Space/TempSeq. ViewNetwork

Space/TempSeq. ViewNetwork

Common sequences/prefixes

- Sequence extraction- Prediction models

Prediction

SensorNetwork

SensorNetwork

SensorNetwork

Response

ResourceNetwork

- Real-time models

Page 9: Enterprise Model Distributed Real-Time Data Mining Advanced Statistical Theory Ranked Hypothesis Active RT Monitoring Confirmed, Rejected Adaptive RT Workflow

…Data

Sensor

Static Network Inference & Mining

DataRepository

Models

Multidimensional Index

Index

Copula ModelFitting

Real Time Dynamic Network Analysis

NetworkControl

System View

Decision Making