big data and cloud technologies: defence and national security - … · 2017. 2. 10. · big data...

Copyright © 2015, Oracle and/or its affiliates. All rights reserved. |

Big Data and Cloud technologies: Defence and National security

Dr. Siva Ravada Senior Directory of Engineering Oracle Database Server Technologies January, 2017


Discussion Topics • What are the disruptive applications with geospatial technology for

security and safety on the horizon?

• There are significant advances in the software available for security and safety, but how convenient is it for the agencies to populate it with data frequently?

• Growth of geospatial data is outpacing both software and services in security and safety

–What are the security challenges with big data and how can we manage big spatial data effectively?

Oracle Confidential – Internal/Restricted/Highly Restricted 2


Customs and Border Protection

• Co-traveler Tracing

– Given a person of interest, by looking at flight records

– Find out people who traveled with the person

• And people who traveled with those people

• And people who traveled with those people

• …and so on

• Relational Tables

3

“John Doe”

Person Table

“John Doe” 8171018

8171018 0098281 Dec/11/2011 8171018 0070103 Feb/03/2010

Person Detail Table

Ticket Purchase Table

0098281 “John Doe” 0098281 “Jane Row”

0070103 “Mary Sue” 0070103 “John Doe”

Ticket InfoTable

“Jane Row” “Mary Sue”

Multiple tables need to join, repeatedly, to track down information

John Doe Jane Row Mary Sue

……

“Mary Sue” 7820101 “Jane Row” 9930191

…..

Graph representation again provides quick and easy traversal-based solution


• Now consider a different example which requires a different metric of closeness

Distance and Closeness … 1 2 3 4 5 31

1

12

10

21

23

……

Situation: Our intel identified (say) 31 members of a drug Cartel. We also want to know people who are close to these members when travelling

Note this is different than shortest-path distance

Become closer • With more shared flights or tickets • With more members shared • With sharing less-populated flight • …


New Capabilities Using Graphs and AI: Do Pattern Recognition, Identify New Relationships, and Predict Future events

Influencer Identification

Communication Stream (e.g. tweets)

Graph Pattern Matching Community Detection

Find out people that are central in the given network – e.g. influencer

Identify group of people that are close to each other – e.g. target group identification

Find out all the sets of entities that match to the given pattern – e.g. fraud detection

5

AI and Deep Learning

Identify patterns and predict future event and generate alerts

Index


Data Volume & Variety Generation Explosion Continues – Terabytes, Petabytes, Exabytes, Zettabytes

• VIDEO: UAVs, DRONES, SURVEILLANCE

• IMAGERY/Raster: (Satellites, Medical)

• Sensors (IOT), LIDAR, 3D, RFID

• Social Media, Web Scraping, Mobile Phones

• Wearable Technologies

• New data products for: Land and Water mgmt, Agriculture, Environment, Transportation, Terrain and City Models, SDIs for planning, maintenance, Emergency response, Defense, Intelligence, Healthcare

• Semantics , Ontologies --

• Location is a Powerful Organizing Principle


Real-time Data Streams

CEP

External Data Sources:

Machine Processable Transactional &

Operational Systems Contents Repository

Databases Mobile Devices, Web resources

Blogs, Mails, news Satellite Imagery, UAVs

Search, Presentation, Report,

Visualization, Query

National data: one Multi-Model Store

Multi-Model Data Management Infrastructure GeoSpatial Documents

Sec

ure

d

Historical

Records

POIs

Demographics

Customer Data

Call Records

SMS

Workflow Initiation

Real-time Dashboards

Console Alerts

EV Grid Management

Automatic Responses and

Publishing

Deep Learning, AI Supervised Learning - Training Data


Big Data Sources Applications

End-user and Developer Environments

Streaming Services

Data Services

Statistics Text

Analytics Graph

Analytics Spatial

Data Mining Natural Lang.

Processing

Structured Data

Unstructured Data

App Services

Developers

Data Integration

Business Users

Business Intelligence

Data Scientists

Discovery

Event Processing Data Management

NoSQL Relational Hadoop

Web-log Sessionization

and Enrichment

Sentiment Analysis

Social Media

Statistics Mining

Support Breadth of Nation Level Data Data arrives, is filtered, stored data is available to all Organizations

JDeveloper Dashboards

Reference Architecture

Sound and Video

Images

Compression Security & Encryption

Vertical Applications

Horizontal Applications

ODBC JDBC

Semantic Metadata Layer

GUIDANCE: THIS IS AN ARCHITECTURE TO SUPPORT ONE SHARED MULTIPURPOSE NATIONAL STORE


Accessible Shared Data: CYBERSECURITY is Major Challenge Requires Information Security and Privacy

Monitoring

Access Control

Encryption & Masking

Monitoring

Access Control

•Database Vault

•Label Security

•Advanced Security

•Secure Backup, Data Masking

•Silicon based Security

Encryption & Masking

Blocking & Logging

Oracle Database


Business Intelligence / Spatial Analytics / Deep Learning/ AI: Optimized with: MULTI-MODEL DATABASE PLATFORM

Deep

Analytics

Simplified IT

Big Data

Big & Fast Data

Volunteered Geographic Statistical Information

Sensors Streaming Data

Geo-referenced Video, 3D, LiDAR Satellites

Simplify Statistics IT

Support for Open Standards Spatial Database, Application Server, BI, tools

Support by Leading Partner solutions

Multi-Model Engineered Systems

Deep

Analytics

Real-time Complex Event Processing

Dense Visualization

Spatial Analysis Graph Analytics

On Premise,

On Cloud,

Shared

Services

On Premise,

On Cloud,

Shared

Services

Shared GeoSpatial Services Location Aware Everything

Fully Parallel and Secure

Neural Network

Copyright © 2015, Oracle and/or its affiliates. All rights reserved. | 12

Faster Innovation

• Faster pace to product innovation

• Modern, global platform

• Shorter upgrade cycle

Faster Deployments

• Pre-installed and pre-configured

• User experience-focused design

• Seamless integration

Lower Cost

• Reduced infrastructure cost

• Reduced IT maintenance cost

• Reduced customization and upgrade cost

Lower Risk

• Reduced administrative burden

• Guaranteed system availability

• Scalable platform for future expansion

The Value Is in the Cloud

Copyright © 2016 Oracle and/or its affiliates. All rights reserved. |


Public Clouds, Private Clouds: Platforms

• Used by multiple tenants on a shared basis

• Hosted and managed by cloud service provider

• Exclusively used by a single organization

• Controlled and managed by in-house IT

Lower upfront costs

Outsourced management

OpEx

Lower total costs

Greater control over security, compliance, QoS

CapEx & OpEx

Trade-offs

Public Clouds

IaaS

PaaS

SaaS I N T R A N E T

Private Cloud

IaaS

PaaS

SaaS I N T E R N E T

IaaS

PaaS

IaaS

PaaS

Apps SaaS

ELASTICITY is key value of Clouds

Oracle Technology Supplies both Public and Private clouds