big data operational excellence ahead in the cloud · big data operational excellence ahead in the...

24
Big Data Operational Excellence Ahead in the Cloud DATA Accelerate Discovery with Visual Analytics Limit Surprise with Smart Data Detect Patterns with Mass Correlation FY11 FY12 FY13+ Ira A. (Gus) Hunt Chief Technology Officer 18 October 2011

Upload: others

Post on 25-Jun-2020

4 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Big Data Operational Excellence Ahead in the Cloud · Big Data Operational Excellence Ahead in the Cloud Chief Technology Officer A Accelerate Discovery ... Public expectations of

Big Data

Operational Excellence

Ahead in the Cloud

DA

TA

Accelerate Discovery with Visual Analytics

Limit Surprise with Smart Data

Detect Patterns with Mass Correlation

FY

11

FY

12 F

Y1

3+

Ira A. (Gus) Hunt

Chief Technology Officer

18 October 2011

Page 2: Big Data Operational Excellence Ahead in the Cloud · Big Data Operational Excellence Ahead in the Cloud Chief Technology Officer A Accelerate Discovery ... Public expectations of

Our Mission

We are the nation's first line of defense. We accomplish

what others cannot accomplish and go where others

cannot go. We carry out our mission by:

Collecting information that reveals the plans, intentions and

capabilities of our adversaries and provides the basis for

decision and action.

Producing timely analysis that provides insight, warning and

opportunity to the President and decisionmakers charged with

protecting and advancing America's interests.

Conducting covert action at the direction of the President to

preempt threats or achieve US policy objectives.

Page 3: Big Data Operational Excellence Ahead in the Cloud · Big Data Operational Excellence Ahead in the Cloud Chief Technology Officer A Accelerate Discovery ... Public expectations of

2

3

4 Big Bets

– Acquire, federate, and position for multiple constituencies to securely

exploit. Grow the haystack, magnify the needles.

Data Big

Excellence Operational

Serve CIA IC by supporting the

Management Talent

– Assume a leadership role in IC activities that benefit the CIA

– Innovate infrastructure operations and provisioning, create an

authoritative source on our asset base, and run IT like a business.

– Focus on continuous learning and diversity of thought, experience,

background

1

4

Page 4: Big Data Operational Excellence Ahead in the Cloud · Big Data Operational Excellence Ahead in the Cloud Chief Technology Officer A Accelerate Discovery ... Public expectations of

2

3

5 Key Technology Enablers

– World-class abilities to discover patterns, correlate information, understand plans

and intentions, and find and identify operational targets in a sea of data

Mission Analytics Advanced

Widgets and Services Enterprise

Security Service as a

Data Harbor Enterprise Data Management--the

– One environment, all data, protected and secure using common security

services such as: ubiquitous encryption, enterprise authentication, audit,

DRM, secure ID propagation, and Gold Version C&A.

– A customizable, integrated and adaptive webtop that lets analysts, ops

officers, and targeters to “have it their way”.

– An ultra-high performance data environment that enables CIA missions to

acquire, federate, and position and securely exploit huge volumes data.

1

4

Cloud Computing – Ruthlessly standardized, rigorously automated, dynamic and elastic commodity

computing environment. Massive capacity ahead of demand. Speed for

mission need.

5

Page 5: Big Data Operational Excellence Ahead in the Cloud · Big Data Operational Excellence Ahead in the Cloud Chief Technology Officer A Accelerate Discovery ... Public expectations of

4

Our World Today

Economic climate

Astounding commercial IT capabilities

Shape-shifting, technologically sophisticated enemies

Public expectations of intelligence perfection - connecting the dots

Deluge of multi-lingual data

Video, audio, Tweets, SMS, etc.

The Perfect Storm

LOL, 555 , 大笑 mdr,

, 笑 ,هاها

Лол, asg, rs

Page 6: Big Data Operational Excellence Ahead in the Cloud · Big Data Operational Excellence Ahead in the Cloud Chief Technology Officer A Accelerate Discovery ... Public expectations of

5

It’s a

BIG Data World

Page 7: Big Data Operational Excellence Ahead in the Cloud · Big Data Operational Excellence Ahead in the Cloud Chief Technology Officer A Accelerate Discovery ... Public expectations of

Google

>1 Trillion Indexed

URLs

6

Page 8: Big Data Operational Excellence Ahead in the Cloud · Big Data Operational Excellence Ahead in the Cloud Chief Technology Officer A Accelerate Discovery ... Public expectations of

Google’s index

>100 Petabytes

7

Page 9: Big Data Operational Excellence Ahead in the Cloud · Big Data Operational Excellence Ahead in the Cloud Chief Technology Officer A Accelerate Discovery ... Public expectations of

YouTube

>789 Petabytes

8

Page 10: Big Data Operational Excellence Ahead in the Cloud · Big Data Operational Excellence Ahead in the Cloud Chief Technology Officer A Accelerate Discovery ... Public expectations of

>144 Million

Tweets per day

9

Page 11: Big Data Operational Excellence Ahead in the Cloud · Big Data Operational Excellence Ahead in the Cloud Chief Technology Officer A Accelerate Discovery ... Public expectations of

Facebook Holdings

>90 Petabytes

10

Page 12: Big Data Operational Excellence Ahead in the Cloud · Big Data Operational Excellence Ahead in the Cloud Chief Technology Officer A Accelerate Discovery ... Public expectations of

11

Sensors

Page 13: Big Data Operational Excellence Ahead in the Cloud · Big Data Operational Excellence Ahead in the Cloud Chief Technology Officer A Accelerate Discovery ... Public expectations of

2

3

Our Job

Leverage the Big Data world

Find the Information that Matters

Connect the Dots

Understand the Plans of our Adversaries – Prevent an attack, Save lives, Safeguard our national security

1

4

Page 14: Big Data Operational Excellence Ahead in the Cloud · Big Data Operational Excellence Ahead in the Cloud Chief Technology Officer A Accelerate Discovery ... Public expectations of

13

Why

We

Care

Page 15: Big Data Operational Excellence Ahead in the Cloud · Big Data Operational Excellence Ahead in the Cloud Chief Technology Officer A Accelerate Discovery ... Public expectations of

14

Why

We

Care

Page 16: Big Data Operational Excellence Ahead in the Cloud · Big Data Operational Excellence Ahead in the Cloud Chief Technology Officer A Accelerate Discovery ... Public expectations of

The

Problem

15

Page 17: Big Data Operational Excellence Ahead in the Cloud · Big Data Operational Excellence Ahead in the Cloud Chief Technology Officer A Accelerate Discovery ... Public expectations of

2

3

Our Problem: Which 5K

Don’t know the future value of a dot today

We cannot connect dots we don’t have

The old collect, winnow, dissem model

fails spectacularly in the Big Data world

The few cannot know the needs of the many

1

Secure the data, Connect the data, Empower the user

Page 18: Big Data Operational Excellence Ahead in the Cloud · Big Data Operational Excellence Ahead in the Cloud Chief Technology Officer A Accelerate Discovery ... Public expectations of

17

Our Reality

Significant budget cuts are coming

IT is under enormous pressure to reduce spending

IT must deliver new and better capabilities--faster

Instability is rising across the globe

Speed and agility are paramount

Operational Excellence is about solving all

of the above--simultaneously

Page 19: Big Data Operational Excellence Ahead in the Cloud · Big Data Operational Excellence Ahead in the Cloud Chief Technology Officer A Accelerate Discovery ... Public expectations of

18

Let’s talk Cloud

Page 20: Big Data Operational Excellence Ahead in the Cloud · Big Data Operational Excellence Ahead in the Cloud Chief Technology Officer A Accelerate Discovery ... Public expectations of

19

=

Big Data Continuous Services

Unbounded Scale

Capacity ahead of demand

Operational Excellence Radical Efficiency

Rigorous Standardization

Ruthless Automation

Failure Tolerant

Redundant by Design

Available by Default

Page 21: Big Data Operational Excellence Ahead in the Cloud · Big Data Operational Excellence Ahead in the Cloud Chief Technology Officer A Accelerate Discovery ... Public expectations of

20

Capacity ahead of demand

– Zero wait, zero effort

– Like 110 out of the wall

– Like dial tone

– Plug in and go

Make IT Frictionless for Mission

Provide CIA and the IC – Continuous Services

– “Unbounded” Scale

– Radical Efficiency

– Rigorous Standardization

– Ruthless Automation

– Failure Tolerant

– Redundant by Design

– Available by Default

Page 22: Big Data Operational Excellence Ahead in the Cloud · Big Data Operational Excellence Ahead in the Cloud Chief Technology Officer A Accelerate Discovery ... Public expectations of

Operational Excellence Radical efficiency

Rigorous standards

Security ahead of need

Capacity ahead of demand

Big Data Mass analytics

Complex reasoning

Hypothesis generation

Answers ahead of questions

Cloud

Computing Operational Excellence Radical efficiency

Rigorous standards

Security ahead of need

Capacity ahead of demand

Page 23: Big Data Operational Excellence Ahead in the Cloud · Big Data Operational Excellence Ahead in the Cloud Chief Technology Officer A Accelerate Discovery ... Public expectations of

2

Its not about the Cloud

– Acquire, federate, and position for multiple constituencies to securely

exploit. Grow the haystack, magnify the needles. Connect the dots.

Big Data

Operational Excellence – Innovate infrastructure operations and provisioning, create an

authoritative source on our asset base, and run IT like a business.

1

Its about:

Cloud is the mechanism to achieve

both securely

Page 24: Big Data Operational Excellence Ahead in the Cloud · Big Data Operational Excellence Ahead in the Cloud Chief Technology Officer A Accelerate Discovery ... Public expectations of

Questions

The journey of a thousand miles

begins with a single step. Lao Tzu