big data operational excellence ahead in the...
TRANSCRIPT
![Page 1: Big Data Operational Excellence Ahead in the Cloudd36cz9buwru1tt.cloudfront.net/aws-gov-summit-2011/CIA_Gus_Hunt… · Big Data Operational Excellence Ahead in the Cloud Chief Technology](https://reader030.vdocuments.net/reader030/viewer/2022041014/5ec4c78f21790147f730d9f2/html5/thumbnails/1.jpg)
Big Data
Operational Excellence
Ahead in the Cloud
DA
TA
Accelerate Discovery with Visual Analytics
Limit Surprise with Smart Data
Detect Patterns with Mass Correlation
FY
11
FY
12 F
Y1
3+
Ira A. (Gus) Hunt
Chief Technology Officer
18 October 2011
![Page 2: Big Data Operational Excellence Ahead in the Cloudd36cz9buwru1tt.cloudfront.net/aws-gov-summit-2011/CIA_Gus_Hunt… · Big Data Operational Excellence Ahead in the Cloud Chief Technology](https://reader030.vdocuments.net/reader030/viewer/2022041014/5ec4c78f21790147f730d9f2/html5/thumbnails/2.jpg)
Our Mission
We are the nation's first line of defense. We accomplish
what others cannot accomplish and go where others
cannot go. We carry out our mission by:
Collecting information that reveals the plans, intentions and
capabilities of our adversaries and provides the basis for
decision and action.
Producing timely analysis that provides insight, warning and
opportunity to the President and decisionmakers charged with
protecting and advancing America's interests.
Conducting covert action at the direction of the President to
preempt threats or achieve US policy objectives.
![Page 3: Big Data Operational Excellence Ahead in the Cloudd36cz9buwru1tt.cloudfront.net/aws-gov-summit-2011/CIA_Gus_Hunt… · Big Data Operational Excellence Ahead in the Cloud Chief Technology](https://reader030.vdocuments.net/reader030/viewer/2022041014/5ec4c78f21790147f730d9f2/html5/thumbnails/3.jpg)
2
3
4 Big Bets
– Acquire, federate, and position for multiple constituencies to securely
exploit. Grow the haystack, magnify the needles.
Data Big
Excellence Operational
Serve CIA IC by supporting the
Management Talent
– Assume a leadership role in IC activities that benefit the CIA
– Innovate infrastructure operations and provisioning, create an
authoritative source on our asset base, and run IT like a business.
– Focus on continuous learning and diversity of thought, experience,
background
1
4
![Page 4: Big Data Operational Excellence Ahead in the Cloudd36cz9buwru1tt.cloudfront.net/aws-gov-summit-2011/CIA_Gus_Hunt… · Big Data Operational Excellence Ahead in the Cloud Chief Technology](https://reader030.vdocuments.net/reader030/viewer/2022041014/5ec4c78f21790147f730d9f2/html5/thumbnails/4.jpg)
2
3
5 Key Technology Enablers
– World-class abilities to discover patterns, correlate information, understand plans
and intentions, and find and identify operational targets in a sea of data
Mission Analytics Advanced
Widgets and Services Enterprise
Security Service as a
Data Harbor Enterprise Data Management--the
– One environment, all data, protected and secure using common security
services such as: ubiquitous encryption, enterprise authentication, audit,
DRM, secure ID propagation, and Gold Version C&A.
– A customizable, integrated and adaptive webtop that lets analysts, ops
officers, and targeters to “have it their way”.
– An ultra-high performance data environment that enables CIA missions to
acquire, federate, and position and securely exploit huge volumes data.
1
4
Cloud Computing – Ruthlessly standardized, rigorously automated, dynamic and elastic commodity
computing environment. Massive capacity ahead of demand. Speed for
mission need.
5
![Page 5: Big Data Operational Excellence Ahead in the Cloudd36cz9buwru1tt.cloudfront.net/aws-gov-summit-2011/CIA_Gus_Hunt… · Big Data Operational Excellence Ahead in the Cloud Chief Technology](https://reader030.vdocuments.net/reader030/viewer/2022041014/5ec4c78f21790147f730d9f2/html5/thumbnails/5.jpg)
4
Our World Today
Economic climate
Astounding commercial IT capabilities
Shape-shifting, technologically sophisticated enemies
Public expectations of intelligence perfection - connecting the dots
Deluge of multi-lingual data
Video, audio, Tweets, SMS, etc.
The Perfect Storm
LOL, 555 , 大笑 mdr,
, 笑 ,هاها
Лол, asg, rs
![Page 6: Big Data Operational Excellence Ahead in the Cloudd36cz9buwru1tt.cloudfront.net/aws-gov-summit-2011/CIA_Gus_Hunt… · Big Data Operational Excellence Ahead in the Cloud Chief Technology](https://reader030.vdocuments.net/reader030/viewer/2022041014/5ec4c78f21790147f730d9f2/html5/thumbnails/6.jpg)
5
It’s a
BIG Data World
![Page 7: Big Data Operational Excellence Ahead in the Cloudd36cz9buwru1tt.cloudfront.net/aws-gov-summit-2011/CIA_Gus_Hunt… · Big Data Operational Excellence Ahead in the Cloud Chief Technology](https://reader030.vdocuments.net/reader030/viewer/2022041014/5ec4c78f21790147f730d9f2/html5/thumbnails/7.jpg)
>1 Trillion Indexed
URLs
6
![Page 8: Big Data Operational Excellence Ahead in the Cloudd36cz9buwru1tt.cloudfront.net/aws-gov-summit-2011/CIA_Gus_Hunt… · Big Data Operational Excellence Ahead in the Cloud Chief Technology](https://reader030.vdocuments.net/reader030/viewer/2022041014/5ec4c78f21790147f730d9f2/html5/thumbnails/8.jpg)
Google’s index
>100 Petabytes
7
![Page 9: Big Data Operational Excellence Ahead in the Cloudd36cz9buwru1tt.cloudfront.net/aws-gov-summit-2011/CIA_Gus_Hunt… · Big Data Operational Excellence Ahead in the Cloud Chief Technology](https://reader030.vdocuments.net/reader030/viewer/2022041014/5ec4c78f21790147f730d9f2/html5/thumbnails/9.jpg)
YouTube
>789 Petabytes
8
![Page 10: Big Data Operational Excellence Ahead in the Cloudd36cz9buwru1tt.cloudfront.net/aws-gov-summit-2011/CIA_Gus_Hunt… · Big Data Operational Excellence Ahead in the Cloud Chief Technology](https://reader030.vdocuments.net/reader030/viewer/2022041014/5ec4c78f21790147f730d9f2/html5/thumbnails/10.jpg)
>144 Million
Tweets per day
9
![Page 11: Big Data Operational Excellence Ahead in the Cloudd36cz9buwru1tt.cloudfront.net/aws-gov-summit-2011/CIA_Gus_Hunt… · Big Data Operational Excellence Ahead in the Cloud Chief Technology](https://reader030.vdocuments.net/reader030/viewer/2022041014/5ec4c78f21790147f730d9f2/html5/thumbnails/11.jpg)
Facebook Holdings
>90 Petabytes
10
![Page 12: Big Data Operational Excellence Ahead in the Cloudd36cz9buwru1tt.cloudfront.net/aws-gov-summit-2011/CIA_Gus_Hunt… · Big Data Operational Excellence Ahead in the Cloud Chief Technology](https://reader030.vdocuments.net/reader030/viewer/2022041014/5ec4c78f21790147f730d9f2/html5/thumbnails/12.jpg)
11
Sensors
![Page 13: Big Data Operational Excellence Ahead in the Cloudd36cz9buwru1tt.cloudfront.net/aws-gov-summit-2011/CIA_Gus_Hunt… · Big Data Operational Excellence Ahead in the Cloud Chief Technology](https://reader030.vdocuments.net/reader030/viewer/2022041014/5ec4c78f21790147f730d9f2/html5/thumbnails/13.jpg)
2
3
Our Job
Leverage the Big Data world
Find the Information that Matters
Connect the Dots
Understand the Plans of our Adversaries – Prevent an attack, Save lives, Safeguard our national security
1
4
![Page 14: Big Data Operational Excellence Ahead in the Cloudd36cz9buwru1tt.cloudfront.net/aws-gov-summit-2011/CIA_Gus_Hunt… · Big Data Operational Excellence Ahead in the Cloud Chief Technology](https://reader030.vdocuments.net/reader030/viewer/2022041014/5ec4c78f21790147f730d9f2/html5/thumbnails/14.jpg)
13
Why
We
Care
![Page 15: Big Data Operational Excellence Ahead in the Cloudd36cz9buwru1tt.cloudfront.net/aws-gov-summit-2011/CIA_Gus_Hunt… · Big Data Operational Excellence Ahead in the Cloud Chief Technology](https://reader030.vdocuments.net/reader030/viewer/2022041014/5ec4c78f21790147f730d9f2/html5/thumbnails/15.jpg)
14
Why
We
Care
![Page 16: Big Data Operational Excellence Ahead in the Cloudd36cz9buwru1tt.cloudfront.net/aws-gov-summit-2011/CIA_Gus_Hunt… · Big Data Operational Excellence Ahead in the Cloud Chief Technology](https://reader030.vdocuments.net/reader030/viewer/2022041014/5ec4c78f21790147f730d9f2/html5/thumbnails/16.jpg)
The
Problem
15
![Page 17: Big Data Operational Excellence Ahead in the Cloudd36cz9buwru1tt.cloudfront.net/aws-gov-summit-2011/CIA_Gus_Hunt… · Big Data Operational Excellence Ahead in the Cloud Chief Technology](https://reader030.vdocuments.net/reader030/viewer/2022041014/5ec4c78f21790147f730d9f2/html5/thumbnails/17.jpg)
2
3
Our Problem: Which 5K
Don’t know the future value of a dot today
We cannot connect dots we don’t have
The old collect, winnow, dissem model
fails spectacularly in the Big Data world
The few cannot know the needs of the many
1
Secure the data, Connect the data, Empower the user
![Page 18: Big Data Operational Excellence Ahead in the Cloudd36cz9buwru1tt.cloudfront.net/aws-gov-summit-2011/CIA_Gus_Hunt… · Big Data Operational Excellence Ahead in the Cloud Chief Technology](https://reader030.vdocuments.net/reader030/viewer/2022041014/5ec4c78f21790147f730d9f2/html5/thumbnails/18.jpg)
17
Our Reality
Significant budget cuts are coming
IT is under enormous pressure to reduce spending
IT must deliver new and better capabilities--faster
Instability is rising across the globe
Speed and agility are paramount
Operational Excellence is about solving all
of the above--simultaneously
![Page 19: Big Data Operational Excellence Ahead in the Cloudd36cz9buwru1tt.cloudfront.net/aws-gov-summit-2011/CIA_Gus_Hunt… · Big Data Operational Excellence Ahead in the Cloud Chief Technology](https://reader030.vdocuments.net/reader030/viewer/2022041014/5ec4c78f21790147f730d9f2/html5/thumbnails/19.jpg)
18
Let’s talk Cloud
![Page 20: Big Data Operational Excellence Ahead in the Cloudd36cz9buwru1tt.cloudfront.net/aws-gov-summit-2011/CIA_Gus_Hunt… · Big Data Operational Excellence Ahead in the Cloud Chief Technology](https://reader030.vdocuments.net/reader030/viewer/2022041014/5ec4c78f21790147f730d9f2/html5/thumbnails/20.jpg)
19
=
Big Data Continuous Services
Unbounded Scale
Capacity ahead of demand
Operational Excellence Radical Efficiency
Rigorous Standardization
Ruthless Automation
Failure Tolerant
Redundant by Design
Available by Default
![Page 21: Big Data Operational Excellence Ahead in the Cloudd36cz9buwru1tt.cloudfront.net/aws-gov-summit-2011/CIA_Gus_Hunt… · Big Data Operational Excellence Ahead in the Cloud Chief Technology](https://reader030.vdocuments.net/reader030/viewer/2022041014/5ec4c78f21790147f730d9f2/html5/thumbnails/21.jpg)
20
Capacity ahead of demand
– Zero wait, zero effort
– Like 110 out of the wall
– Like dial tone
– Plug in and go
Make IT Frictionless for Mission
Provide CIA and the IC – Continuous Services
– “Unbounded” Scale
– Radical Efficiency
– Rigorous Standardization
– Ruthless Automation
– Failure Tolerant
– Redundant by Design
– Available by Default
![Page 22: Big Data Operational Excellence Ahead in the Cloudd36cz9buwru1tt.cloudfront.net/aws-gov-summit-2011/CIA_Gus_Hunt… · Big Data Operational Excellence Ahead in the Cloud Chief Technology](https://reader030.vdocuments.net/reader030/viewer/2022041014/5ec4c78f21790147f730d9f2/html5/thumbnails/22.jpg)
Operational Excellence Radical efficiency
Rigorous standards
Security ahead of need
Capacity ahead of demand
Big Data Mass analytics
Complex reasoning
Hypothesis generation
Answers ahead of questions
Cloud
Computing Operational Excellence Radical efficiency
Rigorous standards
Security ahead of need
Capacity ahead of demand
![Page 23: Big Data Operational Excellence Ahead in the Cloudd36cz9buwru1tt.cloudfront.net/aws-gov-summit-2011/CIA_Gus_Hunt… · Big Data Operational Excellence Ahead in the Cloud Chief Technology](https://reader030.vdocuments.net/reader030/viewer/2022041014/5ec4c78f21790147f730d9f2/html5/thumbnails/23.jpg)
2
Its not about the Cloud
– Acquire, federate, and position for multiple constituencies to securely
exploit. Grow the haystack, magnify the needles. Connect the dots.
Big Data
Operational Excellence – Innovate infrastructure operations and provisioning, create an
authoritative source on our asset base, and run IT like a business.
1
Its about:
Cloud is the mechanism to achieve
both securely
![Page 24: Big Data Operational Excellence Ahead in the Cloudd36cz9buwru1tt.cloudfront.net/aws-gov-summit-2011/CIA_Gus_Hunt… · Big Data Operational Excellence Ahead in the Cloud Chief Technology](https://reader030.vdocuments.net/reader030/viewer/2022041014/5ec4c78f21790147f730d9f2/html5/thumbnails/24.jpg)
Questions
The journey of a thousand miles
begins with a single step. Lao Tzu