![Page 1: Big Data: Are You Ready? - Citia BTCcitia.co.uk/content/files/50_128-598.pdfBig Data in Action •Hadoop: to capture & store data in file system & use MapReduce programs to interpret](https://reader034.vdocuments.net/reader034/viewer/2022050200/5f53a9dae221c00f1b7229b6/html5/thumbnails/1.jpg)
1
Big Data: Are You Ready?
Kevin Lancaster
Director, Engineered Systems
Oracle Europe, Middle East & Africa
![Page 2: Big Data: Are You Ready? - Citia BTCcitia.co.uk/content/files/50_128-598.pdfBig Data in Action •Hadoop: to capture & store data in file system & use MapReduce programs to interpret](https://reader034.vdocuments.net/reader034/viewer/2022050200/5f53a9dae221c00f1b7229b6/html5/thumbnails/2.jpg)
A Data Explosion...
![Page 3: Big Data: Are You Ready? - Citia BTCcitia.co.uk/content/files/50_128-598.pdfBig Data in Action •Hadoop: to capture & store data in file system & use MapReduce programs to interpret](https://reader034.vdocuments.net/reader034/viewer/2022050200/5f53a9dae221c00f1b7229b6/html5/thumbnails/3.jpg)
Billing
engines
Custom
developed
Traditional Data Sources
![Page 4: Big Data: Are You Ready? - Citia BTCcitia.co.uk/content/files/50_128-598.pdfBig Data in Action •Hadoop: to capture & store data in file system & use MapReduce programs to interpret](https://reader034.vdocuments.net/reader034/viewer/2022050200/5f53a9dae221c00f1b7229b6/html5/thumbnails/4.jpg)
Billing
engines
Custom
developed
New, Non-Traditional Data Sources
![Page 5: Big Data: Are You Ready? - Citia BTCcitia.co.uk/content/files/50_128-598.pdfBig Data in Action •Hadoop: to capture & store data in file system & use MapReduce programs to interpret](https://reader034.vdocuments.net/reader034/viewer/2022050200/5f53a9dae221c00f1b7229b6/html5/thumbnails/5.jpg)
![Page 6: Big Data: Are You Ready? - Citia BTCcitia.co.uk/content/files/50_128-598.pdfBig Data in Action •Hadoop: to capture & store data in file system & use MapReduce programs to interpret](https://reader034.vdocuments.net/reader034/viewer/2022050200/5f53a9dae221c00f1b7229b6/html5/thumbnails/6.jpg)
Big Data Buzz
“Big data, analytics get even bigger, hotter in 2012” InfoWorld – 12/30/11
“The promise of big data” Intelligent Utility - 8/28/11
“Are you ready for the era of big data?” McKinsey Quarterly - 11/11
“Health care is next frontier for big data” Wall Street Journal – 1/19/12
“Big data: science’s microscope of the 21st century” Business Week – 11/8/11
“Decisions, decisions…will big data have big impact?” Financial Times – 1/24/12
![Page 7: Big Data: Are You Ready? - Citia BTCcitia.co.uk/content/files/50_128-598.pdfBig Data in Action •Hadoop: to capture & store data in file system & use MapReduce programs to interpret](https://reader034.vdocuments.net/reader034/viewer/2022050200/5f53a9dae221c00f1b7229b6/html5/thumbnails/7.jpg)
Why Is Big Data Important?
Source: * McKinsey Global Institute: Big Data – The next frontier for innovation, competition and productivity (May 2011)
US HEALTH CARE
$300 B
“In a big data world, a competitor that fails to sufficiently
develop its capabilities will be left behind.”
Increase industry
value per year by
McKinsey Global Institute
US RETAIL
60+%
Increase net
margin by
MANUFACTURING
–50%
Decrease dev.,
assembly costs by
GLOBAL PERSONAL
LOCATION DATA
$100 B
Increase service
provider revenue by
EUROPE PUBLIC
SECTOR ADMIN
€250 B
Increase industry
value per year by
![Page 8: Big Data: Are You Ready? - Citia BTCcitia.co.uk/content/files/50_128-598.pdfBig Data in Action •Hadoop: to capture & store data in file system & use MapReduce programs to interpret](https://reader034.vdocuments.net/reader034/viewer/2022050200/5f53a9dae221c00f1b7229b6/html5/thumbnails/8.jpg)
Are You Ready for all that value?
TO DERIVE REAL VALUE FROM “BIG DATA” YOU NEED:
• THE RIGHT TOOLS TO CAPTURE AND ORGANIZE IT
• AND BE ABLE TO ANALYZE IT
WITHIN THE CONTEXT OF ALL YOUR ENTERPRISE DATA
![Page 9: Big Data: Are You Ready? - Citia BTCcitia.co.uk/content/files/50_128-598.pdfBig Data in Action •Hadoop: to capture & store data in file system & use MapReduce programs to interpret](https://reader034.vdocuments.net/reader034/viewer/2022050200/5f53a9dae221c00f1b7229b6/html5/thumbnails/9.jpg)
Gartner’s View: Big Data Drivers
![Page 10: Big Data: Are You Ready? - Citia BTCcitia.co.uk/content/files/50_128-598.pdfBig Data in Action •Hadoop: to capture & store data in file system & use MapReduce programs to interpret](https://reader034.vdocuments.net/reader034/viewer/2022050200/5f53a9dae221c00f1b7229b6/html5/thumbnails/10.jpg)
Gartner’s View: Big Data Drivers
• Now economic to use data that hasn’t
been used before.
• The “un-structured” word
• Use of technologies like Hadoop to hold
the data and support (Java) apps to
analyze/filter/aggregate useful content
into something of value, when
combined with other data...
![Page 11: Big Data: Are You Ready? - Citia BTCcitia.co.uk/content/files/50_128-598.pdfBig Data in Action •Hadoop: to capture & store data in file system & use MapReduce programs to interpret](https://reader034.vdocuments.net/reader034/viewer/2022050200/5f53a9dae221c00f1b7229b6/html5/thumbnails/11.jpg)
What Makes it Big Data?
VOLUME VELOCITY VARIETY VALUE
SOCIAL
BLOG
SMART
METER
101100101001
001001101010
101011100101
010100100101
![Page 12: Big Data: Are You Ready? - Citia BTCcitia.co.uk/content/files/50_128-598.pdfBig Data in Action •Hadoop: to capture & store data in file system & use MapReduce programs to interpret](https://reader034.vdocuments.net/reader034/viewer/2022050200/5f53a9dae221c00f1b7229b6/html5/thumbnails/12.jpg)
Velocity Variety Value (yes, & Volume)
drive the “Big Data” discussion
![Page 13: Big Data: Are You Ready? - Citia BTCcitia.co.uk/content/files/50_128-598.pdfBig Data in Action •Hadoop: to capture & store data in file system & use MapReduce programs to interpret](https://reader034.vdocuments.net/reader034/viewer/2022050200/5f53a9dae221c00f1b7229b6/html5/thumbnails/13.jpg)
Big Data Use Cases
Today’s Challenge New Data What’s Possible
Healthcare
Expensive office visits Remote patient monitoring
Preventive care, reduced
hospitalization
Manufacturing
In-person support Product sensors Automated diagnosis, support
Location-Based Services
Based on home zip code Real time location data
Geo-advertising, traffic, local
search
Public Sector
Standardized services Citizen surveys
Tailored services,
cost reductions
Retail
One size fits all marketing Social media
Sentiment analysis
segmentation
![Page 14: Big Data: Are You Ready? - Citia BTCcitia.co.uk/content/files/50_128-598.pdfBig Data in Action •Hadoop: to capture & store data in file system & use MapReduce programs to interpret](https://reader034.vdocuments.net/reader034/viewer/2022050200/5f53a9dae221c00f1b7229b6/html5/thumbnails/14.jpg)
BIG DATA = BIG VALUE ?
THE KEY IS NOT TO FOLLOW THE HYPE,
BUT PASSIONATELY SEARCH:
HOW TO DRIVE VALUE USING BIG DATA
![Page 15: Big Data: Are You Ready? - Citia BTCcitia.co.uk/content/files/50_128-598.pdfBig Data in Action •Hadoop: to capture & store data in file system & use MapReduce programs to interpret](https://reader034.vdocuments.net/reader034/viewer/2022050200/5f53a9dae221c00f1b7229b6/html5/thumbnails/15.jpg)
Make Better Decisions Using Big Data
Big Data in Action
ANALYZE
DECIDE ACQUIRE
ORGANIZE
![Page 16: Big Data: Are You Ready? - Citia BTCcitia.co.uk/content/files/50_128-598.pdfBig Data in Action •Hadoop: to capture & store data in file system & use MapReduce programs to interpret](https://reader034.vdocuments.net/reader034/viewer/2022050200/5f53a9dae221c00f1b7229b6/html5/thumbnails/16.jpg)
How will you acquire live streams of semi- and un-structured data?
What is Your Big Data Strategy?
ANALYZE
DECIDE
ORGANIZE
ACQUIRE
![Page 17: Big Data: Are You Ready? - Citia BTCcitia.co.uk/content/files/50_128-598.pdfBig Data in Action •Hadoop: to capture & store data in file system & use MapReduce programs to interpret](https://reader034.vdocuments.net/reader034/viewer/2022050200/5f53a9dae221c00f1b7229b6/html5/thumbnails/17.jpg)
How will you organize big data so it can be integrated into your data center?
What is Your Big Data Strategy?
ANALYZE
DECIDE ACQUIRE
ORGANIZE
![Page 18: Big Data: Are You Ready? - Citia BTCcitia.co.uk/content/files/50_128-598.pdfBig Data in Action •Hadoop: to capture & store data in file system & use MapReduce programs to interpret](https://reader034.vdocuments.net/reader034/viewer/2022050200/5f53a9dae221c00f1b7229b6/html5/thumbnails/18.jpg)
What skill sets and tools will you use to analyze big data?
What is Your Big Data Strategy?
ANALYZE
DECIDE ACQUIRE
ORGANIZE ANALYZE
![Page 19: Big Data: Are You Ready? - Citia BTCcitia.co.uk/content/files/50_128-598.pdfBig Data in Action •Hadoop: to capture & store data in file system & use MapReduce programs to interpret](https://reader034.vdocuments.net/reader034/viewer/2022050200/5f53a9dae221c00f1b7229b6/html5/thumbnails/19.jpg)
How will you share the analysis in real-time?
What is Your Big Data Strategy?
ANALYZE
ACQUIRE
ORGANIZE
DECIDE
![Page 20: Big Data: Are You Ready? - Citia BTCcitia.co.uk/content/files/50_128-598.pdfBig Data in Action •Hadoop: to capture & store data in file system & use MapReduce programs to interpret](https://reader034.vdocuments.net/reader034/viewer/2022050200/5f53a9dae221c00f1b7229b6/html5/thumbnails/20.jpg)
Gartner’s View: Big Data Technologies
![Page 21: Big Data: Are You Ready? - Citia BTCcitia.co.uk/content/files/50_128-598.pdfBig Data in Action •Hadoop: to capture & store data in file system & use MapReduce programs to interpret](https://reader034.vdocuments.net/reader034/viewer/2022050200/5f53a9dae221c00f1b7229b6/html5/thumbnails/21.jpg)
Gartner’s View: Big Data Technologies
• Introduced Hadoop & NoSQL
• Different from the RDBMS
• Relatively immature
• Advice: work with vendors who
can pull it all together and
connect with existing systems.
![Page 22: Big Data: Are You Ready? - Citia BTCcitia.co.uk/content/files/50_128-598.pdfBig Data in Action •Hadoop: to capture & store data in file system & use MapReduce programs to interpret](https://reader034.vdocuments.net/reader034/viewer/2022050200/5f53a9dae221c00f1b7229b6/html5/thumbnails/22.jpg)
Technology to Acquire & Organize Big Data
Big Data in Action
ACQUIRE
ORGANIZE
![Page 23: Big Data: Are You Ready? - Citia BTCcitia.co.uk/content/files/50_128-598.pdfBig Data in Action •Hadoop: to capture & store data in file system & use MapReduce programs to interpret](https://reader034.vdocuments.net/reader034/viewer/2022050200/5f53a9dae221c00f1b7229b6/html5/thumbnails/23.jpg)
Big Data in Action
• Hadoop: to capture & store data in file system & use MapReduce
programs to interpret & distill information
• NoSQL (key-value stores) for very fast capture and simple queries
with low latency - “OLTP for the Big Data World”
![Page 24: Big Data: Are You Ready? - Citia BTCcitia.co.uk/content/files/50_128-598.pdfBig Data in Action •Hadoop: to capture & store data in file system & use MapReduce programs to interpret](https://reader034.vdocuments.net/reader034/viewer/2022050200/5f53a9dae221c00f1b7229b6/html5/thumbnails/24.jpg)
Gartner’s View: Integrating Big Data
![Page 25: Big Data: Are You Ready? - Citia BTCcitia.co.uk/content/files/50_128-598.pdfBig Data in Action •Hadoop: to capture & store data in file system & use MapReduce programs to interpret](https://reader034.vdocuments.net/reader034/viewer/2022050200/5f53a9dae221c00f1b7229b6/html5/thumbnails/25.jpg)
Gartner’s View: Integrating Big Data
• Real Value = combination of
‘big data’ and existing data
• Need skills, architecture
• Combining in RDBMS means:
– In-Database Analytics
– In-Memory Technology
– And existing BI/DW skills
![Page 26: Big Data: Are You Ready? - Citia BTCcitia.co.uk/content/files/50_128-598.pdfBig Data in Action •Hadoop: to capture & store data in file system & use MapReduce programs to interpret](https://reader034.vdocuments.net/reader034/viewer/2022050200/5f53a9dae221c00f1b7229b6/html5/thumbnails/26.jpg)
•Oracle Data Integrator Application Adapter for Hadoop
•Oracle Loader for Hadoop
•Oracle Direct Connector for Hadoop Distributed File System
•Oracle R Connector for Hadoop
Oracle Big Data Connectors
![Page 27: Big Data: Are You Ready? - Citia BTCcitia.co.uk/content/files/50_128-598.pdfBig Data in Action •Hadoop: to capture & store data in file system & use MapReduce programs to interpret](https://reader034.vdocuments.net/reader034/viewer/2022050200/5f53a9dae221c00f1b7229b6/html5/thumbnails/27.jpg)
R Statistical Programming Language
Open source language and environment Used for statistical computing and graphics Strength in easily producing publication-quality graphs Highly extensible
![Page 28: Big Data: Are You Ready? - Citia BTCcitia.co.uk/content/files/50_128-598.pdfBig Data in Action •Hadoop: to capture & store data in file system & use MapReduce programs to interpret](https://reader034.vdocuments.net/reader034/viewer/2022050200/5f53a9dae221c00f1b7229b6/html5/thumbnails/28.jpg)
Small data models only are stored and run on user’s laptop
Why R Wasn’t Ready for the Enterprise
![Page 29: Big Data: Are You Ready? - Citia BTCcitia.co.uk/content/files/50_128-598.pdfBig Data in Action •Hadoop: to capture & store data in file system & use MapReduce programs to interpret](https://reader034.vdocuments.net/reader034/viewer/2022050200/5f53a9dae221c00f1b7229b6/html5/thumbnails/29.jpg)
Oracle R Enterprise Approach
Models run in-database Processes large data sets Uses the power of Oracle Database 11g and Exadata Same code, much faster
![Page 30: Big Data: Are You Ready? - Citia BTCcitia.co.uk/content/files/50_128-598.pdfBig Data in Action •Hadoop: to capture & store data in file system & use MapReduce programs to interpret](https://reader034.vdocuments.net/reader034/viewer/2022050200/5f53a9dae221c00f1b7229b6/html5/thumbnails/30.jpg)
Oracle Integrated Solution Stack for Big Data
ACQUIRE
Oracle NoSQL
Database
HDFS
Enterprise
Applications
ORGANIZE
Hadoop (MapReduce)
Oracle Loader for Hadoop
Oracle Data Integrator
DECIDE
Analytic
Applications
ANALYZE
In-D
ata
base
An
aly
tics
Data
Warehouse
![Page 31: Big Data: Are You Ready? - Citia BTCcitia.co.uk/content/files/50_128-598.pdfBig Data in Action •Hadoop: to capture & store data in file system & use MapReduce programs to interpret](https://reader034.vdocuments.net/reader034/viewer/2022050200/5f53a9dae221c00f1b7229b6/html5/thumbnails/31.jpg)
Oracle Integrated Solution Stack Oracle Engineered Systems for Big Data Analytics
ACQUIRE ORGANIZE ANALYZE DECIDE
![Page 32: Big Data: Are You Ready? - Citia BTCcitia.co.uk/content/files/50_128-598.pdfBig Data in Action •Hadoop: to capture & store data in file system & use MapReduce programs to interpret](https://reader034.vdocuments.net/reader034/viewer/2022050200/5f53a9dae221c00f1b7229b6/html5/thumbnails/32.jpg)
Hardware:
• 216 CPU cores, 864 GB RAM, 648 TB disk
• 40 Gb/s InfiniBand, inter-rack, node connectivity
• 10 Gb/s Ethernet, data center connectivity
System Software:
• Oracle Linux, Oracle Java Hotspot VM
• Oracle NoSQL Database Community Edition
• Open-source R distribution
• Cloudera’s Distribution including Apache Hadoop
• Cloudera Manager
Oracle Engineered Systems Oracle Big Data Appliance
![Page 33: Big Data: Are You Ready? - Citia BTCcitia.co.uk/content/files/50_128-598.pdfBig Data in Action •Hadoop: to capture & store data in file system & use MapReduce programs to interpret](https://reader034.vdocuments.net/reader034/viewer/2022050200/5f53a9dae221c00f1b7229b6/html5/thumbnails/33.jpg)
Oracle Big Data Appliance
“If anyone doubted Oracle's seriousness about
competing in the big data arena, those doubts
should be removed by today's release of the
Oracle Big Data Appliance. The appliance is
hitting the market sooner than many people
expected it would, and it includes key software
from Cloudera…” – InformationWeek
![Page 34: Big Data: Are You Ready? - Citia BTCcitia.co.uk/content/files/50_128-598.pdfBig Data in Action •Hadoop: to capture & store data in file system & use MapReduce programs to interpret](https://reader034.vdocuments.net/reader034/viewer/2022050200/5f53a9dae221c00f1b7229b6/html5/thumbnails/34.jpg)
Oracle Big Data Appliance
(1) Oracle mainstreams its Hadoop platform with Cloudera OEM deal, January 2012, Tony Baer
“Clearly, Oracle's release of Oracle Big Data
Appliance signifies a full commitment to Hadoop
as a first-class citizen of the Oracle data platform.
Its price, $450,000 for 216 CPU cores backed by
648TB of storage and the same Infiniband
backplane used by Oracle Exadata and Oracle's
other engineered systems, is definitely
competitive.” – Ovum (1)
![Page 35: Big Data: Are You Ready? - Citia BTCcitia.co.uk/content/files/50_128-598.pdfBig Data in Action •Hadoop: to capture & store data in file system & use MapReduce programs to interpret](https://reader034.vdocuments.net/reader034/viewer/2022050200/5f53a9dae221c00f1b7229b6/html5/thumbnails/35.jpg)
Maximizing the Value of Enterprise Big Data
•Hardware and software for Big Data
•Integrates all enterprise data
–Structured and unstructured
–SQL and NoSQL
•Fastest time-to-market
•Single vendor support
![Page 36: Big Data: Are You Ready? - Citia BTCcitia.co.uk/content/files/50_128-598.pdfBig Data in Action •Hadoop: to capture & store data in file system & use MapReduce programs to interpret](https://reader034.vdocuments.net/reader034/viewer/2022050200/5f53a9dae221c00f1b7229b6/html5/thumbnails/36.jpg)
![Page 37: Big Data: Are You Ready? - Citia BTCcitia.co.uk/content/files/50_128-598.pdfBig Data in Action •Hadoop: to capture & store data in file system & use MapReduce programs to interpret](https://reader034.vdocuments.net/reader034/viewer/2022050200/5f53a9dae221c00f1b7229b6/html5/thumbnails/37.jpg)