the formula for hadoop project success
DESCRIPTION
As the big data market matures, Hadoop discussions are expanding from pure technology to how businesses can use it to drive innovation and leap-frog competition. In this session, Karmasphere will outline how to successfully deploy Hadoop projects by bringing together the right people, technology and use cases. We will discuss the optimal project team, the role of data scientists and analysts, the new big data analytics workflow and use cases for driving rapid ROI and success.TRANSCRIPT
The Formula for Hadoop Project Success
Gail EnnisCEO
Volume, Variety and Velocity all increasing rapidly Source: IBM, Oct 2012
OMG!…The Opportunity Is Huge
{"frequentlyPurchasedWith": [], "color": "Black", "skutype": "parent", "productTemplate": "Computer_Accessory", "salesRankMediumTerm": "3039", "shortDescription": "Compatible with Windows 8 and RT and Android 3.0 tablets; Bluetooth technology; convertible stand/carrying case", "includedItemList": [{"includedItem": "Logitech Tablet Keyboard for Windows 8 and RT and Android 3.0+ Tablets"}, {"includedItem": "4 AAA batteries"}, {"includedItem": "Owner's manual"}], "subclassId": 2409, "sku": 6541967, "width": "12.3\"", "subclass": "BLUETOOTH KEYBOARDS", "source": "BoxStore", "modelNumber": "920-004569", "digital": false, "department": "COMPUTERS", "type": "HardGood", "productId": 1218752781558, "description": "None", "technologyCode": "None", "longDescription": "This Logitech 920-004569 keyboard features a low-profile, 65-key design for easy, comfortable typing on your Windows 8 or RT or Android 3.0 tablet. The convertible stand allows comfortable viewing and provides on-the-go protection for the keyboard.", "categoryPath": [{"name": "Box Store", "id": "cat00000"}, {"name": "Computers & Tablets", "id": "abcat0500000"}, {"name": "iPad, Tablets & E-Readers", "id": "pcmcat209000050006"}, {"name": "Tablet Accessories", "id": "pcmcat231800050009"}, {"name": "Tablet Docks, Keyboards & Stands", "id": "pcmcat242000050003"}], "manufacturer": "Logitech", "classId": 492, "upc": "097855090973", "regularPrice": 69.99, "class_1": "TABLET ACCESSORIES", "relatedProducts": [{"sku": 4974041}, {"sku": 1306578835}, {"sku": 4640745}, {"sku": 9610542}, {"sku": 8785729}, {"sku": 6640676}]}{"frequentlyPurchasedWith": [], "color": "Gray", "skutype": "parent", "productTemplate": "Computer_Accessory", "salesRankMediumTerm": "None", "shortDescription": "Compatible with BlackBerry Playbook tablets; wool construction; TPU plastic cradle; elastic band; metallic clip; functions as a stand; play-through design", "includedItemList": [{"includedItem": "DICOTA TabBook Case for BlackBerry Playbook Tablets"}], "subclassId": 2404, "sku": 6738835, "width": "5.5\"", "subclass": "SO TABLET ACCY", "source": "BoxStore", "modelNumber": "D30203", "digital": false, "department": "COMPUTERS", "type": "HardGood", "productId": 1218789793935, "description": "None", "technologyCode": "None", "longDescription": "This DICOTA TabBook D30203 case helps keep your BlackBerry Playbook tablet safe from hazards, with wool construction and a TPU plastic cradle for durability and an elastic band to keep your tablet snug and secure in the case.", "categoryPath": [{"name": "Box Store", "id": "cat00000"}, {"name": "Computers & Tablets", "id": "abcat0500000"}, {"name": "iPad, Tablets & E-Readers", "id": "pcmcat209000050006"}, {"name": "Tablet Accessories", "id": "pcmcat231800050009"}, {"name": "Tablet Cases, Covers & Sleeves", "id": "pcmcat242000050002"}], "manufacturer": "DICOTA", "classId": 492, "upc": "7332752000964", "regularPrice": 49.99, "class_1": "TABLET ACCESSORIES", "relatedProducts": [{"sku": 6118882}, {"sku": 6118737}, {"sku": 1305180220}, {"sku": 4124528}, {"sku": 1304792301}, {"sku": 6744043}]}
InformationWeek 2013
There’s certainlychallenges
A Success Formula for a Hadoop Project
✚= =
WHATyour
company & you
HOWbest
practices
MORE BI?
Big Data Analytics
What Can We Make Happen?“Data Platform of Intent”
Big Data Full
Fidelity Analysis
Unstructured Behavioral,
Open, Affordable
HADOOP
HQL
BI Data Cube
Analysis
Structured, Transactional
Closed, Expensive
RDBS & EDW
SQL
Powered by the CommunityPowered by Vendors
Report On What Happened?Database of Transactions
1. What auxiliary products should we recommend?
2. What new features should our product have?
3. How can we eliminate support issues?
Hadoop Innovation Use Cases … some examples
Another IdeaScore Your Predictive Models On Hadoop
Model Builder Model Description
Hive UDFs
Standard Hive
Reinvent Your CareerLeadThrive
This is the time to be the river, not the rock
Big Data Projects on HadoopWe’re On a journey that’s just starting
You Are Here….Time to get going!
But first!
Education Training Certifications
#1. Form a Partnership With LOB Find a use case Identify some budget Form a project team Be willing to educate others Partner on a small POC, don’t boil the ocean
Hadoop Project SuccessBest Practice #1
Teams are Highly Cross-Functional
Product Manager (LOB) Power Analysts (IT or LOB) Business Analyst (LOB) Product Manager (LOB IT Architect (IT) Project Manager (IT/LOB)
“By 2016 the CMO will have more budget than the CIO”
- Gartner Group
Marketing The “Budget Richest” LOB?
#2. Use the Right Big Data Analytics tooling
• Supports the entire time• Reuse and share for speed and efficiency• Leverage pre-built analytics
Hadoop Project SuccessBest Practice #2
PERSONALIZED ANALYTICS HUB
#3. Embrace Full Fidelity Big Data Analytics Not sampled, all the data – maintains richness Don’t replicate or move the data Keep complexity and TCO low
Hadoop Project SuccessBest Practice #3
Data Warehouse
OLTP to OLAP Mapping
Analyst
In SummaryIn BI, The Analyst Was at the End of the Process
Ordering App
Financial App
Master Data
Stag
ing
OLAPReports
BI UsingData Cube
Analysis
Structured, Sampled Transitional,
Closed, Expensive
RDBS & EDW
SQL
Driven by Vendors
In Big Data Analytics on HadoopThe Analyst is at the Center of the Process
Application
AnalyticsData
Unstructured Behavioral,
Open, Affordable
HADOOP
HQL
Analyst
Full Fidelitiy Analytics
Get distracted….
Or
Big Data on Hadoop Project
Thank YouWe’re happy to help
Questions