the formula for hadoop project success

The Formula for Hadoop Project Success

Gail EnnisCEO

Volume, Variety and Velocity all increasing rapidly Source: IBM, Oct 2012

OMG!…The Opportunity Is Huge

{"frequentlyPurchasedWith": [], "color": "Black", "skutype": "parent", "productTemplate": "Computer_Accessory", "salesRankMediumTerm": "3039", "shortDescription": "Compatible with Windows 8 and RT and Android 3.0 tablets; Bluetooth technology; convertible stand/carrying case", "includedItemList": [{"includedItem": "Logitech Tablet Keyboard for Windows 8 and RT and Android 3.0+ Tablets"}, {"includedItem": "4 AAA batteries"}, {"includedItem": "Owner's manual"}], "subclassId": 2409, "sku": 6541967, "width": "12.3\"", "subclass": "BLUETOOTH KEYBOARDS", "source": "BoxStore", "modelNumber": "920-004569", "digital": false, "department": "COMPUTERS", "type": "HardGood", "productId": 1218752781558, "description": "None", "technologyCode": "None", "longDescription": "This Logitech 920-004569 keyboard features a low-profile, 65-key design for easy, comfortable typing on your Windows 8 or RT or Android 3.0 tablet. The convertible stand allows comfortable viewing and provides on-the-go protection for the keyboard.", "categoryPath": [{"name": "Box Store", "id": "cat00000"}, {"name": "Computers & Tablets", "id": "abcat0500000"}, {"name": "iPad, Tablets & E-Readers", "id": "pcmcat209000050006"}, {"name": "Tablet Accessories", "id": "pcmcat231800050009"}, {"name": "Tablet Docks, Keyboards & Stands", "id": "pcmcat242000050003"}], "manufacturer": "Logitech", "classId": 492, "upc": "097855090973", "regularPrice": 69.99, "class_1": "TABLET ACCESSORIES", "relatedProducts": [{"sku": 4974041}, {"sku": 1306578835}, {"sku": 4640745}, {"sku": 9610542}, {"sku": 8785729}, {"sku": 6640676}]}{"frequentlyPurchasedWith": [], "color": "Gray", "skutype": "parent", "productTemplate": "Computer_Accessory", "salesRankMediumTerm": "None", "shortDescription": "Compatible with BlackBerry Playbook tablets; wool construction; TPU plastic cradle; elastic band; metallic clip; functions as a stand; play-through design", "includedItemList": [{"includedItem": "DICOTA TabBook Case for BlackBerry Playbook Tablets"}], "subclassId": 2404, "sku": 6738835, "width": "5.5\"", "subclass": "SO TABLET ACCY", "source": "BoxStore", "modelNumber": "D30203", "digital": false, "department": "COMPUTERS", "type": "HardGood", "productId": 1218789793935, "description": "None", "technologyCode": "None", "longDescription": "This DICOTA TabBook D30203 case helps keep your BlackBerry Playbook tablet safe from hazards, with wool construction and a TPU plastic cradle for durability and an elastic band to keep your tablet snug and secure in the case.", "categoryPath": [{"name": "Box Store", "id": "cat00000"}, {"name": "Computers & Tablets", "id": "abcat0500000"}, {"name": "iPad, Tablets & E-Readers", "id": "pcmcat209000050006"}, {"name": "Tablet Accessories", "id": "pcmcat231800050009"}, {"name": "Tablet Cases, Covers & Sleeves", "id": "pcmcat242000050002"}], "manufacturer": "DICOTA", "classId": 492, "upc": "7332752000964", "regularPrice": 49.99, "class_1": "TABLET ACCESSORIES", "relatedProducts": [{"sku": 6118882}, {"sku": 6118737}, {"sku": 1305180220}, {"sku": 4124528}, {"sku": 1304792301}, {"sku": 6744043}]}

InformationWeek 2013

There’s certainlychallenges

A Success Formula for a Hadoop Project

✚= =

WHATyour

company & you

HOWbest

practices

MORE BI?

Big Data Analytics

What Can We Make Happen?“Data Platform of Intent”

Big Data Full

Fidelity Analysis

Unstructured Behavioral,

Open, Affordable

HADOOP

HQL

BI Data Cube

Analysis

Structured, Transactional

Closed, Expensive

RDBS & EDW

SQL

Powered by the CommunityPowered by Vendors

Report On What Happened?Database of Transactions

1. What auxiliary products should we recommend?

2. What new features should our product have?

3. How can we eliminate support issues?

Hadoop Innovation Use Cases … some examples

Another IdeaScore Your Predictive Models On Hadoop

Model Builder Model Description

Hive UDFs

Standard Hive

Reinvent Your CareerLeadThrive

This is the time to be the river, not the rock

Big Data Projects on HadoopWe’re On a journey that’s just starting

You Are Here….Time to get going!

But first!

Education Training Certifications

#1. Form a Partnership With LOB Find a use case Identify some budget Form a project team Be willing to educate others Partner on a small POC, don’t boil the ocean

Hadoop Project SuccessBest Practice #1

Teams are Highly Cross-Functional

Product Manager (LOB) Power Analysts (IT or LOB) Business Analyst (LOB) Product Manager (LOB IT Architect (IT) Project Manager (IT/LOB)

“By 2016 the CMO will have more budget than the CIO”

- Gartner Group

Marketing The “Budget Richest” LOB?

#2. Use the Right Big Data Analytics tooling

• Supports the entire time• Reuse and share for speed and efficiency• Leverage pre-built analytics

Hadoop Project SuccessBest Practice #2

PERSONALIZED ANALYTICS HUB

#3. Embrace Full Fidelity Big Data Analytics Not sampled, all the data – maintains richness Don’t replicate or move the data Keep complexity and TCO low

Hadoop Project SuccessBest Practice #3

Data Warehouse

OLTP to OLAP Mapping

Analyst

In SummaryIn BI, The Analyst Was at the End of the Process

Ordering App

Financial App

Master Data

Stag

ing

OLAPReports

BI UsingData Cube

Analysis

Structured, Sampled Transitional,

Closed, Expensive

RDBS & EDW

SQL

Driven by Vendors

In Big Data Analytics on HadoopThe Analyst is at the Center of the Process

Application

AnalyticsData

Unstructured Behavioral,

Open, Affordable

HADOOP

HQL

Analyst

Full Fidelitiy Analytics

Get distracted….

Or

Big Data on Hadoop Project

Thank YouWe’re happy to help

Questions