dataops at scale –taking apache hadoop enterprise-wide€¦ · does your company use hadoop in...

15
June 28, 2017 Predictable Hybrid Big Data DataOps at Scale – Taking Apache Hadoop Enterprise-Wide

Upload: duongxuyen

Post on 15-May-2018

215 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: DataOps at Scale –Taking Apache Hadoop Enterprise-Wide€¦ · Does your company use Hadoop in production? a.Yes b.No c.Unsure d.What is Hadoop in production? ... stack also minimizes

June 28, 2017 Predictable Hybrid Big Data

DataOps at Scale – Taking Apache Hadoop Enterprise-Wide

Page 2: DataOps at Scale –Taking Apache Hadoop Enterprise-Wide€¦ · Does your company use Hadoop in production? a.Yes b.No c.Unsure d.What is Hadoop in production? ... stack also minimizes

@ODPiOrg

TODAY’S PRESENTERS

2

John Mertic, Director of Program Management, ODPi

Tamara Dull, Director of Emerging Technologies,SAS Institute

Page 3: DataOps at Scale –Taking Apache Hadoop Enterprise-Wide€¦ · Does your company use Hadoop in production? a.Yes b.No c.Unsure d.What is Hadoop in production? ... stack also minimizes

@ODPiOrg

Page 4: DataOps at Scale –Taking Apache Hadoop Enterprise-Wide€¦ · Does your company use Hadoop in production? a.Yes b.No c.Unsure d.What is Hadoop in production? ... stack also minimizes

@ODPiOrg

SIZE ISN’T THE REAL CHALLENGE

Page 5: DataOps at Scale –Taking Apache Hadoop Enterprise-Wide€¦ · Does your company use Hadoop in production? a.Yes b.No c.Unsure d.What is Hadoop in production? ... stack also minimizes

@ODPiOrg

ENTERPRISE HADOOP DEPLOYMENT CONTINUUM

Page 6: DataOps at Scale –Taking Apache Hadoop Enterprise-Wide€¦ · Does your company use Hadoop in production? a.Yes b.No c.Unsure d.What is Hadoop in production? ... stack also minimizes

@ODPiOrg6

Does your company use Hadoop in production?

a. Yes

b.No

c. Unsure

d.What is Hadoop in production?

POLLING QUESTION #1

Page 7: DataOps at Scale –Taking Apache Hadoop Enterprise-Wide€¦ · Does your company use Hadoop in production? a.Yes b.No c.Unsure d.What is Hadoop in production? ... stack also minimizes

@ODPiOrg

DATAOPS @ ENTERPRISE-WIDE

Page 8: DataOps at Scale –Taking Apache Hadoop Enterprise-Wide€¦ · Does your company use Hadoop in production? a.Yes b.No c.Unsure d.What is Hadoop in production? ... stack also minimizes

@ODPiOrg8

What stage are most of your Hadoop deployments?

a. Lab

b.PoC

c. Pilot

d.Enterprise-wide production

POLLING QUESTION #2

Page 9: DataOps at Scale –Taking Apache Hadoop Enterprise-Wide€¦ · Does your company use Hadoop in production? a.Yes b.No c.Unsure d.What is Hadoop in production? ... stack also minimizes

@ODPiOrg

ENTERPRISE PRODUCTION HADOOP NEEDS

Page 10: DataOps at Scale –Taking Apache Hadoop Enterprise-Wide€¦ · Does your company use Hadoop in production? a.Yes b.No c.Unsure d.What is Hadoop in production? ... stack also minimizes

@ODPiOrg10

What challenges did you encounter while expanding Hadoop use?

a. Data governance and security

b.App lifecycle management

c. Deployment cloud/on-prem

d.Application portability

POLLING QUESTION #3

Page 11: DataOps at Scale –Taking Apache Hadoop Enterprise-Wide€¦ · Does your company use Hadoop in production? a.Yes b.No c.Unsure d.What is Hadoop in production? ... stack also minimizes

@ODPiOrg

ENTERPRISE HADOOP ADOPTIONHardening Hadoop as an Enterprise-wide Production Platform

Page 12: DataOps at Scale –Taking Apache Hadoop Enterprise-Wide€¦ · Does your company use Hadoop in production? a.Yes b.No c.Unsure d.What is Hadoop in production? ... stack also minimizes

@ODPiOrg

ENTERPRISE HADOOP CHALLENGES

Modern data tools and platforms are non-trivial ( by design )

Enterprise deployment pattern considerations don’t make it upstream

Interoperability standards are inconsistent, even though

platform vendors often derive from the same codebase

Page 13: DataOps at Scale –Taking Apache Hadoop Enterprise-Wide€¦ · Does your company use Hadoop in production? a.Yes b.No c.Unsure d.What is Hadoop in production? ... stack also minimizes

@ODPiOrg

13

INFRASTRUCTURE NOT BOUND TO A DATACENTER

Page 14: DataOps at Scale –Taking Apache Hadoop Enterprise-Wide€¦ · Does your company use Hadoop in production? a.Yes b.No c.Unsure d.What is Hadoop in production? ... stack also minimizes

@ODPiOrg

GET INVOLVED WITH ODPi

Page 15: DataOps at Scale –Taking Apache Hadoop Enterprise-Wide€¦ · Does your company use Hadoop in production? a.Yes b.No c.Unsure d.What is Hadoop in production? ... stack also minimizes

@ODPiOrg