cisco tidal enterprise scheduler for hadoop

10
© 2012 Cisco and/or its affiliates. All rights reserved. Cisco Public 1 October 21, 2012 Cisco Tidal Enterprise Scheduler for Hadoop

Upload: cisco-data-center-sdn

Post on 29-May-2015

4.374 views

Category:

Documents


1 download

TRANSCRIPT

Page 1: Cisco Tidal Enterprise Scheduler for Hadoop

© 2012 Cisco and/or its affiliates. All rights reserved. Cisco Public 1

October 21, 2012

Cisco Tidal Enterprise Scheduler for Hadoop

Page 2: Cisco Tidal Enterprise Scheduler for Hadoop

© 2012 Cisco and/or its affiliates. All rights reserved. Cisco Public 2

Cisco Unified Data Center

UNIFIEDFABRIC

UNIFIED COMPUTING

Highly Scalable, Secure Network

Fabric

Modular StatelessComputing Elements

UNIFIED MANAGEMENT

AutomatedManagement

Page 3: Cisco Tidal Enterprise Scheduler for Hadoop

© 2012 Cisco and/or its affiliates. All rights reserved. Cisco Public 3

Big Data Landscape

Structured

Commercial

Open source

Unstructured

(RDBMS)

Page 4: Cisco Tidal Enterprise Scheduler for Hadoop

© 2012 Cisco and/or its affiliates. All rights reserved. Cisco Public 4

Hadoop Adoption Frameworkthe Journey to Enterprise Wide Hadoop Operations

1Idea & resource

mobilization

4Enterprise wide

operations

2The first science

experiment

3Routine analyses

1

2

3

4

Will this work?What use case? What distribution?Find hardware

One real use caseFew nodesLimited data feedsOpen source

Multiple use casesCommercial HadoopReal hardware costsMany data feeds

Enterprise scaleData loadsClustersOperational SLAs

Team

Beh

avio

rs

Transition Stages

Under the desk deploymentSolve one problem one time with an “under the desk” system

Small cluster deployment Manual tuning, distro selection, data transport, “Eureka” use case

Enterprise scale Hadoop services Resource sharing, automation, performance, data integration, SLAs

Hadoop-as-a-Service Holistic operational excellence to various departments like an SP

Developer

Application Owner/PM

Enterprise Architect

CIO

Page 5: Cisco Tidal Enterprise Scheduler for Hadoop

© 2012 Cisco and/or its affiliates. All rights reserved. Cisco Public 5

IntegratedCisco UCS

Server Management

Integrated Network

Management w/ Fabric

Interconnect and Nexus Switches

Integrated Data

Management

Cisco UCS B-series

Cisco UCS C-series

w/ Direct Attach Storage

Data Center Applications Big Data Applications

Cisco Workload Automation Delivers Automated Business Processing Abstraction Layer

Data Feeds

Big Data Jobs

Data Center Applications

Automated Backup and Storage

In/out of Big Data Grids

Cisco Data Center Big Data Common Platform Architecture:Compute, Network and Automated Workload Processing

Page 6: Cisco Tidal Enterprise Scheduler for Hadoop

© 2012 Cisco and/or its affiliates. All rights reserved. Cisco Public 6

ReportsDashboards

AnalyticsOLAP

Alerts

Cisco Tidal Enterprise Scheduler

ERP Applications

DB

CRM Applications

DB

DW

DW

ERP/CRM Apps& Databases

Data Exchange System(s)

ETL/DW/Big Data/BISystems & Applications

Manages Enterprise Workloads

DW

Data In

tegratio

n

Business Intelligence Application(s)

File Drop BoxFTP/SFTP/FTPS

Saas, AWSFTP Server

DB

API Feeds(Twitter, FB, LI etc)

!

Big Data

Page 7: Cisco Tidal Enterprise Scheduler for Hadoop

© 2012 Cisco and/or its affiliates. All rights reserved. Cisco Public 7Cisco Systems Confidential - Internal Use Only

BackupMaster

PrimaryMaster

Fault Monitor

Core Business Logic & High Availability

Client Manager Client Manager

Database(Oracle/MS)

LDAP/AD

Exposed TES APIs

Adapters

Standards Based Interfaces

JMSSSH SMTPREST/SOAP Windows

SAP PeopleSoft Oracle EBS JD Edwards

BI & Database

Business Objects

Oracle MS-SQL Informatica Cognos

UNIX/Linux Windows HPUXSolaris AIX Tru64

Data Center Applications

Big Data (Hadoop)

Private and Public Cloud

EC2 S3

Agents

Hive SqoopMapReduce HDFS

Historic and Predictive Analytics

VMware

CLIBrowser Based UI

Self-ServicePortal

Mobile App

JDBC

Adapter Host Framework

NEW for Cisco TES 6.1

Page 8: Cisco Tidal Enterprise Scheduler for Hadoop

© 2012 Cisco and/or its affiliates. All rights reserved. Cisco Public 8

Cisco Workload AutomationHolistic Approach for Hadoop Automation

Cisco Tidal Enterprise SchedulerAutomates & Manages Hadoop Workloads

Example: Product Sentiment Analysis

Twitter Feeds

Map Reduce

Hive

BI Analytics

SQL

Sqoop

Map Reduce

Map Reduce

Call logs

Web Clicks

Gather Data Data IntegrationLoad Data Data AnalysisReport Generation

and Distribution

Web ServicesSSHDB/JDBCERP/CRM

Data MoverSqoop

MapReduceInformatica

HiveSqoopInformatica

Business ObjectsCognosWeb Services

Page 9: Cisco Tidal Enterprise Scheduler for Hadoop

© 2012 Cisco and/or its affiliates. All rights reserved. Cisco Public 9

Cisco Big Data Value Proposition• Integrated solution

No other vendor can deliver this

• Cost effective with lowest TCODelivers maximum performance, predictably and reliably: Network, compute, management and automation

• Seamlessly integrates Data Center apps and Big Data appsCisco UCS B- and C-series compute

Fabric Interconnects

Nexus switches

End-to-end workload interconnectivity

Partner ecosystem

Page 10: Cisco Tidal Enterprise Scheduler for Hadoop

Thank you.