data Сenter design&deploy forum - cisco€¦ · • Активность в...

2016 | Москва

Data СenterDesign&Deploy Forum

Data Сenter Design&Deploy Forum 2016 | Moscow

Кукса Юрий

Технический архитектор решений, Cisco Data Center EMEAR

Инфраструктура под большие данные и аналитику


• Большие данные и аналитика – цели и задачи, история охоты за австралийским долларом

• Инфраструктурные решения Cisco – BiModal IT для разных аналитик

• От лабораторного Hadoop до платформы промышленного внедрения.

Agenda


277x data created by IoE devices vs. end users – source: 2014 Cisco® Global Cloud Index

By 2020, there will be 5200 GB of data for every person on earth – source: 2012 Digital Universe Study conducted by IDC and sponsored by EMC (see:

http://www.computerworld.com/article/2493701/data-center/by-2020--there-will-be-5-200-gb-of-data-for-every-person-on-earth.html)

180 billion mobile app downloads by 2015 – source: 2011 IDC Study: https://www.smaato.com/blog-180billiondownloads/

277XData created

by IoE devices

vs. end-user

30MNew devices

connected

every week

180BMobile apps

downloaded

in 2015

40%Of all data will

come from

sensor

data by 2020

5TB+of data

per person

by 2020

4.2BWeb filtering

blocks per day

Цифровизация и интернет вещей меняет мир.Лавина данных !

DISRUPTION

http://www.computerworld.com/article/2493701/data-center/by-2020--there-will-be-5-200-gb-of-data-for-every-person-on-earth.html

https://www.smaato.com/blog-180billiondownloads/


Всяких разных данных .

Traditional Data

Warehouse Big Data Store

Structured Data Unstructured and Big Data Data Streaming at the Edge

Real TimeMake a Decision NOW

Short and Long Term “Rear

View Mirror”Plan for a Business Decision Today

Collect lots of data - Optimized Analysis/Compliance


Зачем эти данные собирать и хранить ?


Зачем эти данные собирать и хранить ?

А еще, если хотите, чтобы ваш

товар/услуга продавались лучше ваших

конкурентов, нажмите эту кнопку !


Весь континент – “сафари” на потребителя

Добыча – австралийские доллары

Охотник-Woolworths и…

Ограничение: методы отъема

денег только законные


В арсенале охотника

• Данные - IN-STORE

• Данные – OUTSIDE-of-STORE

• Просмотр кабельного

• Активность в социальных сетях

• Транзакционная активность

• Данные полностью анонимные (Privacy)

Без помощников не обошлось


Фокус на помощниках

- Признанный лидер в технологии Hadoop

- Имеет собственный MapR Distribution for

Hadoop

- В своей MapR Converged Data Platform

смогли объединить мощь Hadoop / Spark в

хранении и процессинге данных с

открытостью данных по известным

протоколам (NFS)

- Валидирует решения с Cisco

- Лидирует с Cisco


Почему MapR выбирает Cisco ?


Hadoop Deployment Issues

• “More than 30% of all support tickets (for Hadoop) are related to mis-configuration”

• …Customers deploying Hadoop clusters are riddled with the complexity of deployment and manageability of Hadoop clusters at scale

• 25% of big data implementations will fail to deliver business value resulting from performance problems due to inadequate network infrastructure.

• To make it worse, latent issues with incorrect configuration can impact application and business performance


Проверенные, документированные решения с

ISV

Бандлы, оптимизированные под

производительность и емкость – снижение

рисков и совокупной стоимости владения

Масштаб

Унифицированное управление.

Простота {design, order, deploy, service}

Networking

Cisco UCS-II for Big Data3-е поколение Cisco UCS Common Platform Architecture

Single SKU

Big Data

Bundles UCS 6200 SeriesFabric Interconnects

LAN, SAN, Management

UCS C220/C240 M4 Servers

UCS C3160


Cisco – лидер в инфраструктурах, оптимизированных для больших данных

Industry's best TPCx-HS

performance in ALL

categories

External Benchmarks

Key performance indicators

for Cisco UCS Integrated

Infrastructure for Big Data

IDC A Leader in Hadoop

Optimized Systems -

Forrester

Forrester

Better Cheaper

1TB 11% 30%

3TB 14% 10%

10TB 28% 3%

30TB 12% 33%

100TB The Best – No

comparison


Много преимуществ, однако в нашем случае MapR и Quantium решающим оказалось:

- Партнерство с MapR

- Производительность UCS-II

- Управляемость – UCS Manager

У нас есть еще истории – читайте

периодику UnleashingIT.com/MapR

UnleashingIT.com/BigData


Аналитика – это не только Hadoop :-)

1. “Быстрая” : Аналитика передового фронта бизнеса в потоке актуальных

данных. MBs/GBs.

2. “Традиционная”: Штабная аналитика с транзакционной БД в центре,

выгрузка в хранилище (ETL ). 10s TB

3. “Big Data” – Штабная аналитика, комбинирующая данные с разных

источников, используя такие технологии, как Hadoop и NoSQL. 100s TBs

или даже PBs.

Все 3 будут будут дополнять друг друга.

Cisco’s Vision – архитектурная поддержка всех 3-х, упрощение

посредством общей инфраструктуры, управления, минимизации

переносов данных (co-location)

16


Строительные блоки Big Data & Analytics

Data Management

DataIntegration

Analytics/Business Intelligence

Cisco IntegratedInfrastructure

Cisco Connected Analytics

Collaboration

Analytics

Contact Center

Analytics

Location

Analytics

Network

Analytics

Data

Preparation

TS

, A

S a

nd

CC

S

Analytics Ready Infrastructure

IT Operations IT Security Business Analytics

Networking Security

*Resell agreements

In-Memory MPP/NoSQL

Servers & Storage

ETL

Management

Data

Virtualization

*

*

*

Assess

Edge Analytics/Streaming

Company Confidential - For Internal Use Only

Copyright © 2016, SAS Insti tute Inc. Al l r ights reserved.

“Bi-Modal IT” инфраструктура, Gartner

• POD #1 ‘Scale-Out’

• POD #2 “Old School’

• ACI Fabric

• UCS Director

POD#1 И POD#2:CONNECTED & “PLATFORMED”

HW, SW,

API

UCS Director

Programmability, Scalability and

AutomationFast and slow. Risky and safe. The Data Center and I&O must function in multiple modes—at varying speeds—to deliver what the enterprise

needs and wants. Rock solid service delivery. Costs that make sense. All combined with the ability to see and seize opportunities as they

arise. As an agile leader charged with moving the business forward, you must seize the power of technologies, deployment models and

processes. You must apply principles of collaboration. And you must strategically redesign the Data Center and I&O for a future of “what if”

possibilities… From Oncoming Gartner Data Center, Infrastructure & Operations Management Event Candidate Summary 16.05.2016

Data Сenter Design&Deploy Forum 2016 | Moscow••

http://www.cisco.com/c/en/us/td/docs/unified_computing/ucs/UCS_CVDs/ucsii_saphana_mapr.html

Data Сenter Design&Deploy Forum 2016 | Moscow••

http://www.cisco.com/c/en/us/td/docs/unified_computing/ucs/UCS_CVDs/Cisco_UCS_Integrated_Infrastructure_for_Big_Data_with_SAP_HANA_Vora.html


DESIGNSBig Data

Cisco Validated Designs for all major big data software distributions can be found at:

www.cisco.com/go/bigdata

Cisco Validated Design – MapR, Cloudera, Hortonworks, Splunk, IBM,…http://www.cisco.com/c/en/us/solutions/enterprise/data-center-designs-cloud-computing/bigdata.html

http://www.cisco.com/go/bigdata

Company Confidential - For Internal Use Only

Copyright © 2016, SAS Insti tute Inc. Al l r ights reserved.

“Bi-Modal IT” инфраструктура, Gartner

• POD #1 ‘Scale-Out’

• POD #2 “Old School’

• ACI Fabric

• UCS Director

POD#1 И POD#2:CONNECTED & “PLATFORMED”

HW, SW,

API

UCS Director

Programmability, Scalability and

AutomationFast and slow. Risky and safe. The Data Center and I&O must function in multiple modes—at varying speeds—to deliver what the enterprise

needs and wants. Rock solid service delivery. Costs that make sense. All combined with the ability to see and seize opportunities as they

arise. As an agile leader charged with moving the business forward, you must seize the power of technologies, deployment models and

processes. You must apply principles of collaboration. And you must strategically redesign the Data Center and I&O for a future of “what if”

possibilities… From Oncoming Gartner Data Center, Infrastructure & Operations Management Event Candidate Summary 16.05.2016


UCSD Express

UCS 6200 Series

Fabric Interconnect

UCS Manager

UCS C240 M3/M4

Series Rack Server

OS Profile

RHEL 6.5NTPDNS

ClustershellUlimit

SwappinessT.HugePage

FirewallSElinux

Hadoop

Profile

HDFS CLDBYARN

ZooKeeperHbaseHive

OozieHue

SparkSolr

SqoopImpalaFlumeFalcon

TezStorm

Cisco UCS

Service Profile

NIC MACs

HBA WWNs

Server UUID

VLAN Assignments

VLAN Tagging

FC Fabrics

Assignments

FC Boot

Parameters

Number of vNICs

Boot order

PXE settings

IPMI Settings

Number of vHBAs

QoS

Call Home

Template

Association

Org & Sub Org

Assoc.

Server Pool

Association

Statistic

Thresholds

BIOS scrub actions

Disk scrub actions

BIOS firmware

Adapter firmware

BMC firmware

RAID settings

Advanced NIC

settings

Serial over LAN

settings

BIOS Settings

Hadoop

Собираем платформу для Hadoop Programmability, Scalability and Automation

Спасибо!

Кукса Юрий, Технический архитектор решений, Cisco Data Center EMEAR

data Сenter design&deploy forum - cisco€¦ · • Активность в...

Documents