hello from paris openstack summit - files.meetup.comfiles.meetup.com/8910652/dell_red hat meetup...

24
1 Hello from Paris OpenStack Summit November 2014 Paul Brook @ PaulBrookAtDell [email protected] + 44 (0) 7802 595 331

Upload: others

Post on 31-Aug-2019

2 views

Category:

Documents


0 download

TRANSCRIPT

1

Hello from Paris

OpenStack Summit November 2014

Paul Brook

@ PaulBrookAtDell

[email protected]

+ 44 (0) 7802 595 331

Mastering Private Clouds and Big Data

+44 (0) 7802 595 331

@paulbrookatdell

[email protected]

Agenda

3

Big Data Hype

Introduction: An advertisement from Dell

Questions

Big Data - CEPH

Options & Business Example

4

4

Dell Red Hat Cloud Solutions

OpenStack – NOW open for business

5

Dell OpenStack Private Cloud Solutions Accelerating the on-ramp to Open Private Cloud

Dell OpenStack Reference Architectures

Comprehensive and flexible

architecture optimized for

OpenStack evaluations and

deployments

Complete end-to-end solution

Hardware, software,

services, and support for an

end-to-end solution strategy

leveraging open source and

partner technologies where

appropriate

OpenStack Community Leadership

Whitepapers, speaking

sessions, webinars, summit

sponsorships, OpenStack

meetups in Boston, Austin,

India, and Ireland,

membership in OpenStack

foundation board

Partnership with the enterprise Linux leader

Red Hat Enterprise Linux OpenStack Platform, combing Red Hat Enterprise Linux, and the latest OpenStack release

Proven at Scale: OpenStack cloud technology has been used to deploy and maintain some of the industry’s largest clouds.

Launch cloud services rapidly Validated hardware, software and services bundles to get you started quickly

Open for Business: Dell success in enterprise hardware combined with Red Hat’s success in Enterprise software create trusted solutions

Big Data Hype

Domains

Websites

E-mail Source: Qmee July 2013, http://blog.qmee.com/qmee-nlinein-60-seconds/

Every minute of every day…

THOUSANDposts every

second

Options

10

Big Data – Architecture for the Internet generation

Traditional Analytics Architecture • High Availability (Clustering, DR…) • Standard Database • Business Intelligence, Data Warehousing • Structured Data

Hadoop Analytics Architecture • High scalability • Hybrid Server (compute and

storage in the same box) • Semi-structured and unstructured

data

Dell x86 PowerEdge Servers

Ethernet Switch

App Servers

Network Switch

SAN Switch

Storage Array

Database

11

High Performance Compute Clusters • Parallel File System

• High throughput • All nodes can access all data • Compute-centric workloads

Hadoop Cluster Architecture • Distributed File System

• Global namespace (ingest!) • Nodes just work on local data • Data/IO-centric workloads

Task/Job Distribution

Data Access (e.g. Infiniband)

Task/Job Distribution

Data Access (local!)

Hadoop Infrastructure vs. HPC Clusters Two Forms of Distributed Computing

12

Dell’s “How to” with Hadoop

• Reference Architecture - Pre-Tested and Sized

• Dell “How To” guides

• Dell Software Group: Shareplex /Statsoft and more

13

Cognitive

analytics

“Who are my top customers?”

“Which are my top performing sales regions?”

“How are we performing against the organizational goals?”

“What is the optimal inventory based on historical trend?

“Would they recommend us to a friend?”

Inc

reasi

ng

matu

rity

Build analytics capabilities to extract insights from all data types

Business reporting and analysis

Data integration and consolidation

Data collection and basic analysis

Predictive analytics

14 Dell - Internal Use - Confidential

Comprehensive solutions enable your success

Services: IT/business alignment, infrastructure readiness, analytics maturity, metrics

Infrastructure

Put the right data in the right

place at the right time

Management

Improve data platform

performance

Integration

Get real-time data movement

Turn data into insights for

better, faster decisions

Advanced analytics & BI

Partners and platforms: Hadoop, Intel, Cloudera, Oracle, Microsoft, SAP, and more

Storage, Servers, Networking

Hadoop,

Toad

Boomi Statistica, Toad Data

Point, Kitenga

Business Example: (Bit of Fun)

16

Big Data-Big Insights- Business Example

Bottom of the Bill

Headline acts

17

Big Data-Big Insights- Business Example Today

Bottom of the Bill

Headline acts

CEPH Example: Research Data: Beta Slides

19

Concept: Get started?

Research Data & Publications

20

Concept: Get started?

Research Data & Publications

How tag metadata?

How long to store?

File types to store?

How Search?

Data Security?

How Collaborate?

21

Holding a tin cup below a Niagara Falls of data

Data keeps on coming &……. ..coming……& coming………..

Has anyone else had this problem and already solved it. ?

Open Source is best protection/longevity. “Web 2.0/Social has already solved scale-storage problem”

22

Solve problems one at a time

OpenStack Layer (Access)

CEPH Storage

Identity Management

Governance

Policy & Control

PUBLISH:

Existing Publishing

routes

23

Solve problems one at a time

OpenStack Layer (Access)

CEPH Storage

Identity Management

Governance

Policy & Control

PUBLISH:

Existing Publishing

routes

Start Here

.

May we help you make data the lifeblood of your organization?

25