hello from paris openstack summit - files.meetup.comfiles.meetup.com/8910652/dell_red hat meetup...
TRANSCRIPT
1
Hello from Paris
OpenStack Summit November 2014
Paul Brook
@ PaulBrookAtDell
+ 44 (0) 7802 595 331
Agenda
3
Big Data Hype
Introduction: An advertisement from Dell
Questions
Big Data - CEPH
Options & Business Example
5
Dell OpenStack Private Cloud Solutions Accelerating the on-ramp to Open Private Cloud
Dell OpenStack Reference Architectures
Comprehensive and flexible
architecture optimized for
OpenStack evaluations and
deployments
Complete end-to-end solution
Hardware, software,
services, and support for an
end-to-end solution strategy
leveraging open source and
partner technologies where
appropriate
OpenStack Community Leadership
Whitepapers, speaking
sessions, webinars, summit
sponsorships, OpenStack
meetups in Boston, Austin,
India, and Ireland,
membership in OpenStack
foundation board
Partnership with the enterprise Linux leader
Red Hat Enterprise Linux OpenStack Platform, combing Red Hat Enterprise Linux, and the latest OpenStack release
Proven at Scale: OpenStack cloud technology has been used to deploy and maintain some of the industry’s largest clouds.
Launch cloud services rapidly Validated hardware, software and services bundles to get you started quickly
Open for Business: Dell success in enterprise hardware combined with Red Hat’s success in Enterprise software create trusted solutions
Domains
Websites
E-mail Source: Qmee July 2013, http://blog.qmee.com/qmee-nlinein-60-seconds/
Every minute of every day…
THOUSANDposts every
second
10
Big Data – Architecture for the Internet generation
Traditional Analytics Architecture • High Availability (Clustering, DR…) • Standard Database • Business Intelligence, Data Warehousing • Structured Data
Hadoop Analytics Architecture • High scalability • Hybrid Server (compute and
storage in the same box) • Semi-structured and unstructured
data
Dell x86 PowerEdge Servers
Ethernet Switch
App Servers
Network Switch
SAN Switch
Storage Array
Database
11
High Performance Compute Clusters • Parallel File System
• High throughput • All nodes can access all data • Compute-centric workloads
Hadoop Cluster Architecture • Distributed File System
• Global namespace (ingest!) • Nodes just work on local data • Data/IO-centric workloads
Task/Job Distribution
Data Access (e.g. Infiniband)
Task/Job Distribution
Data Access (local!)
Hadoop Infrastructure vs. HPC Clusters Two Forms of Distributed Computing
12
Dell’s “How to” with Hadoop
• Reference Architecture - Pre-Tested and Sized
• Dell “How To” guides
• Dell Software Group: Shareplex /Statsoft and more
13
Cognitive
analytics
“Who are my top customers?”
“Which are my top performing sales regions?”
“How are we performing against the organizational goals?”
“What is the optimal inventory based on historical trend?
“Would they recommend us to a friend?”
Inc
reasi
ng
matu
rity
Build analytics capabilities to extract insights from all data types
Business reporting and analysis
Data integration and consolidation
Data collection and basic analysis
Predictive analytics
14 Dell - Internal Use - Confidential
Comprehensive solutions enable your success
Services: IT/business alignment, infrastructure readiness, analytics maturity, metrics
Infrastructure
Put the right data in the right
place at the right time
Management
Improve data platform
performance
Integration
Get real-time data movement
Turn data into insights for
better, faster decisions
Advanced analytics & BI
Partners and platforms: Hadoop, Intel, Cloudera, Oracle, Microsoft, SAP, and more
Storage, Servers, Networking
Hadoop,
Toad
Boomi Statistica, Toad Data
Point, Kitenga
20
Concept: Get started?
Research Data & Publications
How tag metadata?
How long to store?
File types to store?
How Search?
Data Security?
How Collaborate?
21
Holding a tin cup below a Niagara Falls of data
Data keeps on coming &……. ..coming……& coming………..
Has anyone else had this problem and already solved it. ?
Open Source is best protection/longevity. “Web 2.0/Social has already solved scale-storage problem”
22
Solve problems one at a time
OpenStack Layer (Access)
CEPH Storage
Identity Management
Governance
Policy & Control
PUBLISH:
Existing Publishing
routes
23
Solve problems one at a time
OpenStack Layer (Access)
CEPH Storage
Identity Management
Governance
Policy & Control
PUBLISH:
Existing Publishing
routes
Start Here