mice, elephants, turtles dimes & dollars hpc & big data · rackspace angry birds played...
Post on 21-May-2020
7 Views
Preview:
TRANSCRIPT
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Mice, Elephants, Turtles Dimes & Dollars HPC & Big Data Marc Hamilton
Hyperscale Business Unit
HP Enterprise Group
March, 2013
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 2
Big Data is Accelerating Innovation & Change
The Internet Client/Server
Mobile, Social, Big Data & The Cloud
Database
ERP
CRM
SCM
HCM
HCM
PLM
MRM
Amazon Web Services
OpSource
IBM
GoGrid
Rackspace
Joyent
Hosting.com Tata Communications
Datapipe
PPM
Alterian
Hyland
LimeLight NetDocuments
NetReach
OpenText
PaperHost
Xerox
HP
Microsoft SLI Systems
EMC
IntraLinks
Jive Software
Qvidian
Sage
salesforce.com
SugarCRM
Volusion
Xactly
Zoho
Adobe
Avid
Corel
Microsoft
Paint.NET
Serif
Yahoo
CyberShift
Saba
Softscape
Sonar6
Ariba
Yahoo!
Quadrem
Elemica
Kinaxis
CCC
DCC
SCM
Cost Management
Order Entry
Product Configurator
Bills of Material Engineering
Claim Processing
Inventory
Manufacturing Projects
Quality Control
Business
Education
Entertainment
Games
Lifestyle
Music
Navigation
News
Photo & Video
Productivity
Reference
Social Networking
Sport
Travel
Utilities
every 60 seconds
400,710 ads requests
2000 lyrics played on Tunewiki
1,500 pings sent on PingMe
34,597 people are using Zinio
208,333 minutes Angry Birds played
23,148 apps downloaded
Unisys
Burroughs
Hitachi
NEC Bull
Fijitsu
ADP VirtualEdge
Cornerstone onDemand
CyberShift
Workbrain
Kenexa Saba
Softscape
Sonar6
SuccessFactors
Taleo
Workday
Workscape
Exact Online
FinancialForce.com
Intacct NetSuite
SAP
NetSuite
Plex Systems
Cash Management
Accounts Receivable
Fixed Assets Costing
Billing
Time and Expense
Activity Management
Payroll
Training
Time & Attendance
Rostering Sales tracking &
Marketing
Commissions Service
Data Warehousing
347,000 tweets
Finance
box.net
TripIt
Zynga
Zynga
Baidu
Twitter Yammer
Atlassian
Atlassian
MobilieIron SmugMug
SmugMug
Atlassian
Amazon
Amazon iHandy
PingMe
PingMe
Associatedcontent
Flickr
Snapfish
YouTube
Answers.com
Tumblr.
Urban
Scribd.
Pandora
MobileFrame.com
Mixi
CYworld
Qzone
Renren
Yandex
Yandex
Heroku
RightScale
New Relic
AppFog
Bromium
Splunk
CloudSigma
cloudability
kaggle
nebula
Parse
ScaleXtreme
SolidFire
Zillabyte
dotCloud
BeyondCore
Mozy
Viber
Fring Toggl
MailChimp
Quickbooks
Hootsuite
Foursquare
buzzd
Dragon Diction eBay
SuperCam
UPS Mobile
Fed Ex Mobile
Scanner Pro
DocuSign
HP ePrint
iSchedule
Khan Academy
BrainPOP
myHomework
Cookie Doodle
Ah! Fasion Girl
Mainframe
• Change how technology is consumed & value it can bring
• Open up new business models
• Remove current inhibitors & unleash power of innovation
New technology access methods
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 3
Anywhere, anytime demand increases opportunities
Hyperscale to be 35% of x86 market
Customer demand for content
Device proliferation
Competitive edge
Driving the need for new and
purpose built products!
Hyperscale workloads growing significantly faster than overall market
Enterprise $28.0
Enterprise $26.0
SP, $2.8 SP, $4.2
Hosting, $2.4 Hosting, $3.3
HPC, $5.2 HPC, $6.4
$0.0
$5.0
$10.0
$15.0
$20.0
$25.0
$30.0
$35.0
$40.0
$45.0
2012 2015
27% 35%
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Mice, Elephants, and Turtles
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 5
Mice and Elephants
• The elephant in the room
• Not all big data comes from mouse clicks
• Hadoop becoming ubiquitous - good or bad? • Is storing 3 full copies of data really efficient or just
easy? • Are Hadoop management tools ready for the
enterprise?
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 6
Breaking The Application Triangle
• As more and more data is stored in HDFS, disruptive innovation becomes difficult – you can’t break the APIs
• So how can you drive disruptive innovation?
Vendors pursue
sustaining innovation
of 2-socket x86
systems for Hadoop
Users select widely
available platforms
to solve their
business problems
Hadoop originally
ran on commonly
available 2-socket
x86 systems
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 7
SSDs are Turtles
• SSDs usage with Hadoop growing
• Disk protocols too slow for SSD/Flash
• Better hardware is available (PCIeGen3, etc.)
• Flash nearing end of life just in time for new NVRAM
• Now its time to address the software bottlenecks
• HDFS on top, but what’s inside?
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 8
HP Insight Cluster Management Utility
8
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Dimes and Dollars
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 10
Are HPC compute nodes getting too powerful for big data use?
Dimes and Dollars
• Relative performance of mobile processors increasing quicker than
server processors
• Typical HPC compute node today, 300 watts, $300/year power
• Nvidia Tegra 5 mobile processor will be the size of a dime, run CUDA
and OpenGL apps
• 60 5-watt mobile processors = $300/year power
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 11
1.5 1.7
4.9
10.5 11.2 11.9 15.7 17.2 18.2
22.2 23.1 25.0 25.4 26.8 29.3
73.0
0.1
1.0
10.0
100.0
Rel
ativ
e p
erfo
ram
ance
(H
igh
er is
bet
ter)
Relative Performance Good Xeon performance ratios
Good ARM /Atom performance ratios
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 12
0.16
0.43
0.66 0.70
1.02
2.50 3.20
4.39
12.00
29.92
0.10
1.00
10.00
100.00R
elat
ive
per
form
ance
/wat
t (h
igh
er is
be
tter
) Relative Performance per Watt
Good ARM /Atom performance/ watt ratios
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 13
1.15 1.25
2.63 2.98 3.14 3.20 3.44 4.44 4.55 4.63 5.08 5.56
8.93 12.16
0.01
0.10
1.00
10.00
Rel
ativ
e p
erfo
rman
ce (
hig
her
is b
ette
r)
2H’13 HP Projections: big leap in mobile performance
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
HP Project Moonshot
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 15
Project Moonshot: A new era of extreme scale computing
Project Moonshot
• 1,000s of servers per rack
• Workload - tuned servers
• Federated infrastructure scales seamlessly with additional servers
Application-driven designs
Space Energy Costs
Redefining server infrastructure for rapid application optimization
Device agnostic architecture scales from extreme low energy CPUs to high performance GPGPUs
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 16
DOE’s National Renewable Energy Lab purchases $10M HP Supercomputer
Supercomputers That Reuse Energy?
- New ProLiant server platform will delivery 1 Pflop of Intel IvyBridge and Xeon Phi
- http://www.nrel.gov/news/press/2012/1985.html
- Power and warm water cooling system co-designed to work with NREL’s new $100M Energy Systems Integration Facility (pictured below)
- Waste heat used to
heat office space & melt
snow in winter
16
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 17
200 TF Linpack – Feb 27, 2013
National Renewable Energy Lab
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 18
Expanding the purpose-built portfolio for big data
SL250 SL270 SL230 Big Data
Accelerators
High-end nodes
Solutions
ProLiant SL Core
Customer specific
High-efficiency
computing
SL2500
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Thank you
top related