fujitsu computer systems confidential rpi rpi the relative performance index what is it? mark...
TRANSCRIPT
Fujitsu Computer Systems Confidential
RPIRPI
The Relative Performance Index
What is it?
Mark Simmons, B.Sc(Hons), DIS, MBCSChief Systems Architect
Fujitsu Computer Systems
PAGE 2 Fujitsu Computer Systems Confidential
Contents
Definition of RPI and Standard Benchmarks RPI and OLTP TPM Standard benchmark results Standard benchmark relevance Benchmark activities in Linux
RPI Load Categorization Benchmark Profiles Application Profiles RPI Values
What is being Benchmarked on a Benchmark Benchmark Categories Testing Ranges
Fujitsu’s TPM Number vs. TPC-C RPI Tool Demonstration Application Services AS Tool Demonstration
PAGE 3 Fujitsu Computer Systems Confidential
RPI and Standard Benchmarks
RPI and OLTP TPM are :-
Internal use only
Attempting to level set the server “playing field”
Designed for system positioning and accurate system sizing
First based on estimates, later adjustments are made if necessary
Also provided for competitive/competitors products, though these
are harder to verify fully
PAGE 4 Fujitsu Computer Systems Confidential
RPI and Standard Benchmarks
Standard benchmark results are usually for:-
Sales and marketing, and for public awareness
Analysts, press and media
Designed for customer confidence
Values are available on public domain web pages
Underlines validity of internal sizing figures
Referenced under diverse Web Pages such as those at:-
http://www.spec.org and http://www.tpc.org
and diverse web pages of the analyst community
PAGE 5 Fujitsu Computer Systems Confidential
SAP SD/ATO/etc
Oracle’sOASB
TPC-H
SPECint_rate2000
TPC-C
SPECjApps2002
SPECfp_rate2000
SPECweb99
SPECjbb2000
HW
OS
DB
J2EE
APPL
Testing Focus
Basic Performance Relevance
CommercialBusiness Relevance
Standard Benchmarks - Relevance and test focus
PAGE 6 Fujitsu Computer Systems Confidential
SPEC CPU2000 (total 180)
SPECweb 99+SSL (total 11)
SPECjbb 2000 (total 25)
TPC-C (total 22)
TPC-H (total 19)
SAP SD (total 27)
Oracle’s OASB (total 20)
HP
Ita2 / PA
22 / 18
2 / 5
6 / 4
5 / 1
2 / -
3 / 1
3** / - **4-way
NEC
Itanium2
4
-
1
2
-
4
-
Unisys
Xeon/Ita2
5 / 3
- / -
1 / -
4 / 2
- / 1
2 / -
- / -
IBM
Xeon/Pw4
2 / 8
- / 1
1 / 2
4 / 3
5 / 1
3 / 1
3 / 2
Sun
USparc
28
-
2
-
2
3
3
FJ / FSC*
Sparc64
24
2*
8
1
2*
4*
1*
Benchmark Activities of major vendors ( >=8 CPU Cores; Jan 03=>Feb04) Quantity
PAGE 7 Fujitsu Computer Systems Confidential
SPEC int/fp 2000
Application and Benchmark Kit
Operating system, Compiler, Libraries
CPU Cache MemoryMulti-CPU
Disk-IO
DBMS LAN
SPEC int/fp 2000 Rate
SPECweb99
TPC-C
TPC-H, TPC-R
SAP
Oracle Applications
CPU
CPUs
Webserver
OLTP
DSS
ERP
ERPBen
chm
ark
Cat
ego
ry
Testing Range
SPECjbb2000Java VM
What is being Benchmarked when performing a Benchmark?
PAGE 8 Fujitsu Computer Systems Confidential
CPU Centric I/O Centric
SPEC OLTP TPC-C/H
no system callslittle disk I/Oone/few processes
well-balancedsystem load
simple - medium transactions• high number of operations• simple- medium operations• short response time• heavy use of physical I/O
SPECint92/95/2000SPECrate_int92/95/2000
tpsA SAP tpsB Oracle AppstpmC
RPI - Load Categorization
RPI MEANRPI CPU RPI TP+I/O
RPI Tool Category to use for sizing
Application Profile
Benchmark Profile
Work Type
PAGE 9 Fujitsu Computer Systems Confidential
Fujitsu‘s measurement for OLTP performance (throughput of transactions
per minute) in commercial environments is:-
based on an Oracle 9i(not RAC) database profile
available for all vendors current systems and all configurations
provides similar load characteristics as TPC-C and its tpmC results
is not standardized, other competitors use similar absolutes or
relative (e.g. mvalues (Sun) / rPERF (IBM) ) figures and the related database
is not defined
TPC’s rules strongly restrict the usage of those proprietary values:
only with signed Non Disclosure Agreement(NDA)
not in public disclosures
no comparisons with published tpmC figures
Fujitsu’s Transactions Per MinuteRPI TPM vs. TPC-C / tpmC
PAGE 10 Fujitsu Computer Systems Confidential
RPI Tool Demonstration
PAGE 11 Fujitsu Computer Systems Confidential
RPI as a metric is not as easily applicable to the LINUX space as it is in
the proprietary Unix space because:-
IA-32 is totally commoditized
There is massive diversity in IA platforms
Plethora of product offerings with very few constants
I/O bandwidth delivery is highly variable
Linux Kernels are generic in nature
Systems running IA32/Linux differ widely in performance delivery
Linux typically degrades faster than other Unix variants in scalability
the heavier the load that is placed upon it
Its “Heavy Lifting” capability is not yet mature !
RPI – The Disadvantage
PAGE 12 Fujitsu Computer Systems Confidential
The Solution is an “Application Level Service”
Application Service is an abstract concept of an “Application Unit of Work” that must:- Concurrently support multiple Linux application processes:
Oracle SAP Directory Services Web Services
Monitor the quality of each application service and automatically adjusts capacity to meet business’s service level goals.
Operate autonomously, with little or no intervention Make Linux based hard- and software resources shift
automatically to meet changing demand. Allow dynamic capacity scaling – mitigating impact of
disparate hardware Offer users a self-management capability to assist in the
administration of dramatically varying environments.
PAGE 13 Fujitsu Computer Systems Confidential
Application Services:Administrative Features
Users must be able to specify application service priorities. Administrators should be able to change priorities dynamically,
redirecting a higher service level toward other applications as business requirements change.
Users must be able to Set min-max ranges or high/low water marks Directly influence the number of instances of an application that
are available for use. Users can define Quality of Service (QoS) metrics based upon:
CPU load Network load.
Application Services must automatically distribute the load using user-selected algorithms. Provide load balancing algorithms Balance servers for a given application Balance across all servers in total.
PAGE 14 Fujitsu Computer Systems Confidential
Application Services:Operational Features
Dynamically provisions servers with the resources necessary to support applications such as:
Dynamically adjusting the number of online application instances.
Meeting defined Quality of Service (QoS) service levels.
Provision applications and operating systems or both Automatically bring servers online for extra application support
Re-provision servers used by lower-priority applications.
Provision net-new servers that are added to the pool Takes excess systems offline if service levels are being met.
Reduce license charges (must be negotiated with ISV!)
Leaves offline servers in “warm” state
Reduce the time to re-provision the server for same applications
Reduce the time to re-provision for same operating system
PAGE 15 Fujitsu Computer Systems Confidential
Application Services:Customer Benefits
Lowers total cost of ownership Server consolidation alone can reduce hardware and software costs Reduces the need to over-spec server capacity Improved utilization decreases costs and increases ROI
Improves productivity Automated solution reduces manual administration Time spent in training Correcting human errors. Load balancing can optimize QoS Service level monitoring and capacity provisioning to meet needs
as workloads change. Improved application response times
Improves application availability Continuous availability of application services avoids costly
downtime
PAGE 16 Fujitsu Computer Systems Confidential
Application Services Tool Demonstration