hpe operations orchestration... · l documentreleasedate ... advanced context flow 200 large...

HPE Operations Orchestration Software Version: 10.70

Windows and Linux Operating Systems

Benchmark Performance Guide

Document Release Date: December 2016 Software Release Date: December 2016


of 20

HPE Operations Orchestration (10.70)

Legal Notices

Warranty The only warranties for Hewlett Packard Enterprise products and services are set forth in the express warranty statements accompanying such products

and services. Nothing herein should be construed as constituting an additional warranty. Hewlett Packard Enterprise shall not be liable for technical or

editorial errors or omissions contained herein.

The information contained herein is subject to change without notice.

Restricted Rights Legend Confidential computer software. Valid license from Hewlett Packard Enterprise required for possession, use or copying. Consistent with FAR 12.211 and

12.212, Commercial Computer Software, Computer Software Documentation, and Technical Data for Commercial Items are licensed to the U.S.

Government under vendor's standard commercial license.

Copyright Notice © Copyright 2016 Hewlett Packard Enterprise Development LP

Trademark Notices Adobe™ is a trademark of Adobe Systems Incorporated.

Microsoft® and Windows® are U.S. registered trademarks of Microsoft

Corporation. UNIX® is a registered trademark of The Open Group.

This product includes an interface of the 'zlib' general purpose compression library, which is Copyright © 1995-2002 Jean-loup Gailly and Mark Adler.

Documentation Updates The title page of this document contains the following identifying information:

l Software Version number, which indicates the software version.

l Document Release Date, which changes each time the document is updated.

l Software Release Date, which indicates the release date of this version of the software.

To check for recent updates or to verify that you are using the most recent edition of a document, go to: https://softwaresupport.hp.com/.

This site requires that you register for an HP Passport and to sign in. To register for an HP Passport ID, click Register on the HP Software Support site or click

Create an Account on the HP Passport login page.

You will also receive updated or new editions if you subscribe to the appropriate product support service. Contact your HPE sales representative for details

https://softwaresupport.hp.com/


of 20


Support Visit the HP Software Support site at: https://softwaresupport.hp.com.

This website provides contact information and details about the products, services, and support that HP Software offers.

HP Software online support provides customer self-solve capabilities. It provides a fast and efficient way to access interactive technical support tools needed to

manage your business. As a valued support customer, you can benefit by using the support website to:

Search for knowledge documents of interest

Submit and track support cases and enhancement requests

Download software patches

Manage support contracts

Look up HP support contacts

Review information about available services

Enter into discussions with other software customers

Research and register for software training

Most of the support areas require that you register as an HP Passport user and to sign in. Many also require a support contract. To register for an HP Passport ID, click

Register on the HP Support site or click Create an Account on the HP Passport login page.

To find more information about access levels, go to: https://softwaresupport.hp.com/web/softwaresupport/access-levels.

HP Software Solutions Now accesses the HPSW Solution and Integration Portal website. This site enables you to explore HP Product Solutions to meet your

business needs, includes a full list of Integrations between HP Products, as well as a listing of ITIL Processes. The URL for this website is

http://h20230.www2.hp.com/sc/solutions/index.jsp.

https://softwaresupport.hp.com/

https://softwaresupport.hp.com/web/softwaresupport/access-levels

http://h20230.www2.hp.com/sc/solutions/index.jsp


of 20


Table of Contents Legal Notices ........................................................................ 2

Warranty ...................................................................................................... 2

Restricted Rights Legend ............................................................................. 2

Copyright Notice .......................................................................................... 2

Trademark Notices ...................................................................................... 2

Documentation Updates ....................................................... 2

Support ................................................................................. 3

Table of Contents ................................................................. 4

Introduction ........................................................................... 5

Objectives ............................................................................. 5

Setup..................................................................................... 5

Tools ............................................................................................................ 6

Throughput Flows ......................................................................................... 6

Single Flow Performance Flows ................................................................. 12

Scenario .............................................................................. 16

Throughput ................................................................................................. 16

Single Flow Performance............................................................................ 17

Comparison ......................................................................... 18

Throughput ................................................................................................. 18

Single Flow Performance............................................................................ 19

Recommendations for Environment Tuning ......................... 20


of 20


Introduction

This document provides an overview of the HPE Operations Orchestration version 10.70

performance.

The following results are described in more detail throughout this document:

HPE OO 10.70 overall execution throughput in comparison with HPE OO 10.60.

HPE OO 10.70 single flow performance in comparison with HPE OO 10.60.

HPE Operations Orchestration version 10.70 performance shows improvment results to HPE OO

10.60.

Objectives

This document details the performance tests made in HPE Operations Orchestration 10.70 using

flow/step execution throughput (steps/time). This includes:

HPE OO throughput in several environments:

o Low cost FOSS (Free and Open-Source Software) operating system

o High cost non-FOSS environments

o Oracle-based environments

o Clustered and stand-alone environments

Single flow performance results of various scenarios comparing HPE OO 10.70 to HPE OO

10.60.

Basic tuning was applied to the environments described in this document. These configurations are

described in Recommendations for Environment Tuning.

Setup

This section describes the different benchmark tests in this document, including:

Environment-related details

Tools that were used

Flows that were triggered and the flow distribution

Results that were achieved, which showcase:

o Throughput

o Single flow performance


of 20


Environment

The following table describes the hardware and software components used for the benchmark

tests:

Model Processors Memory Storage Network Notes

Server ProLiant BL460c G7 12 core

2667Mhz

16 GB Local 1 GB Windows 2012/RHEL

6.3

Database ProLiant DL380 G7 12 core

2933Mhz

32 GB DAS 1 GB RHEL 6.3 - Oracle

Tools

The following tools were used to produce this benchmark:

HPE LoadRunner 11.52

HPE SiteScope 11.20

Throughput Flows

This section describes the flows that were used during the benchmark throughput tests.

These flows were designed to emphasize the different functionality aspects of HPE OO and to load

test the different resources of the system (CPU, memory, and so on). By running a combination of

all of these flows, we tried to simulate a heterogeneous customer environment.

Note: The purpose of these flows was to load HPE OO as a platform, and not to perform any

actual work, as the goal of the benchmark is to verify the performance of HPE OO as a platform

and not to verify the performance of the HPE OO content.


of 20


Large Context Flow

This flow receives a 4 MB context and has 103 steps.

Short Flow

This flow uses “Generate Data” operation and has 2 steps.


of 20


Medium Flow

This flow uses the “Generate Data” operation and has 102 steps.

Long Flow



of 20


Multi-Instance Flow

This flow contains a multi-instance implementation of the UUID generator and runs with 300 lanes

per flow.

Subflow

This flow runs an instance of a medium-sized flow as a subflow.


of 20


Parallel Flow

This flow runs 55 lanes of parallel split (only part of the flow can be seen in the following image).


of 20

Advanced Flow

This flow was designed to mimic consecutive calls of multiple short and medium sized subflows

from within a parent flow, while passing data from the parent flow to the subflow and vice-versa.

Advanced Context Flow

This flow was designed to mimic consecutive calls of multiple short and medium sized subflows

from within a parent flow, while passing a large amount of data from the parent flow to the

subflow and vice-versa. 4500 ASCII chars are used and passed from inputs to outputs, primary

results and raw results. This flow uses scriptlets and filters.



of 20

Single Flow Performance Flows

In order to achieve more precise results, we chose to create flows with long execution times.This

section describes the flows that were used during the benchmark for single flow performance

tests.

Large MI Flow

This flow loops 25 times and uses two multi-instance steps, each of which has 50 instance steps.

Parallel Flow

This flow loops 50 lanes of a parallel split step 20 times (only part of the flow can be seen in the

following image).



of 20

Subflows Level10

This flow loops 25 times, and each iteration contains 10 levels of subflows.

Large Sequential Flow

This flow loops 10,000 times and uses the “Do Nothing” operation.

Large Context Flow

This flow loops 150 times, and uses the “List Appender” operation, that creates a large context

variable



of 20

Advanced Flow This flow was designed to mimic consecutive calls of multiple short and medium sized subflows from within a parent flow, while passing data from the parent flow to the subflow and vice-versa.

Long Flow




of 20

Advanced Context Flow This flow was designed to mimic consecutive calls of multiple short and medium sized sub-flows from within a parent flow, while passing a large amount of data from the parent flow to the sub-flow and vice-versa. 4500 ASCII chars are used and passed from inputs to outputs, primary results and raw results. This flow uses scriptlets and filters.



of 20

Scenario

This section describes the scenario used for the benchmark:

The workload was generated using HPE LoadRunner.

The flow triggering was done using HPE OO REST API calls.

We used HPE SiteScope integration with LoadRunner to monitor the different parts of the

system during the tests, including JMX monitors for the JVM monitors (memory, garbage

collection).

Throughput

The flow distribution was as follows:

Flow Type Number Of Flows per Type

Advanced Flow 1800

Medium Flow 1000

Parallel Flow, Short Flow, Sub Flow, Multi-Instance Flow 480

Advanced Context Flow 200

Large Context, Long Flow 40

And the amount of steps per flow-type at runtime:

Flow Type Number Of Steps per Flow Type at Runtime

Advanced Flow 120


Medium Flow 102

Parallel Flow 112

Multi-Instance Flow 603

Sub Flow 104

Short Flow 2

Large Context 103

Long Flow 10002

The number of executed flows for each benchmark test is 5,000, which amounts to 1,140,280 steps.



of 20

Single Flow Performance The purpose of this test is to measure the execution time of various flow types in 10.70 and compare the results with the ones from 10.60. The table below shows the number of steps at runtime for each flow that was used in this Benchmark:

Flow Type Number Of Steps per Flow Type at Runtime

Large MI Flow 5080

Parallel Flow 2045

Subflows Level10 1030

Large Sequential Flow 20005

Large Context Flow 306

Advanced Flow 120

Long Flow 10002




of 20

Comparison

Throughput

The following chart shows the throughput of 10.70 and 10.60 in either single or cluster mode

configurations with STANDARD persistence level.

Notes:

A higher result shows better performance.

HPE Operations Orchestration was scaled out in both versions .10 70 and 10.60.

For more information about STANDARD persistence level, see the HPE OO 10.50

benchmark, version-related changes, page 7.

11851320

2125

9951130

1470

0

500

1000

1500

2000

2500

Single/Windows/Oracle Single/Linux/Oracle Cluster/Windows/Oracle

Throughput on different HP OO Deployments in STANDARD mode

(steps/sec)

10.70 10.60

https://hpln.hp.com/node/28508/attachment



of 20

Single Flow Performance

The following chart compares the single flow performance of HPE Operations Orchestration

10.60 to 10.70, configurations with STANDARD persistence level.

Notes:

A lower result shows better performance.

For more information about STANDARD persistence level, see the HPE OO 10.50

benchmark document, version-related changes, page 7.

Large MI Flow Parallel FlowSubflowsLevel10

LargeSequential

Flow

Large ContextFlow

Advaced Flow Long FlowAdvanced

Context Flow

10.70 56 23 97 20 6 0.3 10 1.24

10.60 72 27 215 20 6 0.37 10 1.27

56

23

97

206 0.3

101.24

72

27

215

206 0.37

101.27

0

50

100

150

200

250

Single Flow Performance: 10.70 Vs 10.60 in STANDARD mode (Sec)

10.70 10.60

https://hpln.hp.com/node/28508/attachment



of 20

Recommendations for Environment Tuning

The following configurations were made during the benchmark tests:

The heap size was increased to 1 GB - 4 GB.

This can be configured in <OO Installation>\oo\central\conf\central-wrapper.conf.

# Initial Java Heap Size (in MB)

wrapper.java.initmemory=1024

# Maximum Java Heap Size (in MB)

wrapper.java.maxmemory=4096

The number of execution threads was increased to 300 while the inBuffer capacity was

increased to 500.

These can both be configured in <OO Installation>\oo\central\conf\central-wrapper.conf

starting from HPE OO 10.50.

wrapper.java.additional.25=-Dcloudslang.worker.numberOfExecutionThreads=300

wrapper.java.additional.26=-Dcloudslang.worker.inBufferCapacity=500

The number of database connections was increased to 20 - 100.

This can be configured in <OO Installation>\oo\central\conf\database.properties.

db.pool.maxPoolSize=100

db.pool.minPoolSize=20

hpe operations orchestration... · l documentreleasedate ... advanced context flow 200 large...

Documents