sentinel ip short message gateway benchmarks€¦ · sentinel ip short message gateway benchmarks...
TRANSCRIPT
Sentinel IP Short Message Gateway Benchmarks
TAS-046-Issue 2.7.0-Release 1
April 2018
Sentinel IP Short Message Gateway Benchmarks (V2.7.0)
Notices
Copyright © 2017 Metaswitch Networks. All rights reserved.
This manual is issued on a controlled basis to a specific person on the understanding that no part of the Metaswitch Networks product code or
documentation (including this manual) will be copied or distributed without prior agreement in writing from Metaswitch Networks.
Metaswitch Networks reserves the right to, without notice, modify or revise all or part of this document and/or change product features or
specifications and shall not be responsible for any loss, cost, or damage, including consequential damage, caused by reliance on these materials.
Metaswitch and the Metaswitch logo are trademarks of Metaswitch Networks. Other brands and products referenced herein are the trademarks or
registered trademarks of their respective holders.
2
Sentinel IP Short Message Gateway Benchmarks (V2.7.0)
Contents
1 Sentinel IP Short Message Gateway Benchmarks......................................................................................................... 4
1.1 Topics........................................................................................................................................................................................................... 4
2 Benchmark Scenarios....................................................................................................................................................... 5
2.1 MO Submission............................................................................................................................................................................................ 5
2.2 CS Delivery...................................................................................................................................................................................................7
3 Hardware and Software.....................................................................................................................................................9
3.1 Hardware...................................................................................................................................................................................................... 9
3.2 Software........................................................................................................................................................................................................9
3.3 Configuration.............................................................................................................................................................................................. 10
4 Benchmark Results......................................................................................................................................................... 11
4.1 Benchmarks................................................................................................................................................................................................11
4.2 Detailed metrics.......................................................................................................................................................................................... 12
4.2.1 Call Rate....................................................................................................................................................................................... 12
MO-Submission...........................................................................................................................................................................12
CS-Delivery................................................................................................................................................................................. 13
4.2.2 Rhino CPU usage......................................................................................................................................................................... 14
4.2.3 Rhino Heap usage........................................................................................................................................................................ 15
4.2.4 Rhino Activities............................................................................................................................................................................. 16
4.2.5 Scenario latencies.........................................................................................................................................................................17
MO-Submission...........................................................................................................................................................................17
CS-Delivery................................................................................................................................................................................. 18
3
Sentinel IP Short Message Gateway Benchmarks (V2.7.0)
1 Sentinel IP Short Message Gateway Benchmarks
This book contains performance benchmarks using the Sentinel IP Short Message Gateway.
1.1 Topics
Benchmark Scenarios Descriptions of each of the benchmark scenarios, and notes on the benchmark methodology
used
Hardware and Software Details of the hardware, software, and configuration used for the benchmarks
Benchmark Results Summaries of the benchmarks and links to detailed metrics.
Other documentation for the Sentinel IP Short Message Gateway can be found on the Sentinel IP Short Message Gateway product page .
4
Sentinel IP Short Message Gateway Benchmarks (V2.7.0)
2 Benchmark Scenarios
This page describes the scenarios and methodology used when running the benchmarks.
2.1 MO Submission
In this scenario, the SCSCF sends a SIP message containing a short message to the IP-SM-GW, which then sends an MO-ForwardSM request
to the SMSC. The Opencloud Scenario Simulator performs the role of SMSC and SCSCF. For details of the message processing, see MO
Submission Flows
1. The SCSCF sends a SIP Message containing a valid RP-Data payload to the IP-SM-GW.
2. The IP-SM-GW responds to the SCSCF with a 202 Accepted message.
3. The IP-SM-GW sends a TCAP OpenRequest to the SMSC.
4. The SMSC replies with an OpenAccept.
5. The IP-SM-GW sends an MO-ForwardSM request to the SMSC.
6. The SMSC replies with an MO-ForwardSM response, and closes the TCAP dialog.
7. The IP-SM-GW sends a SIP Message containing an RP-ACK to the SCSCF.
8. The SCSCF replies with a 200 OK.
5
Sentinel IP Short Message Gateway Benchmarks (V2.7.0)
6
Sentinel IP Short Message Gateway Benchmarks (V2.7.0)
2.2 CS Delivery
In this scenario, the SMSC delivers a MT SMS to the IP-SM-GW, which then sends the message over the CS network. The OpenCloud Scenario
Simulator performs the role of SMSC, MSC, and HLR. For details of changes made to proxied messages and details of message processing, see
MT Delivery Flows .
1. The SMSC sends an OpenRequest containing a SendRoutingInfoForSM request to the IP-SM-GW.
2. The IP-SM-GW proxies that message to the HLR.
3. The HLR replies with a SendRoutingInfoForSM response.
4. The IP-SM-GW proxies that response to the SMSC, and closes the dialog to the SMSC.
5. The SMSC sends an OpenRequest containing an MT-ForwardSM request to the IP-SM-GW.
6. The IP-SM-GW sends an empty OpenRequest to the MSC.
7. The MSC response with an OpenAccept
8. The IP-SM-GW sends the MT-Forward-SM request to the MSC on the established dialog
9. The MSC closes the dialog
10. The IP-SM-GW sends an OpenAccept to the SMSC, and closes the dialog.
7
Sentinel IP Short Message Gateway Benchmarks (V2.7.0)
8
Sentinel IP Short Message Gateway Benchmarks (V2.7.0)
3 Hardware and Software
This page describes the hardware and software used when running the benchmarks.
3.1 Hardware
3.2 Software
Vendor Software Version
9
Sentinel IP Short Message Gateway Benchmarks (V2.7.0)
OpenCloud Sentinel IP Short Message Gateway 2.6.0.3
OpenCloud Rhino 2.5.0.2
OpenCloud Scenario Simulator 2.3.0.10
OpenCloud IN Scenario Pack 1.5.0.4
OpenCloud SIP Scenario Pack 1.0.3.9-M1
Apache Apache Cassandra 2.0.17
Oracle Java 1.7.0_71
3.3 Configuration
Parameter Value
heap_size 6144M
new_size 1536M
gc_type cms
gc_max_pause 50
gc_pause_interval 250
CMSOccupancyFraction 60
SurvivorRatio 16
MaxTenuringThreshold 2
10
Sentinel IP Short Message Gateway Benchmarks (V2.7.0)
4 Benchmark Results
This page contains the results for the Sentinel IP-SM-GW benchmarks, with both summaries on page and detailed metrics on page 12 .
Context for these results are provided by the benchmark scenarios description on page 5 .
4.1 Benchmarks
Call rate on page 12 1000 messages per second, evenly split across the MO-Submission and CS-Delivery call flows.
CPU usage on page 1300% across 12 cores
Maximum theoretical CPU usage is 2400%.
Heap usage on page 2300MB average heap
Scenario Latencies on page
17Scenario 50th
percentile90thpercentile
95thpercentile
99thpercentile
MO-Submission 7.4ms 9.7ms 16.7ms 71.1ms
CS-Delivery 7.0ms 9.4ms 15.5ms 72.3ms
11
Sentinel IP Short Message Gateway Benchmarks (V2.7.0)
4.2 Detailed metrics
4.2.1 Call Rate
MO-Submission
12
Sentinel IP Short Message Gateway Benchmarks (V2.7.0)
CS-Delivery
13
Sentinel IP Short Message Gateway Benchmarks (V2.7.0)
4.2.2 Rhino CPU usage
14
Sentinel IP Short Message Gateway Benchmarks (V2.7.0)
4.2.3 Rhino Heap usage
15
Sentinel IP Short Message Gateway Benchmarks (V2.7.0)
4.2.4 Rhino Activities
16
Sentinel IP Short Message Gateway Benchmarks (V2.7.0)
4.2.5 Scenario latencies
MO-Submission
17
Sentinel IP Short Message Gateway Benchmarks (V2.7.0)
CS-Delivery
18