leveraging sap ase workload analyzer to optimize your database environment
TRANSCRIPT
(c) 2015 Independent SAP Technical User GroupAnnual Conference, 2015
ISUG-TECH 2015
Conference
Leveraging SAP ASE Workload Analyzer
Vinod Chandran
(c) 2015 Independent SAP Technical User GroupAnnual Conference, 2015
Agenda
• ASE Corona Objectives
• ASE Workload Analyzer Overview
• Use Cases and Typical Configuration
• Workflow and Functional Details
• ASE Workload Analyzer Key Features
• ASE Workload Capture Usage
• Repository Database Overview
• Workload Replay overview
• Workload Analyzer – administration, configuration, upgrade, licensing
• ASE Cockpit
• Summary
• Q&A
(c) 2015 Independent SAP Technical User GroupAnnual Conference, 2015
Speaker
Vinod Chandran is a product expert in the product management team at SAP
representing ASE. As a senior member of the team, he has represented ASE
for 19+ years in various roles during his career spanning 23+ years. He has
a master’s degree in electronics and computer science as well as a master’s
Degree in business administration.
(c) 2015 Independent SAP Technical User GroupAnnual Conference, 2015
ASE Corona Objectives
Corona is capable of handling extreme transaction throughput while maintaining best TCO for Custom and SAP Business Suite applications. Key areas of focus include:
• Leverage emerging hardware, memory and storage technology for scale-up with MemScale option.
• Workload analysis and optimizations
• Zero data loss - Always_On functionality providing HADR solution using synchronous replication for planned and unplanned downtime.
• Storage/simplicity leading to TCO/Operational Scalability using Data Store Access Management.
ASE Workload Analyzer
Feature Overview
Annual Conference, 2015
(c) 2015 Independent SAP Technical User GroupAnnual Conference, 2015
Overview
• Enables user to capture commands received by ASE from client.
• Captured workload can be used to
• replay against an ASE server non-disruptively
• Analyze and diagnose problems
• Manage configuration changes proactively
• Integrated with ASE Cockpit
• Analytics based recommendations helps DBAs
• improve server performance
• tune server to be more efficient.
(c) 2015 Independent SAP Technical User GroupAnnual Conference, 2015
High Level Use Cases from Customer Requirements
ID Use Case Description
1 Evaluate upgrade options/new features.
Use replay to understand benefits from new options
2 Investigate client activities. Reports of client activity patterns – e.g # of requests per IP address
3 Problem reproduction Support diagnosis of product problems by replaying in controlled environment
4 Measure impact from configuration changes.
E.g. server configuration change
5 Evaluate migration options. Use replay to understand upgrade/migration benefits
6 Identify problematic queries.
E.g. identify queries with long response time due to missing indexes.
7 Get advice from analyzing captured workload (advisors).
Identify indexes and partitions that will enhance performance of existing applications
(c) 2015 Independent SAP Technical User GroupAnnual Conference, 2015
“Typical” Configuration
Production
Test
Repository
Application UsersDBA/Developer
ASE
Ckpt
ASE
Ckpt
ASE
Ckpt
Host 1
Host 2
Host 3
Storage (PCAP files)
Capture Analysis
Replay
(c) 2015 Independent SAP Technical User GroupAnnual Conference, 2015
Workflow and Functional Details
Capture Workload
Analyze Results
Prepare Test
System
Replay & Capture
Workload
Analyze Results
• Capture client
commands and
ASE responses
• Capture network
traffic
• Capture
performance
metrics
• Capture system
cfg
• Generate raw
workload files
• Preprocess
workload
• Display metrics &
summary
• Identify problem
queries
• Evaluate
performance
• Display errors
• Compare metrics
from multiple runs
• Load production
DB into test server
• Verify and install
logins, users,
roles
• Configure test
server
• Set OS and
environment
parameters
• Setup replay
engine
• Evaluate workload
thread
requirements
• Create client
threads
• Execute workload
• Coordinate
threads
• Capture workload
on ASE
• Capture ASE
metrics
• Preprocess
workload
• Display metrics
& summary
• Evaluate
performance
• Display errors
• Compare results
• Compare
metrics to
original run
(c) 2015 Independent SAP Technical User GroupAnnual Conference, 2015
Key Features• Capture workload within ASE
• Save TDS to PCAP files (one per engine)
• Provide options for enabling, disabling, filtering capture within ASE
• Licensed feature
• Component: ASE Server (Managed from ASE Cockpit)
• Analyze workload
• Summarize workload metrics by entire workload, client connection, individual query levels, frequently executed or long-running query, errors
• Filter by query text, response time, execution count, user or client name, etc.
• Components: ASE Cockpit and Repository Database
• Workload Replay
• Replay workload
• Capture workload data
• Replay rate configuration
• Filter commands by login, application
• Components: ASE Cockpit and Repository Database
(c) 2015 Independent SAP Technical User GroupAnnual Conference, 2015
Key Features (Cont.)
• Compare captured workloads• Report differences in total workload time, individual query execution time, average
execution time for repeated queries
• Components: ASE Cockpit and Repository Database
• Graphical user interface• Management of ASE configuration, initiation of capture, replay, analysis
• Interactive user interface for drilling into workload metrics at workload, connection, query and other levels
• Component: ASE Cockpit
(c) 2015 Independent SAP Technical User GroupAnnual Conference, 2015
DBCC Usage
workload_capture dbcc command
Start workload capture
usage: dbcc workload_capture(start)
Stop workload capture
usage: dbcc workload_capture(stop)
Monitor workload capture status:
usage: dbcc workload_capture(status)
Help
usage: dbcc workload_capture(help)
Repository Database
Annual Conference, 2015
(c) 2015 Independent SAP Technical User GroupAnnual Conference, 2015
Overview
Repository database is used to save Raw TDS data and the analysis results.
The data is loaded by the ASE Cockpit
SAP ASE is the only supported repository database in current release.
No special platform requirement for repository database.
SAP ASE 15.7 or above version is required for repository database.
Repository database in local network with the cockpit server will bring significant performance improvement.
(c) 2015 Independent SAP Technical User GroupAnnual Conference, 2015
Overview (Cont.)
The Repository Database should be installed on a dedicated ASE server
Repository load, analysis and replay are performance intensive
Configuration and resource requirements are specific to Workload Analyzer
A license for an additional ASE server will be included with the purchase of the Workload Analyzer feature in Corona GA.
Workload Replay
Annual Conference, 2015
(c) 2015 Independent SAP Technical User GroupAnnual Conference, 2015
Workload Replay OverviewReplay a workload and view analysis result
Prepare replay environment (outside of Cockpit)
Restore databases and configuration manually
Create corresponding logins and roles
Default configuration should be the same as source ASE server.
Connect repository database
Start a new replay
Run replay workload wizard
Replay workload wizard guides you through the workload replay process
Analyze replayed workload
Import the replay generated PCAP files using import wizard
Analyze the imported workload
View analysis result
(c) 2015 Independent SAP Technical User GroupAnnual Conference, 2015
Administration
To capture the workload during replay. Following permissions are needed.
Granular permissions disabled:
User with sa or sso role
Granular permissions enabled:
User with “set tracing any process” privilege
(c) 2015 Independent SAP Technical User GroupAnnual Conference, 2015
Installation and Configuration
•No special installation steps required
•Integrated inside ASE installation
Install a separate Cockpit server to manage replay ASE server from Cockpit server that is used to manage the source ASE server.
Prepare repository database that has captured workload.
There should be three ASE servers as part of the workload capture and replay process:
1) The original production ASE server on which the workload was captured
2) The dedicated ASE server for the Workload Analyzer repository database (sybcatdb)
3) The target server for the replay session
(c) 2015 Independent SAP Technical User GroupAnnual Conference, 2015
Upgrade
Not applicable
This feature introduced into ASE Corona.
(c) 2015 Independent SAP Technical User GroupAnnual Conference, 2015
Licensing
• Required for Corona GA release (Capture and Replay)
• There is no special license requirement for the repository database.
ASE Cockpit
Annual Conference, 2015
(c) 2015 Independent SAP Technical User GroupAnnual Conference, 2015
Overview
Graphical user interface to use Workload Analyzer feature
Provide wizards to guide user
Configure the workload repository database
Start a workload capture on the ASE server
Import a captured workload into repository database
Replay a workload on the ASE server
Provide dialogs to enable user
Monitor and control the status of workload capture procedure
Monitor and control the status of workload replay procedure
Monitor and control the status of workload analysis
Provide dashboard to enable user
View the workload analysis results
(c) 2015 Independent SAP Technical User GroupAnnual Conference, 2015
Cockpit Usage
STEPS:
Prepare repository database
This is a prerequisite step for the below 3 use cases
Start a workload capture and view analysis result
Import an existing workload and view analysis result
Replay a workload and view analysis result
(c) 2015 Independent SAP Technical User GroupAnnual Conference, 2015
Step 1: Prepare Repository database
Setup repository database server (outside of Cockpit)
SAP ASE 15.7 or higher version is required
Deploy on local network helps improving analysis performance
Run script installsybcatdb to setup Repository database
Configure parameters for repository database (outside of Cockpit)
Disk space, number of connections, data caches, etc.
Minimum and recommended configurations
Connect ASE Cockpit to repository database
We will see this in the following screens
(c) 2015 Independent SAP Technical User GroupAnnual Conference, 2015
Step 1: Prepare Repository database
Connect to repository db
Specify repository name / repository host name / port / user name / password
Click “Finish” to create a repository entry and connect to it.
(c) 2015 Independent SAP Technical User GroupAnnual Conference, 2015
Step 2: Start a workload capture and view analysis result
Run new capture wizard
New capture wizard guides you through the setup process to capture a live workload
Provide filters and options
Analyze captured workload
Loads the captured PCAP file into repository database
Generates analytical and statistical data for the workload
View analysis result
Capture dashboard
Capture duration / sessions / requests / errors
Top long / frequent running requests
IP address / login / application reports
(c) 2015 Independent SAP Technical User GroupAnnual Conference, 2015
Step 2:
Start a workload capture and view analysis result
Run new capture wizard
SAP ASE 16.0 SP02 is required. Otherwise, incompatible version error message will be shown. And “Next” and “Finish” button will be disabled.
(c) 2015 Independent SAP Technical User GroupAnnual Conference, 2015
Step 2: Start a workload capture and view analysis result
Run new capture wizard
Specify a capture name
A default name is provided but a more meaningful name may be useful
Add comments
(c) 2015 Independent SAP Technical User GroupAnnual Conference, 2015
Step 2:
Start a workload capture and view analysis result
Run new capture wizard
Specify the logins and applications that should be included or excluded in this capture
ASE Cockpit logins will be excluded by default (see next screen)
(c) 2015 Independent SAP Technical User GroupAnnual Conference, 2015
Step 2:
Start a workload capture and view analysis result
Run new capture wizard
Customized output location
The PCAP files will be generated at this location
The default location is $SYBASE
Save all TDS response data
ASE will record all the response TDS in PCAP files if this is turned on; Otherwise, only some necessary info will be recorded
The default is off
Ignore Cockpit workload
ASE will not record the workload from Cockpit connections
The default is on
(c) 2015 Independent SAP Technical User GroupAnnual Conference, 2015
Step 2:
Start a workload capture and view analysis result
Run new capture wizard
Scheduled capture is currently not supported
Click “Finish” to start a new capture
(c) 2015 Independent SAP Technical User GroupAnnual Conference, 2015
Step 2:
Start a workload capture and view analysis result Run new capture wizard
Monitor workload capture status
Click “Stop Capture” to stop current capture
(c) 2015 Independent SAP Technical User GroupAnnual Conference, 2015
Step 2:
Start a workload capture and view analysis result Analyze captured workload
Select “Analyze” menu option
Monitor analysis progress
(c) 2015 Independent SAP Technical User GroupAnnual Conference, 2015
Step 2:
Start a workload capture and view analysis result View Analysis result
Dashboard view
Capture duration
Session number
Request number
Error number
Top 10 long SQLs
Top 10 frequent SQLs
Top 3 IP addresses
Top 3 logins
Top 3 applications
(c) 2015 Independent SAP Technical User GroupAnnual Conference, 2015
Step 2:
Start a workload capture and view analysis result View analysis result
Top long SQLs
(c) 2015 Independent SAP Technical User GroupAnnual Conference, 2015
Step 3:
Import an existing workload and view analysis result Run import workload wizard
Import workload wizard guides you through the process to import an existing workload
Standard PCAP file format is required
Analyze imported workload
Similar operation as captured workload
View analysis result
Similar operation as captured workload
(c) 2015 Independent SAP Technical User GroupAnnual Conference, 2015
Step 3: Import an existing workload and view analysis result
Run import wizard
Specify PCAP files location in text field
Select PCAP files that are going to be imported
If source server had multiple engines then there will be multiple PCAP files for the capture. Select all of them.
(c) 2015 Independent SAP Technical User GroupAnnual Conference, 2015
Step 3:
Import an existing workload and view analysis result Analyze imported workload
Select “Analyze” menu option
Monitor analysis progress
(c) 2015 Independent SAP Technical User GroupAnnual Conference, 2015
Step 4: Replay a workload and view analysis result
Prepare replay environment (outside of Cockpit)
Restore databases
Create corresponding logins and roles
Run replay workload wizard
Replay workload wizard guides you through the workload replay process
Analyze replayed workload
Import the replay generated PCAP files using import wizard
Analyze the imported workload
View analysis result
Similar operation as imported workload
(c) 2015 Independent SAP Technical User GroupAnnual Conference, 2015
Step 4: Replay a workload and view analysis result
Run replay wizard
Select a workload that is going to be replayed
(c) 2015 Independent SAP Technical User GroupAnnual Conference, 2015
Licensing
Licensing will be required for Corona GA
The ASE Cockpit will not be licensed but the ability to capture workload on an ASE server will be
controlled by a license.
(c) 2015 Independent SAP Technical User GroupAnnual Conference, 2015
Installation and Configuration
ASE Cockpit must be installed and running
ASE Cockpit Technical User must be configured
•See the Server menu in the ASE Cockpit Explore tab
The ASE Cockpit user must have a valid login to the ASE server
•This is required for authentication with ASE Cockpit
Before starting the workload capture, import and replay, you must prepare the repository database and make sure ASE Cockpit is connected to the repository database via the repository wizard.
It is ideal to use a separate Cockpit server to manage the replay ASE server from the Cockpit server that is used to manage the source ASE server.
(c) 2015 Independent SAP Technical User GroupAnnual Conference, 2015
Summary
• ASE 16.0 and later releases - new generation of ASE developed to address
challenges around large data volumes.
• ASE 16.0 and later releases have made tremendous strides in the area of
operational scalability and analysis.
• Significant new capabilities that enhance performance, analysis,
operational scalability, storage optimization with Workload Analyzer,
Data Server Access Management functionalities.
•Aggressive roadmaps and release timelines
(c) 2015 Independent SAP Technical User GroupAnnual Conference, 2015
:
Sybase ASE Resources
For Developers:
http://scn.sap.com/community/developer-center/oltp-db
For Custom ASE Applications:
http://scn.sap.com/community/sybase-adaptive-server-enterprise
For SAP Business Suite on ASE:
http://scn.sap.com/community/sybase-ase
(c) 2015 Independent SAP Technical User GroupAnnual Conference, 2015
Further Information
SAP Education and Certification Opportunities
www.sap.com/education
SAP Public Web
scn.sap.com www.sap.com
(c) 2015 Independent SAP Technical User GroupAnnual Conference, 2015
© 2014 SAP AG or an SAP affiliate company. All rights reserved.
No part of this publication may be reproduced or transmitted in any form or for any purpose without the express permission of SAP AG or an
SAP affiliate company.
SAP and other SAP products and services mentioned herein as well as their respective logos are trademarks or registered trademarks of SAP AG
(or an SAP affiliate company) in Germany and other countries. Please see http://global12.sap.com/corporate-en/legal/copyright/index.epx for additional trademark information and notices.
Some software products marketed by SAP AG and its distributors contain proprietary software components of other software vendors.
National product specifications may vary.
These materials are provided by SAP AG or an SAP affiliate company for informational purposes only, without representation or warranty of any kind, and SAP AG or its affiliated companies shall not be
liable for errors or omissions with respect to the materials. The only warranties for SAP AG or
SAP affiliate company products and services are those that are set forth in the express warranty statements accompanying such products and
services, if any. Nothing herein should be construed as constituting an additional warranty.
In particular, SAP AG or its affiliated companies have no obligation to pursue any course of business outlined in this document or any related presentation, or to develop or release any functionality
mentioned therein. This document, or any related presentation, and SAP AG’s or its affiliated companies’ strategy and possible future developments, products, and/or platform directions and functionality
are all subject to change and may be changed by SAP AG or its affiliated companies at any time for any reason without notice. The information in this document is not a commitment, promise, or legal
obligation to deliver any material, code, or functionality. All forward-looking statements are subject to various risks and uncertainties that could cause actual results to differ materially from expectations.
Readers are cautioned not to place undue reliance on these forward-looking statements, which speak only as of their dates, and they should not be relied upon in making purchasing decisions.
Annual Conference, 2015 (c) 2015 Independent SAP Technical User Group
Questions and Answers
Annual Conference, 2015 (c) 2015 Independent SAP Technical User Group
Thank You for Attending
Please complete your session
feedback form