automating your website testing

11 © ALP International CorporationMarch 2001 MD-CFUG

Automating your Website Testing

ByBy

Andrew L. Pollner and Lei WangAndrew L. Pollner and Lei Wang

ALP International CorporationALP International Corporation


Why Load Test?

To Simulate Multiple Users on a SystemTo Simulate Multiple Users on a System To Measure end-to-end performanceTo Measure end-to-end performance To Measure Server Performance:To Measure Server Performance:

– Database (Oracle)Database (Oracle)– Application (CF)Application (CF)– Middleware (Web Logic)Middleware (Web Logic)– Web (Netscape)Web (Netscape)


When Should Loadtesting Occur?

When sizing a serverWhen sizing a server After Application Has StabilizedAfter Application Has Stabilized When other users are not on the systemWhen other users are not on the system After notifying Sys Admin.s, DBA’s, Test After notifying Sys Admin.s, DBA’s, Test

ManagersManagers


What’s Needed for Loadtesting?

Knowledge of:Knowledge of: ApplicationApplication DatabaseDatabase EnvironmentEnvironment LoadRunner!LoadRunner!


Loadtesting Concepts - Part I

TransactionTransaction

RendezvousRendezvous

Measured event (i.e. Time it takes to Measured event (i.e. Time it takes to return data to a screen after a return data to a screen after a QUERY button is pressed)QUERY button is pressed)

Synchronized point where Synchronized point where transaction is to occur transaction is to occur simultaneouslysimultaneously


Loadtesting Concepts - Part II

Vuser Vuser

SgroupSgroup

ScenarioScenario

A defined user type which A defined user type which

executes a specific testexecutes a specific test

A group of Vusers which with a A group of Vusers which with a

characteristic profilecharacteristic profile

A combination of sgroupsA combination of sgroups


Types of Vusers

WebWeb C/S GUIC/S GUI Terminal EmulationTerminal Emulation SQLSQL


Using LoadRunner - Web

Record HTTP ScriptRecord HTTP Script Generalize traceGeneralize trace Add Transaction points:Add Transaction points:

– start_transaction(“ClaimWriteback”)start_transaction(“ClaimWriteback”)– end_transaction(“ClaimWriteback”, PASS)end_transaction(“ClaimWriteback”, PASS)

Add Rendezvous:Add Rendezvous:– rendezvous(“Login”) rendezvous(“Login”)

rendezvous(“ClaimWriteback”)rendezvous(“ClaimWriteback”)


Login

Enter Data

Save Data

Login

Enter Data

Save Data

Login

Enter Data

Save Data

Rendevouz 1 ==>

Rendevouz 2 ==>

Rendevouz 3 ==>

Start Synchronization


Login

Enter Data

Save Data

Login

Enter Data

Save Data

Login

Enter Data

Save Data

Rendevouz 1 ==>

Rendevouz 2 ==>

Rendevouz 3 ==>

Step Synchronization


Using LoadRunner - DB

Get SQL traceGet SQL trace Generalize SQL traceGeneralize SQL trace Add Transaction points:Add Transaction points:

– start_transaction(“ClaimWriteback”)start_transaction(“ClaimWriteback”)– end_transaction(“ClaimWriteback”, PASS)end_transaction(“ClaimWriteback”, PASS)

Add Rendezvous:Add Rendezvous:– rendezvous(“Login”) rendezvous(“Login”)

rendezvous(“ClaimWriteback”)rendezvous(“ClaimWriteback”)


Product Categories

GUI/Web vusersGUI/Web vusers– Netscape BrowserNetscape Browser– IE BrowserIE Browser– Client ServerClient Server

RTE vusersRTE vusers– Terminal EmulationTerminal Emulation

SQL (dB) vusersSQL (dB) vusers– Client ServerClient Server


LoadRunner Family of Products

Both Client Both Client ANDAND Server Load Testing Server Load Testing Wide range of platformsWide range of platforms

– Win 2000Win 2000

– NTNT

– Win95/98Win95/98

– UNIXUNIX

ReportingReporting– Automatically for each userAutomatically for each user

– By transactionBy transaction


Single point of control: ControllerSingle point of control: Controller

Client AND Server Load TestingTesting the Site

WAN/Internet

SYBASE SERVER

NTSQLSERVER


Single point of control: ControllerSingle point of control: Controller Drive multiple Drive multiple realreal NT GUI clients :End-to-End NT GUI clients :End-to-End


SYBASE SERVER

NT

SQLSERVER

WAN/Internet


Single point of control: ControllerSingle point of control: Controller Drive multiple Drive multiple realreal NT GUI clients : End-to-End NT GUI clients : End-to-End Stress SQL Server with multiple Stress SQL Server with multiple virtualvirtual NT clients NT clients


SYBASE SERVER

NT

NT

SQLSERVER

WAN/Internet


Single point of controlSingle point of control Drive multiple Drive multiple realreal clients clients Stress SQL Server Stress SQL Server virtualvirtual clients NT clients NT Stress Sybase: Stress Sybase: virtualvirtual clients NT/UNIX clients NT/UNIX

Client AND Server Load TestingTesting the Enterprise

SYBASE SERVER

NT/UNIX

NT WAN/Internet


Advanced Loadtest Measurement

Mean vs. MedianMean vs. Median 90% Percentile90% Percentile Performance under loadPerformance under load System Performance MeasurementSystem Performance Measurement

– CPUCPU– SWAPSWAP– DISKDISK


Analyzing Loadtest Results - ICLIENT LAN WAN

GUI

ApplicationProtocol SQL Server

Total System Performance: Client, LAN, SQL Server, WAN, Sybase

Sybase

SERVERSERVER

Client

Load


Transaction Performance: LAN, SQL Server, WAN & Sybase

Analyzing Loadtest Results - IICLIENT LAN WAN

GUI

ApplicationProtocol SQL Server Sybase

SERVERSERVER

Client

Load

Server

Load


Analyzing Loadtest Results - IIICLIENT LAN WAN

GUI

ApplicationProtocol SQL Server

Transaction Performance: WAN, Sybase

Sybase

SERVERSERVER

Client

Load

Server

Load


Analyzing Loadtest Results - IVCLIENT LAN WAN

GUI


SERVERSERVER

Transaction Performance: SYBASE

Client

Load

Server

Load


Analyzing Loadtest Results - VCLIENT LAN WAN

GUI


SERVERSERVER

Client

Load

Server

Load

Transaction Response Time: Client

Transaction Response Time: LAN, SQL Server


Conclusions

Loadtesting:Loadtesting: Is a necessary component in testing an Is a necessary component in testing an

application and its environmentapplication and its environment Has multiple purposesHas multiple purposes Comes in many flavorsComes in many flavors Is an extension to Functional testingIs an extension to Functional testing Is complex!Is complex!


DEMO!


Virtual User Generator


LoadRunner Controller


Controller Vusers


Vuser Protocol


Transaction Report


Page Faults Graph


On-line Monitors


Q&A

automating your website testing

Documents