Тестирование производительности ajax приложений с...

atdays.com

Performance Testing

AJAX Application with

JMeter

Vladimir Primakov

atdays.com #atdays

Agenda

AJAX

Main Difficulties of Performance Testing

of AJAX applications with jmeter and

their Solutions

Conclusions

Questions

2

atdays.com #atdays

Me

3

QA Manager at Kuadriga company.

3 years of continuous experience in automated

testing: IBM Rational Robot, Test Complete,

Selenium (RC), Jmeter.

Successfully applied server-side performance and

load testing on 4-5 different projects.

Enjoy photography, sports, and self-improvement

Profile in Linkedin:

http://www.linkedin.com/in/vladimirprimakov

Email: [email protected]

Skype: vladimir.primakov

http://www.linkedin.com/in/vladimirprimakov

mailto:[email protected]

atdays.com #atdays

AJAX - ASYNCHRONOUS JAVASCRIPT AND XML

AJAX – XMLHttpRequest + DHTML (HTML, CSS, Javascript)

4

atdays.com #atdays

Classic and Ajax Web-apps

5

atdays.com #atdays 6

Browser Client We

b-se

rve

r Data store,

backend

processing

Server Side

Classic

GUI


atdays.com #atdays


7

Http Request

Browser Client

http(s) transport W

eb

-serv

er

Data store,

backend

processing

Server Side

Classic

GUI

atdays.com #atdays


8

Http Request

Http Response

HTML + javascript +

CSS data

Browser Client

http(s) transport W

eb

-serv

er

Data store,

backend

processing

Server Side

Classic

GUI

atdays.com #atdays


9

Http Request

Http Response

Browser Client

http(s) transport W

eb

-serv

er

Data store,

backend

processing

Server Side

Classic

GUI

Browser Client

Web/

XML/

JSON

server

Data store,

backend

processing

Server Side

AJAX

GUI

HTML + javascript +

CSS data

atdays.com #atdays


10

Http Request

Http Response

Browser Client

http(s) transport W

eb

-serv

er

Data store,

backend

processing

Server Side

Classic

GUI

Browser Client

Web/

XML/

JSON

server

Data store,

backend

processing

Server Side

AJAX

Ajax

Engine

GUI

JavaScript

call

HTML + javascript +

CSS data

atdays.com #atdays


11

Http Request

Http Response

Browser Client

http(s) transport W

eb

-serv

er

Data store,

backend

processing

Server Side

Classic

GUI

Browser Client

Web/

XML/

JSON

server

Data store,

backend

processing

Server Side

AJAX

Ajax

Engine XMLHttp

Request

object

GUI

JavaScript

call

HTML + javascript +

CSS data

atdays.com #atdays


12

Http Request

Http Response

Browser Client

http(s) transport W

eb

-serv

er

Data store,

backend

processing

Server Side

Classic

GUI

(XML)Http Request

Browser Client

http(s) transport

Web/

XML/

JSON

server

Data store,

backend

processing

Server Side

AJAX

Ajax

Engine XMLHttp

Request

object

GUI

JavaScript

call

HTML + javascript +

CSS data

atdays.com #atdays


13

Http Request

Http Response

Browser Client

http(s) transport W

eb

-serv

er

Data store,

backend

processing

Server Side

Classic

GUI

(XML)Http Request

(XML) Http Response

XML/JSON

Browser Client

http(s) transport

Web/

XML/

JSON

server

Data store,

backend

processing

Server Side

AJAX

Ajax

Engine XMLHttp

Request

object

GUI

JavaScript

call

HTML + javascript +

CSS data

atdays.com #atdays


14

Http Request

Http Response

Browser Client

http(s) transport W

eb

-serv

er

Data store,

backend

processing

Server Side

Classic

GUI

(XML)Http Request

(XML) Http Response

XML/JSON

Browser Client

http(s) transport

Web/

XML/

JSON

server

Data store,

backend

processing

Server Side

AJAX

Ajax

Engine XMLHttp

Request

object

GUI

JavaScript

call

HTML+CSS

HTML + javascript +

CSS data

atdays.com #atdays


15

Http Request

Http Response

Browser Client

http(s) transport W

eb

-serv

er

Data store,

backend

processing

Server Side

Classic

GUI

(XML)Http Request

(XML) Http Response

Size - Small

Browser Client

http(s) transport

Web/

XML/

JSON

server

Data store,

backend

processing

Server Side

AJAX

Ajax

Engine XMLHttp

Request

object

GUI

JavaScript

call

HTML+CSS

Size - Big


Classic Response Request

Post HTML Page


Classic

AJAX

Response Request Post HTML Page

Request

Post

JSON Response Part of a page

a)

b)


(AJAX) JSON Response

Part of a page

a)

b)

atdays.com #atdays

Vaadin}> (GWT) Ajax framework

19

https://vaadin.com/home

atdays.com #atdays


20

Server Side

GWT

GUI (javascript)

Browser Client Vaadin

Server-side GUI

UIDL - User Interface Description Language

Web

Server

Backend

Processing

GWT widgets

Java

objects

atdays.com #atdays


21

Server Side

GWT

GUI (javascript)

Browser Client


Web

Server

Backend

Processing

GWT widgets

Java

objects

Mirroring (GUI)

Vaadin Server-side GUI

atdays.com #atdays


22

Server Side

GWT

GUI (javascript)

Browser Client Vaadin

Server-side GUI


Web

Server

Backend

Processing

GWT widgets

Java

objects

atdays.com #atdays


23

Server Side

Vaadin

Engine (javascript)

GWT

GUI (javascript)

Java

objects

Browser Client


Web

Server

Backend

Processing

GWT widgets UIDL Vaadin

Server-side GUI

atdays.com #atdays


24

Server Side

Vaadin

Engine (javascript)

GWT

GUI (javascript)

JSON (UIDL)

Java

objects

Browser Client


Web

Server

Backend

Processing


Server-side GUI

atdays.com #atdays


25

(XML) Http Request

Server Side

http(s) transport

Vaadin

Engine (javascript)

GWT

GUI (javascript)

JSON (UIDL)

Java

objects

Browser Client


Web

Server

Backend

Processing


Server-side GUI

atdays.com #atdays


26

(XML) Http Request

Server Side

http(s) transport

Vaadin

Engine (javascript)

GWT

GUI (javascript)

JSON (UIDL)

Java

objects UIDL

Browser Client


Web

Server

Backend

Processing


Server-side GUI

atdays.com #atdays


27

(XML) Http Request

(XML) Http Response

JSON (UIDL)

Server Side

http(s) transport

Vaadin

Engine (javascript)

GWT

GUI (javascript)

JSON (UIDL)

Java

objects UIDL

Browser Client


Web

Server

Backend

Processing


Server-side GUI


UIDL Request (Post)

(UIDL) JSON Response

(Show Notifications window)

(Rendering Notifications window)


UIDL Request (Post)





UIDL Request (Post)




Element Type Paintable ID

Arguments

atdays.com #atdays

MAIN DIFFICULTIES OF PERFORMANCE

TESTING OF AJAX APPLICATIONS WITH JMETER AND THEIR SOLUTIONS

31

atdays.com #atdays



32

atdays.com #atdays



33

atdays.com #atdays



34

atdays.com #atdays

Typical Performance/Load Testing Stages

35

Analyze Results, Report, and Retest

Execute the Test

Configure the Test Environment

Implement the Usage Scenarios (Scripts)

Plan and Design Usage Scenarios

Identify Performance Acceptance Criteria

Identify the Test Environment


Analyze Results, Report, and Retest

Execute the Test

Configure the Test Environment

Implement the Usage Scenarios (Scripts)

Plan and Design Usage Scenarios

Identify Performance Acceptance Criteria

Identify the Test Environment

Typical Performance/Load Testing Stages

atdays.com #atdays

Problems in Details:

Typical Ajax Applications

37

Unreadable Responses/Requests

Hard to find consistency between

Responses/Requests and GUI elements

Dynamic IDs

Sequential dependency between requests

atdays.com #atdays

Problems in Details:

Vaadin (UIDL) Ajax Applications

38

The same URL for most requests(Vaadin)

Dependency on Screen Resolution (Vaadin)

Error requests are not evident (Vaadin)

Too many requests (Vaadin)

atdays.com #atdays

SOLUTIONS

40


Unreadable

Responses/Requests


1. Get used to this

format

Unreadable

Responses/Requests


2. Use JSON Viewers


3. Use JSON Parsers


4. Parse JSON Yourself

atdays.com #atdays



46


1. Use self-explanatory named IDs

(classes) for GUI elements




2. Use Anchors


2. Use Anchors

SAMPLE Scenario: 1. Create a ticket via email in the task management

system

2. Check that the ticket is created

3. Delete the ticket


1) Creating a ticket via email (SMTP Sampler) 2. Use Anchors



2) Login into the Ticket System




3) Request to show tickets




3) Request to show tickets 4) JSON Response (Tickets page)





5) Checking whether the

ticket is created






ticket is created

6) Extracting ticket ID (Regular Expression Extractor)






ticket is created

6) Extracting ticket ID (Regular Expression Extractor)

7) Request to Delete ticket


Dynamic IDs


Put Your application into the mode with

Static IDs (Don’t forget to restore this mode

every time you run scripts)

Dynamic IDs





Set specific (debug) IDs for your GUI

elements <h2 id=“AjaxPTproblems">

Dynamic IDs





Set specific (debug) IDs for your GUI

elements <h2 id=“AjaxPTproblems">

Use anchors

Dynamic IDs


Sequential dependency between

requests

E.g.: IDs of all

tree elements

changes every

time I make

changes to

the tree

If dynamic IDs are

used, sequential

dependency

between requests

happens - it means

that previous actions

may influence next

actions and the order

of actions matters


Define definite initial data in the tested

application


requests



application

Breakdown scenarios into undependable

chunks


requests



application


chunks

Record scenarios from the beginning to

the end of the chunks


requests



application


chunks

Record scenarios from the beginning to

the end of the chunks

Separate chunks using login/logout

(because initialization of IDs happens after

login)


requests


Example


Rename requests during traffic recording - at once as a certain

definite action is made by you in a web-browser.

The same URL for the most requests

(Vaadin)

Rename During Recording


Define one screen resolution for your tests

and record traffic only for it

Dependency on Screen Resolution

(Vaadin)

Screen coordinates are used while accessing these buttons


Error requests are not evident

(Vaadin)

The response code for Vaadin

“Out of Sync” and other

response Errors is still HTTP/1.1 200


Put Global Response Assertion on the test plan level



Get used to it!

atdays.com #atdays

Other Problems

75

Difficulty to make estimations

Script creation for (full) AJAX application takes ~

3-4 times more than for Classic application

atdays.com #atdays

Other Problems

76

Difficulty to make estimations

Script creation for (full) AJAX application takes ~

3-4 times more than for Classic application

Bad Supportability (Vaadin)

If application changes in most cases you have to

recreate the affected scenarios completely.

atdays.com #atdays

Conclusions

77


Vladimir Primakov

Email: [email protected]

Skype: vladimir.primakov

mailto:[email protected]

Тестирование производительности ajax приложений с...

Documents