selecting the right automated testing tool
TRANSCRIPT
![Page 1: Selecting the Right Automated Testing tool](https://reader036.vdocuments.net/reader036/viewer/2022081401/55a22b171a28ab9d718b479c/html5/thumbnails/1.jpg)
Art, Science or Both? Selecting The Right Automated Testing
Tool HCMC STC MONTHLY MEETUP
NOV 2014
THAO VO
![Page 2: Selecting the Right Automated Testing tool](https://reader036.vdocuments.net/reader036/viewer/2022081401/55a22b171a28ab9d718b479c/html5/thumbnails/2.jpg)
My Background
• QA Architect at KMS Technology Inc.
• Board member of HCMC Software Testing Club
• 12+ years in software development & software testing
• 6+ years in automated & performance testing
• 5+ years as a Test Lead
• Speaker and Facilitator at HCM STC Conference
• Trainer of S/W Testing at IITS, CSC, KMS and Digimate
2
![Page 3: Selecting the Right Automated Testing tool](https://reader036.vdocuments.net/reader036/viewer/2022081401/55a22b171a28ab9d718b479c/html5/thumbnails/3.jpg)
Outline
3
• Test Automation Overview
• Steps to Evaluate a Tool
• Evaluation Criteria
• Automated Tool Landscape
Source: http://bit.ly/1EN7EPM
![Page 4: Selecting the Right Automated Testing tool](https://reader036.vdocuments.net/reader036/viewer/2022081401/55a22b171a28ab9d718b479c/html5/thumbnails/4.jpg)
4
Test Automation Overview
![Page 5: Selecting the Right Automated Testing tool](https://reader036.vdocuments.net/reader036/viewer/2022081401/55a22b171a28ab9d718b479c/html5/thumbnails/5.jpg)
Test Automation Process
5
Source: http://bit.ly/1wJ250x
1 • Assessment & Tool Evaluation
2 • Planning & Design
3 • Implementation
4 • Execution & Report
5 • Maintenance
![Page 6: Selecting the Right Automated Testing tool](https://reader036.vdocuments.net/reader036/viewer/2022081401/55a22b171a28ab9d718b479c/html5/thumbnails/6.jpg)
6
Why is Tool Evaluation Important?
![Page 7: Selecting the Right Automated Testing tool](https://reader036.vdocuments.net/reader036/viewer/2022081401/55a22b171a28ab9d718b479c/html5/thumbnails/7.jpg)
To be successful
7
Tool
People Approach
Source: http://bit.ly/1uttTt7
Source: http://bit.ly/1xEI5zd
Source: http://bit.ly/1utxkQq
![Page 8: Selecting the Right Automated Testing tool](https://reader036.vdocuments.net/reader036/viewer/2022081401/55a22b171a28ab9d718b479c/html5/thumbnails/8.jpg)
8
Tool Evaluation Steps
![Page 9: Selecting the Right Automated Testing tool](https://reader036.vdocuments.net/reader036/viewer/2022081401/55a22b171a28ab9d718b479c/html5/thumbnails/9.jpg)
Tool Evaluation Steps
9
Source: http://agilepainrelief.com/notesfromatooluser/2013/01/creating-acceptance-criteria-waiting-too-long.html
Define requirement & expectation
Define & prioritize criteria
![Page 10: Selecting the Right Automated Testing tool](https://reader036.vdocuments.net/reader036/viewer/2022081401/55a22b171a28ab9d718b479c/html5/thumbnails/10.jpg)
Tool Evaluation Steps
10
Source: http://freedogpics.com/tag/german-shepherd-rescue/page/4/
Collect and list out all tools
on the market
![Page 11: Selecting the Right Automated Testing tool](https://reader036.vdocuments.net/reader036/viewer/2022081401/55a22b171a28ab9d718b479c/html5/thumbnails/11.jpg)
Tool Evaluation Steps
11
Source: http://marketingdeviant.com/6-critical-factors-in-building-charisma/
Allocate suitable
resources
![Page 12: Selecting the Right Automated Testing tool](https://reader036.vdocuments.net/reader036/viewer/2022081401/55a22b171a28ab9d718b479c/html5/thumbnails/12.jpg)
Tool Evaluation Steps
12
Source: http://www.careerealism.com/committed-new-years-resolutions/
Download and use
Do PoC with a sample of test cases
![Page 13: Selecting the Right Automated Testing tool](https://reader036.vdocuments.net/reader036/viewer/2022081401/55a22b171a28ab9d718b479c/html5/thumbnails/13.jpg)
Tool Evaluation Steps
13
Source: http://www.returnofkings.com/38961/the-marriage-paradigm
Finalize the evaluation
![Page 14: Selecting the Right Automated Testing tool](https://reader036.vdocuments.net/reader036/viewer/2022081401/55a22b171a28ab9d718b479c/html5/thumbnails/14.jpg)
14
Define Requirement & Criteria
![Page 15: Selecting the Right Automated Testing tool](https://reader036.vdocuments.net/reader036/viewer/2022081401/55a22b171a28ab9d718b479c/html5/thumbnails/15.jpg)
15
Principle
Source: http://bit.ly/11fyOBJ
![Page 16: Selecting the Right Automated Testing tool](https://reader036.vdocuments.net/reader036/viewer/2022081401/55a22b171a28ab9d718b479c/html5/thumbnails/16.jpg)
16
Common Criteria
1. Cost - License - Training & Support - Implementation - Maintenance
Source: http://bit.ly/1xK9qRt
Source: http://bit.ly/1sUHl4K
![Page 17: Selecting the Right Automated Testing tool](https://reader036.vdocuments.net/reader036/viewer/2022081401/55a22b171a28ab9d718b479c/html5/thumbnails/17.jpg)
17
Common Criteria
2. Record & Playback
Source: http://bit.ly/1us1bbZ
![Page 18: Selecting the Right Automated Testing tool](https://reader036.vdocuments.net/reader036/viewer/2022081401/55a22b171a28ab9d718b479c/html5/thumbnails/18.jpg)
18
Common Criteria
3. Cross environment (platform, browser, etc.) capability
![Page 19: Selecting the Right Automated Testing tool](https://reader036.vdocuments.net/reader036/viewer/2022081401/55a22b171a28ab9d718b479c/html5/thumbnails/19.jpg)
19
Common Criteria
4. Scripting language
Source: http://bit.ly/1uzpnc6
![Page 20: Selecting the Right Automated Testing tool](https://reader036.vdocuments.net/reader036/viewer/2022081401/55a22b171a28ab9d718b479c/html5/thumbnails/20.jpg)
20
Common Criteria
5. Ability to develop framework
Source: http://bit.ly/1sWrm5d
![Page 21: Selecting the Right Automated Testing tool](https://reader036.vdocuments.net/reader036/viewer/2022081401/55a22b171a28ab9d718b479c/html5/thumbnails/21.jpg)
21
Common Criteria
6. Object Management Object Recognition Object Identity Tool Object Programming
Source: http://bit.ly/1fg0hoy
![Page 22: Selecting the Right Automated Testing tool](https://reader036.vdocuments.net/reader036/viewer/2022081401/55a22b171a28ab9d718b479c/html5/thumbnails/22.jpg)
22
Common Criteria
7. Community & Support Document, online support Popularity Forum, question response
![Page 23: Selecting the Right Automated Testing tool](https://reader036.vdocuments.net/reader036/viewer/2022081401/55a22b171a28ab9d718b479c/html5/thumbnails/23.jpg)
23
Other Criteria
• Integrated development environment & systems (version control, requirement, defect tracking)
• Scripting support: debugging, IntelliSense function and Code completion
• Error recovery
• Database support
• Speed of Execution
• Test Management capability
![Page 24: Selecting the Right Automated Testing tool](https://reader036.vdocuments.net/reader036/viewer/2022081401/55a22b171a28ab9d718b479c/html5/thumbnails/24.jpg)
24
Prioritize Criteria
![Page 25: Selecting the Right Automated Testing tool](https://reader036.vdocuments.net/reader036/viewer/2022081401/55a22b171a28ab9d718b479c/html5/thumbnails/25.jpg)
25
Score Ranking
Criteria Support Level Score
Outstanding 5
Good support 4
Support as normal 3
Support but need to have an expert or workaround
2
Be able to use but limitation 1
Don’t have 0
![Page 26: Selecting the Right Automated Testing tool](https://reader036.vdocuments.net/reader036/viewer/2022081401/55a22b171a28ab9d718b479c/html5/thumbnails/26.jpg)
26
Expected Classification
Expectation Level Score
Must have 13
Should have 8
Nice to have 5
Rarely need 3
![Page 27: Selecting the Right Automated Testing tool](https://reader036.vdocuments.net/reader036/viewer/2022081401/55a22b171a28ab9d718b479c/html5/thumbnails/27.jpg)
27
The Result
![Page 28: Selecting the Right Automated Testing tool](https://reader036.vdocuments.net/reader036/viewer/2022081401/55a22b171a28ab9d718b479c/html5/thumbnails/28.jpg)
28
Automated Tool Landscape
• Unified Functional Testing (QTP), TestComplete, Telerik, SilkTest, Rational Functional Tester, Squish, eggPlant, Ranorex, TestArchitect, CodedUI, TestPartner, etc.
• Watir, Selenium, Cucumber, SpecFlow, Sahi, Robotium, Appium, MonkeyTalk, SoapUI, Sikuli, T-Plan Robot, AutoIT, etc.
![Page 29: Selecting the Right Automated Testing tool](https://reader036.vdocuments.net/reader036/viewer/2022081401/55a22b171a28ab9d718b479c/html5/thumbnails/29.jpg)
29
Q&A
![Page 30: Selecting the Right Automated Testing tool](https://reader036.vdocuments.net/reader036/viewer/2022081401/55a22b171a28ab9d718b479c/html5/thumbnails/30.jpg)
Profile
• Thao Vo – QA Architect at KMS Technology Inc. (http://www.kms-technology.com/); Board member of HCMC Software Testing Club (http://www.hcmc-stc.org/).
• Email: [email protected] or [email protected] or [email protected]
• LinkedIn: http://vn.linkedin.com/pub/thao-van-vo/24/31a/b35
30
![Page 31: Selecting the Right Automated Testing tool](https://reader036.vdocuments.net/reader036/viewer/2022081401/55a22b171a28ab9d718b479c/html5/thumbnails/31.jpg)
© 2014 HCMC Software Testing Club
THANK YOU