Automation Open Source Tools

QA Talks #3

Selenium

- Selenium IDE- Selenium 1.0(RC)- Selenium 2.0(Webdriver)- Selenium Grid

- is a suit of tools for web browser automation and it is composed of:

Supported by Selenium

Selenium IDE Example

Selenium IDE Limitation

- for Firefox only- do not support:

- loops, exception handling- conditional statement- re-execution of failed test- video recording - reporting functionality- flash

Watir - is a Ruby libraries for automating web browsers. It allows you to write easy to read and maintain tests.

Ruby script example

Watir Example

Pros&Cons

Pros Cons

Selenium:- cross browser, OS- programming languages- native IDE- record and play functionality- webdriver Watir:- easy to understand- rich API- Watir(Ruby), Watij(Java), WatiN(.NET)- cross browser, OS- webdriver

Selenium:- doesn't work directly with Flash- IDE for Firfox only- updates Watir:- doesn't work directly with Flash- IE only by default (but there is watir-webdriver)- ruby (if you don't learn before)

FlexMonkey

- Record and Playback- Verifying that ER match AR

- Generating ready-to-run FlexUnit scripts

- is a free tool for used fortesting Flex and Air basedapplications

Meet the Monkeys!

Selenium IDE Plugin

FoneMonkey for iOS

FlexMonkey for testing Flex and AIR applications

FoneMonkey for Android

FlexMonkey Example

Turnkeylinux

● Specials (LAMP, SVN, Torrent, Domain Controller, Jabber)

● Content management (Joomla, Drupal, WordPress)

● Web development (Ruby, Symphony)● Issue tracking (Redmine,Bugzilla)● Messaging (Jabber, Mail)● Database (MySQL, PostgreSQL)

45+ ready-to-use free open source solutions

Save your time!

and much more...

TestLink- is open source web-based test management tool

Redmine- is a project management & issue tracking tool

Summary

- easy to setup and understand- easily integrates with other tools (e.g. Teslink+Redmine\TestLink+Bugzilla)

- containes almost all required features- crossplatform- plugins- compare all available tools

Useful linkshttp://www.w3.org/QA/Tools/ W3C validator toolshttp://www.bugzilla.org/ Bug-tracking systemhttp://seleniumhq.org/ Selenium web automationhttp://code.google.com/p/aost/ Tellurium http://www.teamst.org/ test management toolhttp://watir.com/ Watir web automationhttp://watirwebdriver.com watir-webdriverhttp://www.gorillalogic.com WebMonkey Flex Automation test toolhttp://cacique.mercadolibre.com Web automation test toolhttp://www.turnkeylinux.org/all linux based ready-to-use solutionshttp://bitnami.org/stacks linux based ready-to-use solutionshttp://www.redmine.org project&issue management toolhttp://www.opensourcetesting.org/ Open Source Toolshttp://qtpselenium.com Selenium training

Automation Open Source Tools for Windows OS

How to choose the best software test automation tool?

- What are you trying to accomplish with the automation tool?

- Define goals of automation- Is there repeated work in the project?- Time taken for My current Manual project

testing- Error rate by Manual testing- Return on Investment

Main characteristics

- OS compatibility- Scripting languages- Documentation- Capture driven- Keyword driven- Code driven- Object tree- Control Finder tool

Main characteristics

- Record and Playback- Video recording- Test suites- Portability - Run from Console- Continuous Integration systems - Performance monitoring- Reporting/Logging

Check-list

- Define the main goals for automation- Define the main features which you need- Define the required team's skills - Choose several suitable tools- Create prototype using each tool- Create comparison chart with characterictics

- Choose more suitable tool for your project

QAliber Test Builder

- Framework for creating tests with no coding skills- Simply drag and drop Test Cases from repository - Use loops, conditions and parameters to create robust scenarios.- Run automated tasks such as handling windows and dialogs, I/O, registry, devices and more.- Log with screenshots, movies, performance graphs.- Supported by an open source community

Qaliber plug-in for Visual StudioQAliber Test Developer is Visual Studio plug-in:- Write C#/.net code, use the .NET framework capabilities.- Create test cases as an integral part of your development solution.- Create GUI / API level test quick!- Record / Play GUI automation.- Support .NET forms / WPF / WEB GUI testing.- Run on all windows platforms with .NET framework 3.0- An ever growing Open source Common tools repository.

AutoIt

AutoIt v3 is a freeware BASIC-like scripting language designed for automating the Windows GUI and general scripting.

- Easy to learn BASIC-like syntax- Manipulate windows and processes, interact with all standard

windows controls- Scripts can be compiled into standalone executables- COM support, regular expressions, directly call external DLL and

Windows API functions- Scriptable RunAs functions- Detailed helpfile and large community-based support forums

White

Framework for automating rich client applications based on Win32, WinForms, WPF, Silverlight and SWT (Java) platforms:

- It is .NET based - Provides a consistent object-oriented API- Hiding the complexity of Microsoft's UIAutomation library

Sikuli

Visual technology to automate and test graphical user interfaces (GUI) using images (screenshots).

- Includes Sikuli Script, a visual scripting API for Jython- Includes Sikuli IDE, an integrated development environment

for writing visual scripts with screenshots easily. - Automates anything you see on the screen without internal

API's support.- You can programmatically control a web page, a

Windows/Linux/Mac OS X desktop application, - Support iphone or android application running in a simulator or

via VNC.

Comparison chart AutoIT QAliber White Sikuli

OS compatibility Windows 2000/ XP/ 2003/ Vista / 2008/ Windows 7/ 2008 R2

HTML (IE), WinForms, WPF, Silverlight, Java, MFC

Win32, WinForms, WPF, Silverlight and SWT (Java) platforms.

WindowsLinuxMacOS

Scripting languages Basic-like scripting language

VB.net/C# .NET Jyton/Python

Documentation Help, Manuals, Video examples

Help, Manuals, Video Tutorials

Community on codeplex.com

Help, Video examples

Capture drivenKeyword drivenCode driven

Code-driven Keyword-drivenCode-driven

Code-driven Capture-driven

Object tree No Yes Yes No

Control Finder tool Yes Yes Yes (UIspy) No

Comparison chartRecord and Playback

Yes Yes Yes (record classes)

No

Video recording No Yes No No

Test suites Yes Yes Yes No

Portability

Yes Yes Yes No

Run from Console Yes No Yes No

Continuous Integration systems

Yes No Yes No

Performance monitoring

No Yes No No

Reporting/Logging Yes Yes Yes No

Useful Links

http://qaliber.net/ Qaliber Test Builder, plug-in for MS VS http://www.autoitscript.com/site/autoit/ AutoIthttp://white.codeplex.com/ White http://sikuli.org/ Sikulihttp://www.opensourcetesting.org/ Open Source Toolshttp://software-testing.ru/ Software-testing forumhttp://www.testingexperience.com/ QA Magazines

email: info@qaclubkiev.com Oleksandr MaidaniukAndrii Matukhno

Contacts:

Kiev 2011

alexander.maydanyuk

andrej_2704

Обсуждение лучших инструментов и практик, применимых в сфере тестирования и обеспечения качества.

http://qaclubkiev.com/