automating testing with open source tools

8/10/2019 Automating Testing With Open Source Tools

http://slidepdf.com/reader/full/automating-testing-with-open-source-tools 1/20

Automating with Open Source

Testing Tools

Corey McGarrahan

rSmart

01-July-08



Agenda

• Getting from Here to There

• Test Procedures

• Criteria for Tool Selection

• Tools Discussed

• And the winner is…

• The Next Step



Where We Want to Be

• No Manual Test Scripts• No Testing Tool

• Totally dependent on Sakai Scripts

Where We Were

• Acceptance tests for all tools

• Regression Suite• Automated the Test Suites



Manual Test Procedures

• Writing Test procedures

• Procedures vs. Scripts

• Hire Testers

• Automate Procedures



Test Script

Resources

1: Add Item

Test ID Test Objective Pass/Fail Notes

1.1 Add an empty folder

1.1.1 Make folder publicly available

1.1.2

Restrict folder access to siteparticipants

1.1.3

Add more than one folder at onetime

1.1.4

Add a folder with spaces in thename



Test Procedure

Step ID Action Expected Result

1. Select the Announcements tool o The Announcements page is displayed

2. Select the Add link o The Add Announcement page is displayed with

the following options:

oAnnouncement Title

oBody

oAccessoAvailability

oAttachments

oEmail Notification

3. Create an Announcement with the following

information:

Title: This is a Test

Body: Lorem ipsum …

Access: No change

Availability: No Change

Attachments: None

Email Notification: No change

Select the Add Announcement button

o The Announcements page is displayed showing

the This is a Test announcement.



Criteria

• Functional Test tool

• Open Source

• Collaborative in nature

• Easy to use, easy to learn• Ability to record and playback

• Manual scripting capabilities

• Command Line functionality

• Maintenance of Scripts

• User Community



Scorecard

• Ease of use - NO

• Record and Playback - YES

• Manual scripting – YES

• Command Line – YES

• Script Maintenance - NO

• User Community - Established



Push To Test w/ TestGen4Web

PushToTest TestMaker is a functional, end-to-end testingplatform that validates the service code from interface todatabase and back. PushToTest is the open-source platform forsoftware developers, QA groups, and IT management to test,optimize, monitor, and govern information systems.

TestGen4Web is a Navigation recorder, and playback tool. Itrecords the user action on the page, form fills, etc, and can savethe recording to a file and replay it back for you on demand.Combined with translators, which can convert this recording toautomated command line test tools, you can generateHTTPUnit, PHP-SimpleTest scripts.



Scorecard

• Ease of use - YES




• Script Maintenance - NO

• User Community - Growing



Selenium IDE

Selenium IDE is an integrated development

environment for Selenium tests. It is

implemented as a Firefox extension, and

allows you to record, edit, and debug tests.Selenium IDE includes the entire Selenium

Core, allowing you to easily and quickly

record and play back tests in the actual

environment that they will run.



Scorecard

• Ease of use – YES




• Script Maintenance - YES

• User Community - Growing rapidly



How We Use Selenium IDE

• Environment Setup

• Site Creation and Data Seeding

• Acceptance Testing

• Positive Path Functional Tests• Regression Testing

• Incorporating bug fixes and code

changes into the Acceptance Testson an ongoing basis



TestSuite.html

<html>

<head>

<title>Test Suite</title>

</head>

<body>

<table cellpadding="1" cellspacing="1" border="1">

<tbody>

<tr>

<td>Test suite for setting up environment and acceptance tests</td>

</tr>

<tr>

<td<a target="testFrame" href=“SS-01.htm" >Site Setup for 2.5</a></td></tr>

<tr>

<td<a target="testFrame" href=“ANNC-01.htm" >Createannouncements</a></td>

</tr>

<tr>

<td<a target="testFrame" href=“CAL-01.htm" >Create calendarevents</a></td>

</tr>

<tr>

<td<a target="testFrame" href=“LGOUT-01.htm" >Log out</a></td>

</tr></tbody>

</table></body>

</html>



Language Options

• HTML

• Java

• C#

• Perl

• PHP

• Ruby



Support with Selenium

• Support Engineers Record steps to recreate bug

and attach Selenium test to JIRA Issue

• QA uses Selenium test to verify bug fix

• Tests are added to Regression Suite



The Next Step

• Continuous Integration• Selenium Remote Control and Selenium

Grid

automating testing with open source tools

Documents