software testing techniques testing tools

Software testing techniquesSoftware testing techniques

Testing tools

Presentation on the seminar

Kaunas University of Technology

Why do we need testing tools?

• Testing is faster• Testing is cheaper• Testing is more effective

We get better quality software for almost the same price.

Types of testing tools

• Unit testing tools• Model-based testing tools• Functional (GUI) testing tools• Non-functional testing tools• Code analysis testing tools

Unit testing

Unit testing is a method by which individual units of source code are tested to determine if they are fit for use.

interface Adder { int add(int a, int b);

} class AdderImpl implements Adder {

int add(int a, int b) { return a + b; } }

Unit testing

public class TestAdder { public void testSum() {

Adder adder = new AdderImpl(); assert(adder.add(1, 1) == 2); assert(adder.add(1, 2) == 3); assert(adder.add(2, 2) == 4); assert(adder.add(0, 0) == 0); assert(adder.add(-1, -2) == -3); assert(adder.add(-1, 1) == 0); assert(adder.add(1234, 988) ==

2222); }

}

Unit testing

Tools:

csUnit, Nunit, NUnitASP, EMTF, CppUnit, Cput, C++test, UnitTest++, Dunit, Jtest, JUnit, TestNG, NUTester, JSUnit, QUnit, jsUnity…

Today we have unit testing tools for more than 70 programming languages.

Model-based testing

Model-based testing is an approach in which you define the behavior of a system in terms of actions that change the state of the system. Such a model of the system results in a well-defined Finite State Machine (FSM) which helps us to understand and predict the system’s behavior.

Model-based testing

Steps:

1.Build the model;

2.Generate expected inputs;

3.Generate expected outputs;

4.Run tests;

5.Compare actual outputs with expected outputs;

6.Decide on further actions (modify the model, generate more tests, stop testing and etc.)

Model-based testing

Advantages:•Forces detailed understanding of the system behavior;•Early bug detection (which is much cheaper);•Test suite grows with the product;•Manage the model instead of the cases (useful when features changing constantly);•Can generate endless tests (since test cases are machine generated);

Model-based testing

Tools:

MaTeLo, SpecExplorer, GraphWalker…

Functional (GUI) testing

Functional testing is a type of black box testing that bases its test cases on the specifications of the software component under test. Functions are tested by feeding them input and examining the output, and internal program structure is rarely considered.

Functional (GUI) testing

public void testAddUserFail() throws Exception {

solo.sendKey(Solo.MENU); solo.clickOnText(“Add”); Assert.assertTrue(solo.searchText(“Name:”)); Assert.assertTrue(solo.searchText(“Surname:”));       solo.clickOnText(“Ok”);   Assert.assertTrue(solo.searchText(“Error”));          }

Functional (GUI) testing

Tools:

Abbot, AutoHotkey, CubicTest, Dogtail, FitNesse, Linux Desktop Testing Project, Maveryx, Qaliber, Selenium, Robotium…

Non-functional testing

Non-functional testing is the testing of a software application for its non-functional requirements.

Non-functional testing

Non-Functional Testing covers:•Load and Performance Testing•Ergonomics Testing•Stress & Volume Testing•Compatibility & Migration Testing•Data Conversion Testing•Security / Penetration Testing•Operational Readiness Testing•Installation Testing•Security Testing

Non-functional testing

Tools:

AppLoader, IBM Rational Performance Tester, Jmeter, LoadRunner, Apache Bench, Httpperf, SLAMD…

Code analysis

Static code analysis. A methodology of detecting errors in program code based on the programmer's reviewing the code marked by the analyzer in those places where potential errors may occur.

Code analysis

The earlier an error is determined, the lower is the cost of its correction. Correction of an error at the testing stage is ten times more expensive than its correction at the construction (coding) stage.

Code analysis

Tools:

Copy/Paste detector, Sonar, Yasca, FxCop, Gendarme, StyleCop, cppcheck, Checkstyle, FindBugs, Hammurapi, Closure Compiler, JSLint…

Questions?

Questions

• Why do we need testing tools?• List types of testing tools.• What is static code analysis?• What are the steps of model-based testing?• What non-functional testing covers?