making the transition from manual to automated testing
TRANSCRIPT
Making the Transition:Manual to Automated TestingTips and Tools to help with the transition to Cross Browser and Cross Device testing with Selenium/ WebDriver
Web
inar
- M
akin
g th
e Tr
ansiti
on fr
om M
anua
l to
Auto
mat
ed Te
sting
• Co-Founder and CEO eureQa, LLC• 20+ years experience in building, testing and managing Web
application projects across multiple industries
• [email protected]• @sayeureqa
08/2
4/20
15
2
Web
inar
- M
akin
g th
e Tr
ansiti
on fr
om M
anua
l to
Auto
mat
ed Te
sting
Agenda• Introduction• Making the Transition to Test Automation• Before you begin• Once you have started – Keeping the automation going• Considerations in Tool selection
• Demo eureQa® + Sauce Labs• Q & A
08/2
4/20
15
3
Web
inar
- M
akin
g th
e Tr
ansiti
on fr
om M
anua
l to
Auto
mat
ed Te
sting
Before you begin - Plan• Scope of Automation – What to automate?• Based on frequency of testing• Business & technical priority• What can be automated (Tool dependent)
• Organize – With a focus on Reuse • Common Workflow components• Identify the granularity of reuse that works for your application• Separate Test Data from Workflows/ business logic• Traceability to requirements & changes (content, data etc.)
• Team and Tools• Strengths and capabilities of your team• Tool capabilities• What does it take to effectively use/deploy the tool• Using Selenium/WebDriver? – Do you need a Framework?
08/2
4/20
15
4
Web
inar
- M
akin
g th
e Tr
ansiti
on fr
om M
anua
l to
Auto
mat
ed Te
sting
Once you have started• Keeping it going• Ease of automation• Keep your tests fresh - Maintenance
• Incorporate testing into development process• Integration into DevOps
• CI & Issue tracking
• Managing Results• Granularity• Structured vs. unstructured• Historical results
• Reporting & Analytics• Report Types, frequency and detail• Distribution
08/2
4/20
15
5
Web
inar
- M
akin
g th
e Tr
ansiti
on fr
om M
anua
l to
Auto
mat
ed Te
sting
Selecting an Automation Tool
08/2
4/20
15Selenium/ WebDriver has emerged as the preferred choice test automation of Web applications
But building test automation with Selenium requires specialized skills and resources
6
Web
inar
- M
akin
g th
e Tr
ansiti
on fr
om M
anua
l to
Auto
mat
ed Te
sting
Selenium Infrastructure• You can build your own Selenium & Browser infrastructure• All combinations of Browsers, OS and Devices
• It involves time, effort and resources• Hardware and network infrastructure• Upgrade Selenium• Upgrade browser and OS versions
• Or you can use the Sauce Labs Cloud
08/2
4/20
15
7
Web
inar
- M
akin
g th
e Tr
ansiti
on fr
om M
anua
l to
Auto
mat
ed Te
sting
Selenium on Sauce Labs
08/2
4/20
15
500 + CombinationsScalable, Secure & Reliable Infrastructure 8
Web
inar
- M
akin
g th
e Tr
ansiti
on fr
om M
anua
l to
Auto
mat
ed Te
sting
Selenium-on-the-Cloud
Project & User Management
Reports
Notifications
Analytics
Dashboards
Custom Build w/ Selenium – Phase 1
Test Automation Framework
Keyword-driven & Data-Driven
08/2
4/20
15
9
Test Script Library
Test Authoring
Integrations w/ ALM Tools
Test Results
Local Selenium + Browsers
Test Scheduler & Runner TestNG
Phase 1 - Custom Programming of: • Test scripts with programming language of choice• Script management • Integrate with Source Code Control• Schedule Test Runs• Run against local Selenium + browsers• Output Test Results and Screenshots – Results Management
Programmers
Sys Admins
Web
inar
- M
akin
g th
e Tr
ansiti
on fr
om M
anua
l to
Auto
mat
ed Te
sting
Project & User Management
Analytics
Dashboards
Custom Build w/ Selenium – Phase 2
Test Automation Framework
08/2
4/20
15
10
Test Script Library
Test Authoring
Integrations w/ ALM Tools
Test Results
Local Selenium + Browsers
Test Scheduler & Runner TestNG
Project Management
Reports
Notifications
Keyword-driven & Data-Driven
Phase 2 - Custom Programming of: • Keyword and Data Driven
Testing• Notifications• Reports on Test Results• Additional ALM
Integrations• Integrate with Sauce Labs
Cloud for large variety of browser, OS and devices
Programmers
Sys Admins
Web
inar
- M
akin
g th
e Tr
ansiti
on fr
om M
anua
l to
Auto
mat
ed Te
sting
Test Script Library
Project & User Management
Integrations w/ ALM Tools
Project Management
Programmers
Sys Admins
Reports
Notifications
Test Results
Analytics
Dashboards
Test Authoring
Custom Build w/ Selenium – Phase 3
Test Automation Framework
Private Cloud
Keyword-driven & Data-Driven
Test Scheduler & Runner TestNG
08/2
4/20
15
11
Phase 3: • Project & User Management• Analytics & Dashboards
Web
inar
- M
akin
g th
e Tr
ansiti
on fr
om M
anua
l to
Auto
mat
ed Te
sting
08/2
4/20
15
12
Full Featured Framework+
Scalable Selenium Infrastructure
Here is an example of what it can look like.
Web
inar
- M
akin
g th
e Tr
ansiti
on fr
om M
anua
l to
Auto
mat
ed Te
sting
Introducing eureQa® + Sauce Labs
08/2
4/20
15
13
Web
inar
- M
akin
g th
e Tr
ansiti
on fr
om M
anua
l to
Auto
mat
ed Te
sting
QaSCRIBE
Test Script
Test Authoring in eureQa®
08/2
4/20
15
Script Library 14
Web
inar
- M
akin
g th
e Tr
ansiti
on fr
om M
anua
l to
Auto
mat
ed Te
sting
Test ScenarioScript Library
Test Script A Test Script B
Test Script C Test Script D
Test Script E Test Script F
Test Script G Test Script H
Test Script I Test Script J
Test Script K Test Script L
Test Script M Test Script NTest Script M
Test Script D
Test Script L
Test Script F
Test Script C
Test Script G
08/2
4/20
15
15
Web
inar
- M
akin
g th
e Tr
ansiti
on fr
om M
anua
l to
Auto
mat
ed Te
sting
Test Scenario
Test Script C
Test Script G
Test Script F
Test Script L
Test Script D
Test Script M
08/2
4/20
15
CI Support16
Web
inar
- M
akin
g th
e Tr
ansiti
on fr
om M
anua
l to
Auto
mat
ed Te
sting
eureQa® + Sauce Labs Demo
08/2
4/20
15
Watch the eureQa® Testing Platform &Sauce Labs Cloud in action!
We will cover:• First automation scenario
• Search for a book on Amazon.com• Verify attributes (ISBN #, Author etc.)• Add Book to Cart• Verify that book has been added to cart• Delete book from Cart
• Data Driven Testing• Automated Cross Browser & Cross Device Testing• Reports and Analytics
17
Web
inar
- M
akin
g th
e Tr
ansiti
on fr
om M
anua
l to
Auto
mat
ed Te
sting
DEMO
08/2
4/20
15
18
Web
inar
- M
akin
g th
e Tr
ansiti
on fr
om M
anua
l to
Auto
mat
ed Te
sting
Next Steps• More information on eureQa• http://www.sayeureqa.com
• More information on Sauce Labs• http://www.saucelabs.com
• Free Trial of eureQa• http://www.eureqatest.com/subscription/?subscription=free
• Sign up before 8/31/2015 and enter promo code “WEBINAR” to get a One Month Free Trial.
• Free Trial of Sauce Labs• https://saucelabs.com/signup/trial
08/2
4/20
15
19
Web
inar
- M
akin
g th
e Tr
ansiti
on fr
om M
anua
l to
Auto
mat
ed Te
sting
08/2
4/20
15
20
Web
inar
- M
akin
g th
e Tr
ansiti
on fr
om M
anua
l to
Auto
mat
ed Te
sting
SUPPORTING DOCUMENTSMore information that was not covered in the Webinar
08/2
4/20
15
21
Web
inar
- M
akin
g th
e Tr
ansiti
on fr
om M
anua
l to
Auto
mat
ed Te
sting
eureQa® Features
08/2
4/20
15
22
Web
inar
- M
akin
g th
e Tr
ansiti
on fr
om M
anua
l to
Auto
mat
ed Te
sting
INTEGRATE
REST Services
Selenium-on-the-Cloud
IssueTrackingCI Tools
CONTINUOUS REAL TIME ANALYTICS
Intelligent Actions Data
Visual Analytics
BUSINESS DASHBOARDS & CONTROL PANEL
Proactive AlertsReports
EXECUTE
Test Scheduler
TestEngine
Test Results
PLAN
Project/ User Definition
Assignments
Test Cases
AUTOMATE
Test Authoring
Test Assembly
Keyword/ Data Driven Testing
08/2
4/20
15
eureQa® Testing Platform23
Web
inar
- M
akin
g th
e Tr
ansiti
on fr
om M
anua
l to
Auto
mat
ed Te
sting
Easy Test Automation• Build Test Automation without programming• Automation by Subject Matter Experts (SMEs), not programmers• Support for advanced automation constructs without programming
• Conditional Logic and Nested Loops• Keyword & Data driven testing• Smart locator identification• System and user defined parameters
• Ease of maintenance and built-in change/version control of test scripts and test data• Increased automation efficiency through reuse
• Assemble unlimited Test Scenarios from existing Test Scripts• Group multiple test scenarios for execution using Run Definitions
• Validate Test Scenarios using real data with any device-OS-browser• Support for Automation of Rich Internet Applications• Test Cases that require File Uploads into Applications
08/2
4/20
15
24
Web
inar
- M
akin
g th
e Tr
ansiti
on fr
om M
anua
l to
Auto
mat
ed Te
sting
Test Management• Traceability and test coverage• Eliminate ‘broken tests’ with Change Impact Analysis• Organize test objects just the way you want to• Powerful search helps you find test objects faster and easier• Manage data definitions and test data files• Manage test results• Test Automation Versioning & Smart Dependencies Migration• Tagging & Labeling (Google Style)• Audit Trial / Change Log • Project & Product level access control & visibility• Reporting on Project and User level activities
08/2
4/20
15
25
Web
inar
- M
akin
g th
e Tr
ansiti
on fr
om M
anua
l to
Auto
mat
ed Te
sting
Test Execution• Cloud based => No infrastructure required• Test cloud based, SaaS, Public facing and internal applications• Cross-Browser & Cross-Device execution of automated tests• Support for test execution on Sauce Labs Cloud• Support for Testing Contexts to control test execution• Unlimited parallel/concurrent execution of tests• Unmanned/Remote Executions from your ALM CI tools• Screenshots, Videos of application response during test execution• Data Driven Testing supported by Excel (CSV) files that contain test
inputs and expected outputs
08/2
4/20
15
26
Web
inar
- M
akin
g th
e Tr
ansiti
on fr
om M
anua
l to
Auto
mat
ed Te
sting
Insightful Reporting and Analytics
• Planning• Traceability Reports• Coverage Reports
• Operations• Summary and detail test results• Standard and Custom PDF & Excel reports• Screenshots and Videos of test runs• Downloadable results• User & Project Activity
• Quality Improvement• Quality Trending• Impact Analysis
• Automatic notifications of test progress. • Project and user-level control of notifications
08/2
4/20
15
27
Web
inar
- M
akin
g th
e Tr
ansiti
on fr
om M
anua
l to
Auto
mat
ed Te
sting
ALM Integration• Support for Agile Development Processes• Integration with CI Tools
• Jenkins• Bamboo• Maven
• Bi-directional integration with Atlassian JIRA• Log issues automatically• Import application feature and module information from JIRA to
build traceability• REST Services API• Initiate test execution• Query on progress of test execution• Download Test Results
08/2
4/20
15
28