TEST MASTER: STOP MANAGING AND START MASTERING
About Silvio Moser
Co-‐founder and CTO of SwissQ Management Consultant, Test Master, Trainer
20-‐plus year career in IT as developer, business analyst, tester, and project leader
Co-‐founder of Swiss TesJng Board (naJonal branch of ISTQB)
SwissQ
A Switzerland-‐based IT consulJng company, specializing in tesJng and requirements
engineering, with a focus on agile methodologies SwissQ organizes the Swiss TesJng Day
and acJvely drives innovaJon
2
TODAY’S TEST MANAGER ROLE
Today’s Test Manager Role
q “Managing” is a big part of the job → Plan and re-‐plan tesJng acJviJes → Set-‐up and configure test management tool (even if it is "just” Excel) → Maintain test cases and aYributes → Organize and document test meeJngs (status, defect, review, …) → Schedule and coordinate test sessions → Create and update test reports → …
The person responsible for project management of tesJng acJviJes and resources, and evaluaJon of a test object. The individual who directs, controls, administers, plans and regulates the evaluaJon of a test object.
4
FIT FOR PURPOSE?
It Used To Be Simple...
6
Workload Mgmt
Client
Configura:on Tools
Administra:on Tools
Repor:ng Tools
Then Something Was Added...
7
Customer DB
Codes
Documents SOA
Content Acquisi:on
Web
App
LeDer
Phone
MQ
Tasks
Claims
Redundant Server Farm (7*24h)
Skills
Rules
MQ
SOA
Message Broker
Bridge
SOA
NoJficaJon
Error
Inbound
Sync DB
Workload Mgmt
Client
Configura:on Tools
Administra:on Tools
Repor:ng Tools
There Is More To Come...
8
Customer DB
Codes
Documents SOA
Content Acquisi:on
Web
App
LeDer
Phone
MQ
Tasks
Claims
Redundant Server Farm (7*24h)
Skills
Rules
MQ
SOA
Message Broker
Bridge
SOA
NoJficaJon
Error
Inbound
Sync DB
And Then…
9
Web
App
develope
r.and
roid.com
, Oct 2013
Mobile Browser Market Share
OS Market Share
Android Fragmenta:on
netmarketshare.com, Oct 2013
Web Browser Market Share
Complexity
Technical Content
Interac:on
Level
10
How SW Engineering Adapts
q Outsourcing q Architectural Blueprints q COTS q ProliferaJon of Programming Languages q Agile Development q …
11
AND TESTING?
From Division Of Roles
Manual Tester
Test Manager
Test Engineer
Test Designer
13
To One FuncJon Fits All
Embedded Tester
test management
manual tes:ng
tes:ng
usability
test design regression tes:ng
test automa:on
performance
14
Embedded TesJng
15
Planning
2
Sprint
Review
Retro-spective
Planning
1 ready
done
Sprint Backlog
Increment
Product Backlog
Daily Scrum
Grooming
Test Estimation
Participation
User Story Testing
Exploratory Testing
Regression Testing
Non-Functional Testing
Story Review Testing Tasks & Stories
Test Reporting
Challenge Done Criteria
Demo
Participation
BUT… WHAT ABOUT INTEGRATION?
Test Master
(agile) test strategy
end-‐to-‐end tes:ng
integra:on
facilitate stakeholder management
orchestra:on
moderate
coaching
Test Master
17
Test Master DuJes
q defines and lives the (agile) Test Strategy, q heads the tesJng Community of PracJce, q coaches people in tesJng roles, q coordinates all tesJng requirements, q removes impediments for tesJng, q controls the “DefiniJon of Done” across all levels, q facilitates communicaJon about tesJng in and
beyond the team, and q plans and coordinates overall tesJng.
18
Source: Test Master job profile at Fortune 500 reinsurance company
Waterfall
Team
Overall
Integrated System
Scrum
RUP
Sync Point Sync Point
System Integra<on Test
Go Live
End-‐to-‐End Test
(final) User Acceptance Test
IntegraJon
Embedded Tester
Test Master
19
Team vs Overall
Team
Overall
Embedded Tester
Test Master
20
Test Master QualificaJons q EssenJal:
→ A minimum of 5 year experience in a Soiware Engineering role. → Experience with waterfall and agile methodologies. → Experience in a systems tesJng environment working on complex
projects. → Good working knowledge of database / DWH development / tesJng. → Financial industry experience. → Excellent communicaJon and negoJaJon skills.
q Should have: → Risk domain experience. → Experience in global team / structure. → Advanced Level TesJng CerJficaJon (ISTQB or ISEB) → Test AutomaJon experJse. → Experience of unit tesJng best pracJces (Clean Code pracJces).
21
Source: Test Master job profile at Fortune 500 reinsurance company
Managing vs. Mastering
Source: Hermann Interna<onal
Holis:c Intui:ve
Integra:ng Synthesizing
Interpersonal Feeling based Kinesthe:c Emo:onal
Organized Sequen:al Planned Detailed
Logical Analy:cal Fact based Quan:ta:ve
Test Master
Test Manager
22
The Importance Of Social Skills
CollaboraJon
NegoJaJon
CommunicaJon
Conflict ResoluJon
ModeraJng
23
EvoluJon Of The Tester
1990
Testers, if they exist at all, are an exoJc breed, who are not taken seriously.
2000
The field and profession establish themselves; there are more and more testers, oien organized in central teams.
2010
The payoff of tesJng is challenged. Testers have to be resourceful.
2014
Agile methods are widely adoped – death of the tester?
Tester
Test Manager Test Engineer
SW Engineer in Test
Embedded Tester Test Master
24
Key Points
q Keep pace with the changing world of soiware development and increased complexity.
q Adapt to a new test curriculum. → Embedded TesJng at team level. → Test Master at integraJon level.
q Defines and lives the (agile) Test Strategy. q Requires strong social skills. q Individuals and interacJons over
processes and tools.
25
STOP MANAGING AND START MASTERING