tmap hd. test engineer. - sogeti.nl tester staat centraal... · 10-9-2015 werken met de tmap suite...
TRANSCRIPT
10-9-2015
Werken met de TMap Suite 1
Sogeti Testing University
TMap® HD.
Test Engineer.
|
Working with the TMap Suite for Test Engineers
Confidence through built-in Quality
Vianen, 3 september 2015
2 Working with the TMap Suite
10-9-2015
Werken met de TMap Suite 2
|
Agenda:
• Welkom en introductie • TMap HD en de TMap Suite • Workshop: Testen met testontwerptechnieken
(maar niet met de hand!!) • Terugkoppeling en conclusie • Afsluiting
3 Working with the TMap Suite
|
Wie van jullie is:
Test Analist / Test Engineer
Test Manager
Overig (Wat dan?)
Wie van jullie heeft:
TMap Test Engineer certificaat
TMap Test Manager certificaat
4 Working with the TMap Suite
Even kort kennis maken…
10-9-2015
Werken met de TMap Suite 3
|
Even voorstellen: Rik Marselis
5 Working with the TMap Suite
Management Consultant Quality & Testing bij
Zo’n 35 jaar IT ervaring, zo’n 17 jaar kwaliteit & testen
Adviseur, procesverbeteraar & coach bij vele organisaties Prince2 Practitioner, CMMI en CISA
Docent voor diverse trainingen, bijv. Agile testen
TMap, TPI en ISTQB geaccrediteerd
Research Auteur div. boeken en artikelen Fellow van SogetiLabs, Spreker op div. conferenties
En daarnaast:
Voorzitter (vereniging voor & door testers, 1700 leden)
@rikmarselis
|
TMap’s evolution: TMap HD & the TMap Suite
Confidence through built-in Quality
6 Working with the TMap Suite
10-9-2015
Werken met de TMap Suite 4
|
TMap’s evolution
7 Working with the TMap Suite
TMap ‘blue’
TMap NEXT
TMap HD
Application
variant Adaptive Pattern
Process driven Business driven Human driven
|
TMap Suite
8 Working with the TMap Suite
The TMap Suite
TMap NEXT certificates remain valid! www.TMap.net
10-9-2015
Werken met de TMap Suite 5
|
TMap HD:
What’s new?
Confidence through built-in Quality
9 Working with the TMap Suite
|
TMap HD: What’s new?
10
10-9-2015
Werken met de TMap Suite 6
|
New: the Elements
11
Mr. Mikkel introduces Neil to the elements…
|
New: the Elements
Mr. Mikkel introduces Neil to the elements…
12
10-9-2015
Werken met de TMap Suite 7
| 13 Working with the TMap Suite
TMap HD: The Elements
People
Integrate
Simplify
Industrialize
Confidence
Human driven Quality driven
| 14 Working with the TMap Suite
How testing is often perceived
Two IT people are cycling up a hill on a tandem-bike. When they finally reach the summit the one in front, the developer, says: ‘It was hard but we made it!’ Then the one at the back, the tester, comments: ‘Yes and I hope you appreciate that I was using the brakes all the time because otherwise we would have rolled down the hill backwards’
Use TMap HD to make sure you are a tester that helps cycling up the hill !!
10-9-2015
Werken met de TMap Suite 8
|
Human Driven as opposed to Process
Driven
Skills, Knowledge and Experience of
the individual are crucial
Team responsibility
vs.
Personal responsibility
15 Working with the TMap Suite
Element People: the T-shaped professional
The difference between failure and success is in… the People involved
|
The modern tester
… must be:
Curious
Creative
Quality driven
Willing to learn
Multi-disciplinary
16 Working with the TMap Suite
… needs to possess:
People-skills
Testing-skills
Tooling-skills
Observational skills
Domain knowledge
10-9-2015
Werken met de TMap Suite 9
|
Element: Integrate
17 Working with the TMap Suite
Collaboration across the entire Application LifeCycle • Reviews and clear handovers in
traditional lifecycle • Integrated cross-functional teams
in iterative lifecycles
|
Element: Simplify
IT is rapidly becoming more complex and more difficult to manage. To reverse this trend we must simplify. By using standard components the process and product become simpler. As a tester we can use test design techniques to make sure we have just enough test cases. Don’t do unnecessary activities. Work in short cycles with clear goals.
18 Working with the TMap Suite
10-9-2015
Werken met de TMap Suite 10
|
Automate and Standardize
The tester needs to develop an additional skill set
Recognize opportunities, even if you can’t realize them yourself
19 Working with the TMap Suite
Element: Industrialize
|
Element: Industrialize
Industrialize is about being efficient and effective Automated test design Automated test execution Automated test data management Automated test environment management But also: Checklists Comparators Tools to specify expected outcomes Etc.
20 Working with the TMap Suite
10-9-2015
Werken met de TMap Suite 11
|
Quality Driven
21 Working with the TMap Suite
TMap HD
Quality-Driven
|
The overarching result!
Confidence in: The quality of the end product The team By the team members and By ‘the organization’!
One self
22 Working with the TMap Suite
The Final Element: Confidence
10-9-2015
Werken met de TMap Suite 12
| 23 Working with the TMap Suite
The Elements & Continuous improvement
People
Integrate
Simplify
Industrialize
Confidence
Human driven Quality driven
continuous improvement
|
Building Blocks
24 Working with the TMap Suite
Confidence through built-in Quality
10-9-2015
Werken met de TMap Suite 13
| Working with the TMap Suite
TMap HD: Building Blocks
25
|
Building Block:
Test varieties
28 Working with the TMap Suite
Confidence through built-in Quality
10-9-2015
Werken met de TMap Suite 14
|
Testing needs different angles and views
Today people are hesitant to use the word ‘Test Level’ since it seems to imply hierarchy.
Testers often struggle to distinguish between Test Levels and Test Types. What should the focus of testing should be? What stakeholders should be involved in testing? Do they have different
needs? Inexperienced Agile teams often do unit testing only, they forget the
need to look from other perspectives
29 Working with the TMap Suite
|
Test varieties
TM
ap
da
g
30
10-9-2015
Werken met de TMap Suite 15
|
Traditional lifecycles
Test levels Test types
Iterative lifecycles
Test approaches
31 Working with the TMap Suite
Implementing test varieties
Blended model
|
Test approaches - Experience based - Coverage based
41 Working with the TMap Suite
Confidence through built-in Quality
10-9-2015
Werken met de TMap Suite 16
|
Test approaches
42 Working with the TMap Suite
• What do these terms mean?
• What is the difference?
|
Test approaches with TMap HD
43 Working with the TMap Suite
Experience based Coverage based
1. Checklist
Used for static & dynamic testing
1. Process
e.g. Proces Cycle Test
2. Error guessing
Based on previously encountered defects
2. Conditions
e.g. Elementary Comparison Test of
Decision table
3. Exploratory testing
Learn, design and execute in parallel
3. Data
e.g. Data Combination Test
4. Appearance
e.g. Syntactic or using user profile
10-9-2015
Werken met de TMap Suite 17
|
Coverage based testing
44 Working with the TMap Suite
Confidence through built-in Quality
|
Welke testontwerptechnieken ken je?
Exp
lora
tory
Test
45
10-9-2015
Werken met de TMap Suite 18
|
Test design techniques & coverage types
TMap NEXT • Equivalence classes • Boundary value analysis
• Decision points (CC, DC, CDC, MCDC, MCC)
• Orthogonal arrays
• Pairwise testing • Data cycle test (CRUD)
• Statistical usage (op.prof. • Right paths / Fault paths • Checklist
• Decision table • Data Combination Test
• Elementary comparison tst • Process Cycle test • Real-life test
• Semantic test • Syntactic test
• Use case test • Error Guessing • Exploratory testing
• Reviews • Walkthroughs
• Inspections
46
ISTQB • Equivalence partitioning • Boundary value analysis • Decision table testing
• Cause Effect graphing • State transition testing
• Use case testing • User story testing • Structure based (SC, CC, DC,
CDC, MCDC, MCC) • Error Guessing
• Exploratory testing • Orthogonal arrays • Pairwise testing
• Domain analysis • Defect based techniques
• Checklist • Combinatorial / Class. tree • Informal review
• Technical review • Walkthrough
• Inspection • Static analysis
Torbjorn Ryber • Exploratory testing
(this is an approach, not a technique)
• Inspection • Walkthrough
• Technical review • Informal review • Modelling
• Equivalence partitions • Boundary values
• Domain tests • Business process testing • Use case testing
• State based testing • Decision tables & trees
• Elementary comparison • Combinatorial testing • Data cycle testing
• Syntax testing • Time cycle testing
• Program Logic (SC, BC, PC) • Data flow testing
Boris Beizer • Control-flow testing
• Loop testing
• Data-flow testing
• Transaction-flow testing
• Domain testing
• Syntax testing
• Finite-state testing
And more…
|
Select from 4 groups of Coverage types
47 Working with the TMap Suite
Better know & use one technique
of each group
than
all techniques of only one group
10-9-2015
Werken met de TMap Suite 19
|
Zo werkt “testen met een testontwerptechniek”
Ontwerp alle testgevallen met een bepaalde techniek
Voer alle testgevallen uit
Rapporteer over de resultaten
48 Working with the TMap Suite
|
Waaruit bestaat een testgeval?
Uitgangssituatie
Actie & Input
Verwacht resultaat
49 Working with the TMap Suite
10-9-2015
Werken met de TMap Suite 20
|
Coverage based testing + Industrialize = COVER
50 Working with the TMap Suite
Confidence through built-in Quality
|
COVER: de testontwerptool van Sogeti
Ontwerpen van:
• testsituaties,
• testgevallen en
• fysieke testgevallen
Diverse technieken
51 Working with the TMap Suite
10-9-2015
Werken met de TMap Suite 21
|
COVER
Demo
52 Working with the TMap Suite
|
Workshop
53 Working with the TMap Suite
Confidence through built-in Quality
10-9-2015
Werken met de TMap Suite 22
|
Workshop; De OV-korting-case
54 Working with the TMap Suite
|
Voorbeeld
55 Working with the TMap Suite
COVER Condities
Elementaire Vergelijkingen Test
10-9-2015
Werken met de TMap Suite 23
|
Uitleg workshop
In teams van + 4 mensen:
Ontwerp testgevallen, m.b.v. COVER met PCT en DCT
Noteer de testgevallen op de logsheet Voer de testgevallen uit
Rapporteer je resultaten
Als je klaar bent: vraag om de exploratory testing charter
56 Working with the TMap Suite
|
Workshop; De OV-korting-case
57 Working with the TMap Suite
10-9-2015
Werken met de TMap Suite 24
|
Toelichting PCT
PCT: - Teken de procesflow met www.draw.io - Exporteer de flow als XML (plain) - Importeer de XML in COVER - Genereer de logische testgevallen - Maak op een logsheet de fysieke testgevallen - Voer de fysieke testgevallen uit
58 Working with the TMap Suite
|
Toelichting DCT
DCT: - Bepaal de verschillende gegevens - Bepaal per gegeven de equivalentieklassen - Ga naar “data” in COVER, en kies “genereer testgevallen” - Vul de gegevens in en de verschillende klassen - Genereer de testgevallen - Maak op een logsheet de fysieke testgevallen - Voer de fysieke testgevallen uit
59 Working with the TMap Suite
10-9-2015
Werken met de TMap Suite 25
|
Terugkoppeling
Hoeveel testgevallen heb je gemaakt?
Wat zijn je testresultaten (passed/failed/observations)
Heb je bevindingen?
Met welk testgeval heb je de bevinding gevonden?
60 Working with the TMap Suite
|
Terugkoppeling en conclusie
Coverage based testen met tooling zodat je op een efficiënte manier een aantoonbare dekking hebt
Experience based testen om aanvullende dekking, en
vooral vertrouwen te krijgen
Combinatie van gegenereerde dekking en hersenkracht
geeft optimaal testen.
61 Working with the TMap Suite
10-9-2015
Werken met de TMap Suite 26
|
Omgaan met een complete gereedschapskist
62 Working with the TMap Suite
|
Conclusie
63 Working with the TMap Suite
Met de TMap Suite ga je van: Werken volgens TMap
Naar:
Werken met TMap
10-9-2015
Werken met de TMap Suite 27
|
TMap HD and TMap NEXT and tmap.net
Confidence through
built-in Quality
Not just for ‘true’ Lean or Agile environments, but also in traditional and hybrid environments.
Human Driven Quality Driven
Elements
People
Simplify
Integrate
Industrialize
Building Blocks
Patterns
Tooling (bijv. COVER)
64 Working with the TMap Suite
The TMap Suite summarized
Confidence
|
Download vanaf www.marselis.eu
of neem een printje mee.
65 Working with the TMap Suite
Meer lezen?