janet gregory - agile testing challenges knowit 2014
DESCRIPTION
Janet Gregory's presentation at Knowit's Agile testing challenges -seminar 22.5.2014TRANSCRIPT
![Page 1: Janet Gregory - Agile testing challenges Knowit 2014](https://reader033.vdocuments.net/reader033/viewer/2022060107/554a18d9b4c905825d8b50b2/html5/thumbnails/1.jpg)
Janet Gregory, DragonFire Inc. Copyright 2014
Knowit, Helsinki
2014
![Page 2: Janet Gregory - Agile testing challenges Knowit 2014](https://reader033.vdocuments.net/reader033/viewer/2022060107/554a18d9b4c905825d8b50b2/html5/thumbnails/2.jpg)
Copyright 2014 DragonFire Inc.
First agile team – 2000
Currently – coaching, testing
Agile Testing; January 2009
Working on 2nd book: Fall 2014 2
![Page 3: Janet Gregory - Agile testing challenges Knowit 2014](https://reader033.vdocuments.net/reader033/viewer/2022060107/554a18d9b4c905825d8b50b2/html5/thumbnails/3.jpg)
Copyright 2014 DragonFire Inc.
• Testing and agile
• Challenges and suggestions
• Importance of collaboration
• Wrap-up
3
![Page 4: Janet Gregory - Agile testing challenges Knowit 2014](https://reader033.vdocuments.net/reader033/viewer/2022060107/554a18d9b4c905825d8b50b2/html5/thumbnails/4.jpg)
Copyright 2014 DragonFire Inc.
• have short feedback loops
• active customer participation
• demand whole team collaboration
• test features as they are coded
• deliver business value at regular intervals
• adapt their processes based on feedback
…and so on………….
![Page 5: Janet Gregory - Agile testing challenges Knowit 2014](https://reader033.vdocuments.net/reader033/viewer/2022060107/554a18d9b4c905825d8b50b2/html5/thumbnails/5.jpg)
Agile teams:
produce a continuous stream of value at a sustainable pace, while adapting to the changing needs of the business.
http://testobsessed.com/blog/2010/12/14/the-agile-acid-test/
![Page 6: Janet Gregory - Agile testing challenges Knowit 2014](https://reader033.vdocuments.net/reader033/viewer/2022060107/554a18d9b4c905825d8b50b2/html5/thumbnails/6.jpg)
Copyright 2014 DragonFire Inc.
• more than “just” testing code
• an activity; not a phase
6
Potentially shippable product
Potentially shippable product
![Page 7: Janet Gregory - Agile testing challenges Knowit 2014](https://reader033.vdocuments.net/reader033/viewer/2022060107/554a18d9b4c905825d8b50b2/html5/thumbnails/7.jpg)
Copyright 2014 DragonFire Inc.
1. Testing doesn’t keep up with coding
2. Forgetting the big picture
3. Testers aren’t really part of the team
4. Trying to test everything manually
7
![Page 8: Janet Gregory - Agile testing challenges Knowit 2014](https://reader033.vdocuments.net/reader033/viewer/2022060107/554a18d9b4c905825d8b50b2/html5/thumbnails/8.jpg)
Copyright 2014 DragonFire Inc. 8
![Page 9: Janet Gregory - Agile testing challenges Knowit 2014](https://reader033.vdocuments.net/reader033/viewer/2022060107/554a18d9b4c905825d8b50b2/html5/thumbnails/9.jpg)
Risk: The Mini-Waterfall
![Page 10: Janet Gregory - Agile testing challenges Knowit 2014](https://reader033.vdocuments.net/reader033/viewer/2022060107/554a18d9b4c905825d8b50b2/html5/thumbnails/10.jpg)
10
• Stories aren’t tested completely
• Testers lose credibility
• Technical debt increases
• Team changes meaning of ‘DONE’
![Page 11: Janet Gregory - Agile testing challenges Knowit 2014](https://reader033.vdocuments.net/reader033/viewer/2022060107/554a18d9b4c905825d8b50b2/html5/thumbnails/11.jpg)
Copyright 2014 DragonFire Inc.
• Include testing tasks in the velocity
• Involve whole team in story creation
◦ ensure stories are small and testable
• Get your developers used to immediate feedback
11
![Page 12: Janet Gregory - Agile testing challenges Knowit 2014](https://reader033.vdocuments.net/reader033/viewer/2022060107/554a18d9b4c905825d8b50b2/html5/thumbnails/12.jpg)
Copyright 2014 DragonFire Inc.
• Know your build pipeline
• Provide adequate test infrastructure
12
![Page 13: Janet Gregory - Agile testing challenges Knowit 2014](https://reader033.vdocuments.net/reader033/viewer/2022060107/554a18d9b4c905825d8b50b2/html5/thumbnails/13.jpg)
Copyright 2014 DragonFire Inc.
Instead of saying NO,
or being the gatekeeper
Be the information provider so business can make the decisions
Questions… about not testing stories
13
![Page 14: Janet Gregory - Agile testing challenges Knowit 2014](https://reader033.vdocuments.net/reader033/viewer/2022060107/554a18d9b4c905825d8b50b2/html5/thumbnails/14.jpg)
Copyright 2014 DragonFire Inc.
The red flags
• Testing only individual stories
• Finding integration bugs late
• Testing is based on what developers code
• Testing finds requirements type bugs
• Developers add extra code after they are finished
14
![Page 15: Janet Gregory - Agile testing challenges Knowit 2014](https://reader033.vdocuments.net/reader033/viewer/2022060107/554a18d9b4c905825d8b50b2/html5/thumbnails/15.jpg)
Copyright 2014 DragonFire Inc.
We only see the tip of the Iceberg We don’t think of big systems We only looking at our own team.
The Risks
15
![Page 16: Janet Gregory - Agile testing challenges Knowit 2014](https://reader033.vdocuments.net/reader033/viewer/2022060107/554a18d9b4c905825d8b50b2/html5/thumbnails/16.jpg)
Copyright 2014 DragonFire Inc.
• Think system impacts
• Test data to reflect real world ◦ Examples, exploratory tests
• Draw pictures / workflows
• Understand the story before coding starts
16
![Page 17: Janet Gregory - Agile testing challenges Knowit 2014](https://reader033.vdocuments.net/reader033/viewer/2022060107/554a18d9b4c905825d8b50b2/html5/thumbnails/17.jpg)
Copyright 2014 DragonFire Inc. 17
![Page 18: Janet Gregory - Agile testing challenges Knowit 2014](https://reader033.vdocuments.net/reader033/viewer/2022060107/554a18d9b4c905825d8b50b2/html5/thumbnails/18.jpg)
Copyright 2014 DragonFire Inc.
• Define “Release DONE” ◦ What needs to be in place?
• Define “Feature DONE” ◦ Acceptance tests for bigger picture
• Define “story DONE” ◦ Acceptance tests – expected behaviour,
misbehaviours
18
![Page 19: Janet Gregory - Agile testing challenges Knowit 2014](https://reader033.vdocuments.net/reader033/viewer/2022060107/554a18d9b4c905825d8b50b2/html5/thumbnails/19.jpg)
![Page 20: Janet Gregory - Agile testing challenges Knowit 2014](https://reader033.vdocuments.net/reader033/viewer/2022060107/554a18d9b4c905825d8b50b2/html5/thumbnails/20.jpg)
Understand the business value !
![Page 21: Janet Gregory - Agile testing challenges Knowit 2014](https://reader033.vdocuments.net/reader033/viewer/2022060107/554a18d9b4c905825d8b50b2/html5/thumbnails/21.jpg)
ATDD (Acceptance Test Driven Development)
![Page 22: Janet Gregory - Agile testing challenges Knowit 2014](https://reader033.vdocuments.net/reader033/viewer/2022060107/554a18d9b4c905825d8b50b2/html5/thumbnails/22.jpg)
Copyright 2014 DragonFire Inc.
Instead of saying NO,
or being the gatekeeper
Be the information provider so business can make the decisions
Questions… Remembering the Big Pic?
22
![Page 23: Janet Gregory - Agile testing challenges Knowit 2014](https://reader033.vdocuments.net/reader033/viewer/2022060107/554a18d9b4c905825d8b50b2/html5/thumbnails/23.jpg)
Copyright 2014 DragonFire Inc.
• Testers aren’t in iteration planning sessions
• Testers test what the developers code
• Testers don’t understand the stories
Testers don’t actively participate
23
![Page 24: Janet Gregory - Agile testing challenges Knowit 2014](https://reader033.vdocuments.net/reader033/viewer/2022060107/554a18d9b4c905825d8b50b2/html5/thumbnails/24.jpg)
• Wrong assumptions are made
• Impacts to the system are found too late
• Everyone’s skills are not utilized
• The team becomes divided
• Testers don’t know what is going on
![Page 25: Janet Gregory - Agile testing challenges Knowit 2014](https://reader033.vdocuments.net/reader033/viewer/2022060107/554a18d9b4c905825d8b50b2/html5/thumbnails/25.jpg)
Copyright 2014 DragonFire Inc.
• Communication is through the defect tracking system
• Developers use testers as a safety net
• The team never ‘gels’
25
• Project team doesn’t buy the ‘build quality in’ concept
![Page 26: Janet Gregory - Agile testing challenges Knowit 2014](https://reader033.vdocuments.net/reader033/viewer/2022060107/554a18d9b4c905825d8b50b2/html5/thumbnails/26.jpg)
26
Tips for Tester Involvement
![Page 27: Janet Gregory - Agile testing challenges Knowit 2014](https://reader033.vdocuments.net/reader033/viewer/2022060107/554a18d9b4c905825d8b50b2/html5/thumbnails/27.jpg)
Copyright 2014 DragonFire Inc. Copyright 2009 Janet Gregory, DragonFire 27
The Agile Testing Quadrants (adapted from Brian Marick)
![Page 28: Janet Gregory - Agile testing challenges Knowit 2014](https://reader033.vdocuments.net/reader033/viewer/2022060107/554a18d9b4c905825d8b50b2/html5/thumbnails/28.jpg)
Copyright 2014 DragonFire Inc.
Instead of saying NO,
or being the gatekeeper
Be the information provider so business can make the decisions
Questions about whole team?
28
![Page 29: Janet Gregory - Agile testing challenges Knowit 2014](https://reader033.vdocuments.net/reader033/viewer/2022060107/554a18d9b4c905825d8b50b2/html5/thumbnails/29.jpg)
Copyright 2014 DragonFire Inc.
• Spending time retesting features already tested
• Not testing new features
• Not contributing to implementation / design discussions
29
• Testers miss meetings – too busy
• Regression suite not run regularly
![Page 30: Janet Gregory - Agile testing challenges Knowit 2014](https://reader033.vdocuments.net/reader033/viewer/2022060107/554a18d9b4c905825d8b50b2/html5/thumbnails/30.jpg)
Copyright 2014 DragonFire Inc.
• Testing cannot keep up with new stories
• Features that used to work, are broken and not noticed
• Testers don’t learn new technology
• Testers get stuck in a rut
30
![Page 31: Janet Gregory - Agile testing challenges Knowit 2014](https://reader033.vdocuments.net/reader033/viewer/2022060107/554a18d9b4c905825d8b50b2/html5/thumbnails/31.jpg)
Copyright 2014 DragonFire Inc.
• Automate as you go
• Include automation time in your estimates
• Design for testability
• Chose tools that encourage collaboration
• Understand the power & risks of automation
31
![Page 32: Janet Gregory - Agile testing challenges Knowit 2014](https://reader033.vdocuments.net/reader033/viewer/2022060107/554a18d9b4c905825d8b50b2/html5/thumbnails/32.jpg)
Common automation model
Automation through the
GUI
Unit Tests
![Page 33: Janet Gregory - Agile testing challenges Knowit 2014](https://reader033.vdocuments.net/reader033/viewer/2022060107/554a18d9b4c905825d8b50b2/html5/thumbnails/33.jpg)
push the tests lower
![Page 34: Janet Gregory - Agile testing challenges Knowit 2014](https://reader033.vdocuments.net/reader033/viewer/2022060107/554a18d9b4c905825d8b50b2/html5/thumbnails/34.jpg)
34
“Living
Documentation” David Evans, Gojko Adzic
![Page 35: Janet Gregory - Agile testing challenges Knowit 2014](https://reader033.vdocuments.net/reader033/viewer/2022060107/554a18d9b4c905825d8b50b2/html5/thumbnails/35.jpg)
Copyright 2014 DragonFire Inc. 35
**Automation does not exclude the need for exploratory testing*
![Page 36: Janet Gregory - Agile testing challenges Knowit 2014](https://reader033.vdocuments.net/reader033/viewer/2022060107/554a18d9b4c905825d8b50b2/html5/thumbnails/36.jpg)
Copyright 2014 DragonFire Inc.
Instead of saying NO,
or being the gatekeeper
Be the information provider so business can make the decisions
Questions… Automation?
36
![Page 37: Janet Gregory - Agile testing challenges Knowit 2014](https://reader033.vdocuments.net/reader033/viewer/2022060107/554a18d9b4c905825d8b50b2/html5/thumbnails/37.jpg)
Copyright 2014 DragonFire Inc.
• Can’t “test quality in”
• Whole team thinks testing
• Team is committed to quality
• Whole team solves problems
• Everyone collaborates
37
![Page 38: Janet Gregory - Agile testing challenges Knowit 2014](https://reader033.vdocuments.net/reader033/viewer/2022060107/554a18d9b4c905825d8b50b2/html5/thumbnails/38.jpg)
Copyright 2014 DragonFire Inc.
Agile testing is full of challenges
• Problems happen faster, so impact is felt faster
• Be courageous – be a change agent
• Adapt, Learn
Mostly, have fun and enjoy the
challenge!
38
![Page 39: Janet Gregory - Agile testing challenges Knowit 2014](https://reader033.vdocuments.net/reader033/viewer/2022060107/554a18d9b4c905825d8b50b2/html5/thumbnails/39.jpg)
Copyright 2014 DragonFire Inc.
Agile Testing: A Practical Guide for Testers and Agile Teams
By Lisa Crispin and Janet Gregory www.agiletester.ca
Contact info
www.janetgregory.ca
Email: [email protected]
Twitter: janetgregoryca
39
![Page 40: Janet Gregory - Agile testing challenges Knowit 2014](https://reader033.vdocuments.net/reader033/viewer/2022060107/554a18d9b4c905825d8b50b2/html5/thumbnails/40.jpg)
Copyright 2014 DragonFire Inc.
• www.lisacrispin.com
• www.testobsessed.com (heuristics cheat sheet)
• Gojko Adzic, Specification by Example, 2011, Bridging the Communication Gap, 2009, Impact Mapping 2013
• www.stickyminds.com/ Pragmatic Personas - Jeff Patton’s weekly column 1/25/2010
• www.mountaingoatsoftware.com – Mike Cohn’s web site
• http://www.exampler.com - Brian Marick’s web site
• Ester Derby and Dianne Larsen, Agile Retrospectives
• Agile Manifesto: http://agilemanifesto.org/
• Mary Poppendieck and Tom Poppendieck, Lean Software Development, Addison-Wesley (series of 3)
• Photos – Janet’s vacations or Microsoft office
40