Download - John Rhodes - DevOps Automated Testing
![Page 1: John Rhodes - DevOps Automated Testing](https://reader034.vdocuments.net/reader034/viewer/2022042907/587097531a28ab412b8b6bd1/html5/thumbnails/1.jpg)
DevOps Automation Best Practices
![Page 2: John Rhodes - DevOps Automated Testing](https://reader034.vdocuments.net/reader034/viewer/2022042907/587097531a28ab412b8b6bd1/html5/thumbnails/2.jpg)
Agenda
• Why Development Automation and Agility
• Automated Build Best Practices
• Automated Test Best Practices
– Database compare tool
![Page 3: John Rhodes - DevOps Automated Testing](https://reader034.vdocuments.net/reader034/viewer/2022042907/587097531a28ab412b8b6bd1/html5/thumbnails/3.jpg)
What is DevOps
![Page 4: John Rhodes - DevOps Automated Testing](https://reader034.vdocuments.net/reader034/viewer/2022042907/587097531a28ab412b8b6bd1/html5/thumbnails/4.jpg)
DevOps
A recent global study, commissioned by CA Technologies,
which canvassed 1,300 senior IT decision-makers
worldwide, revealed respondents had seen a 17% to
23% improvement with regards to increased
earnings, shorter time-to-market, heightened
competitiveness and greater customer satisfaction
due to their DevOps initiatives.
![Page 5: John Rhodes - DevOps Automated Testing](https://reader034.vdocuments.net/reader034/viewer/2022042907/587097531a28ab412b8b6bd1/html5/thumbnails/5.jpg)
Mode 1 vs Mode 2 Organizations
Two Types of Organizations: Mode 1 “linear” vs Mode 2 “non-linear”.
Is one better? Not necessarily.Does DevOps Apply to both? Yes!
![Page 6: John Rhodes - DevOps Automated Testing](https://reader034.vdocuments.net/reader034/viewer/2022042907/587097531a28ab412b8b6bd1/html5/thumbnails/6.jpg)
Gartner
By 2020, 80% of the practices associated with DevOps
and Mode 2 “Agile” management will be adopted by
Mode 1 organizations.
DevOps is a Bridge
Key message: Automate as Much as Possible,
regardless of your star status!
![Page 7: John Rhodes - DevOps Automated Testing](https://reader034.vdocuments.net/reader034/viewer/2022042907/587097531a28ab412b8b6bd1/html5/thumbnails/7.jpg)
One way to get there
7
• DILBERT © 2007 Scott Adams. Used By permission of UNIVERSAL UCLICK. All rightsreserved.
![Page 8: John Rhodes - DevOps Automated Testing](https://reader034.vdocuments.net/reader034/viewer/2022042907/587097531a28ab412b8b6bd1/html5/thumbnails/8.jpg)
Best Practices of Agile Management
• Manage Agile Projects
– Manage user stories/tickets/use cases -> Backlog
– Plan, prioritize, order, specify, assign resources
– Execute sprints, work on sprint backlog items
– Monitor progress
– Deploy changes
• Transparency
– Reports
![Page 9: John Rhodes - DevOps Automated Testing](https://reader034.vdocuments.net/reader034/viewer/2022042907/587097531a28ab412b8b6bd1/html5/thumbnails/9.jpg)
Best Practices Release Automation
SCRUM – an agile framework
![Page 10: John Rhodes - DevOps Automated Testing](https://reader034.vdocuments.net/reader034/viewer/2022042907/587097531a28ab412b8b6bd1/html5/thumbnails/10.jpg)
Sprints
![Page 11: John Rhodes - DevOps Automated Testing](https://reader034.vdocuments.net/reader034/viewer/2022042907/587097531a28ab412b8b6bd1/html5/thumbnails/11.jpg)
User Stories
![Page 12: John Rhodes - DevOps Automated Testing](https://reader034.vdocuments.net/reader034/viewer/2022042907/587097531a28ab412b8b6bd1/html5/thumbnails/12.jpg)
Kanban Board
OPEN DEVELOPMENT TEST COMPLETED2007697
Check out process
Story Points: 0
2007693
Add price/discount information
Story Points: 6
2007692
Update product detail information
Story Points: 2
2007674
Create Welcome Page
Story Points: 2
Login Process2007698
Enter credit card information
Story Points: 0
2007695
Browse product catalogue
Story Points: 0
2007694
Upoad product pictures
Story Points: 3
2007675
Create new login user
Story Points: 4
Customer Management2007699
Track shipment
Story Points: 0
2007696
Select product for shopping cart
Story Points: 0
2007676
Login with user name and password
Story Points: 5
Product Management2007700
View Order History
Story Points: 0
2007677
Request new password
Story Points: 4
Product Order Process2007701
Report order summary per month
Story Points: 0
2007678
Update security questions
Story Points: 3
Reporting2007702
Report cancelled orders YTD
Story Points: 0
2007679
Disable login user
Story Points: 2
2007703
Report order backlog
Story Points: 0
2007685
Set up Infrastructure for AgileX development
Story Points: 4
2007704
Cancel order
Story Points: 0
2007686
Load backlog for AgileX development
Story Points: 3
2007705
Report orders by product group
Story Points: 0
2007691
Create product
Story Points: 4
KANBAN BOARD
![Page 13: John Rhodes - DevOps Automated Testing](https://reader034.vdocuments.net/reader034/viewer/2022042907/587097531a28ab412b8b6bd1/html5/thumbnails/13.jpg)
Story Mapping
AgileX
│
LOGIN PROCESS CUSTOMER MANAGEMENT PRODUCT MANAGEMENT PRODUCT ORDER PROCESS REPORTING
2007674
Create Welcome Page
Story Points: 2
2007681
Create new customer
Story Points: 6
2007690
Create product groups
Story Points: 1
2007696
Select product for shopping cart
Story Points: 0
2007701
Report order summary per month
Story Points: 0
2007675
Create new login user
Story Points: 4
2007682
Update customer information
Story Points: 3
2007691
Create product
Story Points: 4
2007697
Check out process
Story Points: 0
2007702
Report cancelled orders YTD
Story Points: 0
2007676
Login with user name and password
Story Points: 5
2007683
Disable customer from ordering products
Story Points: 1
2007692
Update product detail information
Story Points: 2
2007698
Enter credit card information
Story Points: 0
2007703
Report order backlog
Story Points: 0
2007677
Request new password
Story Points: 4
2007684
Integrate google maps for customer location
Story Points: 3
2007693
Add price/discount information
Story Points: 6
2007699
Track shipment
Story Points: 0
2007705
Report orders by product group
Story Points: 0
2007678
Update security questions
Story Points: 3
2007695
Browse product catalogue
Story Points: 0
2007694
Upoad product pictures
Story Points: 3
2007700
View Order History
Story Points: 0
2007679
Disable login user
Story Points: 2
2007704
Cancel order
Story Points: 0
2007680
View login history
Story Points: 3
STORY MAPPING
![Page 14: John Rhodes - DevOps Automated Testing](https://reader034.vdocuments.net/reader034/viewer/2022042907/587097531a28ab412b8b6bd1/html5/thumbnails/14.jpg)
Burn Down Charts
Sprint 0 From 09/30/2013 To 10/04/2013 Estimated Story Points: 7
Date Day Story Points Burn Down Ideal Burn Down
9/30/2013 1 0 7 7
10/01/2013 2 3 4 5
10/02/2013 3 0 4 4
10/03/2013 4 0 4 2
10/04/2013 5 4 0 0
Sprint 1 From 10/07/2013 To 10/18/2013 Estimated Story Points: 23
Date Day Story Points Burn Down Ideal Burn Down
10/7/2013 1 0 23 23
10/08/2013 2 2 21 20
10/09/2013 3 0 21 18
10/10/2013 4 4 17 15
10/11/2013 5 0 17 13
10/14/2013 6 9 8 10
10/15/2013 7 0 8 8
10/16/2013 8 0 8 5
10/17/2013 9 3 5 3
10/18/2013 10 2 3 0
BURN DOWN CHARTS
0
5
10
15
20
25
1 2 3 4 5 6 7 8 9 10
Sprint 1 From 10/07/2013 To 10/18/2013
Burn Down
Ideal Burn Down
Sprint 2 From 10/21/2013 To 11/01/2013
0
1
2
3
4
5
6
7
8
1 2 3 4 5 6 7 8 9 10
Sprint 0 From 09/30/2013 To 10/04/2013
Burn Down
Ideal Burn Down
![Page 15: John Rhodes - DevOps Automated Testing](https://reader034.vdocuments.net/reader034/viewer/2022042907/587097531a28ab412b8b6bd1/html5/thumbnails/15.jpg)
What has changed?
CM First Group. 15
CA Plex CA 2EIBM i
LibraryFilesystem
SVN Repository
![Page 16: John Rhodes - DevOps Automated Testing](https://reader034.vdocuments.net/reader034/viewer/2022042907/587097531a28ab412b8b6bd1/html5/thumbnails/16.jpg)
Automated Deployment
CM First Group. 16
Plex Function.dll
.pnl
.dll
Plex FunctionPlex FunctionPlex FunctionPlex FunctionPlex FunctionPlex FunctionPlex Functions in PKG and Code
library
IBM I
Java WebClient
.NET
.warPlex FunctionPlex FunctionPlex FunctionPlex FunctionPlex FunctionPlex FunctionPlex Functions in
PKG
Plex Function & DBRPGIV
LF and PF
WinC
![Page 17: John Rhodes - DevOps Automated Testing](https://reader034.vdocuments.net/reader034/viewer/2022042907/587097531a28ab412b8b6bd1/html5/thumbnails/17.jpg)
Update a Model
15.06.2016 Page 17
The extracted/checked in models can be selected for update into the group model (depending on configuration)The Model Manager unlocks the group model and opens up the localmodel.
![Page 18: John Rhodes - DevOps Automated Testing](https://reader034.vdocuments.net/reader034/viewer/2022042907/587097531a28ab412b8b6bd1/html5/thumbnails/18.jpg)
Summary
• Moving towards Agile / DevOps
– Short Cycles
– Transparency, Inspection, Adaption
• Use Tooling
– AUTOMATION is crucial for Agile/DevOPs
![Page 19: John Rhodes - DevOps Automated Testing](https://reader034.vdocuments.net/reader034/viewer/2022042907/587097531a28ab412b8b6bd1/html5/thumbnails/19.jpg)
Best Practices in Automated Testing
CM First Group. 19
![Page 20: John Rhodes - DevOps Automated Testing](https://reader034.vdocuments.net/reader034/viewer/2022042907/587097531a28ab412b8b6bd1/html5/thumbnails/20.jpg)
Cost of Defects
1:10:100
![Page 21: John Rhodes - DevOps Automated Testing](https://reader034.vdocuments.net/reader034/viewer/2022042907/587097531a28ab412b8b6bd1/html5/thumbnails/21.jpg)
Tortoise and the Hare
Slo
w c
yle
Fast
Cyc
leHigh Defect Low Defect
![Page 22: John Rhodes - DevOps Automated Testing](https://reader034.vdocuments.net/reader034/viewer/2022042907/587097531a28ab412b8b6bd1/html5/thumbnails/22.jpg)
Promise of Test Automation
• Speed
– Automated tests fast to run
• Flexibility
– Can be done off hours
• Accuracy
– Not prone to human error
• Reusability
– Without boredom
• Maximizing People
– QA modifies and perfects the process
![Page 23: John Rhodes - DevOps Automated Testing](https://reader034.vdocuments.net/reader034/viewer/2022042907/587097531a28ab412b8b6bd1/html5/thumbnails/23.jpg)
Tortoise and Hare Reprise
Slo
w c
yle
Fast
Cyc
leHigh Defect Low Defect
![Page 24: John Rhodes - DevOps Automated Testing](https://reader034.vdocuments.net/reader034/viewer/2022042907/587097531a28ab412b8b6bd1/html5/thumbnails/24.jpg)
Payback Times
Cu
mu
lati
ve $
$$
Time / Test Cycles
Naïve Automation
Manual
Next Gen Automation
![Page 25: John Rhodes - DevOps Automated Testing](https://reader034.vdocuments.net/reader034/viewer/2022042907/587097531a28ab412b8b6bd1/html5/thumbnails/25.jpg)
Types of Test Automation
• Functional Testing
– Unit Tests
– Integration Tests
– Regression Tests
• API Testing
• Load Testing
• Database Compare
• Code Test Coverage
• Vendors
– Worksoft
• 5250/3270, SAP (Certify)
– SmartBear
• Web, Windows (TestComplete, LoadComplete, SOAPUI)
![Page 26: John Rhodes - DevOps Automated Testing](https://reader034.vdocuments.net/reader034/viewer/2022042907/587097531a28ab412b8b6bd1/html5/thumbnails/26.jpg)
Best Practices to Get Started
• Choose a tool that can do end to end testing across
technologies
• Look at existing testing closely for actual coverage
– Considering using coverage tools
• Change the way you think about time
• Don’t try to “boil the ocean”. Pick your 25 top processes.
![Page 27: John Rhodes - DevOps Automated Testing](https://reader034.vdocuments.net/reader034/viewer/2022042907/587097531a28ab412b8b6bd1/html5/thumbnails/27.jpg)
Certify Process
![Page 28: John Rhodes - DevOps Automated Testing](https://reader034.vdocuments.net/reader034/viewer/2022042907/587097531a28ab412b8b6bd1/html5/thumbnails/28.jpg)
Users and Groups
![Page 29: John Rhodes - DevOps Automated Testing](https://reader034.vdocuments.net/reader034/viewer/2022042907/587097531a28ab412b8b6bd1/html5/thumbnails/29.jpg)
Applications and Projects
![Page 30: John Rhodes - DevOps Automated Testing](https://reader034.vdocuments.net/reader034/viewer/2022042907/587097531a28ab412b8b6bd1/html5/thumbnails/30.jpg)
Application Maps
![Page 31: John Rhodes - DevOps Automated Testing](https://reader034.vdocuments.net/reader034/viewer/2022042907/587097531a28ab412b8b6bd1/html5/thumbnails/31.jpg)
Versioning Maps
![Page 32: John Rhodes - DevOps Automated Testing](https://reader034.vdocuments.net/reader034/viewer/2022042907/587097531a28ab412b8b6bd1/html5/thumbnails/32.jpg)
Versioning Maps
![Page 33: John Rhodes - DevOps Automated Testing](https://reader034.vdocuments.net/reader034/viewer/2022042907/587097531a28ab412b8b6bd1/html5/thumbnails/33.jpg)
Requirements
![Page 34: John Rhodes - DevOps Automated Testing](https://reader034.vdocuments.net/reader034/viewer/2022042907/587097531a28ab412b8b6bd1/html5/thumbnails/34.jpg)
Processes
![Page 35: John Rhodes - DevOps Automated Testing](https://reader034.vdocuments.net/reader034/viewer/2022042907/587097531a28ab412b8b6bd1/html5/thumbnails/35.jpg)
Variables and Datasets
![Page 36: John Rhodes - DevOps Automated Testing](https://reader034.vdocuments.net/reader034/viewer/2022042907/587097531a28ab412b8b6bd1/html5/thumbnails/36.jpg)
Executing Processes
![Page 37: John Rhodes - DevOps Automated Testing](https://reader034.vdocuments.net/reader034/viewer/2022042907/587097531a28ab412b8b6bd1/html5/thumbnails/37.jpg)
Executing Processes
![Page 38: John Rhodes - DevOps Automated Testing](https://reader034.vdocuments.net/reader034/viewer/2022042907/587097531a28ab412b8b6bd1/html5/thumbnails/38.jpg)
Executing Processes
![Page 39: John Rhodes - DevOps Automated Testing](https://reader034.vdocuments.net/reader034/viewer/2022042907/587097531a28ab412b8b6bd1/html5/thumbnails/39.jpg)
Executing Processes