how devops was killing test automation...how devops was killing test automation vincent wijnen...

32
How DevOps Was Killing Test Automation Vincent Wijnen Sogeti, Netherlands.

Upload: others

Post on 23-Jun-2020

18 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: How Devops Was Killing Test Automation...How DevOps Was Killing Test Automation Vincent Wijnen Sogeti, Netherlands. Test Automation? Automated execution of testcases to verify the

How DevOps Was Killing Test

Automation

Vincent Wijnen

Sogeti, Netherlands.

Page 2: How Devops Was Killing Test Automation...How DevOps Was Killing Test Automation Vincent Wijnen Sogeti, Netherlands. Test Automation? Automated execution of testcases to verify the

Test Automation?

Page 3: How Devops Was Killing Test Automation...How DevOps Was Killing Test Automation Vincent Wijnen Sogeti, Netherlands. Test Automation? Automated execution of testcases to verify the

Automated execution of testcases to verify the quality of delivered software

Page 4: How Devops Was Killing Test Automation...How DevOps Was Killing Test Automation Vincent Wijnen Sogeti, Netherlands. Test Automation? Automated execution of testcases to verify the

DevOps & Test Automation

Testing QualityDelivered Software

Development

DevOps Team

Page 5: How Devops Was Killing Test Automation...How DevOps Was Killing Test Automation Vincent Wijnen Sogeti, Netherlands. Test Automation? Automated execution of testcases to verify the

How does Test Automation look?

Page 6: How Devops Was Killing Test Automation...How DevOps Was Killing Test Automation Vincent Wijnen Sogeti, Netherlands. Test Automation? Automated execution of testcases to verify the
Page 7: How Devops Was Killing Test Automation...How DevOps Was Killing Test Automation Vincent Wijnen Sogeti, Netherlands. Test Automation? Automated execution of testcases to verify the

Which one was from a Test Automation Engineer?

Page 8: How Devops Was Killing Test Automation...How DevOps Was Killing Test Automation Vincent Wijnen Sogeti, Netherlands. Test Automation? Automated execution of testcases to verify the

DevOps Team

PO Dev

Engineers

Ops

Engineers

Test

Engineers

Scrum

Master

TATA

Page 9: How Devops Was Killing Test Automation...How DevOps Was Killing Test Automation Vincent Wijnen Sogeti, Netherlands. Test Automation? Automated execution of testcases to verify the

AdaptersPO Dev

EngineersOps

EngineersTest

EngineersScrumMaster

TATA

Core FunctionalityPO Dev

EngineersOps

EngineersTest

EngineersScrumMaster

TATA

Payment EnginesPO Dev

EngineersOps

EngineersTest

EngineersScrumMaster

TATA

Database & PlatformPO Dev

EngineersOps

EngineersTest

EngineersScrumMaster

TATA

Page 10: How Devops Was Killing Test Automation...How DevOps Was Killing Test Automation Vincent Wijnen Sogeti, Netherlands. Test Automation? Automated execution of testcases to verify the
Page 11: How Devops Was Killing Test Automation...How DevOps Was Killing Test Automation Vincent Wijnen Sogeti, Netherlands. Test Automation? Automated execution of testcases to verify the

Test Automation

Automated Testing

Page 12: How Devops Was Killing Test Automation...How DevOps Was Killing Test Automation Vincent Wijnen Sogeti, Netherlands. Test Automation? Automated execution of testcases to verify the

Test Tooling as API Traditional TA Tools TA for Everyone

± 1 year ± 6 months± 2 years

Page 13: How Devops Was Killing Test Automation...How DevOps Was Killing Test Automation Vincent Wijnen Sogeti, Netherlands. Test Automation? Automated execution of testcases to verify the

Business Dev Test Operations

Production

Page 14: How Devops Was Killing Test Automation...How DevOps Was Killing Test Automation Vincent Wijnen Sogeti, Netherlands. Test Automation? Automated execution of testcases to verify the
Page 15: How Devops Was Killing Test Automation...How DevOps Was Killing Test Automation Vincent Wijnen Sogeti, Netherlands. Test Automation? Automated execution of testcases to verify the

Business Dev Test Operations

Production

Page 16: How Devops Was Killing Test Automation...How DevOps Was Killing Test Automation Vincent Wijnen Sogeti, Netherlands. Test Automation? Automated execution of testcases to verify the

AdaptersPO Dev

EngineersOps

EngineersTest

EngineersScrumMaster

TATA

Core FunctionalityPO Dev

EngineersOps

EngineersTest

EngineersScrumMaster

TATA

Payment EnginesPO Dev

EngineersOps

EngineersTest

EngineersScrumMaster

TATA

Database & PlatformPO Dev

EngineersOps

EngineersTest

EngineersScrumMaster

TATA

Page 17: How Devops Was Killing Test Automation...How DevOps Was Killing Test Automation Vincent Wijnen Sogeti, Netherlands. Test Automation? Automated execution of testcases to verify the

DevOps Team

PO Dev

Engineers

Ops

Engineers

Test

Engineers

Scrum

Master

TATA

Page 18: How Devops Was Killing Test Automation...How DevOps Was Killing Test Automation Vincent Wijnen Sogeti, Netherlands. Test Automation? Automated execution of testcases to verify the

DevOps Team

PO Dev

Engineers

Ops

Engineers

Test

Engineers

Scrum

Master

ATATAT AT AT AT AT AT

Page 19: How Devops Was Killing Test Automation...How DevOps Was Killing Test Automation Vincent Wijnen Sogeti, Netherlands. Test Automation? Automated execution of testcases to verify the

Payment EnginesPO Dev

EngineersOps

EngineersTest

EngineersScrumMaster

ATATAT AT AT AT AT AT

Database & PlatformPO Dev

EngineersOps

EngineersTest

EngineersScrumMaster

ATATAT AT AT AT AT AT

AdaptersPO Dev

EngineersOps

EngineersTest

EngineersScrumMaster

ATATAT AT AT AT AT AT

Core FunctionalityPO Dev

EngineersOps

EngineersTest

EngineersScrumMaster

ATATAT AT AT AT AT AT

Where does Test Automation go?

Page 20: How Devops Was Killing Test Automation...How DevOps Was Killing Test Automation Vincent Wijnen Sogeti, Netherlands. Test Automation? Automated execution of testcases to verify the

Focus & Scope

Page 21: How Devops Was Killing Test Automation...How DevOps Was Killing Test Automation Vincent Wijnen Sogeti, Netherlands. Test Automation? Automated execution of testcases to verify the

Normal DevOps Team Test Automation DevOps Team

Live Environment

Low Quality

End Users

Distance to End Users

Production Test

Production Incidents Reduced Velocity

Clients Normal DevOps Teams

High None

Focus

Page 22: How Devops Was Killing Test Automation...How DevOps Was Killing Test Automation Vincent Wijnen Sogeti, Netherlands. Test Automation? Automated execution of testcases to verify the

KPI

New Feature Hotfix Stability Performance

Test Automation

Perf. Testing Test DataDeployment Automation

ToP

rod

uct

ion

To T

est

Bu

sin

ess

Fac

ing

Team

Fac

ing

Focus

Page 23: How Devops Was Killing Test Automation...How DevOps Was Killing Test Automation Vincent Wijnen Sogeti, Netherlands. Test Automation? Automated execution of testcases to verify the

Scope

Dev Test Ops TA

1 Sprint

Page 24: How Devops Was Killing Test Automation...How DevOps Was Killing Test Automation Vincent Wijnen Sogeti, Netherlands. Test Automation? Automated execution of testcases to verify the

Scope

Dev Test Ops TA

Page 25: How Devops Was Killing Test Automation...How DevOps Was Killing Test Automation Vincent Wijnen Sogeti, Netherlands. Test Automation? Automated execution of testcases to verify the

Scope

Dev Test Ops TA

Page 26: How Devops Was Killing Test Automation...How DevOps Was Killing Test Automation Vincent Wijnen Sogeti, Netherlands. Test Automation? Automated execution of testcases to verify the

Scope

Dev Test Ops TA

Page 27: How Devops Was Killing Test Automation...How DevOps Was Killing Test Automation Vincent Wijnen Sogeti, Netherlands. Test Automation? Automated execution of testcases to verify the

Scope

Dev Test Ops TA

Page 28: How Devops Was Killing Test Automation...How DevOps Was Killing Test Automation Vincent Wijnen Sogeti, Netherlands. Test Automation? Automated execution of testcases to verify the

Scope

Dev Test Ops TA

Page 29: How Devops Was Killing Test Automation...How DevOps Was Killing Test Automation Vincent Wijnen Sogeti, Netherlands. Test Automation? Automated execution of testcases to verify the

DevOps Team 1 DevOps Team 2 DevOps Team 3 DevOps Team 4

Test Automation Team

PO Ops

Stories

Test Automation Software

Page 30: How Devops Was Killing Test Automation...How DevOps Was Killing Test Automation Vincent Wijnen Sogeti, Netherlands. Test Automation? Automated execution of testcases to verify the

Payment EngineMainframe Order Manager

TA Guild

Page 31: How Devops Was Killing Test Automation...How DevOps Was Killing Test Automation Vincent Wijnen Sogeti, Netherlands. Test Automation? Automated execution of testcases to verify the

Copyrights: Martin Fowlerhttps://martinfowler.com/bliki/TestPyramid.html

Page 32: How Devops Was Killing Test Automation...How DevOps Was Killing Test Automation Vincent Wijnen Sogeti, Netherlands. Test Automation? Automated execution of testcases to verify the

Question Time!

Scaling Cost Governance Work Distribution

Tooling Choice CD / CI Required SkillsetApproach to Test

Automation

Vincent [email protected]

Team Roles Guilds Testing Pyramid