test automation is dead code copenhagen 2016
TRANSCRIPT
![Page 1: Test automation is dead CoDe Copenhagen 2016](https://reader031.vdocuments.net/reader031/viewer/2022030213/589ae39b1a28abee708b5669/html5/thumbnails/1.jpg)
@sebrose h)p://cucumber.io
Seb Rose Cucumber Limited
Test automa*on is dead. Long live test automa*on!
![Page 2: Test automation is dead CoDe Copenhagen 2016](https://reader031.vdocuments.net/reader031/viewer/2022030213/589ae39b1a28abee708b5669/html5/thumbnails/2.jpg)
@sebrose h)p://cucumber.io
Agenda
• Introduction • Traditional test automation • A new hope • Long live test automation!
![Page 3: Test automation is dead CoDe Copenhagen 2016](https://reader031.vdocuments.net/reader031/viewer/2022030213/589ae39b1a28abee708b5669/html5/thumbnails/3.jpg)
@sebrose h)p://cucumber.io
“a process of gathering informa1on about [so5ware] with the intent that the
informa1on could be used for some purpose”
What is testing?
Gerry Weinberg Perfect So5ware and Other Illusions About Tes1ng
![Page 4: Test automation is dead CoDe Copenhagen 2016](https://reader031.vdocuments.net/reader031/viewer/2022030213/589ae39b1a28abee708b5669/html5/thumbnails/4.jpg)
@sebrose h)p://cucumber.io
What is automation?
• the technique of making an apparatus, a process, or a system operate automatically
• the state of being operated automatically
• automatically controlled operation of an apparatus, process, or system by mechanical or electronic devices that take the place of human labor
h)p://www.merriam-webster.com/dicIonary/automaIon
![Page 6: Test automation is dead CoDe Copenhagen 2016](https://reader031.vdocuments.net/reader031/viewer/2022030213/589ae39b1a28abee708b5669/html5/thumbnails/6.jpg)
@sebrose h)p://cucumber.io
Agenda
• Introduction • Traditional test automation • A new hope • Long live test automation!
![Page 7: Test automation is dead CoDe Copenhagen 2016](https://reader031.vdocuments.net/reader031/viewer/2022030213/589ae39b1a28abee708b5669/html5/thumbnails/7.jpg)
@sebrose h)p://cucumber.io
Test automaIon
• Take one manual test script • Automate it • Repeat
![Page 8: Test automation is dead CoDe Copenhagen 2016](https://reader031.vdocuments.net/reader031/viewer/2022030213/589ae39b1a28abee708b5669/html5/thumbnails/8.jpg)
@sebrose h)p://cucumber.io
Traditional rationale
• Saves time and money • Increases coverage • Improves accuracy • Decreases drudgery
![Page 10: Test automation is dead CoDe Copenhagen 2016](https://reader031.vdocuments.net/reader031/viewer/2022030213/589ae39b1a28abee708b5669/html5/thumbnails/10.jpg)
@sebrose h)p://cucumber.io
“Let’s make toast the american way…
You burn it; I’ll scrape it”
W. Edwards Deming
![Page 13: Test automation is dead CoDe Copenhagen 2016](https://reader031.vdocuments.net/reader031/viewer/2022030213/589ae39b1a28abee708b5669/html5/thumbnails/13.jpg)
@sebrose h)p://cucumber.io
h)p:
//cla
ysno
w.c
o.uk
/arc
hite
ctur
al-a
lignm
ent-
and-
test
-indu
ced-
desig
n-da
mag
e-fa
llacy
/
Test automation pyramid
![Page 15: Test automation is dead CoDe Copenhagen 2016](https://reader031.vdocuments.net/reader031/viewer/2022030213/589ae39b1a28abee708b5669/html5/thumbnails/15.jpg)
@sebrose h)p://cucumber.io
Traditional rationale
• Saves time and money • Increases coverage • Improves accuracy • Decreases drudgery
![Page 16: Test automation is dead CoDe Copenhagen 2016](https://reader031.vdocuments.net/reader031/viewer/2022030213/589ae39b1a28abee708b5669/html5/thumbnails/16.jpg)
@sebrose h)p://cucumber.io
Actual outcomes
• Takes longer, costs more • Limits coverage • Promotes confusion • Increases maintenance
![Page 18: Test automation is dead CoDe Copenhagen 2016](https://reader031.vdocuments.net/reader031/viewer/2022030213/589ae39b1a28abee708b5669/html5/thumbnails/18.jpg)
@sebrose h)p://cucumber.io
Agenda
• Introduction • Traditional test automation • A new hope • Long live test automation!
![Page 19: Test automation is dead CoDe Copenhagen 2016](https://reader031.vdocuments.net/reader031/viewer/2022030213/589ae39b1a28abee708b5669/html5/thumbnails/19.jpg)
@sebrose h)p://cucumber.io
That is not the test automa=on you
are looking for.
![Page 20: Test automation is dead CoDe Copenhagen 2016](https://reader031.vdocuments.net/reader031/viewer/2022030213/589ae39b1a28abee708b5669/html5/thumbnails/20.jpg)
@sebrose h)p://cucumber.io
h)p:
//lis
acris
pin.
com
/201
1/11
/08/
usin
g-th
e-ag
ile-t
esIn
g-qu
adra
nts/Agile testing quadrants
![Page 21: Test automation is dead CoDe Copenhagen 2016](https://reader031.vdocuments.net/reader031/viewer/2022030213/589ae39b1a28abee708b5669/html5/thumbnails/21.jpg)
@sebrose h)p://cucumber.io
More than just testing …
Tes$ng proposi$ons. Is tesIng proposiIons more important than having examples as exemplars?
h)ps://accu.org/index.php/journals/c364/
![Page 22: Test automation is dead CoDe Copenhagen 2016](https://reader031.vdocuments.net/reader031/viewer/2022030213/589ae39b1a28abee708b5669/html5/thumbnails/22.jpg)
@sebrose h)p://cucumber.io
“Much of the essence of building a program is in fact the debugging of the specifica=on.”
Fred Brooks
![Page 23: Test automation is dead CoDe Copenhagen 2016](https://reader031.vdocuments.net/reader031/viewer/2022030213/589ae39b1a28abee708b5669/html5/thumbnails/23.jpg)
@sebrose h)p://cucumber.io
Don’t test - specify collaboratively
h)p:
//pro
ject
cart
oon.
com
/
![Page 24: Test automation is dead CoDe Copenhagen 2016](https://reader031.vdocuments.net/reader031/viewer/2022030213/589ae39b1a28abee708b5669/html5/thumbnails/24.jpg)
@sebrose h)p://cucumber.io
Example mapping
h)ps
://cu
cum
ber.i
o/bl
og/2
015/
12/0
8/ex
ampl
e-m
appi
ng-in
trod
ucIo
n
![Page 25: Test automation is dead CoDe Copenhagen 2016](https://reader031.vdocuments.net/reader031/viewer/2022030213/589ae39b1a28abee708b5669/html5/thumbnails/25.jpg)
@sebrose h)p://cucumber.io
Living documentation
h)ps
://re
lisha
pp.c
om/G
DS/
whi
teha
ll/do
cs/h
istor
ical
-acc
ount
s
![Page 26: Test automation is dead CoDe Copenhagen 2016](https://reader031.vdocuments.net/reader031/viewer/2022030213/589ae39b1a28abee708b5669/html5/thumbnails/26.jpg)
@sebrose h)p://cucumber.io
Bene
fit (R
isk)
Cost
Invest in infrastructure
Pointless
Highvalue
Bread & bu)er
Costs and benefits
![Page 27: Test automation is dead CoDe Copenhagen 2016](https://reader031.vdocuments.net/reader031/viewer/2022030213/589ae39b1a28abee708b5669/html5/thumbnails/27.jpg)
P y r a m i d
h)ps
://w
ww
.ibm
.com
/dev
elop
erw
orks
/lib
rary
/j-a
opw
ork1
1/Te
sIng
Pyra
mid
.jpg
![Page 28: Test automation is dead CoDe Copenhagen 2016](https://reader031.vdocuments.net/reader031/viewer/2022030213/589ae39b1a28abee708b5669/html5/thumbnails/28.jpg)
h)p:
//cla
ysno
w.c
o.uk
/the
-tes
Ing-
iceb
erg/
I c e b e r g
![Page 29: Test automation is dead CoDe Copenhagen 2016](https://reader031.vdocuments.net/reader031/viewer/2022030213/589ae39b1a28abee708b5669/html5/thumbnails/29.jpg)
![Page 30: Test automation is dead CoDe Copenhagen 2016](https://reader031.vdocuments.net/reader031/viewer/2022030213/589ae39b1a28abee708b5669/html5/thumbnails/30.jpg)
@sebrose h)p://cucumber.io
Be)er communicaIon
(Ubiquitous language)Reduced risk (Faster feedback)
Increased trust
(CollaboraIon)Living documentaIon
Long live test
automaAon!
![Page 31: Test automation is dead CoDe Copenhagen 2016](https://reader031.vdocuments.net/reader031/viewer/2022030213/589ae39b1a28abee708b5669/html5/thumbnails/31.jpg)
Seb Rose Twi$er: @sebrose Blog: h$p://cucumber.io E-mail: [email protected]