© Sauce Labs, Inc.

What is DevOps &What Does it Mean for QA?

Presented by Chris Riley ( @HoardingInfo ), DevOps AnalystJuly 14, 2015

© Sauce Labs, Inc.© Sauce Labs, Inc.

Presenter

Chris Riley – technologist, research analyst, O’Reilly author and subject matter expert on DevOps. @hoardinginfo

© Sauce Labs, Inc.

Outline

• Introduction• Definitions• Nope … not really new• New Challenges• The Intersection of DevOps & QA• A QA Strategy for DevOps• Future of _______

© Sauce Labs, Inc.

The Two Faces

The Movement: People, Process, Tools

The Function: Infrastructure automation and oversight

© Sauce Labs, Inc.

Data?

© Sauce Labs, Inc.

Why the movement?

© Sauce Labs, Inc.

A moving Target

• Confusion!“DevOp

s” Functio

n

“DevOps” Movement

“DevOps”

“DevOps”

“DevOps”

“DevOps”

Developer

QA

IT Ops

“DevOps”

Vendor

Executive

Observer / SI

© Sauce Labs, Inc.

Enterprise SMB Startup

Developer Eh.. But LOB? Cool Done!

QA No Time Need the $$ What QA

Executive Nah. I want to keep my job Do that thing I’ll script it

IT Ops Done it for years, leave me alone

My budget, My thing

What’s IT?

Vendor They are doing it They are doing it Did it

Observer/SI

$ You got this -

© Sauce Labs, Inc.

False Comparison

X

© Sauce Labs, Inc.

So Basically No One Knows

Trough of disillusionment

© Sauce Labs, Inc.

What we do know:

• People then Process then Tools• The processes are concrete

• Plan• Dev• Integrate• QA• System Test• Release • Monitor• Measure

• “Culture” != Debug Ninja | Rockstar | Slide in the Lobby

• It is evolving

© Sauce Labs, Inc.

But Really It Is Very Easy

Faster releases at a higher quality

© Sauce Labs, Inc.

Faster releases at a higher quality

© Sauce Labs, Inc.

© Sauce Labs, Inc.

Uh oh - Problem

Current and Looming Challenges of DevOps

• We went too fast, crashed - sustainability• We release a whole bunch, but no clue what is going on• The more bugs, the more bugs, the more bugs, the

more• Chef is so three years ago – change• Oh yeah the person who did that, they left• Heartbleed v2.0

© Sauce Labs, Inc.

Why Should QA Care?

© Sauce Labs, Inc.

Who Cares?

• Get a budget

• Play with new and cool tools

• Be Prepared for Change

• Greater Opportunity

© Sauce Labs, Inc.

Happen to it, don’t let it happen to you

What can QA do?

• Deliver wins• Deliver data• Find your spot• Continuous Documentation• Make your developers champions• Suggest improvements to the pipeline• Realize and leverage your unique position• Automate something, then automate something else

© Sauce Labs, Inc.

Real-world

• Acorns

• WellsFargo

• Constant Contact

© Sauce Labs, Inc.

The Future of ______

Where is it going?

• A mobile focus• Containers not code• Developers are more accountable• User driven test case development• QA -> QE: Test Strategy, Quality Evangelist

© Sauce Labs, Inc.

QA

Resources• Test Automation KPIs -

http://sauceio.com/index.php/2015/06/test-automation-kpis/

• It Worked on My Machine - http://sauceio.com/index.php/2015/07/it-worked-on-my-machine-communication-trap/

• Sign up for a free trial of Saucehttps://saucelabs.com/signup/trial