aws re:invent 2016: [jk repeat] the enterprise fast lane - what your competition doesn't want...
TRANSCRIPT
© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Christian Deger, Chief Architect, AutoScout24, @cdeger
Constantin Gonzalez, Principal Solutions Architect, AWS, @zalez
December 1, 2016
The Enterprise Fast LaneWhat Your Competition Doesn't Want You to Know
About Enterprise Cloud Transformation
JKT303
What to expect from this session
• How to become cloud native
• How to transition from “difficult to change” to
evolutionary architecture
• How to drive cultural change across your organization
• Real-world enterprise IT transformation experience
• Tools and ideas for your own digital journey
New IT
• Unlimited resources
• No financial risk
• Software-defined,
dynamic architecture
• 100% automated
• Flexible
• Deployed in minutes
• World-wide
• Secure
• Robust
Cloud =
no physical
limitations
Cloud promises
•Lower cost
Cloud promises
•Lower costVisit:
ARC313 Running Lean Architectures:
How to Optimize for Cost Efficiency
Cloud promises
•Lower cost
•Better agility
Agility
Agility
• Technical agility
Agility
• Technical agility
• Organizational agility
Culture
Christian DegerChief [email protected]@cdeger
2.4 million vehicles
2000 servers
2 data centers
MTBF optimized
Development
“Change”
Operations
“Stability”
Dev and Ops Silos
***
New
CEO
talent?Do you attract
21st centuryWhat does a
tech company
look like?
Great design
Universally connected
Mobile first
Instant business value
Massive data insight
Highly available
good, but not great
Hmm, we are
Rebooteverything
.NET/Windows to JVM/Linux
Monolith to microservices
Data center to AWS
Devs + Ops to collaboration culture
Involve product people
“Death Star” diagrams
Amazon 2008 Twitter 2013
http://scs-architecture.org/
Self-contained systems = microservices flavor
Team 1
Team 2 Team 3
One business
capability is
owned, built
and run as an
SCS by one
team.
Self-contained
systems are
vertical slices
integrated at
the UI.
Same
direction
STRATEGIC
GOALSGoals of the business side
ARCHITECTURAL
PRINCIPLESHigh-Level Principles
DESIGN AND DELIVERY
PRINCIPLESTactical measures
REDUCE TIME TO MARKET
Establish fast feedback loops to learn, validate and
improve. Remove friction, hand-offs and undifferentiated
work.
MOBILE FIRST
Start small and use device capabilities.
SUPPORT DATA-DRIVEN DECISIONS
Provide relevant metrics and data for user and market
insights. Validate hypothesis for problems worth solving.
YOU BUILT IT, YOU RUN IT
The team is responsible for shaping, building, running and
maintaining its products. Fast feedback from live and
customers helps us to continuously improve.
ORGANIZED AROUND BUSINESS CAPABILITIES
Build teams around products not projects. Follow the
domain and respect bounded contexts. Make boundaries
explicit. Inverse Conway Maneuver.
LOOSELY COUPLED
By default avoid sharing and tight coupling.
No integration database. Don’t create the next monolith.
MACRO AND MICRO ARCHITECTURE
Clear separation. Autonomous micro services within the
rules and constraints of the macro architecture.
AWS FIRST
Favor AWS platform service over managed service,
over self-hosted OSS, over self built solutions.
DATA-DRIVEN/METRIC-DRIVEN
Collect business and operational metrics. Analyze, alert
and act on them.
ELIMINATE ACCIDENTAL COMPLEXITY
Strive to keep it simple. Don’t over-engineer.
Focus on necessary domain complexity.
AUTONOMOUS TEAMS
Make fast local decisions. Be responsible. Know your
boundaries. Share findings.
INFRASTRUCTURE AS CODE
Automate everything: Reproducible, traceable, auditable
and tested. Immutable servers.
CROSS-FUNCTIONAL TEAMS
Engineers from all backgrounds work together in
collaborative teams as engineers and share
responsibilities. No silos.
BE BOLD
Go into production early. Value monitoring over tests.
Fail fast, recover and learn. Optimize for MTTR not MTBF.
SECURITY, COMPLIANCE AND DATA PRIVACY
Build with least privilege and data privacy in mind.
Know your threat model. Limit blast radius.
COST EFFICIENCY
Run your segment in the right balance of cost and value.
ONE SCOUT IT
Foster collaboration. Harmonize and standardize tools.
Pull common capabilities into decoupled platform services.
Version 2.0Icons made by Freepik from www.flaticon.com are licensed under CC BY 3.0
BEST TALENT
Autonomy, purpose and mastery: We know why we do
things, we decide how to approach them and deliberately
practice our skills.
Build
MeasureLearn
Conway’s Law
“Organizations which design systems ...
are constrained to produce designs which
are copies of the communication
structures of these organizations.”
Autonomous teams
business capabilitiesorganized around
You build it,
you run it.
We are all
engineers!
Follow the
trail
Guilds
Self-organizing; common interests; across teams
Macro architecture, infrastructure, front end, QA...
Beware of Mandelbrot teams
Continuous
delivery
Application code in
one repository per
service.
CI
Deployment
package as
artifact.
CD
Deliver package to
servers
Delivery pipeline—data center
Application code
and infrastructure
specification in one
repository per
service.
CI
Deployment
package and
infrastructure
declaration as
artifact.
CD
1. Create or update
service infrastructure.
2. New instances pull
down package and
start application.
Delivery pipeline—AWS
Cattle,not pets
Hamburgers,not cattle
Event streaming
Monitoring is the new testing
Nostaging
environment
Learners
ExperiencedRamp up
First 8 teams: Split teams to share knowledge
Learners
ExperiencedRamp up
Plan for next teams: Coach don’t split
Coaching
015 Teams
025 Lambda functions
200 Repositories
040 Microservices
009 Systems
Status quo
New service
service boostrapping1/2 day
front end3 days
back end4 days
cycle time20 minutes
Idea
ProductData
build
measure
learn
The innovation cycle
Idea
ProductData
build
measure
learnCloud
Microservices
CI/CD
Big Data
IoT
Mobile
Analytics
BI
Machine Learning
The Cloud enables technical agility…
Idea
ProductData
build
measure
learnCloud
Microservices
CI/CD
Big Data
IoT
Mobile
Analytics
BI
Machine Learning
Lean
Agile
DevOps
…and culture enables organizational agility
Picture Credits
Wandergeselle by Sigismund von Dobschütz, licensed under CC-BY-SA-3.0
"HotWheels - '69 Ford Torino Talladega“ by Leap Kye, licensed under CC BY-ND 2.0
Enterprise IT Adoption Cycle by Simon Wardley under CC BY-SA 3.0
Leosvel et Diosmani by Ludovic Péron under CC BY-SA 3.0
Spare wheel by Brian Snelson under CC BY 2.0
Stopwatch by William Warby under CC BY 2.0
Remember to complete
your evaluations!