eliminating busywork at the organizational level · 6/23/2020 · © 2020, amazon web services,...
TRANSCRIPT
![Page 1: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/1.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates.
David Yanacek, Sr. Principal Engineer, AWS Lambda
@dyanacek
Eliminating Busywork at the
Organizational LevelTips for using serverless to its fullest potential
![Page 2: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/2.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
Table of contents
• Removing roadblocks to serverless
• Finding the right path(s) to serverless
• Leveraging trailblazers: A how-to guide
![Page 3: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/3.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates.
Removing Roadblocks to Serverless
![Page 4: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/4.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
LE
VE
L O
F A
BS
TR
AC
TIO
N
FOCUS ON BUSINESS LOGIC
PHYSICAL MACHINES
Requires “guess” planning
Lives for years on-premises
Heavy investments (capex)
Low innovation factor
Deploy in months
Computing evolution – A paradigm shift
![Page 5: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/5.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
LE
VE
L O
F A
BS
TR
AC
TIO
N
FOCUS ON BUSINESS LOGIC
VIRTUAL MACHINES
Hardware independence
Faster provisioning speed (minutes/hours)
Trade capex for opex
More scale
Elastic resources
Faster speed and agility
Reduced maintenance
Computing evolution – A paradigm shift
![Page 6: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/6.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
LE
VE
L O
F A
BS
TR
AC
TIO
N
FOCUS ON BUSINESS LOGIC
CONTAINERIZATION
Platform independence
Consistent runtime environment
Higher resource utilization
Easier and faster deployments
Isolation and sandboxing
Start speed (deploy in seconds)
Computing evolution – A paradigm shift
![Page 7: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/7.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
AWS Lambda
AWS Fargate
LE
VE
L O
F A
BS
TR
AC
TIO
N
FOCUS ON BUSINESS LOGIC
Continuous scaling
Fault tolerance built-in
Pay for value
Zero maintenance
SERVERLESS
Computing evolution – A paradigm shift
![Page 8: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/8.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
Laziness
![Page 9: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/9.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
Laziness
Productivity
Developer efficiency
![Page 10: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/10.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
Law of Laziness:
Developers choose tools that get the
job done using the least amount of effort
(Productivity)
![Page 11: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/11.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
LE
VE
L O
F A
BS
TR
AC
TIO
N
SERVERLESS
AWS Lambda AWS Fargate
The path(s) to serverless
CONTAINERS
VIRTUAL MACHINES
PHYSICAL MACHINES
FOCUS ON BUSINESS LOGIC
![Page 12: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/12.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
𝑠
![Page 13: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/13.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
![Page 14: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/14.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
![Page 15: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/15.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
The invisible hand
![Page 16: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/16.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
![Page 17: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/17.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
LE
VE
L O
F A
BS
TR
AC
TIO
N
SERVERLESS
AWS Lambda AWS Fargate
Which path to serverless?
CONTAINERS
VIRTUAL MACHINES
PHYSICAL MACHINES
FOCUS ON BUSINESS LOGIC
![Page 18: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/18.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
(Productivity)
Law of Laziness:
Developers choose tools that get the
job done using the least amount of effort
![Page 19: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/19.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
![Page 20: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/20.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
(less effort with serverless)
![Page 21: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/21.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
Removing Barriers to Change
![Page 22: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/22.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
Development transformation at Amazon: 2001-2002
![Page 23: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/23.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
2-tier architecture
![Page 24: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/24.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
The cost of coordination
![Page 25: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/25.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
Release train: build, test, deploy, monitor
![Page 26: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/26.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
Lots of coordination
developers
delivery pipeline
monolith
![Page 27: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/27.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
Lots that can go wrong
developers
delivery pipeline
monolith
![Page 28: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/28.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
Bottlenecked processes
![Page 29: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/29.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
“[A system’s speed and throughput is
limited by the speed of its serialized tasks]”
Amdahl’s law:
![Page 30: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/30.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
parallelization
serialization
Amdahl’s law:
![Page 31: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/31.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
The cost of coordination
![Page 32: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/32.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
parallelization
serialization
coordination
Universal scalability law:
![Page 33: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/33.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
The teams behind the monolith
![Page 34: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/34.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
The cost of consensus building
![Page 35: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/35.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
Reduced consensus building through abstraction
API
API
API
API
![Page 36: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/36.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
Reduced coordination
![Page 37: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/37.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
The hidden cost of coordination
(coupling makes change harder)
![Page 38: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/38.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
Breaking down activation energy
![Page 39: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/39.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
Breaking down the blockers
Coordination / coupling
Existing release tools
Existing monitoring tools
Existing security practices
![Page 40: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/40.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
![Page 41: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/41.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates.
Where can I look for good
opportunities to use
serverless?
![Page 42: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/42.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
SERVERLESS
AWS Lambda AWS Fargate
“The road less traveled”
SERVERFULL
![Page 43: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/43.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
SERVERLESS
AWS Lambda AWS Fargate
All roads lead to serverless!
![Page 44: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/44.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
What new development effort are
we about to take on?
![Page 45: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/45.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
InstanceLambda function
Using Lambda within Lambda
?
AWS Lambda
![Page 46: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/46.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
Lambda triggers
Amazon Kinesis
Amazon Simple Queue Service
Amazon DynamoDB
AWS Lambda Your Lambda Function
![Page 47: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/47.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
Configuring Lambda triggers
CreateEventSourceMapping()
Amazon Kinesis
AWS Lambda Your Lambda FunctionAmazon Simple Queue Service
Amazon DynamoDB
![Page 48: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/48.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
A fork in the road
Is the decision reversable?
How much coupling is there to
existing systems?
CreateEventSourceMapping()
AWS Lambda
InstanceLambda function
?
![Page 49: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/49.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
All roads lead to serverless!
CreateEventSourceMapping()
AWS Lambda
Lambda function
![Page 50: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/50.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
What part of the monolith is
causing scale problems?
![Page 51: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/51.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
Serverless is more than compute
COMPUTE
DATA STORES
INTEGRATION
Amazon
DynamoDB
Amazon Aurora
Serverless
Amazon
S3
AWS
Lambda
AWS
Fargate
Amazon
EventBridge
Amazon
API Gateway
Amazon
SQS
Amazon
SNS
AWS
AppSync
AWS
Step Functions
![Page 52: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/52.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
Example: website session data
Users
Relational Database
Web Server
(browser session data) (application data)
![Page 53: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/53.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
Example: website session data
Users
Relational Database
Web Server
(browser session data) (application data)
![Page 54: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/54.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
Example: Website session data
Sharded databasesAmazon DynamoDB
(session data)
(application data)
?
Users
Web Server Existing database
![Page 55: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/55.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
Example: Website session data
Amazon DynamoDB
(session data)
(application data)
Users
Web Server Existing database
![Page 56: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/56.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
Example: Website session data
Web Server
Amazon DynamoDB
Amazon API Gateway
Amazon DynamoDB
Accelerator (DAX) Amazon Aurora Amazon Managed
Apache Cassandra
Service
Amazon
ElastiCache
![Page 57: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/57.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
What part of the monolith is
causing (human) scale problems?
![Page 58: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/58.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
A different kind of scaling bottleneck
![Page 59: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/59.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
Yesterday’s microservice, tomorrow’s monolith
CreateEventSourceMapping()
AWS Lambda
Control plane serviceLambda function
?
43 APIs (and counting!)
![Page 60: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/60.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
Mono to Micro
Moving monolithic applications to
microservices by gradually
creating events and APIs for
various components on of the
legacy application
The Strangler Pattern
![Page 61: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/61.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
Tools for branching out
Amazon API Gateway
Monolith
Foo()
Bar()
Baz()
Bar()
Baz()
Foo()Bar()
Foo()
![Page 62: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/62.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
What operational paper cuts could
we automate if automation was
easy?
![Page 63: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/63.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
Automating with an “ops bot”
Nightly scaling
Root cause analysis
Automated actions
Automated backups
![Page 64: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/64.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
Who operates the operations automation?
![Page 65: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/65.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
What new project do we need to
build especially quickly?
![Page 66: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/66.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
Infrequently used web tools?
![Page 67: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/67.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
Virtual Choir video uploader
Amazon Simple
Storage Service
Amazon Cognito Amazon Simple
Notification Service
notification
Choir Choir
director
![Page 68: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/68.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
What might someone build during a
hackathon using serverless?
![Page 69: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/69.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
Serverless is huge in hackathons
Experiment with
big ideas
Science!
Build new tools
Drive data analytics
Sandboxed prototyping
![Page 70: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/70.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
Which systems utilize hardware
especially poorly?
![Page 71: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/71.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
Low utilization workloads
(waste)
(problem)
(no provisioning)
![Page 72: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/72.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates.
Leveraging Serverless
Trailblazers
![Page 73: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/73.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
Opportunistic adoption
(low adoption cost)
(large payoff)
![Page 74: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/74.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
Using a catalyst
(catalyst reduces energy)
![Page 75: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/75.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
What did you do to adopt serverless
that you could avoid doing next time?
![Page 76: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/76.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
Story: Bridging sign-in systems
Operators
Existing operational
tools
![Page 77: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/77.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
Story: Bridging sign-in systems
Operators
Existing operational
tools
Corporate Sign-In
(verify)
![Page 78: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/78.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
Story: Bridging sign-in systems
Operators
New Lambda-based
web tool
Amazon API GatewayCorporate Sign-In
?
![Page 79: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/79.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
Story: Bridging sign-in systems
Operators
New Lambda-based
web tool
Corporate Sign-In Authorizer
![Page 80: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/80.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
Story: Bridging sign-in systems
Operators
New Lambda-based
web tool
Corporate Sign-In Amazon Cognito Amazon
API Gateway
![Page 81: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/81.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
Story: Bridging sign-in systems
New tool!
(other developers)
![Page 82: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/82.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates.
In conclusion…
![Page 83: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/83.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
(Productivity)
Law of Laziness:
Developers choose tools that get the
job done using the least amount of effort
![Page 84: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/84.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
LE
VE
L O
F A
BS
TR
AC
TIO
N
SERVERLESS
AWS Lambda AWS Fargate
More abstraction, less busywork
CONTAINERS
VIRTUAL MACHINES
PHYSICAL MACHINES
FOCUS ON BUSINESS LOGIC
![Page 85: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/85.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
LE
VE
L O
F A
BS
TR
AC
TIO
N
SERVERLESS
AWS Lambda AWS Fargate
Many starting points, many paths
CONTAINERS
VIRTUAL MACHINES
PHYSICAL MACHINES
FOCUS ON BUSINESS LOGIC
![Page 86: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/86.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
Identifying opportunities and catalysts
(low adoption cost)
(large payoff)(catalysts)
![Page 87: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/87.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
Many paths, many questions
• New development?
• System scale problems?
• Human scale problems?
• Missing operational tools?
• Urgent new project?
• Poor utilization?
• Hackathon ideas?
• Adoption papercuts?
![Page 88: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/88.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
SERVERLESS
AWS Lambda AWS Fargate
All roads lead to serverless!
![Page 89: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/89.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
SOA: Service-oriented architecture
API
API
API
API
![Page 90: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/90.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
Conway’s law:
The structure of any system designed by an organization
is isomorphic to the structure of the organization.
![Page 91: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/91.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
SOA:
Service-oriented architecture
![Page 92: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/92.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
The new SOA:
Serverless organizational architecture
![Page 93: Eliminating Busywork at the Organizational Level · 6/23/2020 · © 2020, Amazon Web Services, Inc. or its Affiliates. © 2020, Amazon Web Services, Inc. or its Affiliates. David](https://reader034.vdocuments.net/reader034/viewer/2022050509/5f9a1b268581a512df7c565c/html5/thumbnails/93.jpg)
© 2020, Amazon Web Services, Inc. or its Affiliates.
Thank you!@dyanacek