serverless architectural patterns and best practices...serverless architectural patterns and best...
TRANSCRIPT
![Page 1: Serverless Architectural Patterns and Best Practices...Serverless Architectural Patterns and Best Practices Agenda Serverless characteristics and practices 3-tier web application Batch](https://reader034.vdocuments.net/reader034/viewer/2022042318/5f07931f7e708231d41daa36/html5/thumbnails/1.jpg)
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Sascha Möllering
29.03.2017
Serverless Architectural
Patterns and Best Practices
![Page 2: Serverless Architectural Patterns and Best Practices...Serverless Architectural Patterns and Best Practices Agenda Serverless characteristics and practices 3-tier web application Batch](https://reader034.vdocuments.net/reader034/viewer/2022042318/5f07931f7e708231d41daa36/html5/thumbnails/2.jpg)
Agenda
Serverless characteristics and practices
3-tier web application
Batch processing
Stream processing
Operations automation
Wrap-up/Q&A
![Page 3: Serverless Architectural Patterns and Best Practices...Serverless Architectural Patterns and Best Practices Agenda Serverless characteristics and practices 3-tier web application Batch](https://reader034.vdocuments.net/reader034/viewer/2022042318/5f07931f7e708231d41daa36/html5/thumbnails/3.jpg)
Spectrum of AWS offerings
AWS
Lambda
Amazon
Kinesis
Amazon
S3
Amazon API
Gateway
Amazon
SQS
Amazon
DynamoDB
AWS IoT
Amazon
EMR
Amazon
ElastiCache
Amazon
RDS
Amazon
Redshift
Amazon
Elasticsearch
Service
Managed Serverless
Amazon EC2
“On EC2”
Amazon
Cognito
Amazon
CloudWatch
![Page 4: Serverless Architectural Patterns and Best Practices...Serverless Architectural Patterns and Best Practices Agenda Serverless characteristics and practices 3-tier web application Batch](https://reader034.vdocuments.net/reader034/viewer/2022042318/5f07931f7e708231d41daa36/html5/thumbnails/4.jpg)
Serverless patterns built with functions
Functions are the unit of deployment and scale
Scales per request—users cannot over or under-provision
Never pay for idle
Skip the boring parts; skip the hard parts
![Page 5: Serverless Architectural Patterns and Best Practices...Serverless Architectural Patterns and Best Practices Agenda Serverless characteristics and practices 3-tier web application Batch](https://reader034.vdocuments.net/reader034/viewer/2022042318/5f07931f7e708231d41daa36/html5/thumbnails/5.jpg)
Lambda considerations and best practices
AWS Lambda is stateless—architect accordingly
• Assume no affinity with underlying compute
infrastructure
• Local filesystem access and child process may not
extend beyond the lifetime of the Lambda request
![Page 6: Serverless Architectural Patterns and Best Practices...Serverless Architectural Patterns and Best Practices Agenda Serverless characteristics and practices 3-tier web application Batch](https://reader034.vdocuments.net/reader034/viewer/2022042318/5f07931f7e708231d41daa36/html5/thumbnails/6.jpg)
Lambda considerations and best practices
Can your Lambda functions
survive the cold?
• Instantiate AWS clients and
database clients outside the
scope of the handler to take
advantage of connection re-use.
• Schedule with CloudWatch
Events for warmth
• ENIs for VPC support are
attached during cold start
import sys
import logging
import rds_config
import pymysql
rds_host = "rds-instance"
db_name = rds_config.db_name
try:
conn = pymysql.connect(
except:
logger.error("ERROR:
def handler(event, context):
with conn.cursor() as cur:
Executes with
each invocation
Executes during
cold start
![Page 7: Serverless Architectural Patterns and Best Practices...Serverless Architectural Patterns and Best Practices Agenda Serverless characteristics and practices 3-tier web application Batch](https://reader034.vdocuments.net/reader034/viewer/2022042318/5f07931f7e708231d41daa36/html5/thumbnails/7.jpg)
Lambda considerations and best practices
How about a file system?
• Don’t forget about /tmp (512 MB
scratch space) exports.ffmpeg = function(event,context)
{
new ffmpeg('./thumb.MP4', function (err,
video)
{
if (!err) {
video.fnExtractFrameToJPG('/tmp’)function (error, files) { … }
…
if (!error)
console.log(files);
context.done();
...
![Page 8: Serverless Architectural Patterns and Best Practices...Serverless Architectural Patterns and Best Practices Agenda Serverless characteristics and practices 3-tier web application Batch](https://reader034.vdocuments.net/reader034/viewer/2022042318/5f07931f7e708231d41daa36/html5/thumbnails/8.jpg)
Lambda considerations and best practices
Custom CloudWatch metrics
• 40 KB per POST
• Default Acct Limit of 150 TPS
• Consider aggregating with Kinesis
def put_cstate ( iid, state ):
response = cwclient.put_metric_data(
Namespace='AWSx/DirectConnect',
MetricData=[
{
'MetricName':'ConnectionState',
'Dimensions': [
{
'Name': 'ConnectionId',
'Value': iid
},
],
'Value': state,
'Unit': 'None’
…
![Page 9: Serverless Architectural Patterns and Best Practices...Serverless Architectural Patterns and Best Practices Agenda Serverless characteristics and practices 3-tier web application Batch](https://reader034.vdocuments.net/reader034/viewer/2022042318/5f07931f7e708231d41daa36/html5/thumbnails/9.jpg)
Pattern 1: 3-Tier Web Application
![Page 10: Serverless Architectural Patterns and Best Practices...Serverless Architectural Patterns and Best Practices Agenda Serverless characteristics and practices 3-tier web application Batch](https://reader034.vdocuments.net/reader034/viewer/2022042318/5f07931f7e708231d41daa36/html5/thumbnails/10.jpg)
Web application
Data stored in
Amazon
DynamoDB
Dynamic content
in AWS Lambda
Amazon API
Gateway
Browser
Amazon
CloudFront
Amazon
S3
![Page 11: Serverless Architectural Patterns and Best Practices...Serverless Architectural Patterns and Best Practices Agenda Serverless characteristics and practices 3-tier web application Batch](https://reader034.vdocuments.net/reader034/viewer/2022042318/5f07931f7e708231d41daa36/html5/thumbnails/11.jpg)
Amazon API
GatewayAWS
Lambda
Amazon
DynamoDB
Amazon
S3Amazon
CloudFront
• Bucket Policies
• ACLs
• OAI
• Geo-Restriction
• Signed Cookies
• Signed URLs
• DDOS
IAM
AuthZ
IAM
Serverless web app security
• Throttling
• Caching
• Usage Plans
Browser
![Page 12: Serverless Architectural Patterns and Best Practices...Serverless Architectural Patterns and Best Practices Agenda Serverless characteristics and practices 3-tier web application Batch](https://reader034.vdocuments.net/reader034/viewer/2022042318/5f07931f7e708231d41daa36/html5/thumbnails/12.jpg)
Amazon API
GatewayAWS
Lambda
Amazon
DynamoDB
Amazon
S3Amazon
CloudFront
• Bucket Policies
• ACLs
• OAI
• Geo-Restriction
• Signed Cookies
• Signed URLs
• DDOS
IAMAuthZ IAM
Serverless web app security
• Throttling
• Caching
• Usage Plans
Browser
Amazon
CloudFront
• HTTPS
• Disable Host
Header Forwarding
AWS WAF
![Page 13: Serverless Architectural Patterns and Best Practices...Serverless Architectural Patterns and Best Practices Agenda Serverless characteristics and practices 3-tier web application Batch](https://reader034.vdocuments.net/reader034/viewer/2022042318/5f07931f7e708231d41daa36/html5/thumbnails/13.jpg)
Amazon API
GatewayAWS
Lambda
Amazon
DynamoDB
Amazon
S3Amazon
CloudFront• Access Logs in S3
Bucket• Access Logs in S3 Bucket
• CloudWatch Metrics-
https://aws.amazon.com/cl
oudfront/reporting/
Serverless web app monitoring
AWS WAF
• WebACL Testing
• Total Requests
• Allowed/Blocked
Requests by ACL
logslogs
• Invocations
• Invocation Errors
• Duration
• Throttled
Invocations
• Latency
• Throughput
• Throttled Reqs
• Returned Bytes
• Documentation
• Latency
• Count
• Cache Hit/Miss
• 4XX/5XX Errors
Streams
AWS
CloudTrail
BrowserCustom CloudWatch
Metrics & Alarms
![Page 14: Serverless Architectural Patterns and Best Practices...Serverless Architectural Patterns and Best Practices Agenda Serverless characteristics and practices 3-tier web application Batch](https://reader034.vdocuments.net/reader034/viewer/2022042318/5f07931f7e708231d41daa36/html5/thumbnails/14.jpg)
Serverless web app lifecycle management
AWS SAM (Serverless Application Model) - blog
AWS
Lambda
Amazon API
Gateway
AWS
CloudFormationAmazon
S3
Amazon
DynamoDB
Package &
Deploy
Code/Packages/
Swagger
Serverless
TemplateServerless
Template
w/ CodeUri
package deploy
CI/CD Tools
![Page 15: Serverless Architectural Patterns and Best Practices...Serverless Architectural Patterns and Best Practices Agenda Serverless characteristics and practices 3-tier web application Batch](https://reader034.vdocuments.net/reader034/viewer/2022042318/5f07931f7e708231d41daa36/html5/thumbnails/15.jpg)
Amazon API Gateway best practices
Use mock integrations
Signed URL from API Gateway for large or binary file
uploads to S3
Asynchronous calls for Lambda > 30s
![Page 16: Serverless Architectural Patterns and Best Practices...Serverless Architectural Patterns and Best Practices Agenda Serverless characteristics and practices 3-tier web application Batch](https://reader034.vdocuments.net/reader034/viewer/2022042318/5f07931f7e708231d41daa36/html5/thumbnails/16.jpg)
Root
/
/{proxy+} ANY Your Node.js
Express app
Greedy variable, ANY method, proxy integration
Simple yet very powerful:
• Automatically scale to meet demand
• Only pay for the requests you receive
![Page 17: Serverless Architectural Patterns and Best Practices...Serverless Architectural Patterns and Best Practices Agenda Serverless characteristics and practices 3-tier web application Batch](https://reader034.vdocuments.net/reader034/viewer/2022042318/5f07931f7e708231d41daa36/html5/thumbnails/17.jpg)
Pattern 2: Batch Processing
![Page 18: Serverless Architectural Patterns and Best Practices...Serverless Architectural Patterns and Best Practices Agenda Serverless characteristics and practices 3-tier web application Batch](https://reader034.vdocuments.net/reader034/viewer/2022042318/5f07931f7e708231d41daa36/html5/thumbnails/18.jpg)
Characteristics
Large data sets
Periodic or scheduled tasks
Extract Transform Load (ETL) jobs
Usually non-interactive and long running
Many problems fit MapReduce programming model
![Page 19: Serverless Architectural Patterns and Best Practices...Serverless Architectural Patterns and Best Practices Agenda Serverless characteristics and practices 3-tier web application Batch](https://reader034.vdocuments.net/reader034/viewer/2022042318/5f07931f7e708231d41daa36/html5/thumbnails/19.jpg)
Serverless batch processing
AWS Lambda:
Splitter
Amazon S3
Object
Amazon DynamoDB:
Mapper Results
AWS Lambda:
Mappers
….
….AWS Lambda:
ReducerAmazon S3
Results
![Page 20: Serverless Architectural Patterns and Best Practices...Serverless Architectural Patterns and Best Practices Agenda Serverless characteristics and practices 3-tier web application Batch](https://reader034.vdocuments.net/reader034/viewer/2022042318/5f07931f7e708231d41daa36/html5/thumbnails/20.jpg)
Considerations and best practices
Cascade mapper functions
Lambda languages vs. SQL
Speed is directly proportional to the concurrent Lambda
function limit
Use DynamoDB/ElastiCache/S3 for intermediate state of
mapper functions
Lambda MapReduce Reference Architecture
![Page 21: Serverless Architectural Patterns and Best Practices...Serverless Architectural Patterns and Best Practices Agenda Serverless characteristics and practices 3-tier web application Batch](https://reader034.vdocuments.net/reader034/viewer/2022042318/5f07931f7e708231d41daa36/html5/thumbnails/21.jpg)
Cost of serverless batch processing
200 GB normalized Google Ngram data-set
Serverless:
• 1000 concurrent Lambda invocations
• Processing time: 9 minutes
• Cost: $7.06
![Page 22: Serverless Architectural Patterns and Best Practices...Serverless Architectural Patterns and Best Practices Agenda Serverless characteristics and practices 3-tier web application Batch](https://reader034.vdocuments.net/reader034/viewer/2022042318/5f07931f7e708231d41daa36/html5/thumbnails/22.jpg)
Pattern 3: Stream Processing
![Page 23: Serverless Architectural Patterns and Best Practices...Serverless Architectural Patterns and Best Practices Agenda Serverless characteristics and practices 3-tier web application Batch](https://reader034.vdocuments.net/reader034/viewer/2022042318/5f07931f7e708231d41daa36/html5/thumbnails/23.jpg)
Stream processing characteristics
• High ingest rate
• Near real-time processing (low latency from ingest to
process)
• Spiky traffic (lots of devices with intermittent network
connections)
• Message durability
• Message ordering
![Page 24: Serverless Architectural Patterns and Best Practices...Serverless Architectural Patterns and Best Practices Agenda Serverless characteristics and practices 3-tier web application Batch](https://reader034.vdocuments.net/reader034/viewer/2022042318/5f07931f7e708231d41daa36/html5/thumbnails/24.jpg)
Serverless stream processing architecture
Sensors
Amazon Kinesis:
Stream
Lambda:
Stream Processor
S3:
Final Aggregated Output
Lambda:
Periodic Dump to S3
CloudWatch Events:
Trigger every 5 minutes
S3:
Intermediate Aggregated
Data
Lambda:
Scheduled Dispatcher
KPL:
Producer
![Page 25: Serverless Architectural Patterns and Best Practices...Serverless Architectural Patterns and Best Practices Agenda Serverless characteristics and practices 3-tier web application Batch](https://reader034.vdocuments.net/reader034/viewer/2022042318/5f07931f7e708231d41daa36/html5/thumbnails/25.jpg)
Fan-out pattern
• Number of Amazon Kinesis Streams shards corresponds to concurrent
Lambda invocations
• Trade higher throughput & lower latency vs. strict message ordering
Sensors
Amazon Kinesis:
Stream
Lambda:
Dispatcher
KPL:
Producer Lambda:
Processors
Increase throughput, reduce processing latency
![Page 26: Serverless Architectural Patterns and Best Practices...Serverless Architectural Patterns and Best Practices Agenda Serverless characteristics and practices 3-tier web application Batch](https://reader034.vdocuments.net/reader034/viewer/2022042318/5f07931f7e708231d41daa36/html5/thumbnails/26.jpg)
Best practices
• Tune batch size when Lambda is triggered by Amazon
Kinesis Streams – reduce number of Lambda
invocations
• Tune memory setting for your Lambda function – shorten
execution time
• Use KPL to batch messages and saturate Amazon
Kinesis Stream capacity
![Page 27: Serverless Architectural Patterns and Best Practices...Serverless Architectural Patterns and Best Practices Agenda Serverless characteristics and practices 3-tier web application Batch](https://reader034.vdocuments.net/reader034/viewer/2022042318/5f07931f7e708231d41daa36/html5/thumbnails/27.jpg)
Monitoring
Amazon Kinesis Stream metric GetRecords.IteratorAgeMilliseconds maximum
![Page 28: Serverless Architectural Patterns and Best Practices...Serverless Architectural Patterns and Best Practices Agenda Serverless characteristics and practices 3-tier web application Batch](https://reader034.vdocuments.net/reader034/viewer/2022042318/5f07931f7e708231d41daa36/html5/thumbnails/28.jpg)
Amazon Kinesis Analytics
Sensors
Amazon Kinesis:
Stream
Amazon Kinesis Analytics:
Window Aggregation
Amazon Kinesis Streams
Producer S3:
Aggregated Output
CREATE OR REPLACE PUMP "STREAM_PUMP" AS INSERT INTO "DESTINATION_SQL_STREAM"
SELECT STREAM "device_id",
FLOOR("SOURCE_SQL_STREAM_001".ROWTIME TO MINUTE) as "round_ts",
SUM("measurement") as "sample_sum",
COUNT(*) AS "sample_count"
FROM "SOURCE_SQL_STREAM_001"
GROUP BY "device_id", FLOOR("SOURCE_SQL_STREAM_001".ROWTIME TO MINUTE);
AggregationTime Window
![Page 29: Serverless Architectural Patterns and Best Practices...Serverless Architectural Patterns and Best Practices Agenda Serverless characteristics and practices 3-tier web application Batch](https://reader034.vdocuments.net/reader034/viewer/2022042318/5f07931f7e708231d41daa36/html5/thumbnails/29.jpg)
Cost comparison - assumptions
• Variable message rate over 6 hours
• Costs extrapolated over 30 days
20,000
10,000
20,000
50,000
20,000
10,000
1 2 3 4 5 6
MESSAGES/SEC
HOURS
![Page 30: Serverless Architectural Patterns and Best Practices...Serverless Architectural Patterns and Best Practices Agenda Serverless characteristics and practices 3-tier web application Batch](https://reader034.vdocuments.net/reader034/viewer/2022042318/5f07931f7e708231d41daa36/html5/thumbnails/30.jpg)
Serverless
• Amazon Kinesis Stream with 5
shards
Cost comparison
Server-based on EC2
• Kafka cluster (3 x m3.large)
• Zookeeper cluster (3 x m3.large)
• Consumer (1 x c4.xlarge)
Service Monthly Cost
Amazon Kinesis Streams $ 58.04
AWS Lambda $259.85
Amazon S3 (Intermediate Files) $ 84.40
Amazon CloudWatch $ 4.72
Total $407.01
Service Monthly Cost
EC2 Kafka Cluster $292.08
EC2 Zookeeper Cluster $292.08
EC2 Consumer $152.99
Total On-Demand $737.15
1-year All Upfront RI $452.42
![Page 31: Serverless Architectural Patterns and Best Practices...Serverless Architectural Patterns and Best Practices Agenda Serverless characteristics and practices 3-tier web application Batch](https://reader034.vdocuments.net/reader034/viewer/2022042318/5f07931f7e708231d41daa36/html5/thumbnails/31.jpg)
Lambda architecture
Data
Sources
Serving Layer
Speed Layer
AWS Lambda: Splitter
Amazon S3Object
Amazon DynamoDB: Mapper Results
Amazon
S3
AWS Lambda: Mappers
….
….AWS Lambda:
ReducerAmazon S3
Results
Batch Layer
Sensors
Amazon Kinesis:
Stream
Lambda:
Stream Processor
S3:
Final Aggregated Output
Lambda:
Periodic Dump to S3
CloudWatch Events:
Trigger every 5 minutes
S3:
Intermediate Aggregated
Data
Lambda:
Scheduled Dispatcher
KPL:
Producer
![Page 32: Serverless Architectural Patterns and Best Practices...Serverless Architectural Patterns and Best Practices Agenda Serverless characteristics and practices 3-tier web application Batch](https://reader034.vdocuments.net/reader034/viewer/2022042318/5f07931f7e708231d41daa36/html5/thumbnails/32.jpg)
Pattern 4: Automation
![Page 33: Serverless Architectural Patterns and Best Practices...Serverless Architectural Patterns and Best Practices Agenda Serverless characteristics and practices 3-tier web application Batch](https://reader034.vdocuments.net/reader034/viewer/2022042318/5f07931f7e708231d41daa36/html5/thumbnails/33.jpg)
Automation characteristics
• Respond to alarms or events
• Periodic jobs
• Auditing and Notification
• Extend AWS functionality
…All while being Highly Available and Scalable
![Page 34: Serverless Architectural Patterns and Best Practices...Serverless Architectural Patterns and Best Practices Agenda Serverless characteristics and practices 3-tier web application Batch](https://reader034.vdocuments.net/reader034/viewer/2022042318/5f07931f7e708231d41daa36/html5/thumbnails/34.jpg)
Automation: dynamic DNS for EC2 instances
AWS Lambda:
Update Route53
Amazon CloudWatch Events:
Rule Triggered
Amazon EC2 Instance
State Changes
Amazon DynamoDB:
EC2 Instance Properties
Amazon Route53:
Private Hosted Zone
Tag:
CNAME = ‘xyz.example.com’
xyz.example.com A 10.2.0.134
![Page 35: Serverless Architectural Patterns and Best Practices...Serverless Architectural Patterns and Best Practices Agenda Serverless characteristics and practices 3-tier web application Batch](https://reader034.vdocuments.net/reader034/viewer/2022042318/5f07931f7e708231d41daa36/html5/thumbnails/35.jpg)
Automation: image thumbnail creation from S3
AWS Lambda:
Resize Images
Users upload photos
S3:
Source BucketS3:
Destination Bucket
Triggered on
PUTs
![Page 36: Serverless Architectural Patterns and Best Practices...Serverless Architectural Patterns and Best Practices Agenda Serverless characteristics and practices 3-tier web application Batch](https://reader034.vdocuments.net/reader034/viewer/2022042318/5f07931f7e708231d41daa36/html5/thumbnails/36.jpg)
CapitalOne Cloud Custodian
AWS Lambda:
Policy & Compliance RulesAmazon CloudWatch Events:
Rules Triggered
AWS CloudTrail:
Events
Amazon SNS:
Alert Notifications
Amazon CloudWatch Logs:
Logs
Read more here: http://www.capitalone.io/cloud-custodian/docs/index.html
![Page 37: Serverless Architectural Patterns and Best Practices...Serverless Architectural Patterns and Best Practices Agenda Serverless characteristics and practices 3-tier web application Batch](https://reader034.vdocuments.net/reader034/viewer/2022042318/5f07931f7e708231d41daa36/html5/thumbnails/37.jpg)
Best practices
• Document how to disable event triggers for your automation when
troubleshooting
• Gracefully handle API throttling by retrying with an exponential back-
off algorithm (AWS SDKs do this for you)
• Publish custom metrics from your Lambda function that are
meaningful for operations (e.g. number of EBS volumes
snapshotted)
![Page 38: Serverless Architectural Patterns and Best Practices...Serverless Architectural Patterns and Best Practices Agenda Serverless characteristics and practices 3-tier web application Batch](https://reader034.vdocuments.net/reader034/viewer/2022042318/5f07931f7e708231d41daa36/html5/thumbnails/38.jpg)
Thank you!