aws ne meetup - introduction to aws iaas

16
Andrew Taylor Senior European Live Services Specialist for Sage UK Utterly Forked - Contract Infrastructure / Architecture @ukandrewtaylor

Upload: andrew-taylor

Post on 15-Jan-2015

126 views

Category:

Technology


2 download

DESCRIPTION

An overview presentation given to the AWSNE Meetup on 2014-07-03. Covers the basics of combining EC2, SQS, CloudFormation and IAM to make a reusable worker tier.

TRANSCRIPT

Page 1: AWS NE Meetup - Introduction to AWS IAAS

Andrew Taylor

Senior European Live Services Specialist for Sage UK

Utterly Forked - Contract Infrastructure / Architecture

@ukandrewtaylor

Page 2: AWS NE Meetup - Introduction to AWS IAAS

AWS - IaaS

CloudFormation

EC2 with IAM Roles

Amazon Linux / CLI tools / CloudInit

S3 / SQS / SNS

Page 3: AWS NE Meetup - Introduction to AWS IAAS

CloudFormation

Repeatable and Predictable

Amazon handles dependency ordering

JSON

Write templates, create stacks

Page 4: AWS NE Meetup - Introduction to AWS IAAS

EC2

Resizable compute capacity designed for developers

Full access. Build what you need / Own what you build

EC2 compute unit - consistent measure of instance performance

Choice of operating systems

Tags

Page 5: AWS NE Meetup - Introduction to AWS IAAS

Amazon Linux

Supported and maintained by AWS

Lightweight and designed for EC2

Twice yearly releases - continual package updates

Compatible with EPEL

Page 6: AWS NE Meetup - Introduction to AWS IAAS

Unified CLI Tools

Unified interface to all* AWS products

Autocomplete and built-in help

Installed by default to Amazon Linux AMI

JSON

Supports EC2 IAM roles

Page 7: AWS NE Meetup - Introduction to AWS IAAS

cfn-init

< Salt/Ansible/Puppet/Chef

> Custom bash scripts

Installed by default on Amazon Linux AMI

Bootstrap through UserData command

Page 8: AWS NE Meetup - Introduction to AWS IAAS

cfn-init…

packages - Yum

sources - S3 or GitHub

users & groups

files - Create a file

commands - Do a thing

services - sysvinit control

Page 9: AWS NE Meetup - Introduction to AWS IAAS

IAM

Identity and Access management

User / Groups / Roles

Fine-grained permission model

Supports SSO / Federated logins via SAML

Page 10: AWS NE Meetup - Introduction to AWS IAAS

SQS / SNS / S3

Simple Queue Service

Not FIFO / 256KB / DLQ

Simple Notification Service

Mobile push / SMS / Email / HTTP / SQS

Simple Storage

Page 11: AWS NE Meetup - Introduction to AWS IAAS

“the hello world of infrastructure”

Page 12: AWS NE Meetup - Introduction to AWS IAAS

_____________________ < COWSAY as a SERVICE > --------------------- \ ^__^ \ (oo)\_______ (__)\ )\/\ ||----w | || ||

Page 13: AWS NE Meetup - Introduction to AWS IAAS

The challenge

A scalable, fault tolerant worker tier that gets messages from SQS and processes the output to S3

Built through code and configuration without manual intervention

Easy to deploy and maintain

Page 14: AWS NE Meetup - Introduction to AWS IAAS

CloudFormation - Elements

An optional list of template parameters (input values supplied at stack creation time)

An optional list of output values (e.g. the complete URL to a web application)

An optional list of data tables used to lookup static configuration values (e.g., AMI names)

The list of AWS resources and their configuration values

Page 15: AWS NE Meetup - Introduction to AWS IAAS

AWS Resources

An SQS queue to pull from

An autoscaling group of EC2 worker nodes

CloudInit config to configure the node

An IAM role and instance profile for the node to assume

An S3 bucket to store output

A CloudWatch alarm to trigger scaling

Page 16: AWS NE Meetup - Introduction to AWS IAAS

Questions?