webinar - life's too short for cloud without analytics

Life’s Too Short…... for Cloud without Analytics Monitoring the Dynamic Nature of Cloud ComputingLee Atchison, Principal Cloud Architect and Advocate at New Relic, Inc.

Confidential ©2008-16 New Relic, Inc. All rights reserved.  

@leeatchison leeatchison

▪Today’s webinar is being recorded. A link to the recording will be emailed to all registrants shortly after.

▪Please be sure to ask any questions via the “questions panel”

▪There is a brief survey after the webinar for any additional questions or feedback.

2

Housekeeping

Confidential ©2008-15 New Relic, Inc. All rights reserved.  

3Confidential ©2008-16 New Relic, Inc. All rights reserved.  

Who am I?

Lee AtchisonPrincipal Cloud Architectand Advocate

Specialize in:Cloud computingServices & Microservices

Scalability, Availability

28 years in industry7 in Amazon Retail & AWS(Built SW/VG AppStore, AWS Elastic Beanstalk)

4 in New Relic(Architecture Lead, Cloud, Service Migration)

@leeatchison leeatchison

4Confidential ©2008-16 New Relic, Inc. All rights reserved.  

We want better apps faster

DynamicEnvironment

BetterData Center

How do we use the cloud to accomplish this?

5Confidential ©2008-16 New Relic, Inc. All rights reserved.  

Cloud as a Better Data Center

6Confidential ©2008-16 New Relic, Inc. All rights reserved.  

Cloud as a “Better Data Center”

Resources are allocated to uses, just like in

a data center

7Confidential ©2008-16 New Relic, Inc. All rights reserved.  

Cloud as a “Better Data Center”

Resources are allocated to uses, just like in

a data center

Provisioning process is faster

8Confidential ©2008-16 New Relic, Inc. All rights reserved.  

Cloud as a “Better Data Center”

Resources are allocated to uses, just like in

a data center

Lifetime of components is relatively long

Provisioning process is faster

9Confidential ©2008-16 New Relic, Inc. All rights reserved.  

Cloud as a “Better Data Center”

Resources are allocated to uses, just like in

a data center

Lifetime of components is relatively long

Provisioning process is faster

Capacity planning is still important and

still applies

10Confidential ©2008-16 New Relic, Inc. All rights reserved.  

Why use a “Better Data Center”?

11Confidential ©2008-16 New Relic, Inc. All rights reserved.  

Why use a “Better Data Center”?

Add new Capacity(faster)

12Confidential ©2008-16 New Relic, Inc. All rights reserved.  

Why use a “Better Data Center”?

Improve ApplicationAvailability

(redundancy)

Add new Capacity(faster)

13Confidential ©2008-16 New Relic, Inc. All rights reserved.  

Why use a “Better Data Center”?

ComplianceImprove ApplicationAvailability

(redundancy)

Add new Capacity(faster)

14Confidential ©2008-16 New Relic, Inc. All rights reserved.  

Who is impacted?

Better DataCenter

Operations Development

15Confidential ©2008-16 New Relic, Inc. All rights reserved.  

Who is impacted?

Better DataCenter

Can I scale my server fleet?Can apps run anywhere?How do they perform in the cloud?

Operations Development

16Confidential ©2008-16 New Relic, Inc. All rights reserved.  

Who is impacted?

Better DataCenter

Can I scale my server fleet?Can apps run anywhere?How do they perform in the cloud?

Operations

Data center is a data center…

Development

17Confidential ©2008-16 New Relic, Inc. All rights reserved.  

Who is impacted?

Better Data Center

Faster Application Launch / Deploy

=

Better DataCenter

Can I scale my server fleet?Can apps run anywhere?How do they perform in the cloud?

Operations

Data center is a data center…

Development

18Confidential ©2008-16 New Relic, Inc. All rights reserved.  

How do I monitor it?Similar to monitoring any other data center…

19Confidential ©2008-16 New Relic, Inc. All rights reserved.  

Monitoring an applicationTypical Server / EC2 Instance• Application &

Application Microservices• Server OS• Hardware (virtual)

EC2 Instance

Application &

Application Microservice

s

Server OS

Server (Virtual)Hardware

20Confidential ©2008-16 New Relic, Inc. All rights reserved.  

AWS MonitoringCloudWatch• Monitors:

– EC2 instance– Virtualization– Hardware– [CPU / Disk / Networking]

• Doesn’t know about:– Server OS– Memory / Filesystem– Processes– Application

• Latency• Error rates• Internal insights

EC2 Instance

Application &

Application Microservice

s

Server OS

Server (Virtual)HardwareCloudWatch

AWS CONSOLE

21Confidential ©2008-16 New Relic, Inc. All rights reserved.  

New Relic MonitoringNew Relic• Monitors (Server):

– How O.S. is performing– Processes– Hardware

• Monitors (Application):– App health– App performance– Microservices

• Doesn’t know– Virtualization

EC2 Instance

Application &

Application Microservice

s

New RelicApplicationMonitoring

Server OS

Server (Virtual)Hardware

New RelicServer

Monitoring

CloudWatch

DASHBOARDS

AWS CONSOLE

22Confidential ©2008-16 New Relic, Inc. All rights reserved.  

AWS New Relic work togetherAWS / CloudWatch• Visibility into virtualization• CPU / Disk / Networking

New Relic• CPU / Disk / Networking• Memory / Filesystem• Processes• Infrastructure components• Application / Microservices:

– Latency– Error rates– App insights

EC2 Instance

Application &

Application Microservice

s

New RelicApplicationMonitoring

Server OS

Server (Virtual)Hardware

New RelicServer

Monitoring

CloudWatch

DASHBOARDS

CloudWatch

monitors

New Relic monitors

AWS CONSOLE

23Confidential ©2008-16 New Relic, Inc. All rights reserved.  

Cloud as a Dynamic Tool

24Confidential ©2008-16 New Relic, Inc. All rights reserved.  

Cloud as a “Dynamic Tool for Dynamic Apps”

Use only the

resources you need

25Confidential ©2008-16 New Relic, Inc. All rights reserved.  

Cloud as a “Dynamic Tool for Dynamic Apps”

Use only the

resources you need

Allocate / de-allocate

resources on the fly

26Confidential ©2008-16 New Relic, Inc. All rights reserved.  

Cloud as a “Dynamic Tool for Dynamic Apps”

Use only the

resources you need

Resource allocation is an integral part of

your application architecture

Allocate / de-allocate

resources on the fly

27Confidential ©2008-16 New Relic, Inc. All rights reserved.  

Dynamic Cloud

Resources are:

Application is aware of and is controlling traditional OPs

resourcesDe-

allocatedConsume

dAllocated

Auto Scale

28Confidential ©2008-16 New Relic, Inc. All rights reserved.  

Dynamic Cloud

Docker containers:• Quicker / cheaper startup /

shutdown than EC2 instances• Easy to consume Docker

containers much like you do “processes”

• Perform jobs:– In a script– Off of some queue of job

requests

29Confidential ©2008-16 New Relic, Inc. All rights reserved.  

Dynamic Cloud

100

10K

1M

3.7 M

83 days 333 days

Docker Container Age(Count vs. Hours)

30Confidential ©2008-16 New Relic, Inc. All rights reserved.  

Dynamic Cloud

950,00011% under one minute

Docker Container Age(by Minute Under and Hour)

31Confidential ©2008-16 New Relic, Inc. All rights reserved.  

EC2 Auto Scaling

Dynamic Cloud Technologies

Mobile / IoT

Dynamic routing

Load balancing

Data transport

Queues and notifications

Docker

Dynamic Cloud is about scaling

32Confidential ©2008-16 New Relic, Inc. All rights reserved.  

How do I monitor the Dynamic Cloud?Dynamic Cloud has unique monitoring requirements…

33Confidential ©2008-16 New Relic, Inc. All rights reserved.  

Responsibility (Dynamic Cloud)

Server OS

Server (Virtual)Hardware

Application &

Application Microservic

es

Application &

Application Microservic

es

Application &

Application Microservic

es

Provisioning

Responsible for the parts you care about• Application &

Application Microservices

Let cloud manage rest• Infrastructure• Allocation/Provisioning• Scaling

34Confidential ©2008-16 New Relic, Inc. All rights reserved.  

AWS Infrastructure New Relic work together

Server OS

Server (Virtual)HardwareCloudWatch

DASHBOARDS

Application &

Application Microservic

es

Application &

Application Microservic

es

Application &

Application Microservic

es

ProvisioningAWS CONSOLE

35Confidential ©2008-16 New Relic, Inc. All rights reserved.  

AWS Infrastructure New Relic work together

Server OS

Server (Virtual)HardwareCloudWatch

DASHBOARDS

Application &

Application Microservic

es

Application &

Application Microservic

es

Application &

Application Microservic

es

ProvisioningAWS CONSOLE

36Confidential ©2008-16 New Relic, Inc. All rights reserved.  

AWS Infrastructure New Relic work together

Server OS

Server (Virtual)HardwareCloudWatch

DASHBOARDS

Application &

Application Microservic

es

Application &

Application Microservic

es

Application &

Application Microservic

es

ProvisioningCloudWatch

& AWS monitoring

New Relic monitors

AWS CONSOLE

37Confidential ©2008-16 New Relic, Inc. All rights reserved.  

How do you monitor this?

Server OS

Server (Virtual)Hardware

Application &

Application Microservic

es

Application &

Application Microservic

es

Application &

Application Microservic

es

Provisioning

?How do you monitor this?

38Confidential ©2008-16 New Relic, Inc. All rights reserved.  

Where did it go? It was just here!!!

? The thing you monitored 10 minutes ago…...doesn’t exist

anymore!

39Confidential ©2008-16 New Relic, Inc. All rights reserved.  

Dynamic Cloud

950,00011% under one minute

Docker Container Age(by Minute Under and Hour)

40Confidential ©2008-16 New Relic, Inc. All rights reserved.  

Monitoring the Dynamic CloudVery different than monitoring traditional Data Center components

Monitor theCloud Components

themselves

Monitor the lifecycle of the

Cloud Components

41Confidential ©2008-16 New Relic, Inc. All rights reserved.  

Who is impacted by Dynamic Cloud?

Better DataCenter

Can I scale my server fleet?Can apps run anywhere?How do they perform in the cloud?

Operations

Data center is a data center…

Development

DynamicCloud

42Confidential ©2008-16 New Relic, Inc. All rights reserved.  

Who is impacted by Dynamic Cloud?

Better DataCenter

Can I scale my server fleet?Can apps run anywhere?How do they perform in the cloud?

Operations

Data center is a data center…

Development

DynamicCloud

What is a container?Why do I care??It was just here, where did it go???

43Confidential ©2008-16 New Relic, Inc. All rights reserved.  

Who is impacted by Dynamic Cloud?

Better DataCenter

Can I scale my server fleet?Can apps run anywhere?How do they perform in the cloud?

Operations

Data center is a data center…

Development

DynamicCloud

What is a container?Why do I care??It was just here, where did it go???

Cloud architecture is integral to the application architectureDevelopers deeply involved in cloud activities

44Confidential ©2008-16 New Relic, Inc. All rights reserved.  

Change is speeding up

TraditionalData Center

CloudData Center

DynamicCloud

Dynamic Cloud enables better applications faster.

Good Better Best

The way you’ve done things in the past won’t work in the future.

45Confidential ©2008-16 New Relic, Inc. All rights reserved.  

Dynamic Cloud

EC2Server running

application / processes

Docker container

Process running a command

This ishard

Things happen faster because of…

46Confidential ©2008-16 New Relic, Inc. All rights reserved.  

Dynamic Cloud

EC2Server running

application / processes

Docker container

Process running a command

LambdaFunction performing a task or operation

47Confidential ©2008-16 New Relic, Inc. All rights reserved.  

The Future with Lambda

48Confidential ©2008-16 New Relic, Inc. All rights reserved.  

Microcomputing & AWS Lambda

• Newest entrance to the “dynamic cloud”

• Provides event driven compute capabilities

49Confidential ©2008-16 New Relic, Inc. All rights reserved.  

Microcomputing & AWS Lambda

• No infrastructure to provision• Massively shared infrastructure

50Confidential ©2008-16 New Relic, Inc. All rights reserved.  

Why use Lambda?Lambda scripts

Run in response to a state change or action in the cloud

Stateless, “filters”Perform quick actions

Virtually no startup/shutdown

cost

51Confidential ©2008-16 New Relic, Inc. All rights reserved.  

AWS Lambda

S3Bucket

DynamoDB

APIGateway

SQS

RESOURCESSOME

• Takes an event from an AWS resource (A Trigger)

52Confidential ©2008-16 New Relic, Inc. All rights reserved.  

AWS Lambda

S3Bucket

DynamoDB

APIGateway

SQS

RESOURCESSOME

LambdaScript

• Takes an event from an AWS resource (A Trigger)

• Creates an instance to execute

LambdaInstance

53Confidential ©2008-16 New Relic, Inc. All rights reserved.  

AWS Lambda

S3Bucket

DynamoDB

APIGateway

SQS

RESOURCESSOME

S3Bucket

APIGateway SQS

RESOURCESSOMELambdaScript

• Takes an event from an AWS resource (A Trigger)

• Creates an instance to execute

• Can impact original or different AWS Resource Lambda

Instance

54Confidential ©2008-16 New Relic, Inc. All rights reserved.  

AWS Lambda

S3Bucket

DynamoDB

APIGateway

SQS

RESOURCESSOME

S3Bucket

APIGateway SQS

RESOURCESSOMELambdaScript

Lambda

Instance

Lambda

Instance Lambd

aInstanc

eLambd

aInstanc

eLambd

aInstanc

e Lambda

Instance

Lambda

Instance

Lambda

Instance Lambd

aInstanc

e

• Takes an event from an AWS resource (A Trigger)

• Creates an instance to execute

• Can impact original or different AWS Resource

• Any number of instances can run at a time

55Confidential ©2008-16 New Relic, Inc. All rights reserved.  

Lambda example #1:

Photo Management App

56Confidential ©2008-16 New Relic, Inc. All rights reserved.  

Photo management application

User

UploadFile

S3 BucketImageImport

• Photos uploaded to S3

57Confidential ©2008-16 New Relic, Inc. All rights reserved.  

Photo management application

User

UploadFile

S3 BucketImageImport

S3 BucketImage

Thumbnails

View Thumbnai

l

LambdaScript

• Photos uploaded to S3• Lambda script creates

thumbnails

58Confidential ©2008-16 New Relic, Inc. All rights reserved.  

Photo management application

User

ImageDatabase

UploadFile

S3 BucketImageImport

S3 BucketImage

Thumbnails

LambdaScript

View Thumbnai

l

LambdaScript

• Photos uploaded to S3• Lambda script creates

thumbnails• Lambda script updates

metadata in database

59Confidential ©2008-16 New Relic, Inc. All rights reserved.  

Photo management application

User

ImageDatabaseApplication

UploadFile

S3 BucketImageImport

S3 BucketImage

Thumbnails

LambdaScript

AppInteraction

s

View Thumbnai

l

LambdaScript

• Photos uploaded to S3• Lambda script creates

thumbnails• Lambda script updates

metadata in database• Application only has

to deal with metadata editing, not photo / file management

60Confidential ©2008-16 New Relic, Inc. All rights reserved.  

Lambda example #2:

Mobile Game App

61Confidential ©2008-16 New Relic, Inc. All rights reserved.  

Mobile game platform

APIGateway

LambdaScript

LambdaScript

LambdaScript

Mobile PhoneApplication Users

Database

• Cloud platform hosts an API for mobile app

– API Gateway• Lambda scripts

implement the API• Lambda scripts

manipulate database• Extremely high

scale possible– No infrastructure

62Confidential ©2008-16 New Relic, Inc. All rights reserved.  

Monitoring Lambda Scripts

Less like server monitoring / More like web application

monitoring

We Care About

We Don’t Care About

• Run time (average, extremes – TP90/TP99)

• Statistical metrics• Error rates and

other deviations from norm

• “Drill down” into individual “runs”

• Details about all ”runs”

• Server / infrastructure metrics

63Confidential ©2008-16 New Relic, Inc. All rights reserved.  

Monitoring LambdaMore like application performance monitoring than infrastructure monitoring

64Confidential ©2008-16 New Relic, Inc. All rights reserved.  

Monitoring LambdaMore like application performance monitoring than infrastructure monitoring

65Confidential ©2008-16 New Relic, Inc. All rights reserved.  

Change is speeding up

TraditionalData Center

CloudData Center

DynamicCloud

Dynamic Cloud enables better applications faster.The rate of change is increasing…

Good Better Best

The way you’ve done things in the past won’t work in the future.

66Confidential ©2008-16 New Relic, Inc. All rights reserved.  

Monitoring just the server

EC2 Instance

Application &

Application Microservice

s

Server OS

Server (Virtual)HardwareCloudWatch

Worked when rate of change was low…

AWS CONSOLE

Monitoring just the server

Server OS

Server (Virtual)Hardware

Application &

Application Microservic

es

Application &

Application Microservic

es

Application &

Application Microservic

es

Provisioning

Insufficient in the cloud:

• Rate of change is faster• Problems come up quicker• “Server” isn’t a server anymore• “Provisioning” isn’t provisioning anymore

You need top to bottom monitoring…

You need full stack accountability...

68Confidential ©2008-16 New Relic, Inc. All rights reserved.  

New Relic enables accountability betweenyour code & AWS

Customers

Mobile / Apps / Browser

On-Premises

On Premises Relational

Data

EC2

AWSContainer Service

AWS RDSSynthetic Customers

S3

NoSQL

AWS Storage Services

Your Responsibilities Application code & 3rd party

services App architecture Customer experience On-Premises components

NoSQLAWS Responsibility: Service Availability & Performance Provisioning & operation of DC Isolation & security of resources Service maintenance & innovation

Architecting for ScaleBy: Lee AtchisonPublished by: O’Reilly Media, Available: June 2016www.architectingforscale.com

Want to Learn More?

©2008-15 New Relic, Inc. All rights reserved.  

Thank you.

Lee AtchisonPrincipal Cloud Architect and Advocate at New Relic, Inc.

Architecting for ScalePublished by: O’Reilly Media, Available: June 2016www.architectingforscale.com

@leeatchison leeatchison

71Confidential ©2008-16 New Relic, Inc. All rights reserved.  

Safe HarborThis document and the information herein (including any information that may be incorporated by reference) is provided for informational purposes only and should not be construed as an offer, commitment, promise or obligation on behalf of New Relic, Inc. (“New Relic”) to sell securities or deliver any product, material, code, functionality, or other feature. Any information provided hereby is proprietary to New Relic and may not be replicated or disclosed without New Relic’s express written permission.

Such information may contain forward-looking statements within the meaning of federal securities laws. Any statement that is not a historical fact or refers to expectations, projections, future plans, objectives, estimates, goals, or other characterizations of future events is a forward-looking statement. These forward-looking statements can often be identified as such because the context of the statement will include words such as “believes,” “anticipates,”, “expects” or words of similar import.

Actual results may differ materially from those expressed in these forward-looking statements, which speak only as of the date hereof, and are subject to change at any time without notice. Existing and prospective investors, customers and other third parties transacting business with New Relic are cautioned not to place undue reliance on this forward-looking information. The achievement or success of the matters covered by such forward-looking statements are based on New Relic’s current assumptions, expectations, and beliefs and are subject to substantial risks, uncertainties, assumptions, and changes in circumstances that may cause the actual results, performance, or achievements to differ materially from those expressed or implied in any forward-looking statement. Further information on factors that could affect such forward-looking statements is included in the filings we make with the SEC from time to time. Copies of these documents may be obtained by visiting New Relic’s Investor Relations website at http://ir.newrelic.com or the SEC’s website at www.sec.gov.

New Relic assumes no obligation and does not intend to update these forward-looking statements, except as required by law. New Relic makes no warranties, expressed or implied, in this document or otherwise, with respect to the information provided.