aws summit - chicago 2016 - new relic - monitoring the dynamic cloud

© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Lee Atchison, Principal Cloud Architect and Advocate at New Relic, Inc.

April 19, 2016 – Chicago, IL

Life’s Too Short…... for Cloud without Analytics

Monitoring the Dynamic Nature of Cloud Computing

Safe HarborThis document and the information herein (including any information that may be incorporated by reference) is provided for informational purposes only and should not be construed as an offer, commitment, promise or obligation on behalf of New Relic, Inc. (“New Relic”) to sell securities or deliver any product, material, code, functionality, or other feature. Any information provided hereby is proprietary to New Relic and may not be replicated or disclosed without New Relic’s express written permission.

Such information may contain forward-looking statements within the meaning of federal securities laws. Any statement that is not a historical fact or refers to expectations, projections, future plans, objectives, estimates, goals, or other characterizations of future events is a forward-looking statement. These forward-looking statements can often be identified as such because the context of the statement will include words such as “believes,” “anticipates,”, “expects” or words of similar import.

Actual results may differ materially from those expressed in these forward-looking statements, which speak only as of the date hereof, and are subject to change at any time without notice. Existing and prospective investors, customers and other third parties transacting business with New Relic are cautioned not to place undue reliance on this forward-looking information. The achievement or success of the matters covered by such forward-looking statements are based on New Relic’s current assumptions, expectations, and beliefs and are subject to substantial risks, uncertainties, assumptions, and changes in circumstances that may cause the actual results, performance, or achievements to differ materially from those expressed or implied in any forward-looking statement. Further information on factors that could affect such forward-looking statements is included in the filings we make with the SEC from time to time. Copies of these documents may be obtained by visiting New Relic’s Investor Relations website at http://ir.newrelic.com or the SEC’s website at www.sec.gov.

New Relic assumes no obligation and does not intend to update these forward-looking statements, except as required by law. New Relic makes no warranties, expressed or implied, in this document or otherwise, with respect to the information provided.

Who am I?

Lee AtchisonPrincipal Cloud Architectand Advocate

Specialize in:Cloud computing

Services & Microservices

Scalability, Availability

28 years in industry7 in Amazon Retail & AWS (Built SW/VG AppStore, AWS Elastic Beanstalk)

4 in New Relic (Architecture Lead, Cloud, Service Migration)

@leeatchison leeatchison

We want better apps faster

DynamicEnvironment

BetterData Center

How do we use the cloud to accomplish this?

Cloud as a Dynamic Tool

Cloud as a “Dynamic Tool for Dynamic Apps”

Use only the resources

you need



you need

Allocate / de-allocate

resources on the fly



you need

Resource allocation is an integral part of

your application architecture

Allocate / de-allocate

resources on the fly

Dynamic Cloud

Resources are:

Application is aware of and is controlling

traditional OPs resources

De-allocatedConsumedAllocated

Auto Scale

Dynamic Cloud

Docker containers:

• Quicker / cheaper startup / shutdown even than EC2 instances

• Easy to consume Docker containers much like you do “processes”

• Perform jobs:– In a script– Off of some queue of job requests

Docker is making the cloud even more dynamic

Dynamic Cloud

100

10K

1M

3.7 M

83 days 333 days

Docker Container Age(Count vs. Hours)

Dynamic Cloud

950,00011% under one minute

Docker Container Age(by Minute Under and Hour)

Dynamic Cloud Technologies

EC2/Spot Instances

Load balancing

Auto Scaling Queues and notifications

Docker

Dynamic Cloud is about scaling

How do I monitor the Dynamic Cloud?

Dynamic Cloud has unique monitoring requirements…

Responsibility (Dynamic Cloud)

Server OS

Server (Virtual)Hardware

Application & Application

Microservices


Microservices


Microservices

Provisioning

• Multiple Applications & Application Microservices &Dynamic services

• Servers &Virtual Hardware &Infrastructure

AWS Infrastructure

Server OS


CloudWatch

AWS CONSOLE

DASHBOARDS


Microservices


Microservices


Microservices

Provisioning

AWS Infrastructure New Relic work together

Server OS


CloudWatch

AWS CONSOLE

DASHBOARDS


Microservices


Microservices


Microservices

Provisioning

AWS Infrastructure New Relic work together

Server OS


CloudWatch

AWS CONSOLE

DASHBOARDS


Microservices


Microservices


Microservices

ProvisioningCloudWatch

& AWS monitoring

New Relic monitors

How do you monitor this?

Server OS



Microservices


Microservices


Microservices

Provisioning

?How do you monitor this?

Where did it go? It was just here!!!

? The thing you monitored 10 minutes ago…...doesn’t exist

anymore!

Dynamic Cloud

950,00011% under one minute

Docker Container Age(by Minute Under and Hour)

Monitoring the Dynamic Cloud

Very different than monitoring traditional Data Center components

Monitor theCloud Components

themselves

Monitor the lifecycle of the

Cloud Components

Who is impacted by Dynamic Cloud?

Better DataCenter

Can I scale my server fleet?Can apps run anywhere?How do they perform in the cloud?

Operations

Data center is a data center…

Development

DynamicCloud


Better DataCenter


Operations


Development

DynamicCloud

What is a container?Why do I care??It was just here, where did it go???


Better DataCenter


Operations


Development

DynamicCloud

What is a container?Why do I care??It was just here, where did it go???

Cloud architecture is integral to the application architectureDevelopers deeply involved in cloud activities

Change is speeding up

TraditionalData Center

CloudData Center

DynamicCloud

Dynamic Cloud enables better applications faster.

Good Better Best

The way you’ve done things in the past won’t work in the future.

Dynamic Cloud

EC2

Server running application / processes

Docker container

Process running a command

Things happen faster because of…

This ishard

Dynamic Cloud

EC2

Server running application / processes

Docker container

Process running a command

Lambda

Function performing a task or operation

Things happen faster with…

Change is speeding up

TraditionalData Center

CloudData Center

DynamicCloud

Dynamic Cloud enables better applications faster.The rate of change is increasing…

Good Better Best

The way you’ve done things in the past won’t work in the future.

Monitoring just the server

EC2 Instance


Microservices

Server OS


CloudWatch

AWS CONSOLE

Worked when rate of change was low…

Monitoring just the server

Server OS



Microservices


Microservices


Microservices

Provisioning

Insufficient in the cloud:

• Rate of change is faster• Problems come up quicker• “Server” isn’t a server anymore• “Provisioning” isn’t provisioning anymore

You need top to bottom monitoring…

You need full stack accountability...

You Need A Solid Monitoring Partner...

Customers

Mobile / Apps / Browser

On-Premises

On Premises Relational Data

EC2

AWSContainer Service

AWS RDSSynthetic Customers

S3

NoSQL

AWS Storage Services

Your Responsibilities

• Application code & 3rd party services• App architecture• Customer experience• On-Premises components

AWS Responsibility:

• Service Availability & Performance• Provisioning & operation of DC• Isolation & security of resources• Service maintenance & innovation

NoSQL

Want to Learn More?

Webinar

Monitoring the Hybrid CloudHow do you measure and make decisions across on-premises data centers, dynamic clouds, and hybrid clouds?

Registration: http://bit.ly/NR421

Webinar: April 21 @ 8 AM PT

Want to Learn More?

Booth #321

Thank You!Lee Atchison, Principal Cloud Architect and Advocate at New Relic, Inc.

Architecting for ScalePublished by: O’Reilly Media, Available: June 2016www.architectingforscale.com

@leeatchison leeatchison

aws summit - chicago 2016 - new relic - monitoring the dynamic cloud

Technology