monitoring performance of enterprise applications on aws: understanding the dynamic nature of cloud...
TRANSCRIPT
© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Andy Wetzel, Director of Industry Solutions at New Relic, Inc.Donald J. Patti, Program Manager & ScrumMaster, Telesis
20 June 2016
Monitoring Performance of Enterprise Applications on AWS: Life’s Too Short…
... for Cloud without Analytics Monitoring the Dynamic Nature of Cloud Computing
Safe HarborThis document and the information herein (including any information that may be incorporated by reference) is provided for informational purposes only and should not be construed as an offer, commitment, promise or obligation on behalf of New Relic, Inc. (“New Relic”) to sell securities or deliver any product, material, code, functionality, or other feature. Any information provided hereby is proprietary to New Relic and may not be replicated or disclosed without New Relic’s express written permission.
Such information may contain forward-looking statements within the meaning of federal securities laws. Any statement that is not a historical fact or refers to expectations, projections, future plans, objectives, estimates, goals, or other characterizations of future events is a forward-looking statement. These forward-looking statements can often be identified as such because the context of the statement will include words such as “believes,” “anticipates,”, “expects” or words of similar import.
Actual results may differ materially from those expressed in these forward-looking statements, which speak only as of the date hereof, and are subject to change at any time without notice. Existing and prospective investors, customers and other third parties transacting business with New Relic are cautioned not to place undue reliance on this forward-looking information. The achievement or success of the matters covered by such forward-looking statements are based on New Relic’s current assumptions, expectations, and beliefs and are subject to substantial risks, uncertainties, assumptions, and changes in circumstances that may cause the actual results, performance, or achievements to differ materially from those expressed or implied in any forward-looking statement. Further information on factors that could affect such forward-looking statements is included in the filings we make with the SEC from time to time. Copies of these documents may be obtained by visiting New Relic’s Investor Relations website at http://ir.newrelic.com or the SEC’s website at www.sec.gov.
New Relic assumes no obligation and does not intend to update these forward-looking statements, except as required by law. New Relic makes no warranties, expressed or implied, in this document or otherwise, with respect to the information provided.
Who are We?
Andy WetzelDirector of Industry Solutions
Specialize in:Testing
Monitoring
Performance Optimization
22 years in industry10 in Mercury Interactive / HP
2 in New RelicDid DevOps when it was called “Lean Manufacturing”
@adwetzel andywetzel
Who are We?
Donald J. PattiProgram Manager/ScrumMaster
SBA One Modernization Program
Specialize in:Agile w/Lean
Software Product Development
Coaching & Consulting
20+ years in industryCSM©/CSP© (Scrum Alliance)
SAFe Agilist© (Scaled Agile Academy)
Lean Six Sigma Black Belt/CSSGB© (ASQ)
Project Management Professional© (PMI)
Balanced Scorecard Professional© (BSI) [email protected]
Avoiding the “Capitol Hill” moment
You have to testify
If app launch / performance is bad
We want better apps faster
BetterData Center
DynamicCloud
Cloud as a Better Data Center
Better Data Center
Resources are allocated to uses, just like in
a data center
Better Data Center
Resources are allocated to uses, just like in
a data center
Provisioning process is faster
Better Data Center
Resources are allocated to uses, just like in
a data center
Lifetime of components is relatively long
Provisioning process is faster
Better Data Center
Resources are allocated to uses, just like in
a data center
Lifetime of components is relatively long
Provisioning process is faster
Capacity planning is still important and still applies
Why use a “Better Data Center”?
ComplianceImprove ApplicationAvailability
(redundancy)
Add new Capacity(faster)
Who is impacted?
Better Data Center Faster Application Launch / Deploy=
Better DataCenter
Can I scale my server fleet?Can apps run anywhere?How do they perform in the cloud?
Operations
Data center is a data center…
Development
How do I monitor it?
Similar to monitoring any other data center…
Monitoring an application
Typical Server / EC2 Instance
• Application & Application Microservices
• Server OS• Hardware (virtual)
EC2 Instance
Application & Application
Microservices
Server OS
Server (Virtual)Hardware
AWS Monitoring
CloudWatch
• Monitors:– EC2 instance– Virtualization– Hardware– [CPU/Disk/Networking]
• Doesn’t know about:– Server OS– Memory/Filesystem– Processes– Application
• Latency• Error rates• Internal insights
EC2 Instance
Application & Application
Microservices
Server OS
Server (Virtual)Hardware
Amazon CloudWatch
AWS MANAGEMENT CONSOLE
New Relic Monitoring
New Relic
• Monitors (Server):– How O.S. is performing– Processes– Hardware
• Monitors (Application):– App health– App performance– Microservices
• Doesn’t know– Virtualization
EC2 Instance
Application & Application
Microservices
New RelicApplicationMonitoring
Server OS
Server (Virtual)Hardware
New RelicServer
Monitoring
AmazonCloudWatch
AWS MANAGEMENT CONSOLE
DASHBOARDS
AWS New Relic work together
EC2 Instance
Application & Application
Microservices
New RelicApplicationMonitoring
Server OS
Server (Virtual)Hardware
New RelicServer
Monitoring
Amazon CloudWatch
AWS MANAGEMENT CONSOLE
DASHBOARDSAWS / CloudWatch
• Visibility into virtualization• CPU / Disk / Networking
New Relic
• CPU / Disk / Networking• Memory / Filesystem• Processes• Infrastructure components• Application / Microservices:
– Latency– Error rates– App insights CloudWatch
monitors
New Relic monitors
The certify.SBA.gov Launch
About “Certify”
SBA’S BUSINESS CERTIFICATION PLATFORM
Hosted on the AWS Cloud
FedRAMP compliant
Replaces legacy ColdFusion /
Oracle systems
Helps small businesses to
win government contracts
Preparation for Launch
Traditional load, performance & stress testing
Implementation of New Relic
Key milestones
Initial Launch
Chief Administrator’s Press Conference
How we avoided “The Capitol Hill” moment
Used New Relic to identify bottlenecks
Proactive real-time monitoring via New Relic helped us to
better manage go-live
The outcome
Successful launch to the cloud –
infrastructure and new application – in only 7 months
Increase in new certification
applications during the first month
No measurable degradation in
performance for either event
(MRT90 = 3 seconds)
600% 0 7
A better data center for SBA
FedRAMP Compliance &
Rapid ATO
Virtual redundancy via AWS Platform
Auto-scaling of cloud
infrastructure
Cloud as a Dynamic Tool
Cloud as a “Dynamic Tool for Dynamic Apps”
Use only the resources
you need
Resource allocation is an integral part of
your application architecture
Allocate / de-allocate
resources on the fly
Dynamic Cloud
Docker containers:
• Quicker / cheaper startup / shutdown than EC2 instances
• Easy to consume Docker containers much like you do “processes”
• Perform jobs:– In a script– Off of some queue of job requests
Dynamic Cloud
100
10K
1M
3.7 M
83 days 333 days
Docker Container Age(Count vs. Hours)
Dynamic Cloud
950,00011% under one minute
Docker Container Age(by Minute Under and Hour)
EC2 Auto Scaling
Dynamic Cloud Technologies
Mobile / IoTDynamic routing
Load balancing
Data transport
Queues and notifications
Docker
Dynamic Cloud is about scaling
Who Uses It?
Better DataCenter
Can I scale my server fleet?Can apps run anywhere?How do they perform in the cloud?
Operations
Data center is a data center…
Development
DynamicCloud
What is a container?What is a Lambda?It was just here, where did it go?
Cloud architecture is integral to the application architectureDevelopers deeply involved in cloud activities
How do I monitor the Dynamic Cloud?
Dynamic Cloud has unique monitoring requirements…
Responsibility (Dynamic Cloud)
Server OS
Application & Application
Microservices
Application & Application
Microservices
Application & Application
Microservices
Provisioning
Responsible for the parts you care about
• Application & Application Microservices
Let cloud manage rest
• Infrastructure• Allocation / Provisioning• Scaling
Server (Virtual)Hardware
AWS Infrastructure New Relic work together
Server OS
Server (Virtual)Hardware
AWS CONSOLE
DASHBOARDS
Application & Application
Microservices
Application & Application
Microservices
Application & Application
Microservices
Provisioning
AmazonCloudWatch
AWS Infrastructure New Relic work together
Server OS
Server (Virtual)Hardware
AWS CONSOLE
DASHBOARDS
Application & Application
Microservices
Application & Application
Microservices
Application & Application
Microservices
Provisioning
AmazonCloudWatch
CloudWatch& AWS monitoring
AWS Infrastructure New Relic work together
Server OS
Server (Virtual)Hardware
AWS CONSOLE
DASHBOARDS
Application & Application
Microservices
Application & Application
Microservices
Application & Application
Microservices
Provisioning
CloudWatch& AWS monitoring
New Relic monitors
AmazonCloudWatch
Monitoring the Dynamic Cloud
Very different than monitoring traditional Data Center components
Monitor theCloud Components
themselves
Monitor the lifecycle of the
Cloud Components
Dynamic Cloud
Amazon EC2
Server running application / processes
Docker container
Process running a command
Amazon Lambda
Function performing a task or operation
Monitoring the Dynamic Cloud
Your world is changing fast…
Monitoring the Dynamic Cloud
… your monitoring tools need to help you keep up
Your world is changing fast…
Change is speeding up
TraditionalData Center
Dynamic Cloud enables better applications faster.The rate of change is increasing…
Good
Change is speeding up
TraditionalData Center
CloudData Center
Dynamic Cloud enables better applications faster.The rate of change is increasing…
Good Better
Change is speeding up
TraditionalData Center
CloudData Center
DynamicCloud
Dynamic Cloud enables better applications faster.The rate of change is increasing…
Good Better Best
Lessons learned
Government can be nimble
Lessons learned
Government can be nimble
Avoiding “The Capitol Hill”
moment
Lessons learned
Government can be nimble
Avoiding “The Capitol Hill”
moment
Leverage data driven
decision-making
Lessons learned
Government can be nimble
Avoiding “The Capitol Hill”
moment
Leverage data driven
decision-making
More gains possible via
Dynamic Cloud
Lessons learned
Government can be nimble
Avoiding “The Capitol Hill”
moment
Leverage data driven
decision-making
More gains possible via
Dynamic Cloud
Otherscan help
Thank You!
Andy Wetzel, Director of Industry Solutions at New Relic, Inc.
Donald J. Patti, Program Manager & ScrumMaster, Telesis