Download - Enterprise Cloud Adoption Strategies
Presenter Name, Title and or Date
Cloud MonitoringOpportunities, Issues, Success Strategies
Lee Atchison Principal Cloud Architect and Advocate | New Relic
1Confidential ©2008-15 New Relic, Inc. All rights reserved.
Who am I?
2Confidential ©2008-15 New Relic, Inc. All rights reserved.
28 years in industry- 7 in Amazon Retail & AWS
(Built 1st AppStore, AWS Elastic Beanstalk)
- 4 in New Relic(Architecture Lead, Cloud, Service Migration)
Specialize in:- Cloud computing
- Services & Microservices
- Scalability, Availability
3Confidential ©2008-15 New Relic, Inc. All rights reserved.
Progressions in Cloud Adoption Enterprise ITCloud Adoption
Strategy
When and how enterprises decide to use the cloud…
Experiment
Secure the Cloud
Enable Servers, Enable SaaS
Enable Value-Added Services
Enable Unique Services
Mandate Cloud Usage
4Confidential ©2008-15 New Relic, Inc. All rights reserved.
Progressions in Cloud Adoption
Standard stepsmost companies
follow
Enterprise IT Cloud Adoption Strategy
Experiment
§ Non-evasive, safe technologies- S3- Perhaps: CloudFront, SQS, SES
§ Stay away from EC2/Servers§ Security: Easy as one-offs§ No “Policies” implemented yet§ “Just seeing what this is all about”
Progressions in Cloud Adoption
Progressions in Cloud Adoption
Enterprise IT Cloud Adoption Strategy
Secure the Cloud
§ IAM (Credentials)
§ VPC (Secure network)
§ AWS Direct Connect (just another data center)
§ Cloud policies begin to be formed§ Critical evolution point
Progressions in Cloud Adoption
Enterprise IT Cloud Adoption Strategy
Enable Servers, Enable SaaS
§ EC2- Basic “data center migration”- Just another server type available…
§ Multiple AZs/Regions- Part of multi-datacenter resiliency strategy
§ Independently: SaaS usage increases- Non-critical or internal uses first
Progressions in Cloud Adoption
Enterprise IT Cloud Adoption Strategy
Enable Value-Added Services
§ Managed Databases- RDS, Aurora
§ Other Managed Services- Elastic Beanstalk, SES, SQS, ElasticSearch
Progressions in Cloud Adoption
Enterprise IT Cloud Adoption Strategy
Enable Unique Services
§ High value, Cloud-specific services- Lambda, Kinesis- SWF, Elastic Transcoder- Redshift
§ Point of commitment......dependent on cloud
Progressions in Cloud Adoption
Enterprise IT Cloud Adoption Strategy
Mandate Cloud Usage
§ Cloud as a data center replacement§ Company is now “all in” with cloud§ Netflix…
Experiment
Secure the Cloud
Enable Servers, Enable SaaS
Enable Value-Added Services
Enable Unique Services
Mandate Cloud Usage
11Confidential ©2008-15 New Relic, Inc. All rights reserved.
Progressions in Cloud Adoption
Different CompaniesDifferent SpeedDifferent Needs
12Confidential ©2008-15 New Relic, Inc. All rights reserved.
Application ITCloud Adoption
Strategy
Application owners go thru similar process
13Confidential ©2008-15 New Relic, Inc. All rights reserved.
Cloud Servers
Managed Components
Unique Components
Peripheral Usage
Application Cloud Committed
Progressions in Cloud Adoption
Parallel process for application owners
Progressions in Cloud Adoption
Application IT Cloud Adoption Strategy
Peripheral Usage
§ S3- Large file storage- Hosting file downloads
§ CloudFront…
Progressions in Cloud Adoption
Application IT Cloud Adoption Strategy
Cloud Servers
§ EC2 as a server choice- Data center migration- Often done when apps need a hardware refresh- Redundant data center
§ Application doesn’t change, just where it runs
Progressions in Cloud Adoption
Application IT Cloud Adoption Strategy
Managed Components
§ RDS for databases§ ElastiCache, SES, ELB§ Elastic Beanstalk§ More DevOps issue than Application
Progressions in Cloud Adoption
Application IT Cloud Adoption Strategy
Unique Components
§ DynamoDB§ ElasticSearch§ SNS, SWF§ Application is distinctly changing
- Rewritten for the cloud
Progressions in Cloud Adoption
Application IT Cloud Adoption Strategy
Application Cloud Committed
§ Lambda§ Data Pipeline§ Kinesis§ Machine Learning§ Using cloud-unique capabilities
- Cloud provider specific- Close tie to specific cloud provider
Cloud Adoption Strategies
Application CloudAdoption Strategy
§ Peripheral Usage
§ Cloud Servers
§ Managed Components
§ Unique Components
§ Application Cloud Committed
Enterprise IT CloudAdoption Strategy
§ Experiment
§ Secure the Cloud
§ Enable Servers, Enable SaaS
§ Enable Value-Added Services
§ Enable Unique Services
§ Mandate Cloud Usage
ApplicationAdoption
CorporateAdoption Cloud Adoption
Mandate
Committed
Allow Value-Added
Allow SaaS
Allow Servers
Secure
Experiment
Experiment Servers ManagedComponents
UniqueComponents
Committed
Mandate
Committed
Allow Value-Added
Allow SaaS
Allow Servers
Secure
Experiment
Experiment Servers ManagedComponents
UniqueComponents
Committed
Technologies Available
S3
IAMVPC
Non-IntegralSaaS
EC2
IntegralSaaS
RDSSES
LambdaKinesis
ApplicationAdoption
CorporateAdoption
AdoptionSweet Spot
First Steps
ApplicationAdoption
CorporateAdoption
Mandate
Committed
Allow Value-Added
Allow SaaS
Allow Servers
Secure
Experiment
Experiment Servers ManagedComponents
UniqueComponents
Committed
Cloud AdoptionCenter of Gravity
IntegralSaaS
RDSSES
LambdaKinesis
AdoptionSweet Spot
First Steps
ApplicationAdoption
CorporateAdoption
Mandate
Committed
Allow Value-Added
Allow SaaS
Allow Servers
Secure
Experiment
Experiment Servers ManagedComponents
UniqueComponents
Committed
S3
IAMVPC
Non-IntegralSaaS
EC2Cloud Adoption
Center of Gravity
ApplicationAdoption
CorporateAdoption Application Types
Mandate
Committed
Allow Value-Added
Allow SaaS
Allow Servers
Secure
Experiment
Experiment Servers ManagedComponents
UniqueComponents
Committed
CriticalApplications
NewApplications
Non-Critical/Internal
ApplicationsStep #1
Step #2
Step #4
First Steps
ApplicationRe-Writes
Step #3
Smaller andcloud-centric
companies often start here
IAMVPC
Non-IntegralSaaS
EC2
IntegralSaaS
RDSSES
LambdaKinesis
ApplicationAdoption
CorporateAdoption Application Types
Mandate
Committed
Allow Value-Added
Allow SaaS
Allow Servers
Secure
Experiment
Experiment Servers ManagedComponents
UniqueComponents
Committed
CriticalApplications
NewApplications
Non-Critical/Internal
ApplicationsStep #1
Step #2
Step #4
First Steps
ApplicationRe-Writes
Step #3
S3
Adoption Success Strategies
Understand where your culture is
Consciously plan your
acceptance
Drive your cultural change
to your desired level
Monitor your adoption
Understand your needs
Monitor Your Adoption
Before Migration
Baseline application(servers, databases, caches, applications,
microservices)
Determine your steady state
Monitor Your Adoption
During Migration
Incorporate cloud’s internal monitoring
Continue application monitoring
The Biggest Role Monitoring Plays In Migration
Performance Post Migration & During Optimization
Pre-migration Feasibility & Benchmarking
Continue Monitoring…
Infrastructure is now out of your control
Some cloud specific concerns
(EC2 instance failures, instance degradation)
Understand application
impact
Ongoing application & infrastructure monitoring is
essential
Monitor Your Adoption
What should you monitor?Cloud Monitoring
31Confidential ©2008-15 New Relic, Inc. All rights reserved.
Typical Ec2 Instance§ Application & Application Microservices§ Server OS§ Hardware (virtual)
Typical Application Stack
EC2 Instance
Application & Application
Microservices
Server OS
Server (Virtual)Hardware
CloudWatch§ Monitors:– EC2 instance– Virtualization– Hardware– [CPU/Disk/Networking]
§ Doesn’t know about:– Server OS– Memory/Filesystem– Processes– Application• Latency• Error rates• Internal insights
AWS Monitoring
EC2 Instance
Application & Application
Microservices
Server OS
Server (Virtual)Hardware
CloudWatch
AWS CONSOLE
New Relic§ Monitors (Server):– How O.S. is performing– Processes– Hardware
§ Monitors (Application):– App health– App performance– Microservices
§ Doesn’t know– Virtualization
New Relic Monitoring
EC2 Instance
Application & Application
Microservices
New RelicApplicationMonitoring
Server OS
Server (Virtual)Hardware
New RelicServer
Monitoring
CloudWatch
AWS CONSOLE
DASHBOARDS
New Relic§ Plugins– Infrastructure visibility– Databases– Load Balancing– Networking– External services
Visibility into CloudWatch§ AWS metrics on
New Relic Dashboards
AWS çè New Relic work together
EC2 Instance
Application & Application
Microservices
New RelicApplicationMonitoring
Server OS
Server (Virtual)Hardware
New RelicServer
Monitoring
CloudWatch
AWS CONSOLE
DASHBOARDS
AWS/CloudWatch§ Visibility into virtualization§ CPU/Disk/Networking
New Relic§ CPU/Disk/Networking§ Memory/Filesystem§ Processes§ Infrastructure components§ Application/Microservices:– Latency– Error rates– App insights
AWS çè New Relic work together
EC2 Instance
Application & Application
Microservices
New RelicApplicationMonitoring
Server OS
Server (Virtual)Hardware
New RelicServer
Monitoring
CloudWatch
AWS CONSOLE
DASHBOARDS New Relic monitors
CloudWatchmonitors
Presenter Name, Title and or Date
Thank You
Lee Atchison Principal Cloud Architect and Advocate | New Relic
37Confidential ©2008-15 New Relic, Inc. All rights reserved.
Architecting for ScalePublished by: O’Reilly Media, Available: May 2016www.architectingforscale.com
@leeatchison leeatchison
New Relic Enables Accountability Between Your Code & AWS
Customers
Mobile / Apps / Browser
On-Premises
On Premises Relational Data
AWS Responsibility:
• Service Availability & Performance
• Provisioning & operation of DC
• Isolation & security of resources
• Service maintenance & innovation
EC2
AWSContainer Service
AWS RDSSynthetic Customers
S3
NoSQL
AWS Storage Services
Your Responsibility:
• Application code & 3rd party services
• App architecture
• Customer experience
• On-premises components