aberdeen oil & gas event - introduction to the aws cloud
DESCRIPTION
In this presentation from the recent AWS Oil & Gas event in Aberdeen we introduce the AWS cloud, its benefits and some of the organisations that are using AWS today. We also cover some specific use-case and case-studies in the oil and gas sector.TRANSCRIPT
Amazon Web Services
Introduc)on AWS & Benefits of the Cloud
Thank You for joining us at the
AWS for the Oil & Gas Industry Aberdeen, November 25, 2014
ü Introduction to AWS ü Benefits of using AWS Cloud ü Security and Compliance ü AWS platform ü Cloud Adoption Strategy ü AWS Cloud for Oil & Gas
There is No Compression Algorithm for Experience and Operational Reliability
ü Introduction to AWS ü Benefits of using AWS Cloud ü Security and Compliance ü AWS platform ü Cloud adoption strategy ü AWS Cloud for Oil & Gas
2014
Every day, AWS adds enough server capacity to power this $7B enterprise
$ 7B retail business 7,800 employees A whole lot of servers
2003
AWS Global Infrastructure GovCloud US West US East South America EU Asia Pacific
US ITAR Region N. California Oregon N. Virginia Sao Paulo Ireland Germany Sydney Tokyo Singapore China
11 regions 28 availability zones 51 edge locations
AWS Rapid Pace of Innovation
2009
Amazon RDS Amazon VPC Auto Scaling
Elastic Load Balancing
+48
2010
Amazon SNS
AWS Identity & Access Management
Amazon Route 53
+61
2011
Amazon ElastiCache
Amazon SES
AWS CloudFormation
AWS Direct Connect
AWS Elastic Beanstalk
GovCloud
+82
Amazon CloudTrail
Amazon CloudHSM
Amazon WorkSpaces
Amazon Kinesis
Amazon Elastic Transcoder
Amazon AppStream
AWS OpsWorks
+280
2013
Amazon SWF
Amazon Redshift
Amazon Glacier
Amazon Dynamo DB
Amazon CloudSearch
AWS Storage Gateway
AWS Data Pipeline
+159
2012
Since inception AWS has: • Released 1000+ new services and features • Introduced over 35 major new services • Announced 45 price reductions
2008
+24 Amazon EBS Amazon CloudFront
+450
2014
Amazon Cognito
Amazon Zocalo
Amazon Mobile Analytics
Amazon Containers
Amazon CodeDeploy
Amazon CodePipeline
Amazon KMS
Amazon CodeCommit
Amazon Aurora
Now part of your everyday life
Gartner “Magic Quadrant for Cloud Infrastructure as a Service,” Lydia Leong, Douglas Toombs, Bob Gill, Gregor Petri, Tiny Haynes, May 28, 2014. This Magic Quadrant graphic was published by Gartner, Inc. as part of a larger research note and should be evaluated in the context of the entire report. The Gartner report is available at http://aws.amazon.com/resources/analyst-reports/. Gartner does not endorse any vendor, product or service depicted in its research publications, and does not advise technology users to select only those vendors with the highest ratings. Gartner research publications consist of the opinions of Gartner's research organization and should not be construed as statements of fact. Gartner disclaims all warranties, expressed or implied, with respect to this research, including any warranties of merchantability or fitness for a particular purpose.
2014 Magic Quadrant for "Cloud Infrastructure as a Service
Enterprises on AWS
Systems Integrators on AWS
ISVs on AWS
Used by Government Agencies & Educational Institutions Worldwide"
WHY are Customers using AWS?
ü Introduction to AWS
ü Benefits of using AWS Cloud ü Security and Compliance ü AWS platform ü Cloud adoption strategy ü AWS Cloud for Oil & Gas
Acquire Resources On Demand
Release Resources When No Longer Needed
Pay For What You Use
Turn Fixed Costs Into Variable
Leverage Other’s Core Competencies
A New Resource Model
Increased Agility Has Become the No. 1 Reason
Businesses Use AWS
Enterprises Are Accelerating Time to Market with AWS…
Credit-risk simulation application
Development & test environments
Migrated 500 web properties to AWS in
5 months
Clinical trial simulations
Decreased "the average
processing time from 23 hours to
20 minutes
Development and test seats access
time reduces from a week to 1 day
New product websites from 2 weeks to 2 days
Simulations time reduced from 60
hours to 1.2 hours
Enterprises Are Accelerating Time to Market with AWS…
Credit-risk simulation application
Development & test environments
Migrated 500 web properties to AWS in
5 months
Clinical trial simulations
Decreased "the average
processing time from 23 hours to
20 minutes
Development and test seats access
time reduces from a week to 1 day
New product websites from 2 weeks to 2 days
Simulations time reduced from 60
hours to 1.2 hours
.. And Transforming to leverage the Cloud
Full-In Transformation Regulatory Compliance
Improving Customer Experience
New Mobile Payment platform
Migrating 2000 Apps to AWS in
18 Months
Running the EU Solvency Test with 88% savings on
infrastructure needs
Big Data initiative to extract value from anonymized CCs
transactions
“AWS was the clear choice in terms of security and PCI DSS
Level 1 compliance compared to an on-premises or co-location
datacenter solution”
“Based on our experience, I believe that we can be even more secure in the AWS cloud than in our own data centers.”
-Tom Soderstrom, CTO, NASA JPL
ü Introduction to AWS ü Benefits of using AWS Cloud
ü Security and Compliance ü AWS platform ü Cloud adoption strategy ü AWS Cloud for Oil & Gas
AWS Private Network Capabilities
Amazon Virtual Private Cloud (VPC)
AWS Direct Connect
Software-defined private network Dedicated private network connection to AWS
AWS Private Compute and Storage Capabilities Choose the right level of compute isolation for every workload
Fine grained access roles and groups
Physical isolation
Identity & Access Management (IAM)
Dedicated Instances Amazon S3 Amazon EBS
Encrypted object storage
Encrypted block storage
AWS Governance Fine-grained access control over data and resources
Control over regional replication
Policies, resource level permissions, temporary
credentials
In-depth audits
Geographic data locality Fine-grained access control
AWS CloudTrail Amazon CloudHSM
Private encryption key management
Certifications and Accreditations for Workloads That Matter
AWS Founda+on Services
Compute Storage Database Networking
AWS Global Infrastructure Regions
Availability Zones Edge Loca+ons
Client-‐side Data Encryp)on
Server-‐side Data Encryp)on
Network Traffic Protec)on
PlaEorm, Applica)ons, Iden)ty & Access Management
Opera)ng System, Network & Firewall Configura)on
Customer content
Security is a shared responsibility between AWS and our customers
Customers are responsible for their security IN
the Cloud
AWS is responsible for the security OF
the Cloud
Over 35 Major Services introduced in 8 Years
ü Introduction to AWS ü Benefits of using AWS Cloud ü Security and Compliance
ü AWS platform ü Cloud adoption strategy ü AWS Cloud for Oil & Gas
Physical Infrastructure
Foundation Services
Platform Services
Applications
AP
Is
Tools and Libraries
Foundation Services
Platform Services
Applications
AP
Is
Tools and Libraries
Regions Availability Zones CDN and Points of Presence
Platform Services
Applications
AP
Is
Tools and Libraries
Regions Availability Zones CDN and Points of Presence
Storage (Object, Block and Archive)
Networking Security & Access Control
Compute (VMs, Auto-scaling and Load Balancing)
Applications
AP
Is
Tools and Libraries
Regions Availability Zones CDN and Points of Presence
Storage (Object, Block and Archive)
Networking Security & Access Control
Compute (VMs, Auto-scaling and Load Balancing)
Databases Analytics App Services Deployment & Management Mobile Services
Applications
AP
Is
Tools and Libraries
Regions Availability Zones CDN and Points of Presence
Storage (Object, Block and Archive)
Networking Security & Access Control
Compute (VMs, Auto-scaling and Load Balancing)
Databases Analytics App Services Deployment & Management Mobile Services
Relational
NoSQL
Caching
Hadoop
Real-time
Data warehouse
Queuing
Orchestration
App streaming
Transcoding
Search
Containers
Dev/ops Tools
Resource Templates
Identity
Sync
Mobile Analytics
Notifications Data Workflows
Usage Tracking
Monitoring and Logs
AP
Is
Regions Availability Zones CDN and Points of Presence
Storage (Object, Block and Archive)
Networking Security & Access Control
Compute (VMs, Auto-scaling and Load Balancing)
Databases Analytics App Services Deployment & Management Mobile Services
Relational
NoSQL
Caching
Hadoop
Real-time
Data warehouse
Queuing
Orchestration
App streaming
Transcoding
Search
Containers
Dev/ops Tools
Resource Templates
Identity
Sync
Mobile Analytics
Notifications Data Workflows
Usage Tracking
Monitoring and Logs
Virtual Desktops Collaboration and Sharing
Libraries, SDK’s
Web Console
Human Interaction
Command Line
Create Agility; Manage Uncertainty; Learn and Pilot Fail Fast and Fail Small
ü Introduction to AWS ü Benefits of using AWS Cloud ü Security and Compliance ü AWS platform
ü Cloud adoption strategy ü AWS Cloud for Oil & Gas
Experimentation Limited Use Wide-spread Use Corporate Standard
Technology adoption goes in stages
Dev & Test True Production Mission Critical All-in
Technology adoption goes in stages
Technology adoption goes in stages
Experiment more, with no CapEx Resource projects instantly Eliminate idle servers Maintain consistency across teams
Technology evaluation Prototyping Agile Development
Use Cases Benefits In some Enterprises, accounts for more than 50% of the overall infrastructure
Dev & Test True Production
Mission Critical All-in
• Reduced the cost of development and testing environments by 75%
• Are creating new test and development environments in hours rather than weeks
• Scale to support a 2000% increase in web requests
ME Bank
Technology adoption goes in stages
Dev & Test True Production
Mission Critical All-in
Develop applications faster Augment existing data center resources Multiple data centers for high availability Auto-scale up and down with demand Hardware upgrades with no downtime Easy global deployment
Benefits Mobile apps
Scientific computing
Public or private web apps
Big data apps
Built a common platform for content delivery Migrated 500 existing sites in less than 5 months Easily copy campaigns across regions Campaign launch went from 2 weeks to 2 days
If a brand manager has an idea, she can implement it before the competition.
Sreenivas Yalamanchili Digital Marketing Services (DMS) Global Technical Manager
Site deployment time
On-premises: 2 weeks
AWS: 2 days
AWS enabling digital innovation
Technology adoption goes in stages
Dev & Test True Production
Mission Critical All-in
Enterprises Are Accelerating Time to Market with AWS…
87,000 compute cores
allowed Novartis to
conduct 39 years of
computational chemistry in
9 hours
SunPower moved a core application to AWS in 3 weeks..
“The way AWS is set up is very intuitive. If we’d used a traditional data center, it would have taken us three months of planning and deployment—but with AWS, we were finished in 3 weeks.”
“Spinning up the resources we needed to get the InfoLease app installed and get high availability in place was very straightforward.”
Technology adoption goes in stages
Dev & Test True Production
Mission Critical All-in
Virtual elimination of IT CapEx Flexibility in resource assignments Time to market Zero hardware maintenance Multiple availability zone deployment
Benefits
Leveraging Cloud technology to boost Oil & Gas operations
ü Introduction to AWS ü Benefits of using AWS Cloud ü Security and Compliance ü AWS platform ü Cloud adoption strategy
ü AWS Cloud for Oil & Gas
Top 10 Predictions for Worldwide Oil & Gas in 2014:• With the change in the global energy supply chain, oil and gas companies will put more focus on
resiliency• IT security will remain the CIO's top concern, with a growing focus on process control security• CIOs will concentrate on innovation, analytics and sourcing to keep the attention of business• Drilling risk mitigation and production optimization will drive further adoption of Big Data and analytics,
new models for machine-to-machine connectivity and field mobility• Safety and accountability will shape the relationship between owners and service companies• The concept of smart pipeline will start to gain significant momentum in most regional markets• Operational design moves to 3D• Asset integrity will take the spotlight in asset life-cycle management• Cloud will see an uptick in adoption, mainly for quick deployment and flexibility• IT spending in oil and gas will increase from $37.6 billion USD in 2011 to $49.4 billion in 2016
IDC Energy Insights
Top 10 Predictions for Worldwide Oil & Gas in 2014:• With the change in the global energy supply chain, oil and gas companies will put more focus on
resiliency• IT security will remain the CIO's top concern, with a growing focus on process control security• CIOs will concentrate on innovation, analytics and sourcing to keep the attention of business• Drilling risk mitigation and production optimization will drive further adoption of Big Data and analytics,
new models for machine-to-machine connectivity and field mobility• Safety and accountability will shape the relationship between owners and service companies• The concept of smart pipeline will start to gain significant momentum in most regional markets• Operational design moves to 3D• Asset integrity will take the spotlight in asset life-cycle management• Cloud will see an uptick in adoption, mainly for quick deployment and flexibility• IT spending in oil and gas will increase from $37.6 billion USD in 2011 to $49.4 billion in 2016
IDC Energy Insights
Overall O&G Value Chain Upstream (oil & gas) Midstream Downstream
Exploration Development Production
Corporate support functions
Storage & Transportation Refine
Process Transportation
On-shore Off-shore (Deep water, Shallow Water )
Trading
Distribution Marketing
Marketing (gas only)
Decommissioning Recycling
Overall O&G Value Chain Upstream (oil & gas) Midstream Downstream
Exploration Development Production
Storage & Transportation Refine
Process Transportation
Distribution Marketing
Marketing (gas only)
• 3d/4d seismic data processing, visualization
• Connected/ Digital oil field/ M2M • Data streaming and storage
• Smart metering • Customer engagement • M2M & Internet of Things • Energy trading
Cloud benefits opportunities
Exploration Development Production
Sub-surface Geology & Geophysics Sub-surface & Surface development Operations & maintenance management
Computational platforms:
§ High Performance Compute/ Big Data
§ Real-time data streaming & visualization
§ Sub-surface Data Storage
Collaboration platforms: § Mobile collaboration § Regional and remote re-
deployment, workspaces
Workflow platforms:
§ ERP/ SCM support § BI/ DW support
Upstream Oil & Gas use cases
Visualiza)on Processing Seismic Data Acquisi)on
Processing raw data
Zone of interest
Compute real attributes
Raw data
Remote Users
Local Users
Central visualization rooms
Processed data
Recalibrate Model real attributes
Petrophysically assess the reservoir
Time-lapse 3D (reservoir monitoring or 4D)
Seismic data processing cycle
- Scalable, High Performance compute - Large amount of data acquisition & transfer - Security of highly sensitive data - High availability and throughput
AWS cloud accelerates HPC capabilities, providing instant scalability and elasticity to analyze massive amounts of scientific data: • Optimized tools to move large data stored on local
data center • Performance-optimized Hadoop framework • CPU intensive instances + placement groups • Low latency & complete control over virtual
networking environment
Seismic data processing/ simulations
AWS allows you to increase the speed of research by running high performance computing in the cloud and to reduce costs by providing Cluster Compute or Cluster GPU servers on-demand without large capital investments: • Cluster GPU Instances for 3d processing and
visualization rooms • AppStream for remote offices and on-site 3d
visualization
- Data collection of multiple sub-surface sensors - Predictive analytics - High availability in remote location - High security level
Reservoir management
- Data collection of multiple surface & sub-surface sensors
- Prediction to prevent failures and breakdowns - All components integrate and communicate - High availability in remote locations
The AWS cloud provides building blocks to create innovative new applications: • Big M2M – the convergence of M2M with Big
Data, we provide Big Data services such as EMR (Hadoop on AWS), S3 and DynamoDB (NoSQL)
• AWS Marketplace provides a software marketplace for the AWS cloud where clients can buy third party M2M software platforms
Production optimizations/ digital oil field
Stochastic Simulation is able to achieve overnight, what until
now would take reservoir engineers years using
conventional simulation technology.
Dr Andrew Wadsley Chief Technology Office
”
“ • The company demonstrated ResAssure's capability, by carrying out 1 million realizations in 1 day for a real field Cartesian model of:
• 200,000 grid cells against • 28 sensitivity parameters using • 40 standard processing cores on AWS
cloud
ResAssure 1mn simulation in 1 day on AWS cloud
Sysdrill has been fully tested and validated for use on AWS
Source: hQp://www.stochas)csimula)on.com/resassure/resassure-‐1-‐million-‐reservoir-‐simula)on-‐of-‐model-‐realisa)ons
The rise of cloud computing is one of the most important
macro-trends in IT infrastructure… simply put,
customers should be able to focus more on the application
than on the infrastructure Arshad Matin
President and CEO of Paradigm
”
“ • Paradigm made the available its Sysdrill well planning and drilling engineering solution on AWS cloud.
• Sysdrill enhances well planning accuracy and
reduces drilling risk and uncertainty. • Paradigm provides the Deployed Instance
option which installs and fully configures Sysdrill for immediate use by customers
Paradigm offers Sysdrill on Amazon Web Services cloud
Source: hQp://www.offshore-‐mag.com/ar)cles/2014/02/paradigm-‐offers-‐sysdrill-‐on-‐amazon-‐web-‐services-‐cloud.html
Sysdrill has been fully tested and validated for use on AWS
We wanted to prove that it can be done in a virtual
environment and in a public cloud environment and with performance comparable to
what you could get internally.
Tom O’Reilly Head of server systems
”
“ • Maersk Oil simulated an Eclipse cluster in the cloud to run reservoir simulations
• It also went one step further and simulated a remote office from that cloud without any of its own infrastructure as the four offices it operates near its fields
Maersk Oil Tests Reservoir Simulations On AWS
Source: hQp://www.enterprisetech.com/2014/04/10/maersk-‐oil-‐tests-‐reservoir-‐simula)ons-‐aws/
• When Hess divested its Energy Marketing division, the IT department had to create a separate environment that could be handed off to a buyer
• Working with APN partner, Nimbo, Hess packaged and moved the infrastructure, including 300 servers and almost 500 TB of data, to the AWS Cloud
• Hess met the six-month divestiture deadline and transferred the business to the buyer in a 30-minute meeting
“The flexibility and scale of AWS enabled us to rapidly migrate a fully functional
infrastructure for our divested business in just 6 months.”
Jim McDonald Lead Architect, Hess
”
“
Hess Corporation is a leading global independent energy company
Hess Uses AWS to Streamline Data Center Migration
We launched Hive towards the end of 2013 and today we
have 75,000 customers… The speed at which we delivered Hive is directly related to our decision to use AWS cloud
Seb Chakraborty Head of Web and Platform Design
”
“ • British Gas started a project called Hive, part of its
Connected Homes Strategy. • Hive Active Heating allows users to control heating
and hot water remotely from mobile, laptop or smartphones.
• Such a flexibility allows users to control heating exactly how they need it and save up to £150 a year on utility bills
British Gas brings central heating control to smartphones with AWS
British Gas uses AWS cloud for scaling the project and to deliver API toolsets around it.
Exploration for new oil
Reservoir management
Risk management & compliance
Cost optimization
Next generation energy
Extensive geophysical data, comprehensive analytics, faster workflows, and access to specialized and often scarce expertise
Significantly faster data acquisition, processing, real-time simulation and optimization of oil & gas reservoir to increase production and reserves
Secure and available data, audit trails and records management for safety, regulatory and risk management purposes.
IAAS and PAAS’s pay-per-use model will allow companies to respond to intensifying global competition, constant regulatory changes and cyclical production to optimize costs, increase flexibility and scalability
Higher pace of innovation of what and how we consume energy – e.g. engaging customers and suppliers, finding new energy sources, optimising consumptions mix
Oil & Gas area of cloud benefit
Thank You