break through data gravity with containersfiles.m1.mailplus.nl/user40544/1305/slides break through...
TRANSCRIPT
DICK VAN STRAATEN
June 20, 2019
BREAK THROUGH DATA GRAVITY WITH CONTAINERS
INTRODUCTION
Dick van StraatenMicrosoft Azure Consultant | Craft Expert Azure Development
WHAT MAKES ME EXITED?
• CloudDemocratizes technology. Offers efficiency, security, scalability and mobility
• ServerlessThe abstraction infrastructure
• ContainersOffers the promise of portability and agility
“Let the datasetchange yourmindset”
– David McCandless –
0.162006
4.42013
1 ZETTABYTE = 1.000.000.000 TERABYTES
ZETTABYTES OF DATA
~502020
Historical and real-time data
LET’S TALK DATA GRAVITY
LET’S TALK DATA GRAVITY
“Data gravity is an analogy of the nature of data and its ability to attract
additional applications and services.”
-Dave McCrory, 2010 -
DATA ATTRACTSApplications and Application Interfaces
Solution
DataApp API
“As love grows, they want to be close to each other.”
SERVICE GRAVITY
WHEN MASS GROWSGravity will increase
Data
App API
PERFORMANCE
Data
App API
Ensure high data
throughputAvoid
latency
WHERE AND HOW DO I STORE MY DATA?
DATA IN THE CLOUD OR ON-PREMISES?
• CostsPay-per-Use vs major investments and operational costs
• Privacy and SecurityValue added services vs possible limited security resources and expertise
• ScalabilityUnlimited real-time scalability
• RedundancyFault Tolerance, Disaster Recovery and Globally available
… WHEN DATA IS ON THE MOVEthen data gravity affects…
HOW TO STORE DATA?Traditional data storage appliances
Compute
Vendor softwareCapacity
Storage
HYPERCONVERGED?
Decloupled
Software
Vendor specific
Storage
THE ALTERNATIVESoftware Defined Storage
Decloupled
Software
Hardware independent Storage
Storage
SOFTWARE DEFINED BENEFITS
• Using commodity hardwareEasy to replace, less expensive
• Storage virtualizationMassive (unlimited) scalability, easy to move
• Object, File, Block BasedEnabling large storage clusters, efficient use of storage
• Fully managed
SDS EXAMPLES
HOW ABOUT MICROSERVICES?
HOW ABOUT CONTAINERS?HOW ABOUT CONTAINERS?
BENEFITS
• PortabilityDeployed easily to multiple different platforms
• IndependentA container can be deployed independently
• ConsistentApplications in containers will run the same, regardless of where they are deployed
• EfficiencyLess resources, rapidly deployed, patched, or scaled
BREAK THROUGH
Break-up your applications, create microservices,
decentralize data.
Run containers, go Serverless.
Use Software Defined Storage, extend storage features.
Use Cloud, create a hybrid environment.
Serve storage out of containers.
MY ENVIRONMENTA Managed Cloud Service
Azure AKSGoogle GKE Amazon EKS
ROOKA Storage Orchestrator for Kubernetes
CEPHA software defined storage platform
DEMO
DRAWBACKS
• Empower - Learning CurveAzure, Docker, Kubernetes, Helm, Tiller, Rook, Ceph….
• Transform - Loosely coupled complexityProtocols, security, versioning, management….
• Optimize - Containers change ownershipYour build it, you run it…
RESOURCES
• Centric Netherlandshttps://www.centric.eu/NL/Default
• Centric Craft Programhttps://www.centric.eu/NL/Default/Craft
• Google Kubernetes Enginehttps://cloud.google.com/kubernetes-engine/
• AWS Elastic Container Service for Kuberneteshttps://aws.amazon.com/eks/
• Azure Kubernetes Serviceshttps://azure.microsoft.com/en-in/services/kubernetes-service/
• Rookhttps://rook.io/
• Cephhttps://ceph.com/