oracle autonomous data warehouse cloud data warehouse like …€¦ · data warehousing, analytics,...

© MJR Analytics 2018, T: +44 01273 041134 (UK) 415-218-2161 (US) W: https;//mjr-analytics.com E: [email protected]

Data Warehouse Like a Tech Startup with Oracle Autonomous Data Warehouse CloudMark Rittman, CEO and Founder, MJR AnalyticsUKOUG Midlands Technology Summit 2019


About the Speaker

● Oracle ACE Director, Author of two Oracle Press books● Regular speaker at every UKOUG Conference & Openworld since 2006● Co-founder and CTO of Rittman Mead, now founder of MJR Analytics ...● … 20 years consulting experience in BI, databases and data integration

● My world was enterprise customers and enterprise software● And so a couple of years ago ... I thought I’d try something different


I joined a tech startup


This startup was all about data


150,000+events/second

>2PBdata in 70,000+ tables

1Bn+interactions/day


And how many DBAs?


Five ?


None


● No DBAs● No servers to manage● No patches to apply or upgrades to apply● No sizing the cluster for peak loads● No indexing or database optimization


Startups need to move fast.

“The battle between every startup and incumbent comes down to whether the startup gets distribution before the incumbent gets innovation.”

- Alex Rampell, A16z, “Distribution vs. Innovation”


So what did they care about?


Hadoop had solved one problem, but created another.


Horizontal scale-out solves one problem, but then the problem becomes managing thousands of servers

Data Warehouse RBDMS > 3 nodes, >1 TB

Hadoop cluster> 50 nodes

200+Hadoop nodes to manage


Agility and time to provision

Scaling their capacity up (and down)

Costs that start small, and align with growth


Digital businesses have spiky workloads

Black Friday New Year Sales

Then the lull beforeNew Year sales

Need more capacityto handle spike

Another spike

After the holidays




Another spike

They want to pay for just what they need

Automatic provisioning of additional nodes

+$$$

De-provisioning of excess nodes

-$$$




Then the lull beforeNew Year sales

Need more capacityto handle spike

Another spike

After the holidays


Workloads spike over a year

De-provisioning of excess nodes

-$$$

Provisioning of additional nodes

+$$$

And automatically deprovision over-capacity


The solution?


Elastic Data Warehousing

Data Warehousing-as-a-Service


Data Warehousing,Analytics,Big Data & Data Engineering

We came from the on-premises world of Oracle and then spent years working in product startups using Google BigQuery, AWS Redshift and Hadoop-based big data platforms.

We offer consulting, strategy, migration and implementation services for clients implementing cloud data platforms and elastically-scalable data warehouses on the following platforms:

○ “How A Big Business Can Use An Autonomous Database To Move Like A Startup” - Forbes Magazine October 2018

https://[email protected]

https://www.forbes.com/sites/oracle/2018/10/04/how-a-big-business-can-use-autonomous-it-to-move-like-a-startup/#4dac5b581752



https://www.mjr-analytics.com


● Built by engineers from Oracle’s RAC and Parallel Server teams● Separation of data and compute

○ Data in Amazon S3○ Compute in Amazon EC2

● Cloud DWaaS of choice forEnterprise DW workloads


● DWaaS-of-choice for eCommerce, gaming and tech startup businesses

● Built on Google Dremel technology, evolution of MR

● Pay-per-query, free tier● My current go-to DB for

ad-hoc development work


But they do have limitationsBut they do have limitations


● Limited or non-standard SQL

● Primarily INSERT-only

● Limits around joins, window functions

● Poor aggregate management


Oracle Autonomous Data Warehouse Cloud

● Fully-managed DW Platform-as-a-Service● Based on Oracle Exadata Database technology● Near-instant provisioning● Elastic scaling and pricing● Simplified column-store table creation● Automated provisioning, patching and upgrades● Automated backups● Includes data visualization + notebook apps


Simplified Table Creation & Accessing Data

● “Load and go”○ Define tables, load data, run queries

■ Typically using free SQL*Developer GUI○ Because it’s based on Exadata technology

■ No indexes, No partitioning or MVs■ Self-tuning and self-optimzing

●


Extend Scale of ADWC through Object Stor

● New DBMS_CLOUD package for object store operation○ Analyze OCS/S3 data

in-place as external tables○ Or load into Autonomous

Data Warehouse Cloud● Extends scale of ADWC beyond

limits of Exadata storage


Scale-Up and Scale-Down of Compute + Storage

● Automated process - but not yet autoscaling● Ability to scale-up / scale-down with steps then automated

○ Pricing based upon CPU ($/CPU/hour) andStorage ($/TB/Month

● Close your ADWC instance when not needed, restart instantly○ Leave data in ADWC storage and set CPU to 0○ CPU and storage to 0 and data left in object store


So why Autonomous Data Warehouse?


Move like a startup, without introducing new technology to your mix.


● It uses Oracle SQL

● It’s based on Oracle Exadata Technology

● Community of experts and customers

● Real-world performance is a work-in-progress

● Features e.g. autoscaling lag competition


Questions?


Talk to us aboutData Warehouse Modernization

We offer consulting, migration and implementation services Oracle, Snowflake and Google BigQuery elastic data warehouses

● “How A Big Business Can Use An Autonomous Database To Move Like A Startup” - Forbes Magazine profile on Mark Rittman and ADWC

● The Rise of the Strategic DBA - Oracle White Paper on ADWC featuring Mark Rittmanhttps://www.mjr-analytics.com

[email protected]+44 01273 041134



https://mjr-analytics.com/s/50704-oracle-strategic-cba-ipaper.pdf

https://www.mjr-analytics.com

mailto:[email protected]


Data Warehouse Like a Tech Startup with Oracle Autonomous Data Warehouse CloudMark Rittman, CEO and Founder, MJR AnalyticsUKOUG Midlands Technology Summit 2019

oracle autonomous data warehouse cloud data warehouse like …€¦ · data warehousing, analytics,...

Documents