data warehousing for everybody: oracle autonomous data ...€¦ · –oracle analytics cloud...
TRANSCRIPT
![Page 1: Data Warehousing for Everybody: Oracle Autonomous Data ...€¦ · –Oracle Analytics Cloud –Oracle Data Integration ... •Based on Apache Zeppelin •Roadmap: Common UI for data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ed224da5e0ec842bd789a56/html5/thumbnails/1.jpg)
Copyright©2017, Oracleand/oritsaffiliates.Allrightsreserved.|
DataWarehousingforEverybody:OracleAutonomousDataWarehouseCloud
GeorgeLumpkin,VicePresident,ProductManagementYasin Baskan,Sr PrincipalProductManager
OracleDatabaseServerTechnologyOctober2,2017
Confidential– OracleInternal/Restricted/HighlyRestricted
![Page 2: Data Warehousing for Everybody: Oracle Autonomous Data ...€¦ · –Oracle Analytics Cloud –Oracle Data Integration ... •Based on Apache Zeppelin •Roadmap: Common UI for data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ed224da5e0ec842bd789a56/html5/thumbnails/2.jpg)
Copyright©2016, Oracleand/oritsaffiliates.Allrightsreserved.|
Thefollowingisintendedtooutlineourgeneralproductdirection.Itisintendedforinformationpurposesonly,andmaynotbeincorporatedintoanycontract.Itisnotacommitmenttodeliveranymaterial,code,orfunctionality,andshouldnotberelieduponinmakingpurchasingdecisions.Thedevelopment,release,timingandpriceofanyfeaturesorfunctionalitydescribedforOracle'sproductsmaychangeandremainsatthesolediscretionofOracleCorporation.FeesapplyfornewDatabaseproductofferings.
SafeHarbor Statement
2
![Page 3: Data Warehousing for Everybody: Oracle Autonomous Data ...€¦ · –Oracle Analytics Cloud –Oracle Data Integration ... •Based on Apache Zeppelin •Roadmap: Common UI for data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ed224da5e0ec842bd789a56/html5/thumbnails/3.jpg)
Copyright©2016, Oracleand/oritsaffiliates.Allrightsreserved.|
Oracle’sVision forAutonomousDatabase
• Self-Driving–Userdefinesservicelevels,databasemakesthemhappen
• Self-Securing–Protectionfrombothexternalattacksandmaliciousinternalusers
• Self-Repairing–Automatedprotectionfromalldowntime
3
AutonomousDatabase
![Page 4: Data Warehousing for Everybody: Oracle Autonomous Data ...€¦ · –Oracle Analytics Cloud –Oracle Data Integration ... •Based on Apache Zeppelin •Roadmap: Common UI for data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ed224da5e0ec842bd789a56/html5/thumbnails/4.jpg)
Copyright©2016, Oracleand/oritsaffiliates.Allrightsreserved.|
IngredientsofanAutonomousDatabase• OracleDatabase18c–Dozensofautomateddatabasefeatures
+• OracleCloudinfrastructure–Single,standardplatformasfocusforself-drivingautomation
+• OracleAutonomousDatabaseCloudtooling–Automationforoptimalconfigurationforeachworkload
4
AutonomousDatabase
![Page 5: Data Warehousing for Everybody: Oracle Autonomous Data ...€¦ · –Oracle Analytics Cloud –Oracle Data Integration ... •Based on Apache Zeppelin •Roadmap: Common UI for data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ed224da5e0ec842bd789a56/html5/thumbnails/5.jpg)
Copyright©2016, Oracleand/oritsaffiliates.Allrightsreserved.|
OneAutonomousDatabase– OptimizedbyUseCase
5
OracleAutonomousDatabase
EnterpriseOLTP,Mixed
Workloads
DataWarehousing
Departments,Developers
2017 2018 Now
DataWarehousing
![Page 6: Data Warehousing for Everybody: Oracle Autonomous Data ...€¦ · –Oracle Analytics Cloud –Oracle Data Integration ... •Based on Apache Zeppelin •Roadmap: Common UI for data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ed224da5e0ec842bd789a56/html5/thumbnails/6.jpg)
Copyright©2016, Oracleand/oritsaffiliates.Allrightsreserved.|
Introducing:AutonomousDataWarehouseCloud
• Easy–Automatedmanagement–Automatedtuning:Simplyloaddataandrun
• Fast–BasedonExadatatechnology
• Elastic– Instantscalingofcomputeorstoragewithnodowntime
6
ExpectedCY2017
![Page 7: Data Warehousing for Everybody: Oracle Autonomous Data ...€¦ · –Oracle Analytics Cloud –Oracle Data Integration ... •Based on Apache Zeppelin •Roadmap: Common UI for data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ed224da5e0ec842bd789a56/html5/thumbnails/7.jpg)
Copyright©2016, Oracleand/oritsaffiliates.Allrightsreserved.|
GettingStartedwithAutonomousDataWarehouseCloud• Provisioningrequiresonly5simplequestions:– Databasename?–Whichdatacenter?– HowmanyCPU’s?– HowmanyTB’s?– Adminpassword?
• Newservicecreatedin<30seconds(regardlessofsize)– Readytoconnectviasqlnet
Confidential
![Page 8: Data Warehousing for Everybody: Oracle Autonomous Data ...€¦ · –Oracle Analytics Cloud –Oracle Data Integration ... •Based on Apache Zeppelin •Roadmap: Common UI for data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ed224da5e0ec842bd789a56/html5/thumbnails/8.jpg)
Copyright©2016, Oracleand/oritsaffiliates.Allrightsreserved.|
Demo:Provisioning
Confidential
![Page 9: Data Warehousing for Everybody: Oracle Autonomous Data ...€¦ · –Oracle Analytics Cloud –Oracle Data Integration ... •Based on Apache Zeppelin •Roadmap: Common UI for data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ed224da5e0ec842bd789a56/html5/thumbnails/9.jpg)
Copyright©2016, Oracleand/oritsaffiliates.Allrightsreserved.|
Whatdidn’t youjustsee?• Nodecisionsfor:–Detailsofthedatabasesoftware–Configurationofhardware–Characteristicsofthedatabase–Architectureforbackupsandavailability
• Allofthis(andmore)isautomaticallyconfigured
Confidential
![Page 10: Data Warehousing for Everybody: Oracle Autonomous Data ...€¦ · –Oracle Analytics Cloud –Oracle Data Integration ... •Based on Apache Zeppelin •Roadmap: Common UI for data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ed224da5e0ec842bd789a56/html5/thumbnails/10.jpg)
Copyright©2016, Oracleand/oritsaffiliates.Allrightsreserved.|
Automatedmanagement• Oracleautomatesend-to-endmanagementofdatawarehouse– Provisioningnewdatabaseinstances– Growing/shrinkingstorageand/orcompute– Patchingandupgrades– Backupandrecovery
• FulllifecyclemanagedusingADWCServiceConsole
Confidential– OracleInternal/Restricted/HighlyRestricted 10
![Page 11: Data Warehousing for Everybody: Oracle Autonomous Data ...€¦ · –Oracle Analytics Cloud –Oracle Data Integration ... •Based on Apache Zeppelin •Roadmap: Common UI for data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ed224da5e0ec842bd789a56/html5/thumbnails/11.jpg)
Copyright©2016, Oracleand/oritsaffiliates.Allrightsreserved.|
Automated
• Thecarsimplifiesoperationsbyautomatingtasks:– Cruisecontrol– Emergencystopping–Warningsforlanechanges
• Thedatabasesimplifiesoperations:– Automaticstoragemanagement,automaticstoragemanagement,…
– Dozensofotherfeatures
Autonomous
• Thecardrivesitself– Noneedtousethesteeringwheelorbrake.
– Simplytellthecarwhereyouaregoing.
• Thedatabasemanagesitself– Allfeaturesautomaticallyimplemented– Simplytellthedatabaseyourgoals
11
Automatedvs.Autonomous
![Page 12: Data Warehousing for Everybody: Oracle Autonomous Data ...€¦ · –Oracle Analytics Cloud –Oracle Data Integration ... •Based on Apache Zeppelin •Roadmap: Common UI for data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ed224da5e0ec842bd789a56/html5/thumbnails/12.jpg)
Copyright©2016, Oracleand/oritsaffiliates.Allrightsreserved.|
WhatdoesAutonomousDatabasemeanfortheDBA?
LesstimeonAdministration
• Lesstimeoninfrastructure• Lesstimeonpatching,upgrades• Lesstimeonensuringavailability• Lesstimeontuning
12
MoretimeonInnovation
• Moretimeondatabasedesign• Moretimeondevelopingnewapps• Moretimeondataanalytics• Moretimeonsecuringdata
Challenge:Therearemoredatamanagementtasksthanhumanstodothework
![Page 13: Data Warehousing for Everybody: Oracle Autonomous Data ...€¦ · –Oracle Analytics Cloud –Oracle Data Integration ... •Based on Apache Zeppelin •Roadmap: Common UI for data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ed224da5e0ec842bd789a56/html5/thumbnails/13.jpg)
Copyright©2016, Oracleand/oritsaffiliates.Allrightsreserved.|
AutomatedTuning• “Loadandgo”– Definetables,loaddata,runqueries• Notuning• Nospecialdatabaseexpertiserequired
– Goodperformanceoutofthebox
• Queryusinganybusinessanalyticstoolorcloudservice– Built-inSQLnotebookalsoincluded
Confidential
![Page 14: Data Warehousing for Everybody: Oracle Autonomous Data ...€¦ · –Oracle Analytics Cloud –Oracle Data Integration ... •Based on Apache Zeppelin •Roadmap: Common UI for data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ed224da5e0ec842bd789a56/html5/thumbnails/14.jpg)
Copyright©2016, Oracleand/oritsaffiliates.Allrightsreserved.|
HippocraticOathofAutonomousPerformance
• Performancefeaturesarecarefullyselected:– Noperformancedegradation– Nosignificantoverhead
Confidential
“Donoharm”
![Page 15: Data Warehousing for Everybody: Oracle Autonomous Data ...€¦ · –Oracle Analytics Cloud –Oracle Data Integration ... •Based on Apache Zeppelin •Roadmap: Common UI for data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ed224da5e0ec842bd789a56/html5/thumbnails/15.jpg)
Copyright©2016, Oracleand/oritsaffiliates.Allrightsreserved.|
• Evaluationofrealcustomerworkloadsandstandardbenchmarks– PerformanceAs-IsversusADWC– Runonidenticalhardware
• ADWCout-of-the-box–Optimized,pre-configuredDBsetup
• Schemaasprovidedbycustomer– Indexes,Partitioning,manualDOP
Confidential
AutonomousDataWarehouseCloud:PerformanceProofPoint
OracleADWC CustomerSchema
Customer#1 39 34
Customer #2 52 53
Customer #3 1032 911
Customer #4 2138 3051
Customer #5 132 196
Customer #6 1478 1831
Customer #7 2551 5137
MSTR 1163 1504
SSB 232 209
![Page 16: Data Warehousing for Everybody: Oracle Autonomous Data ...€¦ · –Oracle Analytics Cloud –Oracle Data Integration ... •Based on Apache Zeppelin •Roadmap: Common UI for data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ed224da5e0ec842bd789a56/html5/thumbnails/16.jpg)
Copyright©2016, Oracleand/oritsaffiliates.Allrightsreserved.|
AutonomousDataWarehouseCloud:Reliability• Enterprise– 99.95%–Fault-tolerant,highly-availableExadata infrastructure• Triple-mirroreddisksfordiskfailures• RealApplicationClustersforcomputenodefailures• Andmore…
–Automaticbackups• Pointintimerecoverytoanytimeinlast30days
•MissionCritical– 99.995%–Standbydatabase
Confidential
![Page 17: Data Warehousing for Everybody: Oracle Autonomous Data ...€¦ · –Oracle Analytics Cloud –Oracle Data Integration ... •Based on Apache Zeppelin •Roadmap: Common UI for data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ed224da5e0ec842bd789a56/html5/thumbnails/17.jpg)
Copyright©2016, Oracleand/oritsaffiliates.Allrightsreserved.|
InstantElasticity• Customerspecifiesnumberofdatabasecores(inOCPU)anddatabasesize(inTB)– CPU’sandstorageareindependent– Databasescangrowandshrinkineitherdimension– PricingbaseduponCPU($/CPU/hour)andStorage($/TB/Month)
• Examples:– Addingnewstorageorcomputecapacityisjustaclickonthecloudconsole– CPUcapacitycanbeaddedon-demandforend-of-quarterprocessing,thenreducedaftertheprocessingiscompleted
– CPUcapacitycanbesettozero,whilestorageremainsinplace(forexample,toreducecostsfordatabaseswhicharenotusedduringweekends/nights)
Confidential
![Page 18: Data Warehousing for Everybody: Oracle Autonomous Data ...€¦ · –Oracle Analytics Cloud –Oracle Data Integration ... •Based on Apache Zeppelin •Roadmap: Common UI for data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ed224da5e0ec842bd789a56/html5/thumbnails/18.jpg)
Copyright©2016, Oracleand/oritsaffiliates.Allrightsreserved.|
InstantElasticity:PayforExactlyWhatyouUse• SizetheDWtotheexactnumberofOPCU’sandTB’srequired– Notconstrainedbyfixedbuildingblocks
• ScaletheDWondemand– Independentlyscalecomputeorstorage– Resizingoccursinstantly,fullyonline
• Shutoffidlecomputesavemoney– Restartinstantly
Confidential
![Page 19: Data Warehousing for Everybody: Oracle Autonomous Data ...€¦ · –Oracle Analytics Cloud –Oracle Data Integration ... •Based on Apache Zeppelin •Roadmap: Common UI for data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ed224da5e0ec842bd789a56/html5/thumbnails/19.jpg)
Copyright©2016, Oracleand/oritsaffiliates.Allrightsreserved.|
EasyMigrationtoAutonomousDataWarehouseCloudMigrationofexistingOraclesystems• DatapumpimportusingADWC-awaresettings– Ensurescompatibledataimport– Violatingdatastructureswillbeignoredorconverted
MigrationofRedshiftsystems• End-to-endmigrationusingmigrationworkbench– Convertandcreatedatawarehouseschema– UnloadRedshiftdataintoS3– LoaddataintoADWC
Migrationofothersystems• Migrationworkbenchassistanceormanual
19
![Page 20: Data Warehousing for Everybody: Oracle Autonomous Data ...€¦ · –Oracle Analytics Cloud –Oracle Data Integration ... •Based on Apache Zeppelin •Roadmap: Common UI for data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ed224da5e0ec842bd789a56/html5/thumbnails/20.jpg)
Copyright©2016, Oracleand/oritsaffiliates.Allrightsreserved.|
SupportedbyarichDataWarehouseEcosystem
• Existingtools runningon-premiseorinOracleCloud– OracleBIanddata-integrationtools– 3rd partyBItools– 3rd partydata-integrationtools
• ConnectivityviaSQL*Net
Confidential
OracleCloudServices–OracleAnalyticsCloud–OracleDataIntegrationPlatformCloud–andothers…
OracleAutonomousDataWarehouseCloudsupports:
![Page 21: Data Warehousing for Everybody: Oracle Autonomous Data ...€¦ · –Oracle Analytics Cloud –Oracle Data Integration ... •Based on Apache Zeppelin •Roadmap: Common UI for data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ed224da5e0ec842bd789a56/html5/thumbnails/21.jpg)
Copyright©2016, Oracleand/oritsaffiliates.Allrightsreserved.|
AutonomousDataWarehouseCloud:SupportFromStrategicPartners
![Page 22: Data Warehousing for Everybody: Oracle Autonomous Data ...€¦ · –Oracle Analytics Cloud –Oracle Data Integration ... •Based on Apache Zeppelin •Roadmap: Common UI for data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ed224da5e0ec842bd789a56/html5/thumbnails/22.jpg)
Copyright©2016, Oracleand/oritsaffiliates.Allrightsreserved.| Confidential
AutonomousDataWarehouseCloud:Architecture
OracleExadataCloudService
OracleDatabase CloudService
ExpressCloudService
DataWarehouseServices(EDWs,DW,departmentalmartsandsandboxes)
AutonomousDataWarehouseCloud
ServiceConsole
Built-inAccessTools
SQLWorksheet OracleML
ServiceManagement
DWDatabase
SQLDeveloper
DeveloperTools
DataIntegrationServices
3rd PartyBIon-premises
OracleDataIntegrationCloudService
3rdPartyDIonOracleCloudCompute
3rdPartyDIOn-premises
![Page 23: Data Warehousing for Everybody: Oracle Autonomous Data ...€¦ · –Oracle Analytics Cloud –Oracle Data Integration ... •Based on Apache Zeppelin •Roadmap: Common UI for data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ed224da5e0ec842bd789a56/html5/thumbnails/23.jpg)
Copyright©2016, Oracleand/oritsaffiliates.Allrightsreserved.|
OracleML:Built-innotebook
• CollaborativeUIfordatascientists– Easyaccesstosharednotebooks,templates,permissions,scheduler,etc.
• BasedonApacheZeppelin• Roadmap:CommonUIfordatascientistsacrossmultipleservices
23
![Page 24: Data Warehousing for Everybody: Oracle Autonomous Data ...€¦ · –Oracle Analytics Cloud –Oracle Data Integration ... •Based on Apache Zeppelin •Roadmap: Common UI for data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ed224da5e0ec842bd789a56/html5/thumbnails/24.jpg)
Copyright©2016, Oracleand/oritsaffiliates.Allrightsreserved.|
QueriesacrossCloudStorageandmore
• Externaltablescanbecreatedondatainobjectstores–OracleObjectStoreorAWSS3– AnysupportedOracle-loaderfileformat• OranyHadoopfileformat(e.g.Parquet)– comingsoon
– BigDataSQLintegration– comingsoon
• Seamlessqueriesoverobjectstore• Seamlessqueriesacrossobjectstoreanddatabase
ElasticDataWarehouseCompute
DataStorage
ExadataStorage
ObjectStorageKafka HDFS
DataStorage
OracleConfidentialandRestricted
![Page 25: Data Warehousing for Everybody: Oracle Autonomous Data ...€¦ · –Oracle Analytics Cloud –Oracle Data Integration ... •Based on Apache Zeppelin •Roadmap: Common UI for data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ed224da5e0ec842bd789a56/html5/thumbnails/25.jpg)
Copyright©2016, Oracleand/oritsaffiliates.Allrightsreserved.|
MoreonAutonomousDatabaseStep-by-StepGuidetoOracleAutonomousDatabaseCloudforDataWarehousing–Wednesday,Oct04,12:00pm- 12:45pm|Moscone West- Room3010
PreviewofOracleAutonomousDatabase–Wednesday,Oct04,3:30pm- 4:15pm|Moscone West- Room3014
Confidential
![Page 26: Data Warehousing for Everybody: Oracle Autonomous Data ...€¦ · –Oracle Analytics Cloud –Oracle Data Integration ... •Based on Apache Zeppelin •Roadmap: Common UI for data](https://reader030.vdocuments.net/reader030/viewer/2022040410/5ed224da5e0ec842bd789a56/html5/thumbnails/26.jpg)