step-by-step guide to oracle autonomous data … guide to oracle autonomous data warehouse cloud ......

Copyright©2017,Oracleand/oritsaffiliates.Allrightsreserved.|

Step-by-StepGuidetoOracleAutonomousDataWarehouseCloud

[email protected]


DownloadPresentaNonSlides

Date Room Session

Monday,4:45pm MosconeWest–Room3004DataWarehousingforEverybody:

OracleAutonomousDataWarehouseCloud

Wednesday,12pm, MosconeWest–Room3010

Step-by-StepGuidetoOracleAutonomousDataWarehouseCloud


ThefollowingisintendedtooutlineourgeneralproductdirecNon.ItisintendedforinformaNonpurposesonly,andmaynotbeincorporatedintoanycontract.Itisnotacommitmenttodeliveranymaterial,code,orfuncNonality,andshouldnotberelieduponinmakingpurchasingdecisions.Thedevelopment,release,NmingandpriceofanyfeaturesorfuncNonalitydescribedforOracle'sproductsmaychangeandremainsatthesolediscreNonofOracleCorporaNon.FeesapplyfornewDatabaseproductofferings.

SafeHarborStatement

3


Agenda

IntroducNontoAutonomousDataWarehouseCloud

Ge\ngstartedwithAutonomousDataWarehouseCloud

1

2


IntroducNontoAutonomousDataWarehouseCloud


AutonomousDataWarehouseCloud

•  Easy– Fully-managed,pre-configuredandopNmizedforDWworkloads– Simplyloaddataandrun• Noneedtodefineindexes,createparNNons,etc.

•  Fast– BasedonExadatatechnology

•  ElasNc– InstantscalingofcomputeorstoragewithnodownNme

ExpectedCY2017


Fully-managed•  Oracleautomatesend-to-endmanagementofthedatawarehouse–  Provisioningnewdatabases–  Growing/shrinkingstorageand/orcompute–  Patchingandupgrades–  Backupandrecovery

•  Fulllifecyclemanagedusingtheserviceconsole–  AlternaNvely,canbemanagedviacommand-lineinterfaceorRESTAPI


Fully-tuned•  “Loadandgo”– Definetables,loaddata,runqueries•  Notuning•  NospecialdatabaseexperNserequired

– Goodperformanceoutofthebox

• QueryusinganybusinessanalyNcstoolorcloudservice– Built-inSQLworksheetandnotebookalsoincluded


Fully-elasNc•  SizetheDWtotheexactcomputeandstoragerequired– Notconstrainedbyfixedbuildingblocks,nopredefinedshapes

•  ScaletheDWondemand– Independentlyscalecomputeorstorage– Resizingoccursinstantly,fullyonline

•  Shutoffidlecomputetosavemoney– Restartinstantly


FullSupportofDWEcosystem• AutonomousDataWarehouseCloudsupports:– ExisNngtools,runningon-premisesorinthecloud• Third-partyBItools• Third-partydata-integraNontools• OracleBIanddata-integraNontools:BIEE,ODI,etc

– Oraclecloudservices:AnalyNcsCloudService,GoldenGateCloudService,IntegraNonCloudService,andothers– ConnecNvityviaSQL*Net,JDBC,ODBC


Architecture

OracleExadataCloudService

OracleDatabaseCloudService

ExpressCloudService

DataWarehouseServices(EDWs,DW,departmentalmartsandsandboxes)


ServiceConsole

Built-inAccessTools

SQLWorksheet OracleML

ServiceManagement

DWDatabase

SQLDeveloper

DeveloperTools

DataIntegra@onServices

OracleDataIntegra@onCloudService

3rdPartyDIonOracleCloudCompute

3rdPartyDIon-premises


Ge\ngStartedwithAutonomousDataWarehouseCloudProvisioningadatabase


ProvisioningaDatabase• Provisioningrequiresonly4simplequesNons:– Databasename?– Datacenter?– NumberofCPUs?– Storagecapacity?– Adminuserpassword?

• Newservicecreatedin<30seconds(regardlessofsize)– Readytoconnect


DemoProvisioningadatabase


Ge\ngStartedwithAutonomousDataWarehouseCloudConnec@ngtothedatabase


ConnecNngtotheDatabase•  SecurelyconnectusingcredenNalwalletsviaSQL*Net,JDBC,ODBC• WalletcanbedownloadedfromtheserviceconsoleorusingRESTAPIs


DemoDownloadingthecreden@alwallet


DemoConnec@ngtothedatabaseusingthewalletinSQLDeveloper


LocaNonofthewallet

Walletpassword

Databaseservicename


DatabaseServiceNames•  3pre-defineddatabaseservices– Choiceofperformanceandconcurrency

•  HIGH–  Highestresources,lowestconcurrency–  Queriesruninparallel

•  MEDIUM–  Lessresources,higherconcurrency–  Queriesruninparallel

•  LOW–  Leastresources,highestconcurrency–  Queriesrunserially

Noofconcurrentqueries Maxidle@me CPUshares

HIGH 3 5mins 4

MEDIUM 20 5mins 2

LOW 32 1hour 1

Exampleforadatabasewith16OCPUs


Ge\ngStartedwithAutonomousDataWarehouseCloudCrea@ngusers


SimplifiedUserCreaNon•  SimplifiedusercreaNonviathenewdatabaserole– Noneedtospecifyanythingexceptthepassword– DWROLEincludesallnecessaryprivilegesforaDWdeveloper/user

create user sh identified by sh; grant dwrole to sh;


Ge\ngStartedwithAutonomousDataWarehouseCloudLoadingdata


DataLoadingOpNons• DataloadingviaSQL*Net– Suitableforsmallvolumesofdata•  SQL*Loaderfromlocalfilesystem•  ETLscriptsthatuseDMLtoinsert/updatedata

• DataloadingfromOracleObjectStorage– Preferredtechniqueforlargevolumesofdata•  AddiNonallyenablesdata-sharingwithothercloudservices

– StagedatainOracleObjectStorage,thenloadintothedatabaseusingnewPL/SQLAPIs


LoadingDatafromObjectStores

•  Sourcedatafromfilesonobjectstoresfordataloading– OracleObjectStoreorAWSS3– AnysupportedOracle-loaderfileformat– Roadmap:anyHadoopfileformat

ADWC

ObjectStorage


NewCloudAPItoAccessObjectStores,DBMS_CLOUD• NewPL/SQLpackageforaccessingfilesinobjectstores• Noneedtomanuallydefineexternaltablesforloadingfiles– Makesiteasiertospecifytheformatofthesourcedata


LoadingDatafromtheOracleObjectStore• DefineyourcredenNalsfortheobjectstore– OracleCloudInfrastructureObjectStoreusernameandSwippasswordrequired

• CredenNalstoredinthedatabaseschemaonceandusedforaccessingtheobjectstoreforallloads

begin dbms_cloud.create_credential( credential_name => 'OBJ_STORE_CRED', username => 'tenant1', password => ’password' ); end; /


LoadingDatafromtheOracleObjectStore•  Loaddatadirectlyintothetargettablewithoutanyintermediatesteps• DataformatinthesourcefileeasilyspecifiedasJSON

begin dbms_cloud.copy_data( table_name =>'CHANNELS', credential_name =>'OBJ_STORE_CRED', file_uri_list =>'https://swiftobjectstorage.us-ashburn-1.oraclecloud.com/v1/dwcsdemo/DEMO_DATA/chan_v3.dat', format => json_object('ignoremissingcolumns' value 'true',

'removequotes' value 'true') ); end; /


TroubleshooNngLoads•  LoadoperaNonsloggedfortroubleshooNngandhistoricalloadtracking– Newtableuser/dba_load_operaNons

•  Logandbadfilesaccessibleastables

select table_name,status,rows_loaded,logfile_table,badfile_table from user_load_operations; TABLE_NAME STATUS ROWS_LOADED LOGFILE_TABLE BADFILE_TABLE -------------------- --------- ----------- -------------------- -------------------- CHANNELS FAILED COPY$1_LOG COPY$1_BAD CHANNELS COMPLETED 5 COPY$2_LOG COPY$2_BAD


DemoLoadingdatafromtheOracleObjectStore


Ge\ngStartedwithAutonomousDataWarehouseCloudQueryingdataonobjectstores


QueryingDataonObjectStores

• Directlyqueryfilesresidingonobjectstoreswithouttheneedtoloadthemfirst– OracleObjectStoreorAWSS3– AnysupportedOracle-loaderfileformat– Roadmap:anyHadoopfileformat

ADWC

ObjectStorage


QueryingDataontheOracleObjectStore• DefineyourcredenNalsfortheobjectstore– OracleCloudInfrastructureObjectStoreusernameandSwippasswordrequired

• CredenNalstoredinthedatabaseschemaonceandusedforaccessingtheobjectstoreforallqueries• Callthedbms_cloudAPIforcreaNnganexternaltableontopofthesourcefiles


QueryingDataontheOracleObjectStorebegin dbms_cloud.create_external_table( table_name =>'CHANNELS_EXT', credential_name =>'OBJ_STORE_CRED', file_uri_list => 'https://swiftobjectstorage.us-ashburn-1.oraclecloud.com/v1/dwcsdemo/DEMO_DATA/chan_v3.dat', format => json_object('ignoremissingcolumns' value 'true', 'removequotes' value 'true'), column_list => 'CHANNEL_ID NUMBER,

CHANNEL_DESC VARCHAR2(20), CHANNEL_CLASS VARCHAR2(20), CHANNEL_CLASS_ID NUMBER, CHANNEL_TOTAL VARCHAR2(13), CHANNEL_TOTAL_ID NUMBER'

); end; / select count(*) from channels_ext;


DemoQueryingdataontheOracleObjectStore


Ge\ngStartedwithAutonomousDataWarehouseCloudWeb-BasedSQLWorksheetandNotebooks


Built-inSQLWorksheetandNotebook• Quicklystartrunningquerieswithbuilt-inweb-basednotebooks– Noneedtoinstallaclientquerytool

•  IniNallysupportsSQLandPL/SQL– Morelanguagesintheroadmap

• BasedonApacheZeppelin


Ge\ngStartedwithAutonomousDataWarehouseCloudScalingyourdatabase


ScalingYourDatabase•  Scaleyourdatabaseondemandwithouttediousmanualsteps– Independentlyscalecomputeorstorage– Resizingoccursinstantly,fullyonline– Memory,IObandwidth,concurrencyscaleslinearlywithCPU

• Closeyourdatabasetosavemoneywhennotused– Restartinstantly


DemoScalingyourdatabase


Ge\ngStartedwithAutonomousDataWarehouseCloudAdministra@onandmonitoring


AutomatedDatabaseConfiguraNon•  init.oraparameters– ParametersopNmizedforDWworkloads– Memory,parallelism,sessionsconfiguredbasedonnumberofCPUs– Userscanmodifyalimitedsetofparameters,e.g.NLSse\ngs

•  Tablespacemanagement– Pre-defineddataandtemporarytablespaces– Userscannotcreate/modifytablespaces

• Compression– AlltablescompressedusingHybridColumnarCompression– Userscannotchangecompressionmethodordisablecompression


AutomatedDatabaseConfiguraNon• OpNmizerstatsgathering– StatsgatheredautomaNcallyduringdirectloadoperaNons– Userscangatherstatsmanuallyiftheywant

• OpNmizerhints– Hintsignoredbydefault– Userscanenablehintsexplicitly

• ResultcacheconfiguraNon– Resultcacheenabledbydefaultforallqueries


Monitoring•  Simplifiedmonitoringusingtheweb-basedserviceconsole• Historicalandreal-Nmeperformancecharts• Real-TimeSQLMonitoringtomonitorrunningandpastSQLstatements• Historicaldataloadmonitoring


DemoMonitoring


OracleAutonomousWarehouseCloudSummary



•  Easy– Fully-managed,pre-configuredandopNmizedforDWworkloads– Simplyloaddataandrun• Noneedtodefineindexes,createparNNons,etc.

•  Fast– BasedonExadatatechnology

•  ElasNc– InstantscalingofcomputeorstoragewithnodownNme

ExpectedCY2017


ExadataCloudService AutonomousDataWarehouseCloud

Automated FullyManaged

FulldatabasefuncNonality:allOraclefeatures

CoreDWfuncNonality:focusedsolelyonDWandsimplicity

ComplexDWsrequiringcustomizedtuningandadvancedfeatures

SimplerDWswithnoadministra<onandlowercosts

Summary-CloudPlarormsforDataWarehousing

step-by-step guide to oracle autonomous data … guide to oracle autonomous data warehouse cloud ......

Documents