step-by-step guide to oracle autonomous data … guide to oracle autonomous data warehouse cloud ......

Step-by-StepGuidetoOracleAutonomousDataWarehouseCloud

YasinBaskanDataWarehouseProductManagementyasin.baskan@oracle.com

DownloadPresentaNonSlides

Date Room Session

Monday,4:45pm MosconeWest–Room3004DataWarehousingforEverybody:

OracleAutonomousDataWarehouseCloud

Wednesday,12pm, MosconeWest–Room3010

Step-by-StepGuidetoOracleAutonomousDataWarehouseCloud

ThefollowingisintendedtooutlineourgeneralproductdirecNon.ItisintendedforinformaNonpurposesonly,andmaynotbeincorporatedintoanycontract.Itisnotacommitmenttodeliveranymaterial,code,orfuncNonality,andshouldnotberelieduponinmakingpurchasingdecisions.Thedevelopment,release,NmingandpriceofanyfeaturesorfuncNonalitydescribedforOracle'sproductsmaychangeandremainsatthesolediscreNonofOracleCorporaNon.FeesapplyfornewDatabaseproductofferings.

SafeHarborStatement

Agenda

IntroducNontoAutonomousDataWarehouseCloud

Ge\ngstartedwithAutonomousDataWarehouseCloud

IntroducNontoAutonomousDataWarehouseCloud

AutonomousDataWarehouseCloud

•  Easy– Fully-managed,pre-configuredandopNmizedforDWworkloads– Simplyloaddataandrun• Noneedtodefineindexes,createparNNons,etc.

•  Fast– BasedonExadatatechnology

•  ElasNc– InstantscalingofcomputeorstoragewithnodownNme

ExpectedCY2017

Fully-managed•  Oracleautomatesend-to-endmanagementofthedatawarehouse–  Provisioningnewdatabases–  Growing/shrinkingstorageand/orcompute–  Patchingandupgrades–  Backupandrecovery

•  Fulllifecyclemanagedusingtheserviceconsole–  AlternaNvely,canbemanagedviacommand-lineinterfaceorRESTAPI

Fully-tuned•  “Loadandgo”– Definetables,loaddata,runqueries•  Notuning•  NospecialdatabaseexperNserequired

– Goodperformanceoutofthebox

• QueryusinganybusinessanalyNcstoolorcloudservice– Built-inSQLworksheetandnotebookalsoincluded

Fully-elasNc•  SizetheDWtotheexactcomputeandstoragerequired– Notconstrainedbyfixedbuildingblocks,nopredefinedshapes

•  ScaletheDWondemand– Independentlyscalecomputeorstorage– Resizingoccursinstantly,fullyonline

•  Shutoffidlecomputetosavemoney– Restartinstantly

FullSupportofDWEcosystem• AutonomousDataWarehouseCloudsupports:– ExisNngtools,runningon-premisesorinthecloud• Third-partyBItools• Third-partydata-integraNontools• OracleBIanddata-integraNontools:BIEE,ODI,etc

– Oraclecloudservices:AnalyNcsCloudService,GoldenGateCloudService,IntegraNonCloudService,andothers– ConnecNvityviaSQL*Net,JDBC,ODBC

Architecture

OracleExadataCloudService

OracleDatabaseCloudService

ExpressCloudService

DataWarehouseServices(EDWs,DW,departmentalmartsandsandboxes)

ServiceConsole

Built-inAccessTools

SQLWorksheet OracleML

ServiceManagement

DWDatabase

SQLDeveloper

DeveloperTools

DataIntegra@onServices

OracleDataIntegra@onCloudService

3rdPartyDIonOracleCloudCompute

3rdPartyDIon-premises

Ge\ngStartedwithAutonomousDataWarehouseCloudProvisioningadatabase

ProvisioningaDatabase• Provisioningrequiresonly4simplequesNons:– Databasename?– Datacenter?– NumberofCPUs?– Storagecapacity?– Adminuserpassword?

• Newservicecreatedin<30seconds(regardlessofsize)– Readytoconnect

DemoProvisioningadatabase

Ge\ngStartedwithAutonomousDataWarehouseCloudConnec@ngtothedatabase

ConnecNngtotheDatabase•  SecurelyconnectusingcredenNalwalletsviaSQL*Net,JDBC,ODBC• WalletcanbedownloadedfromtheserviceconsoleorusingRESTAPIs

DemoDownloadingthecreden@alwallet

DemoConnec@ngtothedatabaseusingthewalletinSQLDeveloper

LocaNonofthewallet

Walletpassword

Databaseservicename

DatabaseServiceNames•  3pre-defineddatabaseservices– Choiceofperformanceandconcurrency

•  HIGH–  Highestresources,lowestconcurrency–  Queriesruninparallel

•  MEDIUM–  Lessresources,higherconcurrency–  Queriesruninparallel

•  LOW–  Leastresources,highestconcurrency–  Queriesrunserially

Noofconcurrentqueries Maxidle@me CPUshares

HIGH 3 5mins 4

MEDIUM 20 5mins 2

LOW 32 1hour 1

Exampleforadatabasewith16OCPUs

Ge\ngStartedwithAutonomousDataWarehouseCloudCrea@ngusers

SimplifiedUserCreaNon•  SimplifiedusercreaNonviathenewdatabaserole– Noneedtospecifyanythingexceptthepassword– DWROLEincludesallnecessaryprivilegesforaDWdeveloper/user

create user sh identified by sh; grant dwrole to sh;

Ge\ngStartedwithAutonomousDataWarehouseCloudLoadingdata

DataLoadingOpNons• DataloadingviaSQL*Net– Suitableforsmallvolumesofdata•  SQL*Loaderfromlocalfilesystem•  ETLscriptsthatuseDMLtoinsert/updatedata

• DataloadingfromOracleObjectStorage– Preferredtechniqueforlargevolumesofdata•  AddiNonallyenablesdata-sharingwithothercloudservices

– StagedatainOracleObjectStorage,thenloadintothedatabaseusingnewPL/SQLAPIs

LoadingDatafromObjectStores

•  Sourcedatafromfilesonobjectstoresfordataloading– OracleObjectStoreorAWSS3– AnysupportedOracle-loaderfileformat– Roadmap:anyHadoopfileformat

ObjectStorage

NewCloudAPItoAccessObjectStores,DBMS_CLOUD• NewPL/SQLpackageforaccessingfilesinobjectstores• Noneedtomanuallydefineexternaltablesforloadingfiles– Makesiteasiertospecifytheformatofthesourcedata

LoadingDatafromtheOracleObjectStore• DefineyourcredenNalsfortheobjectstore– OracleCloudInfrastructureObjectStoreusernameandSwippasswordrequired

• CredenNalstoredinthedatabaseschemaonceandusedforaccessingtheobjectstoreforallloads

begin dbms_cloud.create_credential( credential_name => 'OBJ_STORE_CRED', username => 'tenant1', password => ’password' ); end; /

LoadingDatafromtheOracleObjectStore•  Loaddatadirectlyintothetargettablewithoutanyintermediatesteps• DataformatinthesourcefileeasilyspecifiedasJSON

begin dbms_cloud.copy_data( table_name =>'CHANNELS', credential_name =>'OBJ_STORE_CRED', file_uri_list =>'https://swiftobjectstorage.us-ashburn-1.oraclecloud.com/v1/dwcsdemo/DEMO_DATA/chan_v3.dat', format => json_object('ignoremissingcolumns' value 'true',

'removequotes' value 'true') ); end; /

TroubleshooNngLoads•  LoadoperaNonsloggedfortroubleshooNngandhistoricalloadtracking– Newtableuser/dba_load_operaNons

•  Logandbadfilesaccessibleastables

select table_name,status,rows_loaded,logfile_table,badfile_table from user_load_operations; TABLE_NAME STATUS ROWS_LOADED LOGFILE_TABLE BADFILE_TABLE -------------------- --------- ----------- -------------------- -------------------- CHANNELS FAILED COPY$1_LOG COPY$1_BAD CHANNELS COMPLETED 5 COPY$2_LOG COPY$2_BAD

DemoLoadingdatafromtheOracleObjectStore

Ge\ngStartedwithAutonomousDataWarehouseCloudQueryingdataonobjectstores

QueryingDataonObjectStores

• Directlyqueryfilesresidingonobjectstoreswithouttheneedtoloadthemfirst– OracleObjectStoreorAWSS3– AnysupportedOracle-loaderfileformat– Roadmap:anyHadoopfileformat

ObjectStorage

QueryingDataontheOracleObjectStore• DefineyourcredenNalsfortheobjectstore– OracleCloudInfrastructureObjectStoreusernameandSwippasswordrequired

• CredenNalstoredinthedatabaseschemaonceandusedforaccessingtheobjectstoreforallqueries• Callthedbms_cloudAPIforcreaNnganexternaltableontopofthesourcefiles

QueryingDataontheOracleObjectStorebegin dbms_cloud.create_external_table( table_name =>'CHANNELS_EXT', credential_name =>'OBJ_STORE_CRED', file_uri_list => 'https://swiftobjectstorage.us-ashburn-1.oraclecloud.com/v1/dwcsdemo/DEMO_DATA/chan_v3.dat', format => json_object('ignoremissingcolumns' value 'true', 'removequotes' value 'true'), column_list => 'CHANNEL_ID NUMBER,

CHANNEL_DESC VARCHAR2(20), CHANNEL_CLASS VARCHAR2(20), CHANNEL_CLASS_ID NUMBER, CHANNEL_TOTAL VARCHAR2(13), CHANNEL_TOTAL_ID NUMBER'

); end; / select count(*) from channels_ext;

DemoQueryingdataontheOracleObjectStore

Ge\ngStartedwithAutonomousDataWarehouseCloudWeb-BasedSQLWorksheetandNotebooks

Built-inSQLWorksheetandNotebook• Quicklystartrunningquerieswithbuilt-inweb-basednotebooks– Noneedtoinstallaclientquerytool

•  IniNallysupportsSQLandPL/SQL– Morelanguagesintheroadmap

• BasedonApacheZeppelin

Ge\ngStartedwithAutonomousDataWarehouseCloudScalingyourdatabase

ScalingYourDatabase•  Scaleyourdatabaseondemandwithouttediousmanualsteps– Independentlyscalecomputeorstorage– Resizingoccursinstantly,fullyonline– Memory,IObandwidth,concurrencyscaleslinearlywithCPU

• Closeyourdatabasetosavemoneywhennotused– Restartinstantly

DemoScalingyourdatabase

Ge\ngStartedwithAutonomousDataWarehouseCloudAdministra@onandmonitoring

AutomatedDatabaseConfiguraNon•  init.oraparameters– ParametersopNmizedforDWworkloads– Memory,parallelism,sessionsconfiguredbasedonnumberofCPUs– Userscanmodifyalimitedsetofparameters,e.g.NLSse\ngs

•  Tablespacemanagement– Pre-defineddataandtemporarytablespaces– Userscannotcreate/modifytablespaces

• Compression– AlltablescompressedusingHybridColumnarCompression– Userscannotchangecompressionmethodordisablecompression

AutomatedDatabaseConfiguraNon• OpNmizerstatsgathering– StatsgatheredautomaNcallyduringdirectloadoperaNons– Userscangatherstatsmanuallyiftheywant

• OpNmizerhints– Hintsignoredbydefault– Userscanenablehintsexplicitly

• ResultcacheconfiguraNon– Resultcacheenabledbydefaultforallqueries

Monitoring•  Simplifiedmonitoringusingtheweb-basedserviceconsole• Historicalandreal-Nmeperformancecharts• Real-TimeSQLMonitoringtomonitorrunningandpastSQLstatements• Historicaldataloadmonitoring

DemoMonitoring

OracleAutonomousWarehouseCloudSummary

•  Easy– Fully-managed,pre-configuredandopNmizedforDWworkloads– Simplyloaddataandrun• Noneedtodefineindexes,createparNNons,etc.

•  Fast– BasedonExadatatechnology

•  ElasNc– InstantscalingofcomputeorstoragewithnodownNme

ExpectedCY2017

ExadataCloudService AutonomousDataWarehouseCloud

Automated FullyManaged

FulldatabasefuncNonality:allOraclefeatures

CoreDWfuncNonality:focusedsolelyonDWandsimplicity

ComplexDWsrequiringcustomizedtuningandadvancedfeatures

SimplerDWswithnoadministra<onandlowercosts

Summary-CloudPlarormsforDataWarehousing

step-by-step guide to oracle autonomous data … guide to oracle autonomous data warehouse cloud ......

Documents

think autonomous: oracle autonomous database transaction...

oracle autonomous database - chicago oracle …...oracle...

oracle plsql step by step guide

connecting microsoft sql server analysis services to oracle...

oracle autonomous database what every dba …...

40621435 123217 oracle streams step by step ppt

oracle streams-step-by-step-ppt

how autonomous is the oracle autonomous data …...example:...

oracle autonomous database transaction processing · oracle...

the automation imperative materialized: oracle autonomous...

step by step to install oracle business intelligence

oracle 11g step by step installation on windows

oracle 11g step

graph studio in oracle autonomous database

step by step how to install oracle xe

oracle autonomous...

step step membuat database oracle 10g

step by step installation of oracle ebs r12

how autonomous is the oracle autonomous data warehouse? ·...

oracle database 19c step by step installation guide on...