finit solutions series_fdm_batch_loader_041410_final

of 43 /43
The Finit Solutions Series Getting the most out of FDM: Fully Automating Your Data Fully Automating Your Data Loads April 14 2010 April 14, 2010 Presented by Jay Hampton www.finitsolutions.com

Author: finitsolutions

Post on 19-Jul-2015

67 views

Category:

Technology


2 download

Embed Size (px)

TRANSCRIPT

  • The Finit Solutions Series

    GettingthemostoutofFDM:Fully Automating Your DataFullyAutomatingYourDataLoads

    April 14 2010April14,2010

    PresentedbyJayHampton

    www.finitsolutions.com

  • The Finit Solutions Series

    AboutFinitSolutions

    www.finitsolutions.com

  • Th Fi it S l ti S i

    Getting the most out of FDM: Fully Automating Your Data Loads

    FinitIntroductionThe Finit Solutions Series

    FinitSolutionsspecializesinconsultingservicesintheOracleHyperionEnterprisePerformanceManagementSolutionssuiteofproducts:

    Financial Consolidation FinancialManagement(HFM)

    Hyperion Enterprise

    Planning and Business Intelligence Planning

    Essbase HyperionEnterprise

    Integration Financial Data Quality Management

    Essbase

    BI+ Reporting ToolsFinancial ReportingFinancialDataQualityManagement

    (FDM)

    OracleDataIntegrator(ODI) DataIntegrationManagement(DIM)

    FinancialReporting Smartview WebAnalysis

    Essbase Excel Add ing g ( )

    Other(EPMA,ERPi,etc) EssbaseExcelAddin

    www.finitsolutions.com 3

  • Th Fi it S l ti S i

    Getting the most out of FDM: Fully Automating Your Data Loads

    FinitsHFMandFDMExpertiseThe Finit Solutions Series

    FinithasoneofthelargestpracticesofHFMcertifiedconsultantsonstaffinthecountry.Wehaveexperiencebacktotheearlyversionsof

    p

    y p yHFMandhaveassistedclientswithallaspectsofHFMdeploymentsfromfulllifecycleimplementationstoapplicationoptimization/redesign activitiesredesignactivities.

    FinithasalonghistorywithHyperionFDMhavingstartedwiththeg y yp glegacyproduct,UpStreamWebLink.FinitbecameUpStreamSoftwaresfirstconsultingpartnerin2002.Collectively,Finithasdesigned and implemented UpStream / Hyperion FDM that havedesignedandimplementedUpStream/HyperionFDMthathavesourceddatafromover4,800 sourcesystemsandareusedbyover5,000 endusers.

    www.finitsolutions.com 4

  • Th Fi it S l ti S i

    Getting the most out of FDM: Fully Automating Your Data Loads

    FinitsClientServiceThe Finit Solutions Series

    W t k li t i i lWetakeclientserviceveryseriously.

    Ourclientserviceapproachhasledto100%customersatisfaction forevery Finitclientf y

    (119andcounting).

    www.finitsolutions.com 5

  • Th Fi it S l ti S i

    Getting the most out of FDM: Fully Automating Your Data Loads

    SomeFinitClientsThe Finit Solutions Series

    www.finitsolutions.com 6

  • Th Fi it S l ti S i

    Getting the most out of FDM: Fully Automating Your Data Loads

    AboutthePresenterThe Finit Solutions Series

    JayHampton([email protected])

    PartnerwithFinitSolutions More than 5 years of experience implementing Hyperion products Morethan5yearsofexperienceimplementingHyperionproducts

    HyperionFinancialDataQualityManagement(FDM) HyperionEnterprise HyperionFinancialManagement(HFM)

    FrequentpresenteratHyperionconferences ServesastheFDMDomainLeadontheOAUGHyperionSpecialInterestGroup

    (SIG)

    www.finitsolutions.com 7

  • Th Fi it S l ti S i

    Getting the most out of FDM: Fully Automating Your Data Loads

    HowtoAskaQuestionThe Finit Solutions Series

    Q

    www.finitsolutions.com 8

  • Th Fi it S l ti S i

    Getting the most out of FDM: Fully Automating Your Data Loads

    AgendaThe Finit Solutions Series

    WhatisFDMBatchLoader?H d th B t h L d k?

    g

    HowdoestheBatchLoaderwork? FileLocationandNamingConventions

    AutoMapCorrectFeature RunningtheBatchLoader Demonstration

    ManualwithInterfaceinWorkbench ViaascriptandFDMTaskFlow

    i i d k ViaascriptandFDMTaskManager

    FDMBatchReports

    www.finitsolutions.com 9

    RealWorldFDMBatchSolutions

  • The Finit Solutions Series

    WhatistheFDMBatchLoader?

    www.finitsolutions.com

  • Th Fi it S l ti S i

    Getting the most out of FDM: Fully Automating Your Data Loads

    WhatisFDMBatchLoader?The Finit Solutions Series

    TheFDMBatchLoadingprocessallowsuserstoautomateasmuchoraslittleoftheFDMprocessastheyrequirep y q

    AutomatesomeoralloftheImport,Validate,ExportandChecksteps

    TheFDMBatchLoadercanbeinitiatedinthefollowingways ManuallyviatheBatchLoaderInterfaceintheFDMWorkbenchy ManuallyviaanFDMScript/TaskFlowintheFDMwebinterface

    AutomaticallyviaanFDMScriptusingtheFDMTaskManager

    www.finitsolutions.com 11

  • Th Fi it S l ti S i

    Getting the most out of FDM: Fully Automating Your Data Loads

    WhatisFDMBatchLoader?The Finit Solutions Series

    GivesyoutheabilitytoloadsametypesoffilesasyouwouldmanuallyinFDMy

    StandardTextFiles MultiLoadFiles(ExcelorText) FDMExcelBasedJournals

    AutoMapFunctionalitybili i ll d i i h l d Abilitytoautomaticallymapanyunmappeditemsintheload

    file

    These unmapped accounts will be logged and can be reportedThese unmapped accountswillbeloggedandcanbereportedon

    www.finitsolutions.com 12

  • Th Fi it S l ti S i

    Getting the most out of FDM: Fully Automating Your Data Loads

    WhatisFDMBatchLoaderThe Finit Solutions Series

    Fullloggingofcompletedbatchprocessesalongwith logging of any errors that occur during thewithloggingofanyerrorsthatoccurduringthebatchprocess

    Thi ll b i d i h B h R f ThiscanallbeviewedintheBatchReportsfromwithinFDMsReportsScreen.

    AbilityforLightsOutProcessing WhencombinedwiththeFDMTaskManager,theBatchLoadercanbesetuptorunautomatically

    NouserneedstologintoFDMtobegintheprocessor

    www.finitsolutions.com 13

    executeanytasks

  • Th Fi it S l ti S i

    Getting the most out of FDM: Fully Automating Your Data Loads

    CostofFDMBatchLoaderThe Finit Solutions Series

    BatchLoaderisaseparatelylicensedcomponentofFDM You already own Batch Loader if you purchased the YoualreadyownBatchLoaderifyoupurchasedtheAdapterSuitewhichcontainstheadaptersforEssbase,Strategic Finance, Tax Stream and Data MartStrategicFinance,TaxStreamandDataMart

    IfyouonlyboughtFDMwiththeHFMorHyperionEnterpriseadaptersyoudonot yetowntheBatchLoaderp p y y

    [email protected] withquestionsaboutBatchLoaderlicensingandwhetheryouq g yhavealreadypurchasedit

    www.finitsolutions.com 14

  • The Finit Solutions Series

    HowdoestheBatchLoaderwork?

    www.finitsolutions.com

  • Th Fi it S l ti S i

    Getting the most out of FDM: Fully Automating Your Data Loads

    HowdoesBatchLoaderwork?The Finit Solutions Series

    TwoMainComponentsd d l d b StandardFileNamingConvention usedby

    FDMtoidentifythePointofViewforthefiletob l d dbeloaded

    StandardFileLocation usedbyFDMtoknowthelocationofthefilestobeprocessed

    www.finitsolutions.com 16

  • Th Fi it S l ti S i

    Getting the most out of FDM: Fully Automating Your Data Loads

    FileNamingConventionThe Finit Solutions Series

    g Filestobeloadedviathebatchloadermustbecreatedwithan

    FDMspecificfilenameformatp

    ThefilenameisusedbyFDMtodeterminethepointofviewtoprocessthefilefor(i.e.whatlocation,periodandcategoryis

    t i d i th fil )containedinthefile)

    Thefilenameisparsedintofivedifferentsegmentsandcanbedelimitedby(~, ,@)y ( , _ , @ )

    SampleFormattedFileName:

    A1000~Texas~Actual~Jan2010~RR.txt

    www.finitsolutions.com 17

  • Th Fi it S l ti S i

    Getting the most out of FDM: Fully Automating Your Data Loads

    FileNamingConventionThe Finit Solutions Series

    g

    A1000~Texas~Actual~Jan2010~RR.txt What are the segments? Whatarethesegments?

    FileID (ex.A1000) afreeformfield.Thisfieldcanbeusedtocontroltheorderinwhichthebatchfileswillload.Itcanalsostorevariables(i.e.username date of run job # etc )username,dateofrun,job#,etc.).

    Location (ex.Texas) FDMlocationnametobeloaded Category (ex.Actual) FDMcategoryname Period (ex.Jan2010) FDMperiodname

    MustmatchFDMPeriod LoadMethod (exRR) LoadMethodisatwocharacterswitch.( )

    Character1=MethodwhenimportingintoFDMAppend/Replace(ValidvaluesAorR)

    Character 2 = Method when exporting to Target Append/Replace (Valid

    www.finitsolutions.com 18

    Character2 MethodwhenexportingtoTargetAppend/Replace(ValidvaluesR,M,A,etc.)

  • Th Fi it S l ti S i

    Getting the most out of FDM: Fully Automating Your Data Loads

    BatchFileLocationThe Finit Solutions Series

    Allfilestobeloadedthroughthebatchloadermust be placed in the appropriate batch foldermustbeplacedintheappropriatebatchfolder Standardbatchfiles(onemonth,onelocation)needtobe placed in the OpenBatch folderbeplacedintheOpenBatch folder

    MultiLoadfilesneedtobeplacedi th O B t hML f ldintheOpenBatchML folder

    ExcelBasedJournalTemplatesd b l d hneedtobeplacedinthe

    OpenBatchML folder

    www.finitsolutions.com 19

  • The Finit Solutions Series

    AutoMapCorrect

    www.finitsolutions.com

  • Th Fi it S l ti S i

    Getting the most out of FDM: Fully Automating Your Data Loads

    AutoMapCorrectThe Finit Solutions Series

    AutomapCorrectwillallowtheFDMprocesstocontinue in the event a mapping error is

    p

    continueintheeventamappingerrorisencountered

    Thesystemwilllooktoaspecifiedlocationtoobtainamapintheeventtheoriginalmapsdonotcoverallaccountsinthesourcefile

    Thiswilladdthatnewmaptothemapsforthislocationforfurtherinstancesofthissourceaccount

    www.finitsolutions.com 21

  • Th Fi it S l ti S i

    Getting the most out of FDM: Fully Automating Your Data Loads

    AutoMapCorrectThe Finit Solutions Series

    TosetupthesuspenseaccountanewlocationcalledAutomapCorrect must be added to the FDM

    p

    AutomapCorrect mustbeaddedtotheFDMapplication

    After adding this location a new map entry needs to be Afteraddingthislocationanewmapentryneedstobemadeintheexplicitmapforeachdimension Source value for this mapping must be called AutoCorrectSourcevalueforthismappingmustbecalledAutoCorrect

    Targetvaluecanbeanyvalidmemberforthedimension

    These mapping entries will be the basis for the autoThesemappingentrieswillbethebasisfortheautomappingforanyunmappedmembersfromabatchload

    www.finitsolutions.com 22

  • The Finit Solutions Series

    RunningtheBatchLoader

    www.finitsolutions.com

  • Th Fi it S l ti S i

    Getting the most out of FDM: Fully Automating Your Data Loads

    BatchLoader ManualviaClientThe Finit Solutions Series

    IntheFDMWorkbenchclickonTools BatchProcessingtoopenthebatchprocessinginterface

    This will allow you toThiswillallowyoutomanuallyconfigurethesettings for an FDM batchsettingsforanFDMbatchandexecuteit

    www.finitsolutions.com 24

  • Th Fi it S l ti S i

    Getting the most out of FDM: Fully Automating Your Data Loads

    BatchLoader ManualviaClientThe Finit Solutions Series

    BelowistheBatchLoaderInterfaceintheWorkbench

    www.finitsolutions.com 25

  • Th Fi it S l ti S i

    Getting the most out of FDM: Fully Automating Your Data Loads

    BatchLoader ManualviaClientThe Finit Solutions Series

    ThefollowingsettingsfortheBatchLoaderaresetupinthe interface and are outlined below

    atc oade a ua a C e t

    theinterfaceandareoutlinedbelow

    BatchType StandardorMultiLoad Process Level Can process anywhere from Import Only to aProcessLevel CanprocessanywherefromImportOnlytoaFullProcessoraConsolidationOnly

    ProcessMethod SerialorParallel(IfParallel,canspecifythenumberofprocessestorun)

    LoadBalanceServer FDMLoadBalanceServerFile Name Delimiter The delimiter for the different FileNameDelimiter ThedelimiterforthedifferentcomponentsoftheBatchFileName(~,_,[email protected])

    UsuallyaBestPracticetouse~asFDMlocationsorcategoriesmay

    www.finitsolutions.com 26

    y g ycontainan_

  • Th Fi it S l ti S i

    Getting the most out of FDM: Fully Automating Your Data Loads

    BatchLoader ManualviaClientThe Finit Solutions Series

    ToprocessafileusingtheManualBatchLoaderatc oade a ua a C e t

    FirstplaceafileintheOpenBatchfolder SelecttheParametersintheInterface SelectExecute

    You will see the status of the job processing and Youwillseethestatusofthejobprocessingandwillseewhenitiscomplete

    www.finitsolutions.com 27

  • Th Fi it S l ti S i

    Getting the most out of FDM: Fully Automating Your Data Loads

    BatchLoader ManualviaWebThe Finit Solutions Series

    BatchLoadercanalsoberunviathewebbysetting up an FDM Task Flow

    atc oade a ua a eb

    settingupanFDMTaskFlow

    Thisallowsuserswhodonothaveaccesstothekb h ( l h kb hWorkbench(onlyPowerusershaveWorkbench

    access)theabilitytorunthebatchloaderscript.

    www.finitsolutions.com 28

  • Th Fi it S l ti S i

    Getting the most out of FDM: Fully Automating Your Data Loads

    BatchLoader ManualviaWebThe Finit Solutions Series

    TheBatchLoaderinterfacealsoallowstheeasycreation of a Batch Script that will be used to run the

    atc oade a ua a eb

    creationofaBatchScriptthatwillbeusedtoruntheBatchProcessviaanFDMTaskFlow

    Simply set the parameters for how you would like theSimplysettheparametersforhowyouwouldlikethescripttooperateandselectCreateScript

    ThiswillcreateaCustomScriptthatcanberuntopinitializetheFDMBatchProcess

    JustlikeotherFDMscriptstheBatchscriptcanbep penhancedtoperformadditionaltasks:

    EmailAlertsAddi i l E L i

    www.finitsolutions.com 29

    AdditionalErrorLogging

  • Th Fi it S l ti S i

    Getting the most out of FDM: Fully Automating Your Data Loads

    BatchLoader ManualviaWebThe Finit Solutions Series

    StepstosetupanFDMBatchTaskFlow1 C C G l S i i h B h L d

    atc oade a ua a eb

    1. CreateCustomGeneralScriptviatheBatchLoaderinterface.

    2 C t C t W b S i t2. CreateCustomWebScript.

    3. CopytheCustomGeneralscriptthatyoucreatedfromthe Batch Loader Interface to the CustomWeb ScripttheBatchLoaderInterfacetotheCustomWebScript.

    4. AdditeminMenuMaker(underTools).

    5 Cli k T k Fl t i t5. ClickonTaskFlowstoseeyourscript.

    6. ClickontheTaskFlowtorunit.

    www.finitsolutions.com 30

  • Th Fi it S l ti S i

    Getting the most out of FDM: Fully Automating Your Data Loads

    BatchLoader TaskManagerThe Finit Solutions Series

    TaskManagerinstallsaWindowsservicethatrunsscheduled tasks (FDM scripts) at specified

    atc oade as a age

    scheduledtasks(FDMscripts)atspecifiedintervals

    k b h d l d dl d l Taskscanbescheduledtorunrepeatedly,daily,weekly,ormonthly

    TaskManagercanbeinstalledonanyserverthatcanaccesstheFDMapplication(theWebserver,theapplicationserver,orthedataserverwhereFDMdataresides)

    www.finitsolutions.com 31

  • Th Fi it S l ti S i

    Getting the most out of FDM: Fully Automating Your Data Loads

    BatchLoader AutomaticThe Finit Solutions Series

    TheTaskManagerwillrunspecifiedFDMscriptsas certain intervals

    atc oade uto at c

    ascertainintervals

    ThisallowstheBatchLoaderScriptsthatwed k l hcreatedtorunviaaTaskFlowwithoutanyuser

    initiation

    www.finitsolutions.com 32

  • Th Fi it S l ti S i

    Getting the most out of FDM: Fully Automating Your Data Loads

    BatchLoader AutomaticThe Finit Solutions Series

    CreatingTasksintheTaskManager1 O h T k M Thi i ll i ll d

    atc oade uto at c

    1. OpenuptheTaskManager.ThisisusuallyinstalledontheFDMApplicationserver

    2 Cli k T k N T k2. ClickonTask NewTask3. ClickontheGeneralTabandEnterinthefollowing

    informationinformation TaskName AnyNamefortheTask FDM Application Select from available applicationsFDMApplication Selectfromavailableapplications ActionScript TheScriptthatyouwishtorun(AnyCustom

    GeneralorCustomWebscript)

    www.finitsolutions.com 33

    UserInformation

  • Th Fi it S l ti S i

    Getting the most out of FDM: Fully Automating Your Data Loads

    BatchLoader AutomaticThe Finit Solutions Series

    atc oade uto at c

    www.finitsolutions.com 34

  • Th Fi it S l ti S i

    Getting the most out of FDM: Fully Automating Your Data Loads

    BatchLoader AutomaticThe Finit Solutions Series

    CreatingTasksintheTaskManager(cont)4 Cli k h S h d l T b d h h f h

    atc oade uto at c

    4. ClickontheScheduleTabandchoosehowoftenthescriptshouldrun

    Frequency Repeat Weekly Monthly Frequency Repeat,Weekly,Monthly Repeat Thisisonlyforrepeat Schedule If Weekly or Monthly, select scheduleSchedule IfWeeklyorMonthly,selectschedule

    www.finitsolutions.com 35

  • The Finit Solutions Series

    BatchLoaderReports

    www.finitsolutions.com

  • Th Fi it S l ti S i

    Getting the most out of FDM: Fully Automating Your Data Loads

    BatchLoader FDMReportsThe Finit Solutions Series

    ThereareseveralstandardFDMreportsthatcanbeused to monitor and track the batch loading process

    atc oade epo ts

    usedtomonitorandtrackthebatchloadingprocess

    TheyarealllistedintheBatchReportsGroup Batch Listing A simple listing of all of the batches that haveBatchListing Asimplelistingofallofthebatchesthathave

    beenrun BatchFileListing Detailstheactualfilenamesinvolvedinall

    of the batchesofthebatches BatchErrorListing showserrorsinthebatchprocess

    (woulddisplaythesametypeoferrorsasamanualrun) BatchProcessingStatus Showsthedetailsofabatchthatis

    currentlyprocessing Batch Auto Map Changes Will show the details of records

    www.finitsolutions.com 37

    BatchAutoMapChanges Willshowthedetailsofrecordsthathavebeenmappedusingtheautomapfeature

  • Th Fi it S l ti S i

    Getting the most out of FDM: Fully Automating Your Data Loads

    BatchLoader FDMReportsThe Finit Solutions Series

    BatchListing Asimplelistingofallofthebatchesthathavebeenrun

    atc oade epo ts

    Batch File Listing Details the actual filenames involved in all of BatchFileListing Detailstheactualfilenamesinvolvedinallofthebatches

    www.finitsolutions.com 38

  • Th Fi it S l ti S i

    Getting the most out of FDM: Fully Automating Your Data Loads

    BatchLoader FDMReportsThe Finit Solutions Series

    BatchErrorListing showserrorsinthebatchprocess(woulddisplaythesametypeoferrorsasamanualrun)

    atc oade epo ts

    p y yp )

    www.finitsolutions.com 39

  • Th Fi it S l ti S i

    Getting the most out of FDM: Fully Automating Your Data Loads

    BatchLoader RealSolutionsThe Finit Solutions Series

    WehavehadmanyclientsusetheFDMBatchLoader in many different ways

    atc oade ea So ut o s

    Loaderinmanydifferentways LoadingHistoricalData

    l l ExcelTemplates LightsoutautomationintoHyperionEnterprise Lightsoutautomationtopulldatafromsource

    systemsandloadthroughtoHFM

    www.finitsolutions.com 40

  • Finit Solutions Series

    FutureWebinarsandContactInfoInfo

    www.finitsolutions.com

  • Th Fi it S l ti S i

    Getting the most out of FDM: Fully Automating Your Data Loads

    UpcomingWebinarsThe Finit Solutions Series

    GettingtheMostoutofEPM:IntroductiontoFinancialCloseManagementandDisclosureManagement

    p g

    OnMay12,youwilllearnabouttwonewtoolsrecentlyreleasedbyOracleHyperion:FinancialCloseManagementandDisclosureManagement.Thesenewtoolsprovidefunctionalitythatstreamlineandprovidebetterinsightintothelastmileoftheclose;taskstypicallyperformedoutsidetheconsolidationsystemthatarerelatedtoitemssuchasexternalreporting,footnoting,andxbrltagging.Wewillreviewsomeofthemainfeaturesandfunctionalityinthesenewtools,includingtaskmanagement,documentlifecyclemanagement,financialcalendartracking,andaccountreconciliations.

    GettingtheMostoutofEPM:NewFeaturesandFunctionalityinFusionEdition11.1.2(TalleyRand)

    DateTBDinJunependingproductrelease.

    Toregister,gotowww.finitsolutions.com/Insights_Webcast.html

    www.finitsolutions.com 42

  • Th Fi it S l ti S i

    Getting the most out of FDM: Fully Automating Your Data Loads

    FinitContactsThe Finit Solutions Series

    Q ti ?Questions? [email protected]

    2168703657

    Emailusfora

    216 870 3657

    EdDeLise(VPofSales)

    d li @fi i l i

    copyoftheslidesor

    l k h d

    [email protected]

    6782963611

    [email protected]

    www.finitsolutions.com 43