finit solutions series_fdm_batch_loader_041410_final

of 43 /43
The Finit Solutions Series Getting the most out of FDM: Fully Automating Your Data Fully Automating Your Data Loads April 14 2010 April 14, 2010 Presented by Jay Hampton www.finitsolutions.com

Upload: finitsolutions

Post on 19-Jul-2015

81 views

Category:

Technology


2 download

TRANSCRIPT

Page 1: Finit solutions series_fdm_batch_loader_041410_final

The Finit Solutions Series

Getting the most out of FDM: Fully Automating Your DataFully Automating Your Data Loads

April 14 2010April 14, 2010

Presented by Jay Hampton

www.finitsolutions.com

Page 2: Finit solutions series_fdm_batch_loader_041410_final

The Finit Solutions Series

About Finit Solutions

www.finitsolutions.com

Page 3: Finit solutions series_fdm_batch_loader_041410_final

Th Fi it S l ti S i

Getting the most out of FDM: Fully Automating Your Data Loads

Finit IntroductionThe Finit Solutions Series

Finit Solutions specializes in consulting services in the Oracle Hyperion Enterprise Performance Management Solutions suite of products:

Financial Consolidation– Financial Management (HFM)

Hyperion Enterprise

Planning and Business Intelligence– Planning

Essbase– Hyperion Enterprise

Integration– Financial Data Quality Management

– Essbase

BI+ Reporting ToolsFinancial ReportingFinancial Data Quality Management 

(FDM)

– Oracle Data Integrator (ODI)

– Data Integration Management (DIM)

– Financial Reporting

– Smartview

– Web Analysis

Essbase Excel Add ing g ( )

– Other (EPMA, ERPi, etc)– Essbase Excel Add‐in

www.finitsolutions.com‐ 3 ‐

Page 4: Finit solutions series_fdm_batch_loader_041410_final

Th Fi it S l ti S i

Getting the most out of FDM: Fully Automating Your Data Loads

Finit’s HFM and FDM ExpertiseThe Finit Solutions Series

• Finit has one of the largest practices of HFM certified consultants on staff in the country.  We have experience back to the early versions of 

p

y p yHFM and have assisted clients with all aspects of HFM deployments from full lifecycle implementations to application optimization / redesign activitiesredesign activities.  

•Finit has a long history with Hyperion FDM having started with the g y yp glegacy product, UpStream WebLink.  Finit became UpStream Software’s first consulting partner in 2002.  Collectively, Finit has designed and implemented UpStream / Hyperion FDM that havedesigned and implemented UpStream / Hyperion FDM that have sourced data from over 4,800 source systems and are used by over 5,000 end users.  

www.finitsolutions.com‐ 4 ‐

Page 5: Finit solutions series_fdm_batch_loader_041410_final

Th Fi it S l ti S i

Getting the most out of FDM: Fully Automating Your Data Loads

Finit’s Client ServiceThe Finit Solutions Series

W t k li t i i lWe take client service very seriously.

Our client service approach has led to 100% customer satisfaction for every Finit client f y

(119 and counting).

www.finitsolutions.com‐ 5 ‐

Page 6: Finit solutions series_fdm_batch_loader_041410_final

Th Fi it S l ti S i

Getting the most out of FDM: Fully Automating Your Data Loads

Some Finit ClientsThe Finit Solutions Series

www.finitsolutions.com‐ 6 ‐

Page 7: Finit solutions series_fdm_batch_loader_041410_final

Th Fi it S l ti S i

Getting the most out of FDM: Fully Automating Your Data Loads

About the PresenterThe Finit Solutions Series

Jay Hampton([email protected])

• Partner with Finit Solutions• More than 5 years of experience implementing Hyperion products• More than 5 years of experience implementing Hyperion products

– Hyperion Financial Data Quality Management (FDM)– Hyperion Enterprise– Hyperion Financial Management (HFM)

• Frequent presenter at Hyperion conferences• Serves as the FDM Domain Lead on the OAUG Hyperion Special Interest Group 

(SIG)

www.finitsolutions.com‐ 7 ‐

Page 8: Finit solutions series_fdm_batch_loader_041410_final

Th Fi it S l ti S i

Getting the most out of FDM: Fully Automating Your Data Loads

How to Ask a QuestionThe Finit Solutions Series

Q

www.finitsolutions.com‐ 8 ‐

Page 9: Finit solutions series_fdm_batch_loader_041410_final

Th Fi it S l ti S i

Getting the most out of FDM: Fully Automating Your Data Loads

AgendaThe Finit Solutions Series

• What is FDM Batch Loader?

H d th B t h L d k?

g

• How does the Batch Loader work?– File Location and Naming Conventions

• AutoMap Correct Feature

• Running the Batch Loader ‐ Demonstration– Manual with Interface in Workbench

– Via a script and FDM Task Flow

i i d k– Via a script and FDM Task Manager

• FDM Batch Reports

www.finitsolutions.com‐ 9 ‐

• Real World FDM Batch Solutions

Page 10: Finit solutions series_fdm_batch_loader_041410_final

The Finit Solutions Series

What is the FDM Batch Loader?

www.finitsolutions.com

Page 11: Finit solutions series_fdm_batch_loader_041410_final

Th Fi it S l ti S i

Getting the most out of FDM: Fully Automating Your Data Loads

What is FDM Batch Loader?The Finit Solutions Series

• The FDM Batch Loading process allows users to automate as much or as little of the FDM process as they requirep y q

• Automate some or all of the Import, Validate, Export and Check steps 

• The FDM Batch Loader can be initiated in the following ways

– Manually via the Batch Loader Interface in the FDM Workbenchy

– Manually via an FDM Script / Task Flow in the FDM web interface

– Automatically via an FDM Script using the FDM Task Manager

www.finitsolutions.com‐ 11 ‐

Page 12: Finit solutions series_fdm_batch_loader_041410_final

Th Fi it S l ti S i

Getting the most out of FDM: Fully Automating Your Data Loads

What is FDM Batch Loader?The Finit Solutions Series

• Gives you the ability to load same types of files as you would manually in FDMy

– Standard Text Files

– Multi‐Load Files (Excel or Text)

– FDM Excel Based Journals

• Auto‐Map Functionality

bili i ll ‘ d’ i i h l d– Ability to automatically map any ‘unmapped’ items in the load file

– These ‘unmapped’ accounts will be logged and can be reportedThese  unmapped  accounts will be logged and can be reported on

www.finitsolutions.com‐ 12 ‐

Page 13: Finit solutions series_fdm_batch_loader_041410_final

Th Fi it S l ti S i

Getting the most out of FDM: Fully Automating Your Data Loads

What is FDM Batch LoaderThe Finit Solutions Series

• Full logging of completed batch processes along with logging of any errors that occur during thewith logging of any errors that occur during the batch process 

Thi ll b i d i h B h R f– This can all be viewed in the Batch Reports from within FDM’s Reports Screen.

• Ability for “Lights Out” Processing– When combined with the FDM Task Manager, the Batch Loader can be set up to run automatically

– No user needs to log into FDM to begin the process or 

www.finitsolutions.com‐ 13 ‐

execute any tasks

Page 14: Finit solutions series_fdm_batch_loader_041410_final

Th Fi it S l ti S i

Getting the most out of FDM: Fully Automating Your Data Loads

Cost of FDM Batch LoaderThe Finit Solutions Series

• Batch Loader is a separately licensed component of FDM

• You already own Batch Loader if you purchased the• You already own Batch Loader if you purchased the ‘Adapter Suite’ which contains the adapters for Essbase, Strategic Finance, Tax Stream and Data MartStrategic Finance, Tax Stream and Data Mart

• If you only bought FDM with the HFM or Hyperion Enterprise adapters you do not yet own the Batch Loaderp p y y

• Please send a note to [email protected] with questions about Batch Loader licensing and whether you q g yhave already purchased it

www.finitsolutions.com‐ 14 ‐

Page 15: Finit solutions series_fdm_batch_loader_041410_final

The Finit Solutions Series

How does the Batch Loader work?

www.finitsolutions.com

Page 16: Finit solutions series_fdm_batch_loader_041410_final

Th Fi it S l ti S i

Getting the most out of FDM: Fully Automating Your Data Loads

How does Batch Loader work?The Finit Solutions Series

• Two Main Components

d d l d b– Standard File Naming Convention – used by FDM to identify the Point of View for the file to b l d dbe loaded

– Standard File Location – used by FDM to know the location of the files to be processed

www.finitsolutions.com‐ 16 ‐

Page 17: Finit solutions series_fdm_batch_loader_041410_final

Th Fi it S l ti S i

Getting the most out of FDM: Fully Automating Your Data Loads

File Naming ConventionThe Finit Solutions Series

g• Files to be loaded via the batch loader must be created with an 

FDM specific file name formatp

• The file name is used by FDM to determine the point of view to process the file for (i.e. what location, period and category is 

t i d i th fil )contained in the file)

• The file name is parsed into five different segments and can be delimited by (‘~’, ‘ ’, ‘@’)y ( , _ , @ )

• Sample Formatted File Name: 

A1000~Texas~Actual~Jan‐2010~RR.txt

www.finitsolutions.com‐ 17 ‐

Page 18: Finit solutions series_fdm_batch_loader_041410_final

Th Fi it S l ti S i

Getting the most out of FDM: Fully Automating Your Data Loads

File Naming ConventionThe Finit Solutions Series

g

A1000~Texas~Actual~Jan‐2010~RR.txt• What are the segments?• What are the segments?

– File ID (ex. A1000)— a free form field. This field can be used to control the order in which the batch files will load.  It can also store variables (i.e. username date of run job # etc )username, date of run, job #, etc.).

– Location (ex. Texas) — FDM location name to be loaded

– Category (ex. Actual)— FDM category name

– Period (ex. Jan‐2010)— FDM period name

• Must match FDM Period

– Load Method (ex RR)— Load Method is a two‐character switch. ( )

• Character 1 = Method when importing into FDM Append/Replace (Valid values A or R)

• Character 2 = Method when exporting to Target Append/Replace (Valid

www.finitsolutions.com‐ 18 ‐

Character 2   Method when exporting to Target Append/Replace (Valid values R,M,A,etc.)

Page 19: Finit solutions series_fdm_batch_loader_041410_final

Th Fi it S l ti S i

Getting the most out of FDM: Fully Automating Your Data Loads

Batch File LocationThe Finit Solutions Series

• All files to be loaded through the batch loader must be placed in the appropriate batch foldermust be placed in the appropriate batch folder – Standard batch files (one month, one location) need to be placed in the OpenBatch folderbe placed in the OpenBatch folder

– Multi‐Load files need to be placed 

i th O B t hML f ldin the OpenBatchML folder

– Excel Based Journal Templates

d b l d hneed to be placed in the 

OpenBatchML folder

www.finitsolutions.com‐ 19 ‐

Page 20: Finit solutions series_fdm_batch_loader_041410_final

The Finit Solutions Series

Auto Map Correct

www.finitsolutions.com

Page 21: Finit solutions series_fdm_batch_loader_041410_final

Th Fi it S l ti S i

Getting the most out of FDM: Fully Automating Your Data Loads

Auto Map CorrectThe Finit Solutions Series

‐ Automap Correct will allow the FDM process to continue in the event a mapping error is

p

continue in the event a mapping error is encountered  

‐ The system will look to a specified location to obtain a map in the event the original maps do not cover all accounts in the source file

‐ This will add that new map to the maps for this location for further instances of this source account

www.finitsolutions.com‐ 21 ‐

Page 22: Finit solutions series_fdm_batch_loader_041410_final

Th Fi it S l ti S i

Getting the most out of FDM: Fully Automating Your Data Loads

Auto Map CorrectThe Finit Solutions Series

‐ To set up the suspense account a new location called “AutomapCorrect” must be added to the FDM

p

AutomapCorrect  must be added to the FDM application

After adding this location a new map entry needs to be‐ After adding this location a new map entry needs to be made in the explicit map for each dimension‐ Source value for this mapping must be called AutoCorrectSource value for this mapping must be called AutoCorrect 

‐ Target value can be any valid member for the dimension  

‐ These mapping entries will be the basis for the autoThese mapping entries will be the basis for the auto mapping for any un‐mapped members from a batch load

www.finitsolutions.com‐ 22 ‐

Page 23: Finit solutions series_fdm_batch_loader_041410_final

The Finit Solutions Series

Running the Batch Loader

www.finitsolutions.com

Page 24: Finit solutions series_fdm_batch_loader_041410_final

Th Fi it S l ti S i

Getting the most out of FDM: Fully Automating Your Data Loads

Batch Loader – Manual via ClientThe Finit Solutions Series

• In the FDM Workbench click on Tools  Batch Processing to open the batch processing interface

• This will allow you toThis will allow you to “manually” configure the settings for an FDM batchsettings for an FDM batch and execute it

www.finitsolutions.com‐ 24 ‐

Page 25: Finit solutions series_fdm_batch_loader_041410_final

Th Fi it S l ti S i

Getting the most out of FDM: Fully Automating Your Data Loads

Batch Loader – Manual via ClientThe Finit Solutions Series

• Below is the Batch Loader Interface in the Workbench

www.finitsolutions.com‐ 25 ‐

Page 26: Finit solutions series_fdm_batch_loader_041410_final

Th Fi it S l ti S i

Getting the most out of FDM: Fully Automating Your Data Loads

Batch Loader – Manual via ClientThe Finit Solutions Series

• The following settings for the Batch Loader are set up in the interface and are outlined below

atc oade a ua a C e t

the interface and are outlined below

– Batch Type – Standard or Multi‐Load

– Process Level – Can process anywhere from Import Only to aProcess Level Can process anywhere from Import Only to a Full Process or a Consolidation Only

– Process Method – Serial or Parallel (If Parallel, can specify the number of processes to run)

– Load Balance Server – FDM Load Balance Server

File Name Delimiter The delimiter for the different– File Name Delimiter – The delimiter for the different components of the Batch File Name (‘~’, ‘_’, or ‘@’) 

• Usually a Best Practice to use ‘~’ as FDM locations or categories may 

www.finitsolutions.com‐ 26 ‐

y g ycontain an ‘_’ 

Page 27: Finit solutions series_fdm_batch_loader_041410_final

Th Fi it S l ti S i

Getting the most out of FDM: Fully Automating Your Data Loads

Batch Loader – Manual via ClientThe Finit Solutions Series

• To process a file using the Manual Batch Loader

atc oade a ua a C e t

– First place a file in the OpenBatch folder

– Select the Parameters in the Interface

– Select Execute  

• You will see the status of the job processing and• You will see the status of the job processing and will see when it is complete

www.finitsolutions.com‐ 27 ‐

Page 28: Finit solutions series_fdm_batch_loader_041410_final

Th Fi it S l ti S i

Getting the most out of FDM: Fully Automating Your Data Loads

Batch Loader – Manual via WebThe Finit Solutions Series

• Batch Loader can also be run via the web by setting up an FDM Task Flow

atc oade a ua a eb

setting up an FDM Task Flow

• This allows users who do not have access to the kb h ( l h kb hWorkbench (only Power users have Workbench 

access) the ability to run the batch loader script.

www.finitsolutions.com‐ 28 ‐

Page 29: Finit solutions series_fdm_batch_loader_041410_final

Th Fi it S l ti S i

Getting the most out of FDM: Fully Automating Your Data Loads

Batch Loader – Manual via WebThe Finit Solutions Series

• The Batch Loader interface also allows the easy creation of a Batch Script that will be used to run the

atc oade a ua a eb

creation of a Batch Script that will be used to run the Batch Process via an FDM Task Flow

• Simply set the parameters for how you would like theSimply set the parameters for how you would like the script to operate and select “Create Script”

• This will create a Custom Script that can be run to pinitialize the FDM Batch Process

• Just like other FDM scripts the Batch script can be p penhanced to perform additional tasks:

– Email Alerts

Addi i l E L i

www.finitsolutions.com‐ 29 ‐

– Additional Error Logging

Page 30: Finit solutions series_fdm_batch_loader_041410_final

Th Fi it S l ti S i

Getting the most out of FDM: Fully Automating Your Data Loads

Batch Loader – Manual via WebThe Finit Solutions Series

Steps to set up an FDM Batch Task Flow1 C C G l S i i h B h L d

atc oade a ua a eb

1. Create Custom General Script via the Batch Loader interface.

2 C t C t W b S i t2. Create Custom Web Script.

3. Copy the Custom General script that you created from the Batch Loader Interface to the CustomWeb Scriptthe Batch Loader Interface to the Custom Web Script.

4. Add item in Menu Maker (under Tools).

5 Cli k T k Fl t i t5. Click on Task Flows to see your script.

6. Click on the Task Flow to run it.

www.finitsolutions.com‐ 30 ‐

Page 31: Finit solutions series_fdm_batch_loader_041410_final

Th Fi it S l ti S i

Getting the most out of FDM: Fully Automating Your Data Loads

Batch Loader – Task ManagerThe Finit Solutions Series

• Task Manager installs a Windows service that runs scheduled tasks (FDM scripts) at specified

atc oade as a age

scheduled tasks (FDM scripts) at specified intervals

k b h d l d dl d l• Tasks can be scheduled to run repeatedly, daily, weekly, or monthly

• Task Manager can be installed on any server that can access the FDM application (the Web server, the application server, or the data server where FDM data resides)

www.finitsolutions.com‐ 31 ‐

Page 32: Finit solutions series_fdm_batch_loader_041410_final

Th Fi it S l ti S i

Getting the most out of FDM: Fully Automating Your Data Loads

Batch Loader – AutomaticThe Finit Solutions Series

• The Task Manager will run specified FDM scripts as certain intervals

atc oade uto at c

as certain intervals 

• This allows the Batch Loader Scripts that we d k l hcreated to run via a Task Flow without any user 

initiation

www.finitsolutions.com‐ 32 ‐

Page 33: Finit solutions series_fdm_batch_loader_041410_final

Th Fi it S l ti S i

Getting the most out of FDM: Fully Automating Your Data Loads

Batch Loader – AutomaticThe Finit Solutions Series

Creating Tasks in the Task Manager1 O h T k M Thi i ll i ll d

atc oade uto at c

1. Open up the Task Manager.  This is usually installed on the FDM Application server

2 Cli k T k N T k2. Click on Task  New Task

3. Click on the General Tab and Enter in the following informationinformation

– Task Name – Any Name for the Task

– FDM Application – Select from available applicationsFDM Application Select from available applications

– Action Script – The Script that you wish to run (Any Custom General or Custom Web script)

www.finitsolutions.com‐ 33 ‐

– User Information

Page 34: Finit solutions series_fdm_batch_loader_041410_final

Th Fi it S l ti S i

Getting the most out of FDM: Fully Automating Your Data Loads

Batch Loader – AutomaticThe Finit Solutions Series

atc oade uto at c

www.finitsolutions.com‐ 34 ‐

Page 35: Finit solutions series_fdm_batch_loader_041410_final

Th Fi it S l ti S i

Getting the most out of FDM: Fully Automating Your Data Loads

Batch Loader – AutomaticThe Finit Solutions Series

Creating Tasks in the Task Manager (cont)4 Cli k h S h d l T b d h h f h

atc oade uto at c

4. Click on the Schedule Tab and choose how often the script should run

Frequency Repeat Weekly Monthly– Frequency – Repeat, Weekly, Monthly

– Repeat – This is only for repeat

– Schedule – If Weekly or Monthly, select scheduleSchedule  If Weekly or Monthly, select schedule

www.finitsolutions.com‐ 35 ‐

Page 36: Finit solutions series_fdm_batch_loader_041410_final

The Finit Solutions Series

Batch Loader Reports

www.finitsolutions.com

Page 37: Finit solutions series_fdm_batch_loader_041410_final

Th Fi it S l ti S i

Getting the most out of FDM: Fully Automating Your Data Loads

Batch Loader – FDM ReportsThe Finit Solutions Series

• There are several standard FDM reports that can be used to monitor and track the batch loading process

atc oade epo ts

used to monitor and track the batch loading process

• They are all listed in the Batch Reports Group– Batch Listing – A simple listing of all of the batches that haveBatch Listing  A simple listing of all of the batches that have 

been run– Batch File Listing – Details the actual filenames involved in all 

of the batchesof the batches– Batch Error Listing – shows errors in the batch process 

(would display the same type of errors as a manual run)– Batch Processing Status – Shows the details of a batch that is 

currently processing– Batch Auto Map Changes – Will show the details of records

www.finitsolutions.com‐ 37 ‐

Batch Auto Map Changes Will show the details of records that have been mapped using the auto map feature 

Page 38: Finit solutions series_fdm_batch_loader_041410_final

Th Fi it S l ti S i

Getting the most out of FDM: Fully Automating Your Data Loads

Batch Loader – FDM ReportsThe Finit Solutions Series

• Batch Listing – A simple listing of all of the batches that have been run

atc oade epo ts

• Batch File Listing – Details the actual filenames involved in all of• Batch File Listing Details the actual filenames involved in all of the batches

www.finitsolutions.com‐ 38 ‐

Page 39: Finit solutions series_fdm_batch_loader_041410_final

Th Fi it S l ti S i

Getting the most out of FDM: Fully Automating Your Data Loads

Batch Loader – FDM ReportsThe Finit Solutions Series

• Batch Error Listing – shows errors in the batch process (would display the same type of errors as a manual run)

atc oade epo ts

p y yp )

www.finitsolutions.com‐ 39 ‐

Page 40: Finit solutions series_fdm_batch_loader_041410_final

Th Fi it S l ti S i

Getting the most out of FDM: Fully Automating Your Data Loads

Batch Loader – Real SolutionsThe Finit Solutions Series

• We have had many clients use the FDM Batch Loader in many different ways

atc oade ea So ut o s

Loader in many different ways– Loading Historical Data

l l– Excel Templates

– Lights out automation into Hyperion Enterprise

– Lights out automation to pull data from source systems and load through to HFM

www.finitsolutions.com‐ 40 ‐

Page 41: Finit solutions series_fdm_batch_loader_041410_final

Finit Solutions Series

Future Webinars and Contact InfoInfo

www.finitsolutions.com

Page 42: Finit solutions series_fdm_batch_loader_041410_final

Th Fi it S l ti S i

Getting the most out of FDM: Fully Automating Your Data Loads

Upcoming WebinarsThe Finit Solutions Series

Getting the Most out of EPM:  Introduction to Financial Close Management and Disclosure Management

p g

On May 12, you will learn about two new tools recently released by Oracle Hyperion:  Financial Close Management and Disclosure Management.  These new tools provide functionality that streamline and provide better insight into the ‘last mile of the close’; tasks typically performed outside the consolidation system that are related to items such as external reporting, footnoting, and xbrl tagging.  We will review some of the main features and functionality in these new tools, including task management, document life‐cycle management, financial calendar tracking, and account reconciliations .

Getting the Most out of EPM:New Features and Functionality in Fusion Edition 11.1.2 (TalleyRand)

Date TBD in June pending product release.  

To register, go to www.finitsolutions.com/Insights_Webcast.html

www.finitsolutions.com‐ 42 ‐

Page 43: Finit solutions series_fdm_batch_loader_041410_final

Th Fi it S l ti S i

Getting the most out of FDM: Fully Automating Your Data Loads

Finit ContactsThe Finit Solutions Series

Q ti ?Questions? Jay Hampton

[email protected]

216‐870‐3657

Email us for a

216 870 3657

Ed DeLise (VP of Sales)

d li @fi i l i

copy of the slides or

l k h d

[email protected]

678‐296‐3611

link to the [email protected]

www.finitsolutions.com‐ 43 ‐