Download - Finit solutions series_fdm_batch_loader_041410_final

The Finit Solutions Series

Getting the most out of FDM: Fully Automating Your DataFully Automating Your Data Loads

April 14 2010April 14, 2010

Presented by Jay Hampton

www.finitsolutions.com


About Finit Solutions


Th Fi it S l ti S i

Getting the most out of FDM: Fully Automating Your Data Loads

Finit IntroductionThe Finit Solutions Series

Finit Solutions specializes in consulting services in the Oracle Hyperion Enterprise Performance Management Solutions suite of products:

Financial Consolidation– Financial Management (HFM)

Hyperion Enterprise

Planning and Business Intelligence– Planning

Essbase– Hyperion Enterprise

Integration– Financial Data Quality Management

– Essbase

BI+ Reporting ToolsFinancial ReportingFinancial Data Quality Management

(FDM)

– Oracle Data Integrator (ODI)

– Data Integration Management (DIM)

– Financial Reporting

– Smartview

– Web Analysis

Essbase Excel Add ing g ( )

– Other (EPMA, ERPi, etc)– Essbase Excel Add‐in

www.finitsolutions.com‐ 3 ‐

Th Fi it S l ti S i


Finit’s HFM and FDM ExpertiseThe Finit Solutions Series

• Finit has one of the largest practices of HFM certified consultants on staff in the country. We have experience back to the early versions of

p

y p yHFM and have assisted clients with all aspects of HFM deployments from full lifecycle implementations to application optimization / redesign activitiesredesign activities.

•Finit has a long history with Hyperion FDM having started with the g y yp glegacy product, UpStream WebLink. Finit became UpStream Software’s first consulting partner in 2002. Collectively, Finit has designed and implemented UpStream / Hyperion FDM that havedesigned and implemented UpStream / Hyperion FDM that have sourced data from over 4,800 source systems and are used by over 5,000 end users.


Th Fi it S l ti S i


Finit’s Client ServiceThe Finit Solutions Series

W t k li t i i lWe take client service very seriously.

Our client service approach has led to 100% customer satisfaction for every Finit client f y

(119 and counting).


Th Fi it S l ti S i


Some Finit ClientsThe Finit Solutions Series

•


Th Fi it S l ti S i


About the PresenterThe Finit Solutions Series

Jay Hampton([email protected])

• Partner with Finit Solutions• More than 5 years of experience implementing Hyperion products• More than 5 years of experience implementing Hyperion products

– Hyperion Financial Data Quality Management (FDM)– Hyperion Enterprise– Hyperion Financial Management (HFM)

• Frequent presenter at Hyperion conferences• Serves as the FDM Domain Lead on the OAUG Hyperion Special Interest Group

(SIG)


Th Fi it S l ti S i


How to Ask a QuestionThe Finit Solutions Series

Q


Th Fi it S l ti S i


AgendaThe Finit Solutions Series

• What is FDM Batch Loader?

H d th B t h L d k?

g

• How does the Batch Loader work?– File Location and Naming Conventions

• AutoMap Correct Feature

• Running the Batch Loader ‐ Demonstration– Manual with Interface in Workbench

– Via a script and FDM Task Flow

i i d k– Via a script and FDM Task Manager

• FDM Batch Reports


• Real World FDM Batch Solutions


What is the FDM Batch Loader?


Th Fi it S l ti S i


What is FDM Batch Loader?The Finit Solutions Series

• The FDM Batch Loading process allows users to automate as much or as little of the FDM process as they requirep y q

• Automate some or all of the Import, Validate, Export and Check steps

• The FDM Batch Loader can be initiated in the following ways

– Manually via the Batch Loader Interface in the FDM Workbenchy

– Manually via an FDM Script / Task Flow in the FDM web interface

– Automatically via an FDM Script using the FDM Task Manager


Th Fi it S l ti S i


What is FDM Batch Loader?The Finit Solutions Series

• Gives you the ability to load same types of files as you would manually in FDMy

– Standard Text Files

– Multi‐Load Files (Excel or Text)

– FDM Excel Based Journals

• Auto‐Map Functionality

bili i ll ‘ d’ i i h l d– Ability to automatically map any ‘unmapped’ items in the load file

– These ‘unmapped’ accounts will be logged and can be reportedThese unmapped accounts will be logged and can be reported on


Th Fi it S l ti S i


What is FDM Batch LoaderThe Finit Solutions Series

• Full logging of completed batch processes along with logging of any errors that occur during thewith logging of any errors that occur during the batch process

Thi ll b i d i h B h R f– This can all be viewed in the Batch Reports from within FDM’s Reports Screen.

• Ability for “Lights Out” Processing– When combined with the FDM Task Manager, the Batch Loader can be set up to run automatically

– No user needs to log into FDM to begin the process or


execute any tasks

Th Fi it S l ti S i


Cost of FDM Batch LoaderThe Finit Solutions Series

• Batch Loader is a separately licensed component of FDM

• You already own Batch Loader if you purchased the• You already own Batch Loader if you purchased the ‘Adapter Suite’ which contains the adapters for Essbase, Strategic Finance, Tax Stream and Data MartStrategic Finance, Tax Stream and Data Mart

• If you only bought FDM with the HFM or Hyperion Enterprise adapters you do not yet own the Batch Loaderp p y y

• Please send a note to [email protected] with questions about Batch Loader licensing and whether you q g yhave already purchased it



How does the Batch Loader work?


Th Fi it S l ti S i


How does Batch Loader work?The Finit Solutions Series

• Two Main Components

d d l d b– Standard File Naming Convention – used by FDM to identify the Point of View for the file to b l d dbe loaded

– Standard File Location – used by FDM to know the location of the files to be processed


Th Fi it S l ti S i


File Naming ConventionThe Finit Solutions Series

g• Files to be loaded via the batch loader must be created with an

FDM specific file name formatp

• The file name is used by FDM to determine the point of view to process the file for (i.e. what location, period and category is

t i d i th fil )contained in the file)

• The file name is parsed into five different segments and can be delimited by (‘~’, ‘ ’, ‘@’)y ( , _ , @ )

• Sample Formatted File Name:

A1000~Texas~Actual~Jan‐2010~RR.txt


Th Fi it S l ti S i


File Naming ConventionThe Finit Solutions Series

g

A1000~Texas~Actual~Jan‐2010~RR.txt• What are the segments?• What are the segments?

– File ID (ex. A1000)— a free form field. This field can be used to control the order in which the batch files will load. It can also store variables (i.e. username date of run job # etc )username, date of run, job #, etc.).

– Location (ex. Texas) — FDM location name to be loaded

– Category (ex. Actual)— FDM category name

– Period (ex. Jan‐2010)— FDM period name

• Must match FDM Period

– Load Method (ex RR)— Load Method is a two‐character switch. ( )

• Character 1 = Method when importing into FDM Append/Replace (Valid values A or R)

• Character 2 = Method when exporting to Target Append/Replace (Valid


Character 2 Method when exporting to Target Append/Replace (Valid values R,M,A,etc.)

Th Fi it S l ti S i


Batch File LocationThe Finit Solutions Series

• All files to be loaded through the batch loader must be placed in the appropriate batch foldermust be placed in the appropriate batch folder – Standard batch files (one month, one location) need to be placed in the OpenBatch folderbe placed in the OpenBatch folder

– Multi‐Load files need to be placed

i th O B t hML f ldin the OpenBatchML folder

– Excel Based Journal Templates

d b l d hneed to be placed in the

OpenBatchML folder



Auto Map Correct


Th Fi it S l ti S i


Auto Map CorrectThe Finit Solutions Series

‐ Automap Correct will allow the FDM process to continue in the event a mapping error is

p

continue in the event a mapping error is encountered

‐ The system will look to a specified location to obtain a map in the event the original maps do not cover all accounts in the source file

‐ This will add that new map to the maps for this location for further instances of this source account


Th Fi it S l ti S i


Auto Map CorrectThe Finit Solutions Series

‐ To set up the suspense account a new location called “AutomapCorrect” must be added to the FDM

p

AutomapCorrect must be added to the FDM application

After adding this location a new map entry needs to be‐ After adding this location a new map entry needs to be made in the explicit map for each dimension‐ Source value for this mapping must be called AutoCorrectSource value for this mapping must be called AutoCorrect

‐ Target value can be any valid member for the dimension

‐ These mapping entries will be the basis for the autoThese mapping entries will be the basis for the auto mapping for any un‐mapped members from a batch load



Running the Batch Loader


Th Fi it S l ti S i


Batch Loader – Manual via ClientThe Finit Solutions Series

• In the FDM Workbench click on Tools Batch Processing to open the batch processing interface

• This will allow you toThis will allow you to “manually” configure the settings for an FDM batchsettings for an FDM batch and execute it


Th Fi it S l ti S i



• Below is the Batch Loader Interface in the Workbench


Th Fi it S l ti S i



• The following settings for the Batch Loader are set up in the interface and are outlined below

atc oade a ua a C e t

the interface and are outlined below

– Batch Type – Standard or Multi‐Load

– Process Level – Can process anywhere from Import Only to aProcess Level Can process anywhere from Import Only to a Full Process or a Consolidation Only

– Process Method – Serial or Parallel (If Parallel, can specify the number of processes to run)

– Load Balance Server – FDM Load Balance Server

File Name Delimiter The delimiter for the different– File Name Delimiter – The delimiter for the different components of the Batch File Name (‘~’, ‘_’, or ‘@’)

• Usually a Best Practice to use ‘~’ as FDM locations or categories may


y g ycontain an ‘_’

Th Fi it S l ti S i



• To process a file using the Manual Batch Loader

atc oade a ua a C e t

– First place a file in the OpenBatch folder

– Select the Parameters in the Interface

– Select Execute

• You will see the status of the job processing and• You will see the status of the job processing and will see when it is complete


Th Fi it S l ti S i


Batch Loader – Manual via WebThe Finit Solutions Series

• Batch Loader can also be run via the web by setting up an FDM Task Flow

atc oade a ua a eb

setting up an FDM Task Flow

• This allows users who do not have access to the kb h ( l h kb hWorkbench (only Power users have Workbench

access) the ability to run the batch loader script.


Th Fi it S l ti S i



• The Batch Loader interface also allows the easy creation of a Batch Script that will be used to run the

atc oade a ua a eb

creation of a Batch Script that will be used to run the Batch Process via an FDM Task Flow

• Simply set the parameters for how you would like theSimply set the parameters for how you would like the script to operate and select “Create Script”

• This will create a Custom Script that can be run to pinitialize the FDM Batch Process

• Just like other FDM scripts the Batch script can be p penhanced to perform additional tasks:

– Email Alerts

Addi i l E L i


– Additional Error Logging

Th Fi it S l ti S i



Steps to set up an FDM Batch Task Flow1 C C G l S i i h B h L d

atc oade a ua a eb

1. Create Custom General Script via the Batch Loader interface.

2 C t C t W b S i t2. Create Custom Web Script.

3. Copy the Custom General script that you created from the Batch Loader Interface to the CustomWeb Scriptthe Batch Loader Interface to the Custom Web Script.

4. Add item in Menu Maker (under Tools).

5 Cli k T k Fl t i t5. Click on Task Flows to see your script.

6. Click on the Task Flow to run it.


Th Fi it S l ti S i


Batch Loader – Task ManagerThe Finit Solutions Series

• Task Manager installs a Windows service that runs scheduled tasks (FDM scripts) at specified

atc oade as a age

scheduled tasks (FDM scripts) at specified intervals

k b h d l d dl d l• Tasks can be scheduled to run repeatedly, daily, weekly, or monthly

• Task Manager can be installed on any server that can access the FDM application (the Web server, the application server, or the data server where FDM data resides)


Th Fi it S l ti S i


Batch Loader – AutomaticThe Finit Solutions Series

• The Task Manager will run specified FDM scripts as certain intervals

atc oade uto at c

as certain intervals

• This allows the Batch Loader Scripts that we d k l hcreated to run via a Task Flow without any user

initiation


Th Fi it S l ti S i



Creating Tasks in the Task Manager1 O h T k M Thi i ll i ll d

atc oade uto at c

1. Open up the Task Manager. This is usually installed on the FDM Application server

2 Cli k T k N T k2. Click on Task New Task

3. Click on the General Tab and Enter in the following informationinformation

– Task Name – Any Name for the Task

– FDM Application – Select from available applicationsFDM Application Select from available applications

– Action Script – The Script that you wish to run (Any Custom General or Custom Web script)


– User Information

Th Fi it S l ti S i



atc oade uto at c


Th Fi it S l ti S i



Creating Tasks in the Task Manager (cont)4 Cli k h S h d l T b d h h f h

atc oade uto at c

4. Click on the Schedule Tab and choose how often the script should run

Frequency Repeat Weekly Monthly– Frequency – Repeat, Weekly, Monthly

– Repeat – This is only for repeat

– Schedule – If Weekly or Monthly, select scheduleSchedule If Weekly or Monthly, select schedule



Batch Loader Reports


Th Fi it S l ti S i


Batch Loader – FDM ReportsThe Finit Solutions Series

• There are several standard FDM reports that can be used to monitor and track the batch loading process

atc oade epo ts

used to monitor and track the batch loading process

• They are all listed in the Batch Reports Group– Batch Listing – A simple listing of all of the batches that haveBatch Listing A simple listing of all of the batches that have

been run– Batch File Listing – Details the actual filenames involved in all

of the batchesof the batches– Batch Error Listing – shows errors in the batch process

(would display the same type of errors as a manual run)– Batch Processing Status – Shows the details of a batch that is

currently processing– Batch Auto Map Changes – Will show the details of records


Batch Auto Map Changes Will show the details of records that have been mapped using the auto map feature

Th Fi it S l ti S i



• Batch Listing – A simple listing of all of the batches that have been run

atc oade epo ts

• Batch File Listing – Details the actual filenames involved in all of• Batch File Listing Details the actual filenames involved in all of the batches


Th Fi it S l ti S i



• Batch Error Listing – shows errors in the batch process (would display the same type of errors as a manual run)

atc oade epo ts

p y yp )


Th Fi it S l ti S i


Batch Loader – Real SolutionsThe Finit Solutions Series

• We have had many clients use the FDM Batch Loader in many different ways

atc oade ea So ut o s

Loader in many different ways– Loading Historical Data

l l– Excel Templates

– Lights out automation into Hyperion Enterprise

– Lights out automation to pull data from source systems and load through to HFM


Finit Solutions Series

Future Webinars and Contact InfoInfo


Th Fi it S l ti S i


Upcoming WebinarsThe Finit Solutions Series

Getting the Most out of EPM: Introduction to Financial Close Management and Disclosure Management

p g

On May 12, you will learn about two new tools recently released by Oracle Hyperion: Financial Close Management and Disclosure Management. These new tools provide functionality that streamline and provide better insight into the ‘last mile of the close’; tasks typically performed outside the consolidation system that are related to items such as external reporting, footnoting, and xbrl tagging. We will review some of the main features and functionality in these new tools, including task management, document life‐cycle management, financial calendar tracking, and account reconciliations .

Getting the Most out of EPM:New Features and Functionality in Fusion Edition 11.1.2 (TalleyRand)

Date TBD in June pending product release.

To register, go to www.finitsolutions.com/Insights_Webcast.html


Th Fi it S l ti S i


Finit ContactsThe Finit Solutions Series

Q ti ?Questions? Jay Hampton

[email protected]

216‐870‐3657

Email us for a

216 870 3657

Ed DeLise (VP of Sales)

d li @fi i l i

copy of the slides or

l k h d

[email protected]

678‐296‐3611

link to the [email protected]


Download - Finit solutions series_fdm_batch_loader_041410_final

Top Related