3.generic extraction

7/31/2019 3.Generic Extraction

http://slidepdf.com/reader/full/3generic-extraction 1/67

BUSINESS INTELLIGENCE

GENERIC EXTRACTION

CHAPTER – 4

EXTRACTIONS

It is mainly used for extracting the data form other Source Systems like

R/3 etc.

DataSource: Defines as extract structure and transfer structure fromsource system (like SAP R/3) and transfer structure from BW side.

ES -> What data to be extracted from source systemTS -> What data to be extracted from source system to BW. TS is a

group of fields which indicated how the data is coming from the source

system

BW R/3

L ESE

TS T TS

SAP – BW FLAT FILE

SAP R/3

SAP BW

1




GENERIC EXTRACTION

TYPES OF EXTRACTIONS

APPLICATION SPECIFIC CROSS APPLICATION

BW CONTENT CUSTOMER GENERICEXTRACTOR GENERATED EXTRACTOR

EXTRACTOR

FI LIS DB VIEWHR, CO FI-SL INFOSET

SAP CRM CO-PA FUNCTION

LO COCKPIT MODULE

APPLIACTION APPLICATION VARIOUS SAP

SPECIFIC SPECIFIC DB TABLESDB TABLES DB TABLES

BASICS DELTA METHOD ENHANCEMENTS

2




GENERIC EXTRACTION

GENERIC EXTRACTION

1. Why do you go for Generic extraction?

- When the data source is not readily available in the Business content- Even if the Business content data source is available and it is already

being used up. And if we want to simulate the same kind of extractor,we can go for generic extraction.2. The T-code for creating Generic Extraction is RSO2.

3. We can create 3 types of data sources using generic extraction- Transaction data

- Master data attribute- Text

4. We can generate generic datasource using the following- Table

- View

- Function module- Infoset Query

STEPS TO CREATE GENERIC EXTRATION: (MASTER DATA)

1. Go to T-Code SBIW otherwise go to T-Code RSO2.

3




GENERIC EXTRACTION

-> Select the radio button Master data Attribute, give name and click onCREATE

-> Select the Application Component by pressing F4 (depending up on

the table which we are extracted). It is just like infoarea.

-> Give the Master data table name like MARA etc.-> Give short, medium, long descriptions and click on SAVE.

4




GENERIC EXTRACTION

-> It shows 4 options like

- SELECTION - > What ever the fields we select here thosefields can appear at DATA SELECTION tab of INFOPACKAGE.

- HIDE -> What ever the fields we select here those fields

can’t be appear in BW side.- INVERSION -> This option is available for Key figures. It

takes –ve sign to the existing values.

- FIELD ONLY -> This option also available for Key figures. If

there is any Enhancement for a particular field at that time

this is enabled.So select whatever the fields we want as data selection and also to

transfer rules otherwise hide other fields and click on SAVE. Then itsays, “Data source has been saved successfully. “

(Here I selected some fields like MATNR, ERSDA, MATKL,MEINS)

5




GENERIC EXTRACTION

-> Then go to BW side -> Create all the Infoobjects that we want to

extract to BW system.-> Go to source system -> select R/3 to BW connection -> select your

application component which we selected while creating the genericdatasource and click on Replicate datasource.

6




GENERIC EXTRACTION

-> Select your datasource, which we are extracted and select Assigninfosource

7




GENERIC EXTRACTION

8




GENERIC EXTRACTION

9




GENERIC EXTRACTION

10




GENERIC EXTRACTION

When we are seeing in the monitor it shows error. It shows the errormessage like the following.

11

Error message when processing in the Business WarehouseDiagnosis

An error occurred in the SAP BW when processing the data. Theerror is

Documented in an error message.System response

The error message(s) was/were sent by:

UpdateProcedure

Check the error message (pushbutton below the text).Select the message in the message dialog box and select the

long text for further information.

Follow the instructions in the message.




GENERIC EXTRACTION

When we click on ERROR MESSAGE it shows the following.

First see in the DETAILS tab in monitor then go to PSA and see in which

places the error may occur.

12

Record 1: Value '00107 ' for characteristic YMATKL does nothave the right internal format

Record 1: YMATKL: Data record 1 ('000000000000000038 '):

Version '00107 ' is not valid

Record 4: Value '013 ' for characteristic YMATKL does nothave the right internal format

Record 4: YMATKL: Data record 4 ('000000000000000068 '):

Version '013 ' is not valid

LIKE THIS IT SHOWS.




GENERIC EXTRACTION

-> Go and see in the PSA also it shows like this if we select only errorrecords in PSA.

-> By seeing this error in PSA and error message in DETAILS tab, I

think that the variable YMATKL must start with a letter. So then go to

the Transfer rule for YMATKL and write the ROUTINE.

-> Click on change to infosource -> select transfer rule for YMATKL ->select ROUTINE ->Click on CREATE -> write the code and click on SAVE.

The code is as follows.

And again click on ACTIVATE.

13

DATA : NUM (20) TYPE C.

DATA : A TYPE C VALUE 'C'.

CONCATENATE A TRAN_STRUCTURE-MATKL INTONUM.

RESULT = NUM.




GENERIC EXTRACTION

-> And again SCHEDULE the infopackage. Then see the MONITOR.

***** THIS IS THE PROCESS OF LOADING THE DATA

USING FULL UPDATE *****

14




GENERIC EXTRACTION

ALE DELTA

Now see loading data using DELTA UPLOAD. For this upload, if we

change any data that changes will be effected in BW while schedulingthe DELTA update. For that also first we can INIT delta. Now see theprocedure of ALE DELTA. First go to MM02 (Change the material

management) and do some changes.

-> Select the MATERIAL by pressing F4

15




GENERIC EXTRACTION

-> Click on SELECT VIEWS and then select some views like BASIC

DATA1 etc.

16




GENERIC EXTRACTION

-> Modify the records from the fields, which we extracted already to BWside like BASIC UNIT OF MEASUREMENT, Material Group etc

17




GENERIC EXTRACTION

-> After all modifications are done click on SAVE.

18




GENERIC EXTRACTION

-> Go to RSO2 and select your data source for master data and click onCHANGE

Go to DATASOURCE menu tab and select ALE DELTA option.

19




GENERIC EXTRACTION

-> Then it asks the TABLE NAME and CHANGE DOC OBJECT.

-> Here TABLE NAME is the table, which we extracted already.-> And CHANGE DOC OBJECT is nothing but a field in that table. How

can we know that is the field that we are giving in the place of CHANGE

DOC OBJECT? [Go to SE11 and give the table name as TCDOB and clickon DISPLAY. Then click on CONTENTS.

20




GENERIC EXTRACTION

21




GENERIC EXTRACTION

-> Whatever the object shows here that can be taken here as CHANGEDOC OBJECT.

22




GENERIC EXTRACTION

-> Click on TRANSFER tab. Click on SAVE and again SAVE.

23




GENERIC EXTRACTION

24




GENERIC EXTRACTION

->Go to BW side and select the DATASOURCE and click on REPLICATEDATASOURCE again.

-> Go to Infosource and double click on your transfer rules and click onACTIVATE transfer rules

25




GENERIC EXTRACTION

-> Go to infopackage and SCHEDULE again by selecting the UPDATE as

INIT DELTA without data transfers.

26




GENERIC EXTRACTION

27




GENERIC EXTRACTION

-> It shows 1 from 1 record after init delta. That means that one recordis used for simulation means in order to enable delta we can run the init

delta option.

28




GENERIC EXTRACTION

-> After completion of init delta successfully come back again and see

now DELTA option is enabled. Select the DELTA option and again

SCHEDULE the infopackage.

29




GENERIC EXTRACTION

30




GENERIC EXTRACTION

31




GENERIC EXTRACTION

***** THIS IS THE ALE DELTA FOR GENERIC

EXTRATION FOR MASTER DATA *****

32




GENERIC EXTRACTION

GENERIC EXTRATION FOR TRANSATION DATA

1. Go to T-CODE SE11 and select the radio button TRANSACTION DATAand give the some technical name and click on CREATE button.

2. Give APLICATION COMPONENT, TABLE NAME and give Descriptions.

Then click on SAVE button.

33




GENERIC EXTRACTION

3. Select the fields like master data otherwise click on hide. For

transaction data KEY FIGURES and REFERENCE are compulsory.So select some key figures along with the reference values. And

then click on SAVE button.

34




GENERIC EXTRACTION

-> Go to BW side and Replicate your datasource by selecting the

application component, which we already assigned in R/3 side, in thesource system tab.

35




GENERIC EXTRACTION

-> Click on Assign infosource by the context menu of the your replicated

datasource

36




GENERIC EXTRACTION

-> Create the infosource as flexible updated

37




GENERIC EXTRACTION

-> Assign the transfer rules by selecting necessary infoobject related tothe object, which we extracted by clicking F4 for each and every

infoobject. And then click on ACTIVATE

-> Go to info provider and create infocube.

38




GENERIC EXTRACTION

39




GENERIC EXTRACTION

40




GENERIC EXTRACTION

41




GENERIC EXTRACTION

-> After the creating of infocube, create update rules for that infocube.

42




GENERIC EXTRACTION

43




GENERIC EXTRACTION

-> Go to infosource and select your datasource and create infopackage.

44




GENERIC EXTRACTION

45




GENERIC EXTRACTION

46




GENERIC EXTRACTION

47




GENERIC EXTRACTION

***** THIS IS THE WAY TO CREATE GENERIC EXTRACTIONUSING TRANSACTION DATA *****

48




GENERIC EXTRACTION

TRANSACTION DATA USING GENERIC DELTA

1. In order do this transaction data using generic delta, first go to the T-

CODE VA02 in order to change sales orders related to SD (VBAK etc).

Select the order by pressing F4 and do some changes that field may bethe field, which we extracted already, or the other filed, but the effect

can occur on the extracted fields.

2. Go to ORDER QUANTITY and change the value. Normally price and

quantity gets net value. So change ORDER QUANTITY value and thenclick on SAVE.

49




GENERIC EXTRACTION

50




GENERIC EXTRACTION

51




GENERIC EXTRACTION

-> Go to RSO2 select your datasource and click on CHANGE. Then selectGENERIC DELTA

-> Give the time field in Field Nm and select Time stamp, click on SAVE.

-> Click on SAVE and SAVE.

52




GENERIC EXTRACTION

53




GENERIC EXTRACTION

-> Go to BW side again replicated your datasource, ACTIVATE yourtransfer rules and SCHEDULE your infopackage.

54




GENERIC EXTRACTION

55




GENERIC EXTRACTION

56




GENERIC EXTRACTION

57




GENERIC EXTRACTION

-> After SCHEDULING the INIT DELTA, Then select the option DELTAUPDATE and SCHEDULE again.

58




GENERIC EXTRACTION

59




GENERIC EXTRACTION

THIS IS THE CREATING OF TRANSACTION DATAUSING GENERIC DELTA

60




GENERIC EXTRACTION

GENERIC DATASOURCE USING TEXTS

Till now we created GENERIC DATASOURCE using MASTER DATA andTRANSACTION DATA. Now see how to create GENERIC DATASOURCE

using TEXTS. For creating either MASTER DATA or TRANSACTION DATA

there are mainly 4 options to extract data. Those are- Table- View

- Function module- Infoset

While creating the TEXTS, including these 4 another option is availablei.e.,

- Domain

-> We know normally TEXT contains LANGUAGE and DESCRIPTION.So here also select the language and description and click on save and

upload that text datasource to BW side like MASTER DATA. Form hereonwards all steps are same. Nothing difference is there. We can upload

the data using DOMAIN also.

61




GENERIC EXTRACTION

GENERIC DATASOURCE

62




GENERIC EXTRACTION

Overview:

1. How many types of Exactions are there?

2. What is meant by Extraction?3. What is the T-CODE for creating GENERIC DATASOURCE?

4. Why do you go for GENERIC DATASOURCE?5. How many ways did you create Generic datasource?6. How many ways did you extract generic datasource?

7. What is the difference between creating GENERIC DATASOURCEusing VIEW and FUNCTION MODULE?

8. When do you go for creating VIEW and FUNCTION MODULE?

9. What is the importance of SELECTION, HIDE, INVERSION and FIELDONLY check boxes?

10. Did you create Generic Extraction? If yes tell me the scenario?11. Why do you go for ALE DELTA? And for which type of datasources

we are going for ALE DELTA?12. How do you find CHANGE DOC OBJECT field for master data?

13. In which T-CODE did you change the data for MATERIAL MASTER

DATA?14. What is the use of GENERIC DELTA? And when do you go for

GENERIC DELTA?15. What are the different ways of setting up the delta in generic

extraction for transaction data?

16. When you setup delta for generic datasource, where does data comefrom?

17. When you are setting up the delta in generic datasources, what arethe different images we can setup?

18. When I am setting up the delta for the generic datasource if I select

the update method a NEW ATATUS for changed records can I load thedata directly to the cube?

19. What is the difference between BUSINESS CONTENT DATASOURCESand GENERIC DATA SOURCE?

20. What is DATA SOURCE?

21. When does the Transfer structure at SAP R/3 side get generated?22. Steps to generate GENERIC EXTRACTION METHOD?

63




GENERIC EXTRACTION

ANSWERS:

1. Two types- Application Specific

- Cross Application

2. Extraction is nothing but loading up of the data from one sourcesystem to the other source system.3. RSO2

4. There are mainly two reasons for going GENERIC EXTRACTION.- When we don’t have any business content data source

readily available.- Even if a business content datasource is available, and it is

already being used up and if we want to simulated the samekind of datasource, we go for generic extraction.

5. Three ways.

- Transaction data- Master data

- Texts6. 4 ways

- Table

- View

- Function Module

- Infoset- Domain (for TEXTS datasources only).

7. In VIEW the EXTRACT STRUCTURE is automatically created, but in

FUNCTION MODULE we must created the EXTRACT STRUCTUREexplicitly.

8. If there is 1:1 relationships then go for creating VIEW and if there is1:M relationship go for creating FUNCTION MODULE.

9.- SELECTION - > What ever the fields we select here those

fields can appear at DATA SELECTION tab of INFOPACKAGE.- HIDE -> What ever the fields we select here those fields

can’t be appear in BW side.- INVERSION -> This option is available for Key figures. It

takes –ve sign to the existing values.- FIELD ONLY -> This option also available for Key figures. If

there is any Enhancement for a particular field at that timethis is enabled.

10. 1. FUNCTION MODULE

64




GENERIC EXTRACTION

To Extract Open deliveries: The datasource 2LIS_12_VAITM is

available as a part of business content extractor, all the delivery itemlevel information. So to extract only open deliveries we have built

generic datasource with function module. We used 3conditions to

identify an open delivery.• If delivery is consider to bean open delivery, if it has no PGI (post

goods issue) document.

• If delivery is consider to bean open delivery, if it has PGI (postgoods issue) documents, and if this PGI document doesn’t contain

billing document.

• If delivery is consider to bean open delivery, if it has PGI (postgoods issue) documents, and if this PGI documents contain billing

document, and this billing document is not yet to be posted.

We have a database table LIPS, which contains all delivery item level

information. So we collect all the records from this LIPS table and crosscheck whether give delivery is open delivery or not. If it is open deliveryinsert the record into E_T_DATA (internal table).

LIPS – Delivery item level information.VBFA – sales Document Flow

VBRP – Billing Document Item data.

2. VIEWIn SAP R/3 3.1v there is no business content datasource to extract

FI_AR information so we went about building the generic datasource

using the view built on two tables BSID and BSAD.BSID – Accounting: Secondary index for customers

BSAD - Accounting: Secondary index for customers (cleared items)Some common fields in these two tables are COMPANY CODE,

CUSTOMER NUMBE etc).

11. When we are generating MASTER DATA delta we go for ALE delta. If there is any changes in MASTER DATA those effects can also occurs in

BW side.12. Go to SE11 – Data Dictionary and see the table TCDOB by selecting

corresponding table.

13. MM01 – creation of Material master dataMM02 – Change

MM03 – Display

14. When we are generating TRANSACTION DATA for delta we go for

GENERIC delta. If there is any changes in TRANSACTION DATA thoseeffects can also occurs in BW side.

VA01 – Creation of SALES and DISTRIBUTION

65




GENERIC EXTRACTION

VA02 – changeVA03 – Display

15. There are mainly 3 options available for generic delta. Those are

• Calday – if we setup delta on base of calday we can run delta

only once per day that to at the end of the clock to minimize themissing of delta records.

• Numeric pointer – This type of delta is suitable only when we

are extracting data from a table which supports only creation of new records, but not change of exiting records

• Time stamp – Using timestamp we can run delta multiple times

per day but we need to use the safety lower limit and safetyupper limit with minimum of 5 minutes.

16. RSA7 (DELTA QUEUE)

17. We can setup 2 types of images,-

New status for changed records- Additive delta

18. NO. If the update type is setup to NEW STATUS for changed records

then it becomes mandatory for us to load data into ODS and then ODSto CUBE.

19. In the case of business content datasource the datasource is ready

madely available in delivered version. In order to use it we have toinstall that particular datasource to create a copy of the datasource in

66




GENERIC EXTRACTION

active version by using RSA5 t-code, select the data source and click ontransfer data source. In case of generic datasource we are creating our

own datasources. We prefer business content data sources with specificto performance.

20. Datasource defined ES and TS at source system and TS at BW

system.21. When you activate transfer rules in BW, it creates a transfer

structure at SAP R/3 side.22. Go to RSO2 -> selected the type of extractor to extract the data

from R/3 to BW- > click on create -> select Application Component

based on which type of data we are extracting -> give the name fromwhich we are extracting the data like table/view, function module,

infoset etc. -> give short, medium, long descriptions and click on save-> select the field here and again click on SAVE-> go to BW side

replicate your datasource based on the type of application component to

which you are extracted.-> Assign transfer rules and activate-> createcube and updated rules -> go to source system and create infopackage

and schedule the infopackage.

GENERIC DATASOURCE

3.generic extraction

Documents