business objects calculation engine changes & regression testing
TRANSCRIPT
![Page 1: Business Objects calculation engine changes & regression testing](https://reader035.vdocuments.net/reader035/viewer/2022070511/58a14a621a28abf8068b6c4d/html5/thumbnails/1.jpg)
Track Calculation Engine Changes & Regressions in SAP BusinessObjects
Bruno Masek, VP, GB&SMITHAmy Betten, Director of Sales, GB&SMITH
![Page 2: Business Objects calculation engine changes & regression testing](https://reader035.vdocuments.net/reader035/viewer/2022070511/58a14a621a28abf8068b6c4d/html5/thumbnails/2.jpg)
• How do you track calculation engine changes? Alt+Tab ? Print Reports and put on top of each other 2 screens Asking Business Or no checking
STATE OF THE ART?
![Page 3: Business Objects calculation engine changes & regression testing](https://reader035.vdocuments.net/reader035/viewer/2022070511/58a14a621a28abf8068b6c4d/html5/thumbnails/3.jpg)
REGRESSION TESTING
WHEN?• Migration• Service Pack / Patch• Univers Update (UNV —> UNX)• ETL / Data-warehouse changes• Etc
![Page 4: Business Objects calculation engine changes & regression testing](https://reader035.vdocuments.net/reader035/viewer/2022070511/58a14a621a28abf8068b6c4d/html5/thumbnails/4.jpg)
3.1 Webi 4.2 Webi
![Page 5: Business Objects calculation engine changes & regression testing](https://reader035.vdocuments.net/reader035/viewer/2022070511/58a14a621a28abf8068b6c4d/html5/thumbnails/5.jpg)
3.1 Deski 4.2 Webi
![Page 6: Business Objects calculation engine changes & regression testing](https://reader035.vdocuments.net/reader035/viewer/2022070511/58a14a621a28abf8068b6c4d/html5/thumbnails/6.jpg)
4.1 SP74.1 SP5
![Page 7: Business Objects calculation engine changes & regression testing](https://reader035.vdocuments.net/reader035/viewer/2022070511/58a14a621a28abf8068b6c4d/html5/thumbnails/7.jpg)
ROI
• In house checking => Safety• No more manual checking • Automated and Scheduled process • Can be used by Business, QA & IT
ROI
![Page 8: Business Objects calculation engine changes & regression testing](https://reader035.vdocuments.net/reader035/viewer/2022070511/58a14a621a28abf8068b6c4d/html5/thumbnails/8.jpg)
USE CASE
While POC, a service pack was implemented 4.1 SP4 to 4.1 SP6. SP6 bugs + regressions were found due to Sybase DB upgrade.Upgrade was stopped, until Bind checked all reports for calculation engine changes/regressions & all issues fixed.Risk management was included in the loop/process and permanent automated regression testing became mandatory.
BI4.1 SP6 and Sybase upgrade
CENTRAL BANK
![Page 9: Business Objects calculation engine changes & regression testing](https://reader035.vdocuments.net/reader035/viewer/2022070511/58a14a621a28abf8068b6c4d/html5/thumbnails/9.jpg)
USE CASE
While POC, administrator ran the automated regression tool live on a few financial reports that had been checked by consultants. Admin found on some reports with data coming from same database : $1Billion margin in 3.1 and $1.2Billion in 4.1. Customer estimated 40+hours were needed to check certain reports each quarter due to service packs.
BI4.1 Quality check
REAL-ESTATE COMPANY
![Page 10: Business Objects calculation engine changes & regression testing](https://reader035.vdocuments.net/reader035/viewer/2022070511/58a14a621a28abf8068b6c4d/html5/thumbnails/10.jpg)
USE CASE
During a migration with very tight budget, City of Chicago implemented automated calculation engine/regression testing after report clean-up and conversion. As a result $200,000 were saved and regressions were found even on reports 100% converted.
Migration 3.1 to 4.2
CITY OF CHICAGO
![Page 11: Business Objects calculation engine changes & regression testing](https://reader035.vdocuments.net/reader035/viewer/2022070511/58a14a621a28abf8068b6c4d/html5/thumbnails/11.jpg)
USE CASE
500 reports (Webi-Deski-Crytal) complex reports needed to be checked. 250 man days were needed with the Alt+tab method. Automated process was implemented taking 15 days and finding 5% Calculation engine changes/regression.
Quality check of 500 reports
INSURANCE COMPANY
![Page 12: Business Objects calculation engine changes & regression testing](https://reader035.vdocuments.net/reader035/viewer/2022070511/58a14a621a28abf8068b6c4d/html5/thumbnails/12.jpg)
USE CASE
One of the largest company in the world. 10% Regressions found.
4.1 to 4.2 Migration
LARGE OIL & GAS COMPANY
![Page 13: Business Objects calculation engine changes & regression testing](https://reader035.vdocuments.net/reader035/viewer/2022070511/58a14a621a28abf8068b6c4d/html5/thumbnails/13.jpg)
USE CASE
4.1 had been implemented for a while. Automated calculation engine changes was implemented. They found out that for years they were regressions in 3.1 that were fixed in 4.1.
3.1 to 4.2
HUGE TELECOM COMPANY
![Page 14: Business Objects calculation engine changes & regression testing](https://reader035.vdocuments.net/reader035/viewer/2022070511/58a14a621a28abf8068b6c4d/html5/thumbnails/14.jpg)
USE CASE
Organization checks regressions randomly, part of QA control. Regressions found between Dev / Prod due to a table change.
DEV and PROD
HEALTHCARE ORGANIZATION
![Page 15: Business Objects calculation engine changes & regression testing](https://reader035.vdocuments.net/reader035/viewer/2022070511/58a14a621a28abf8068b6c4d/html5/thumbnails/15.jpg)
12,000 Documents730 Users
70 Universes
DETAILED REGRESSION TESTING USE CASE
SAP BusinessObjects XI3.1 SP7to
SAP Business Intelligence 4.2 SP2
Federal Agency
![Page 16: Business Objects calculation engine changes & regression testing](https://reader035.vdocuments.net/reader035/viewer/2022070511/58a14a621a28abf8068b6c4d/html5/thumbnails/16.jpg)
1. RUN THE 360BIND EXPORTS & COMPARISONS
2. IDENTIFY ALL KINDS OF REGRESSIONS
3. ANALYZE ROOT CAUSE OF REGRESSIONS
4. RUN IMPACT ANALYSIS ON ALL PLATFORM DOCUMENTS
![Page 17: Business Objects calculation engine changes & regression testing](https://reader035.vdocuments.net/reader035/viewer/2022070511/58a14a621a28abf8068b6c4d/html5/thumbnails/17.jpg)
1. Run Exports and Comparisons: 1.5 hours
![Page 18: Business Objects calculation engine changes & regression testing](https://reader035.vdocuments.net/reader035/viewer/2022070511/58a14a621a28abf8068b6c4d/html5/thumbnails/18.jpg)
EXPORT 1
![Page 19: Business Objects calculation engine changes & regression testing](https://reader035.vdocuments.net/reader035/viewer/2022070511/58a14a621a28abf8068b6c4d/html5/thumbnails/19.jpg)
Run Exports and Comparisons 1.5 hours
Create an Export Task
![Page 20: Business Objects calculation engine changes & regression testing](https://reader035.vdocuments.net/reader035/viewer/2022070511/58a14a621a28abf8068b6c4d/html5/thumbnails/20.jpg)
Select Documents
Run the 360Bind Exports and Comparisons 1.5 hours
![Page 21: Business Objects calculation engine changes & regression testing](https://reader035.vdocuments.net/reader035/viewer/2022070511/58a14a621a28abf8068b6c4d/html5/thumbnails/21.jpg)
Add Documents
Run the 360Bind Exports and Comparisons 1.5 hours
![Page 22: Business Objects calculation engine changes & regression testing](https://reader035.vdocuments.net/reader035/viewer/2022070511/58a14a621a28abf8068b6c4d/html5/thumbnails/22.jpg)
Select Frequency
Run the 360Bind Exports and Comparisons 1.5 hours
![Page 23: Business Objects calculation engine changes & regression testing](https://reader035.vdocuments.net/reader035/viewer/2022070511/58a14a621a28abf8068b6c4d/html5/thumbnails/23.jpg)
Select an Export Categoryor Create a New one
Run the 360Bind Exports and Comparisons 1.5 hours
![Page 24: Business Objects calculation engine changes & regression testing](https://reader035.vdocuments.net/reader035/viewer/2022070511/58a14a621a28abf8068b6c4d/html5/thumbnails/24.jpg)
Populate the Prompts
and Schedule!
Run the 360Bind Exports and Comparisons 1.5 hours
![Page 25: Business Objects calculation engine changes & regression testing](https://reader035.vdocuments.net/reader035/viewer/2022070511/58a14a621a28abf8068b6c4d/html5/thumbnails/25.jpg)
EXPORT 2
![Page 26: Business Objects calculation engine changes & regression testing](https://reader035.vdocuments.net/reader035/viewer/2022070511/58a14a621a28abf8068b6c4d/html5/thumbnails/26.jpg)
Export TaskXI 3
Run the 360Bind Exports and Comparisons 1.5 hours
Select the first export task
Export it into a Zip file
![Page 27: Business Objects calculation engine changes & regression testing](https://reader035.vdocuments.net/reader035/viewer/2022070511/58a14a621a28abf8068b6c4d/html5/thumbnails/27.jpg)
Import TaskBI 4
Run the 360Bind Exports and Comparisons 1.5 hours
Import the task saved
and Run it
![Page 28: Business Objects calculation engine changes & regression testing](https://reader035.vdocuments.net/reader035/viewer/2022070511/58a14a621a28abf8068b6c4d/html5/thumbnails/28.jpg)
COMPARISON
![Page 29: Business Objects calculation engine changes & regression testing](https://reader035.vdocuments.net/reader035/viewer/2022070511/58a14a621a28abf8068b6c4d/html5/thumbnails/29.jpg)
Schedule Comparison Job
Run the 360Bind Exports and Comparisons 1.5 hours
![Page 30: Business Objects calculation engine changes & regression testing](https://reader035.vdocuments.net/reader035/viewer/2022070511/58a14a621a28abf8068b6c4d/html5/thumbnails/30.jpg)
Select Export Category
Run the 360Bind Exports and Comparisons 1.5 hours
Working folder you exported the reports
![Page 31: Business Objects calculation engine changes & regression testing](https://reader035.vdocuments.net/reader035/viewer/2022070511/58a14a621a28abf8068b6c4d/html5/thumbnails/31.jpg)
Select Export Results
Run the 360Bind Exports and Comparisons 1.5 hours
![Page 32: Business Objects calculation engine changes & regression testing](https://reader035.vdocuments.net/reader035/viewer/2022070511/58a14a621a28abf8068b6c4d/html5/thumbnails/32.jpg)
Select Comparison Options
Run the 360Bind Exports and Comparisons 1.5 hours
![Page 33: Business Objects calculation engine changes & regression testing](https://reader035.vdocuments.net/reader035/viewer/2022070511/58a14a621a28abf8068b6c4d/html5/thumbnails/33.jpg)
1. RUN THE 360BIND EXPORTS AND COMPARISONS
2. IDENTIFY ALL KINDS OF REGRESSIONS
3. ANALYZE ROOT CAUSE OF REGRESSIONS
4. RUN IMPACT ANALYSIS ON ALL PLATFORM DOCUMENTS
![Page 34: Business Objects calculation engine changes & regression testing](https://reader035.vdocuments.net/reader035/viewer/2022070511/58a14a621a28abf8068b6c4d/html5/thumbnails/34.jpg)
2. Identify all Kinds of Regressions: 1 hour
![Page 35: Business Objects calculation engine changes & regression testing](https://reader035.vdocuments.net/reader035/viewer/2022070511/58a14a621a28abf8068b6c4d/html5/thumbnails/35.jpg)
Data - Structure - Images - Style28/28 documents with regressions
Identify all Kinds of Regressions1 hour
![Page 36: Business Objects calculation engine changes & regression testing](https://reader035.vdocuments.net/reader035/viewer/2022070511/58a14a621a28abf8068b6c4d/html5/thumbnails/36.jpg)
1. Vertical Alignment & Font Families
Identify all Kinds of Regressions1 hour
XI 3.1 BI 4.2
![Page 37: Business Objects calculation engine changes & regression testing](https://reader035.vdocuments.net/reader035/viewer/2022070511/58a14a621a28abf8068b6c4d/html5/thumbnails/37.jpg)
Data - Structure - Images - Style24/28 documents with regressions
Identify all Kinds of Regressions1 hour
![Page 38: Business Objects calculation engine changes & regression testing](https://reader035.vdocuments.net/reader035/viewer/2022070511/58a14a621a28abf8068b6c4d/html5/thumbnails/38.jpg)
2. Image: Label font, Scales and Layout
Identify all Kinds of Regressions1 hour
XI 3.1 BI 4.2
![Page 39: Business Objects calculation engine changes & regression testing](https://reader035.vdocuments.net/reader035/viewer/2022070511/58a14a621a28abf8068b6c4d/html5/thumbnails/39.jpg)
2. Image: Label font, Scales and Layout
Identify all Kinds of Regressions1 hour
XI 3.1 BI 4.2
![Page 40: Business Objects calculation engine changes & regression testing](https://reader035.vdocuments.net/reader035/viewer/2022070511/58a14a621a28abf8068b6c4d/html5/thumbnails/40.jpg)
Data - Structure - Images - Style17/28 documents with regressions
Identify all Kinds of Regressions1 hour
![Page 41: Business Objects calculation engine changes & regression testing](https://reader035.vdocuments.net/reader035/viewer/2022070511/58a14a621a28abf8068b6c4d/html5/thumbnails/41.jpg)
3. Data: Missing Decimals (48.32 48.00)
Business Expenses Details (in %)
Percentage Total< 100%!!!
Identify all Kinds of Regressions1 hour
XI 3.1 BI 4.2
![Page 42: Business Objects calculation engine changes & regression testing](https://reader035.vdocuments.net/reader035/viewer/2022070511/58a14a621a28abf8068b6c4d/html5/thumbnails/42.jpg)
3. Data: Error DIV/0
Business Expenses Details (in %)
Identify all Kinds of Regressions1 hour
XI 3.1 BI 4.2
![Page 43: Business Objects calculation engine changes & regression testing](https://reader035.vdocuments.net/reader035/viewer/2022070511/58a14a621a28abf8068b6c4d/html5/thumbnails/43.jpg)
1. RUN THE 360BIND EXPORTS AND COMPARISONS
2. IDENTIFY ALL KINDS OF REGRESSIONS
3. ANALYZE ROOT CAUSE OF REGRESSIONS
4. RUN IMPACT ANALYSIS ON ALL PLATFORM DOCUMENTS
![Page 44: Business Objects calculation engine changes & regression testing](https://reader035.vdocuments.net/reader035/viewer/2022070511/58a14a621a28abf8068b6c4d/html5/thumbnails/44.jpg)
3. Analyze root cause of Data Regressions: 1 hour• Document: “State A14 - Expenses Details”• Variable Analyzed: “C Fch Ttc”
![Page 45: Business Objects calculation engine changes & regression testing](https://reader035.vdocuments.net/reader035/viewer/2022070511/58a14a621a28abf8068b6c4d/html5/thumbnails/45.jpg)
• Variable is using “Round()” function included in “FormatNumber()” function: FormatNumber(Round(…))
Analyze root cause of Data Regressions1 hour
![Page 46: Business Objects calculation engine changes & regression testing](https://reader035.vdocuments.net/reader035/viewer/2022070511/58a14a621a28abf8068b6c4d/html5/thumbnails/46.jpg)
Analyze root cause of Data Regressions1 hour
Working fine in XIR3.1 SP7 but no longer in BI 4.2 SP2 due to Calculation Engine Modification
![Page 47: Business Objects calculation engine changes & regression testing](https://reader035.vdocuments.net/reader035/viewer/2022070511/58a14a621a28abf8068b6c4d/html5/thumbnails/47.jpg)
1. RUN THE 360BIND EXPORTS AND COMPARISONS
2. IDENTIFY ALL KINDS OF REGRESSIONS
3. ANALYZE ROOT CAUSE OF REGRESSIONS
4. RUN IMPACT ANALYSIS ON ALL PLATFORM DOCUMENTS
![Page 48: Business Objects calculation engine changes & regression testing](https://reader035.vdocuments.net/reader035/viewer/2022070511/58a14a621a28abf8068b6c4d/html5/thumbnails/48.jpg)
4. Run impact analysis on all the Documents: 0.5 hour
Identify all documents using “FormatNumber(Round(…))” formulas in variables or cells
596 Documents probably impacted by the Regressions
IMPACT ANALYSIS
![Page 49: Business Objects calculation engine changes & regression testing](https://reader035.vdocuments.net/reader035/viewer/2022070511/58a14a621a28abf8068b6c4d/html5/thumbnails/49.jpg)
Run impact analysis on all the Documents0.5 hour
• Identify which one are really used:
262 Documents to Fix for the Migration
![Page 50: Business Objects calculation engine changes & regression testing](https://reader035.vdocuments.net/reader035/viewer/2022070511/58a14a621a28abf8068b6c4d/html5/thumbnails/50.jpg)
28 documents troubleshot between versions:
• Service proposal from a BI consulting company= 3 days to test the 28 documents with manual comparison
• 360Bind and 360Eyes:1. Run the 360Bind exports and comparisons : 1.5 hours2. Identify all kinds of regressions : 1 hour3. Analyze root cause of regressions : 1 hour4. Run impact analysis on all platform documents : 0.5 hour= 4 hours to identify all the 28 document regressions and the impact on the 12,000 platform documents
FIND CALCULATION ENGINE CHANGES
![Page 51: Business Objects calculation engine changes & regression testing](https://reader035.vdocuments.net/reader035/viewer/2022070511/58a14a621a28abf8068b6c4d/html5/thumbnails/51.jpg)
EASIER, FASTER, CHEAPER & SAFER MIGRATION
![Page 52: Business Objects calculation engine changes & regression testing](https://reader035.vdocuments.net/reader035/viewer/2022070511/58a14a621a28abf8068b6c4d/html5/thumbnails/52.jpg)
Backup, promote & version BO content
Schedule & burst your BO reports
Explore & analyze BO metadata and licenses
Automate report qualificationNon-regression testing
XIR2
XI3
BI4
Secure your BO deployment
Streamline and Extend SAP BusinessObjects
STREAMLINE SAP BUSINESSOBJECTS
![Page 53: Business Objects calculation engine changes & regression testing](https://reader035.vdocuments.net/reader035/viewer/2022070511/58a14a621a28abf8068b6c4d/html5/thumbnails/53.jpg)
ABOUT GB&SMITH
• 1,000,000 administrated users• Won EY entrepreneur of the
year and other famous prices• Continuously evolving
company and tools
• More than 500 customers• In more than 30 countries• Small to big deployment
(100-92000 users)
• 70 employees• Very reactive support team
(98% renewal rate)• 50% in R&D
![Page 54: Business Objects calculation engine changes & regression testing](https://reader035.vdocuments.net/reader035/viewer/2022070511/58a14a621a28abf8068b6c4d/html5/thumbnails/54.jpg)
THEY TRUST US
![Page 55: Business Objects calculation engine changes & regression testing](https://reader035.vdocuments.net/reader035/viewer/2022070511/58a14a621a28abf8068b6c4d/html5/thumbnails/55.jpg)
![Page 56: Business Objects calculation engine changes & regression testing](https://reader035.vdocuments.net/reader035/viewer/2022070511/58a14a621a28abf8068b6c4d/html5/thumbnails/56.jpg)
Take a look at our solutions on: www.youtube.com/360suite
Let’s work together
QUESTIONS?