![Page 1: Bus Matrix… the foundation of your Data Warehouse](https://reader035.vdocuments.net/reader035/viewer/2022081420/56816882550346895ddefd6a/html5/thumbnails/1.jpg)
Bus Matrix…the foundation of your Data Warehouse
Bill Anton Prime Data Intelligence
![Page 2: Bus Matrix… the foundation of your Data Warehouse](https://reader035.vdocuments.net/reader035/viewer/2022081420/56816882550346895ddefd6a/html5/thumbnails/2.jpg)
About Me• I Love Data!• …also, Microsoft DW/BI (MCTS/MCITP, MCSA/MCSE)
• Independent Consultant @ Prime Data Intelligence, LLC• Atlanta BI SQL Server Users Group
• Twitter: @SQLbyoBI• Blog: http://byoBI.com • Email:[email protected]
![Page 3: Bus Matrix… the foundation of your Data Warehouse](https://reader035.vdocuments.net/reader035/viewer/2022081420/56816882550346895ddefd6a/html5/thumbnails/3.jpg)
What we will cover today • Dimensional Modeling 101• What, Why, How• Common Challenges
• Bus Matrix• What is it?• How does it help?• Examples
![Page 4: Bus Matrix… the foundation of your Data Warehouse](https://reader035.vdocuments.net/reader035/viewer/2022081420/56816882550346895ddefd6a/html5/thumbnails/4.jpg)
What is Dimensional Modeling?
Facts•additive amounts•E.g. Sales amount, inventory quantity•SUM, AVERAGE, MAX, MIN, COUNT
Dimensions•descriptive attributes•E.g. Date, Product, Location, Customer•GROUP BY <attribute>, <attribute>, etc
![Page 5: Bus Matrix… the foundation of your Data Warehouse](https://reader035.vdocuments.net/reader035/viewer/2022081420/56816882550346895ddefd6a/html5/thumbnails/5.jpg)
What is Dimensional Modeling?
FACT
DIMENSION
DIMENSION DIMENSION
DIMENSIONDIMENSION
“Star Schema”
![Page 6: Bus Matrix… the foundation of your Data Warehouse](https://reader035.vdocuments.net/reader035/viewer/2022081420/56816882550346895ddefd6a/html5/thumbnails/6.jpg)
What is Dimensional Modeling?• Denormalization• “Repeating Values”• Opposite of “normalized” (e.g. 3rd Normal Form)• Optimized for reads (not writes)
![Page 7: Bus Matrix… the foundation of your Data Warehouse](https://reader035.vdocuments.net/reader035/viewer/2022081420/56816882550346895ddefd6a/html5/thumbnails/7.jpg)
Dimensional Modeling 101Question: What are the most common types of Data Warehouse methodologies/architectures?
• Kimball• Inmon• Data Vault
![Page 8: Bus Matrix… the foundation of your Data Warehouse](https://reader035.vdocuments.net/reader035/viewer/2022081420/56816882550346895ddefd6a/html5/thumbnails/8.jpg)
Question: For which of these DW methodologies should you include a dimensional model?
Kimball, Inmon, Data Vault
All of them
Dimensional Modeling 101
![Page 9: Bus Matrix… the foundation of your Data Warehouse](https://reader035.vdocuments.net/reader035/viewer/2022081420/56816882550346895ddefd6a/html5/thumbnails/9.jpg)
Kimball Dimensional DW
Source Stage DW Cubes
![Page 10: Bus Matrix… the foundation of your Data Warehouse](https://reader035.vdocuments.net/reader035/viewer/2022081420/56816882550346895ddefd6a/html5/thumbnails/10.jpg)
Inmon 3NF EDW + Data Mart(s)
Source Stage 3NF DW CubesData Marts
![Page 11: Bus Matrix… the foundation of your Data Warehouse](https://reader035.vdocuments.net/reader035/viewer/2022081420/56816882550346895ddefd6a/html5/thumbnails/11.jpg)
Data Vault + Data Mart(s)
Source Stage Data Vault DW CubesData Marts
![Page 12: Bus Matrix… the foundation of your Data Warehouse](https://reader035.vdocuments.net/reader035/viewer/2022081420/56816882550346895ddefd6a/html5/thumbnails/12.jpg)
Why Dimensional Modeling• Intuitive to Business Users• Simpler than OLTP/3NF• Rise of Self-Service (E.g. Power Pivot, Power View)
• Iterative Development• “Agile”
• Performance• Optimized for analytical queries
e.g. sales amount by product in 2013 for top 10 all-time customers
• And many more…See Teo Lachev’s “WHY SEMANTIC LAYER” newsletter:http://www.prologika.com/Newsroom/Newsletter2013Fall.aspx
![Page 13: Bus Matrix… the foundation of your Data Warehouse](https://reader035.vdocuments.net/reader035/viewer/2022081420/56816882550346895ddefd6a/html5/thumbnails/13.jpg)
Intuitive to Business Users
Dimensions
Dimensions
Facts
![Page 14: Bus Matrix… the foundation of your Data Warehouse](https://reader035.vdocuments.net/reader035/viewer/2022081420/56816882550346895ddefd6a/html5/thumbnails/14.jpg)
How many bikes did we sell last year?
![Page 15: Bus Matrix… the foundation of your Data Warehouse](https://reader035.vdocuments.net/reader035/viewer/2022081420/56816882550346895ddefd6a/html5/thumbnails/15.jpg)
Do we sell more bikes to single or married females?
![Page 16: Bus Matrix… the foundation of your Data Warehouse](https://reader035.vdocuments.net/reader035/viewer/2022081420/56816882550346895ddefd6a/html5/thumbnails/16.jpg)
What was our most/least profitable product this year?
![Page 17: Bus Matrix… the foundation of your Data Warehouse](https://reader035.vdocuments.net/reader035/viewer/2022081420/56816882550346895ddefd6a/html5/thumbnails/17.jpg)
What was the Average Monthly Gross Margin Return on Inventory Investment (GMROII) by Product Category for the trailing 6 months?
It’s Complicated
![Page 18: Bus Matrix… the foundation of your Data Warehouse](https://reader035.vdocuments.net/reader035/viewer/2022081420/56816882550346895ddefd6a/html5/thumbnails/18.jpg)
Star-Schema
FACT
DIMENSION
DIMENSION DIMENSION
DIMENSIONDIMENSION
Sales
Product
Store Sales Person
Customer
Date
![Page 19: Bus Matrix… the foundation of your Data Warehouse](https://reader035.vdocuments.net/reader035/viewer/2022081420/56816882550346895ddefd6a/html5/thumbnails/19.jpg)
1 “Star” per Fact table
Sales Process Inventory Process
Sales
Product
Sales Person Store
Customer
Date
Inventory
ProductStore
Date
![Page 20: Bus Matrix… the foundation of your Data Warehouse](https://reader035.vdocuments.net/reader035/viewer/2022081420/56816882550346895ddefd6a/html5/thumbnails/20.jpg)
Facts are related through dimensions…
Sales
Product
Sales Person Store
Customer
Date
Inventory
ProductStore
Date
Sales Process Inventory Process
![Page 21: Bus Matrix… the foundation of your Data Warehouse](https://reader035.vdocuments.net/reader035/viewer/2022081420/56816882550346895ddefd6a/html5/thumbnails/21.jpg)
Facts are related through dimensions…
Sales Product
Sales Person Store
Customer Date
Inventory
“Conformed Dimensions”
A conformed dimension is a set of data attributes that have been physically referenced by multiple fact tables using the same key value to refer to the same structure, attributes, domain values, definitions and concepts.
Dimensions are conformed when they are either exactly the same (including keys) or one is a perfect subset of the other.
Dimension tables are NOT conformed if the attributes are labeled differently or contain different values.
![Page 22: Bus Matrix… the foundation of your Data Warehouse](https://reader035.vdocuments.net/reader035/viewer/2022081420/56816882550346895ddefd6a/html5/thumbnails/22.jpg)
Dimensions: Conformed vs Unconformed
![Page 23: Bus Matrix… the foundation of your Data Warehouse](https://reader035.vdocuments.net/reader035/viewer/2022081420/56816882550346895ddefd6a/html5/thumbnails/23.jpg)
Revisiting Average Monthly Gross Margin Return on Inventory Investment (GMROII)
Sum of each month ending inventory cost
Sales Product
Sales Person Store
Customer Date
Inventory
Profit for total time period
Average Monthly GMROII
![Page 24: Bus Matrix… the foundation of your Data Warehouse](https://reader035.vdocuments.net/reader035/viewer/2022081420/56816882550346895ddefd6a/html5/thumbnails/24.jpg)
What was the Average Monthly Gross Margin Return on Inventory Investment (GMROII) by Product Category for the trailing 6 months?
![Page 25: Bus Matrix… the foundation of your Data Warehouse](https://reader035.vdocuments.net/reader035/viewer/2022081420/56816882550346895ddefd6a/html5/thumbnails/25.jpg)
Where things start to get complex…• 1 Star per Fact table• Multiple Fact tables per business process• Multiple business processes in an enterprise
![Page 26: Bus Matrix… the foundation of your Data Warehouse](https://reader035.vdocuments.net/reader035/viewer/2022081420/56816882550346895ddefd6a/html5/thumbnails/26.jpg)
Dimensional Model becomes a “Galaxy of Stars”
Sales
FinanceProduction
HR
Distribution
![Page 27: Bus Matrix… the foundation of your Data Warehouse](https://reader035.vdocuments.net/reader035/viewer/2022081420/56816882550346895ddefd6a/html5/thumbnails/27.jpg)
ER Diagram: Adventure Works Sample DW
![Page 28: Bus Matrix… the foundation of your Data Warehouse](https://reader035.vdocuments.net/reader035/viewer/2022081420/56816882550346895ddefd6a/html5/thumbnails/28.jpg)
For bigger Data Warehouses…
This ^^ Turns into this ^^
![Page 29: Bus Matrix… the foundation of your Data Warehouse](https://reader035.vdocuments.net/reader035/viewer/2022081420/56816882550346895ddefd6a/html5/thumbnails/29.jpg)
Variety of Problems to Overcome with Dimensional Modeling• Communication & Strategy• What’s the short term plan of attack? • What’s the long term plan of attack?
• Documentation• What’s in our Data Warehouse?• Business Users can’t read ER diagrams• Business Users are typically only familiar with a 1 or 2 business processes
• E.g. Sales User vs Inventory User; Warehouse Supervisor vs CEO
• Conforming Dimensions is hard…REALLY hard• So are changes (E.g. Impact Analysis)
![Page 30: Bus Matrix… the foundation of your Data Warehouse](https://reader035.vdocuments.net/reader035/viewer/2022081420/56816882550346895ddefd6a/html5/thumbnails/30.jpg)
What’s the Solution?• Train business users to read ER Diagrams?• Simplify Data Model?• Ignore certain business processes?• Don’t use Conformed Dimensions?• Force business users to manually map data between processes?
What about a Bus Matrix?
![Page 31: Bus Matrix… the foundation of your Data Warehouse](https://reader035.vdocuments.net/reader035/viewer/2022081420/56816882550346895ddefd6a/html5/thumbnails/31.jpg)
What is a Bus Matrix?
2-dimensional visualization showing the intersection of facts and dimensions
![Page 32: Bus Matrix… the foundation of your Data Warehouse](https://reader035.vdocuments.net/reader035/viewer/2022081420/56816882550346895ddefd6a/html5/thumbnails/32.jpg)
Variety of Use-Cases for a Bus Matrix
• Documentation, Communication, Training• Facilitate User Adoption of BI tools• Communicate Expectations w/ Business• New users unfamiliar with new business process
• Team Development• Agile• Prioritization of Tasks• Divide & Conquer
• Road-Mapping• Prioritization of Business Processes in a Business Intelligence
“Program”
![Page 33: Bus Matrix… the foundation of your Data Warehouse](https://reader035.vdocuments.net/reader035/viewer/2022081420/56816882550346895ddefd6a/html5/thumbnails/33.jpg)
Documentation For Business
![Page 34: Bus Matrix… the foundation of your Data Warehouse](https://reader035.vdocuments.net/reader035/viewer/2022081420/56816882550346895ddefd6a/html5/thumbnails/34.jpg)
Documentation for IT
![Page 35: Bus Matrix… the foundation of your Data Warehouse](https://reader035.vdocuments.net/reader035/viewer/2022081420/56816882550346895ddefd6a/html5/thumbnails/35.jpg)
Master Bus Matrix
![Page 36: Bus Matrix… the foundation of your Data Warehouse](https://reader035.vdocuments.net/reader035/viewer/2022081420/56816882550346895ddefd6a/html5/thumbnails/36.jpg)
Team DevelopmentSprint 1Internet Sales
Sprint 2Reseller Sales
![Page 37: Bus Matrix… the foundation of your Data Warehouse](https://reader035.vdocuments.net/reader035/viewer/2022081420/56816882550346895ddefd6a/html5/thumbnails/37.jpg)
Road-Mapping
![Page 38: Bus Matrix… the foundation of your Data Warehouse](https://reader035.vdocuments.net/reader035/viewer/2022081420/56816882550346895ddefd6a/html5/thumbnails/38.jpg)
When To Create a Bus Matrix• During Requirements Gathering• Before You Start Development!• Updated Over Time• Changes to Business Processes• New Source Systems (E.g. mergers/acquisitions)
![Page 39: Bus Matrix… the foundation of your Data Warehouse](https://reader035.vdocuments.net/reader035/viewer/2022081420/56816882550346895ddefd6a/html5/thumbnails/39.jpg)
How To Create a Bus MatrixManual via Excel Automated via SSRS
![Page 40: Bus Matrix… the foundation of your Data Warehouse](https://reader035.vdocuments.net/reader035/viewer/2022081420/56816882550346895ddefd6a/html5/thumbnails/40.jpg)
Manual
• Only option when starting out ;-)
• Updates can be made quickly made as requirements come in
• Adds development overhead, but the ROI is well worth it
![Page 41: Bus Matrix… the foundation of your Data Warehouse](https://reader035.vdocuments.net/reader035/viewer/2022081420/56816882550346895ddefd6a/html5/thumbnails/41.jpg)
Automated
Based on example from Alex Whittleshttp://www.purplefrogsystems.com/blog/2010/09/olap-cube-documentation-in-ssrs-part-1/
• Reporting pack with drill-through to data dictionary information
• Can be based on Cube or Relational Database (*FK required)
• Incorporate query statistics to visualize common usage patterns
• Use MDS to allow SME’s to manage business definitions
![Page 42: Bus Matrix… the foundation of your Data Warehouse](https://reader035.vdocuments.net/reader035/viewer/2022081420/56816882550346895ddefd6a/html5/thumbnails/42.jpg)
QUESTIONS
![Page 43: Bus Matrix… the foundation of your Data Warehouse](https://reader035.vdocuments.net/reader035/viewer/2022081420/56816882550346895ddefd6a/html5/thumbnails/43.jpg)
References
http://byobi.com/blog/bus-matrix/
Twitter: @SQLbyoBIBlog: http://byoBI.com Email: [email protected]