your automation decision: automation matrix 2014
TRANSCRIPT
![Page 1: Your Automation Decision: Automation Matrix 2014](https://reader033.vdocuments.net/reader033/viewer/2022051716/6281470ce47bbd279957164b/html5/thumbnails/1.jpg)
© 2014 Genesee Academy, LLC
Data Modeling Data Vault Modeling Big Data Agile DW Ensemble Modeling Certification
Your Automation Decision:
Automation Matrix 2014
© 2014 Genesee Academy, LLC USA +1 303 526 0340 Sweden +46 70 250 2102 [email protected]
gohansgo
Keynote by Hans Hultgren, May 22 2014
Automation in BI & Analytics Conference 2014
![Page 2: Your Automation Decision: Automation Matrix 2014](https://reader033.vdocuments.net/reader033/viewer/2022051716/6281470ce47bbd279957164b/html5/thumbnails/2.jpg)
© 2014 Genesee Academy, LLC
About this Session
• The promise of automation is compelling. As a key contributor to improved agility, automation can be an integral component of the agile data warehouse program.
• But automation theories, methods, tools and techniques vary greatly. So
which approach will work best for you in your organization? • This presentation introduces a current framework for classifying
automation capabilities. This framework presents a set of classification criteria and automation categories that together help us to define the scope of our automation requirements.
2
Automation Matrix
![Page 3: Your Automation Decision: Automation Matrix 2014](https://reader033.vdocuments.net/reader033/viewer/2022051716/6281470ce47bbd279957164b/html5/thumbnails/3.jpg)
© 2014 Genesee Academy, LLC
• Using the updated Automation Matrix you will be able to capture, describe and communicate your specific needs for automation (capture requirements). And the Matrix is also used to classify, evaluate and rank various automation tools and techniques (comparative tools assessment).
• The Automation Matrix is a form of decision support framework for your automation decisions. Specifically: the Automation Matrix helps people to identify the categories of automation and create a matrix of features and capabilities. This matrix is used for two purposes:
1) Identify and understand specific automation requirements and 2) Map the features of various automation tools against this Matrix
so that people can make informed and knowledgeable decisions on which automation tools to consider.
3
Automation Matrix
![Page 4: Your Automation Decision: Automation Matrix 2014](https://reader033.vdocuments.net/reader033/viewer/2022051716/6281470ce47bbd279957164b/html5/thumbnails/4.jpg)
© 2014 Genesee Academy, LLC
• Why do you want to Automate? • What are your primary Automation Requirements? • What are your Automation Critical Success Factors? • What components of the DWBI Architecture are in Scope?
4
Automation Decision Process
![Page 5: Your Automation Decision: Automation Matrix 2014](https://reader033.vdocuments.net/reader033/viewer/2022051716/6281470ce47bbd279957164b/html5/thumbnails/5.jpg)
© 2014 Genesee Academy, LLC
• Agility and Automation • The Automation Matrix • Classification Criteria • Automation Categories • Applying the Matrix
Welcome
![Page 6: Your Automation Decision: Automation Matrix 2014](https://reader033.vdocuments.net/reader033/viewer/2022051716/6281470ce47bbd279957164b/html5/thumbnails/6.jpg)
© 2014 Genesee Academy, LLC
DWBI Agility
• Agility – Overall performance in adapting to change.
• Data Warehosue Agility = constantly adapting to change – New and Changing Sources – New Attributes and Mappings – New and Changing Transformations – New and Changing Requirements – New and Changing Business Rules – New Forms of Data (n-structured, etc.) – New and Changing Deliveries – Expanding Subject Areas
• Enterprise Data Warehouse = adapting to change
Data Warehousing = Agility
![Page 7: Your Automation Decision: Automation Matrix 2014](https://reader033.vdocuments.net/reader033/viewer/2022051716/6281470ce47bbd279957164b/html5/thumbnails/7.jpg)
© 2014 Genesee Academy, LLC
• Automation in the operations of the business means automating some business process. Production, sales, manufacturing, and shipping for example.
7
About Automation
Process Automation
Operational
Sales/POS Logistics Manufacturing Campaigns CRM Accounting
What did we do before
Automation?
![Page 8: Your Automation Decision: Automation Matrix 2014](https://reader033.vdocuments.net/reader033/viewer/2022051716/6281470ce47bbd279957164b/html5/thumbnails/8.jpg)
© 2014 Genesee Academy, LLC
• What are we Automating in the Data Warehouse & Data Marts?
8
About Automation
Process Automation
D/W
Integration Historization Managing Data
Operational
Sales/POS Logistics Manufacturing Campaigns CRM Accounting
Data Marts
Analysis Decisions Reporting
![Page 9: Your Automation Decision: Automation Matrix 2014](https://reader033.vdocuments.net/reader033/viewer/2022051716/6281470ce47bbd279957164b/html5/thumbnails/9.jpg)
© 2014 Genesee Academy, LLC 9
About Process Automation
D/W • Combing Data &
Keeping History. • Integration,
Historization, and maintain auditability
• Move, coordinate, manage and integrate Data
• Data is the Asset
Operational • Sell Products • Ship Products • Invoice Customers • Create, deploy &
manage campaigns • Contact Customers
• Move, coordinate,
manage Products & Stores for Customers
• Data is Artifact
Data Marts • Analyzing data to
make decisions or discover correlations
• Specify, formulate and make decisions.
• Provide metrics & feedback to business
• Data is the raw material & the product
What does Agility Mean for these Automation areas?
![Page 10: Your Automation Decision: Automation Matrix 2014](https://reader033.vdocuments.net/reader033/viewer/2022051716/6281470ce47bbd279957164b/html5/thumbnails/10.jpg)
© 2014 Genesee Academy, LLC
• Process Needs to be Specified in order to be Automated (Modeling Pattern Consistency required for Automation)
• In DWBI areas we are
Automating processes that Automates Processes Automating processes that are constantly Changing
Data Warehousing = Agility
Data Warehouse Automation = Agility Automation
10
Data Warehouse Automation
![Page 11: Your Automation Decision: Automation Matrix 2014](https://reader033.vdocuments.net/reader033/viewer/2022051716/6281470ce47bbd279957164b/html5/thumbnails/11.jpg)
© 2014 Genesee Academy, LLC
Facts about Agile DWBI programs
• An Automation Tool does not make you agile. • A Modeling Approach does not make you agile. • An Agile Aware & Trained Team does not make you agile. • A Project Management Approach does not make you agile. • All of the above combined does not make you agile. • Basically, you can’t be agile.
Until you have an Agile Organization
11
![Page 12: Your Automation Decision: Automation Matrix 2014](https://reader033.vdocuments.net/reader033/viewer/2022051716/6281470ce47bbd279957164b/html5/thumbnails/12.jpg)
© 2014 Genesee Academy, LLC
Facts about Agile DWBI programs
People Process
Tools Techniques
12
Agile Organization
AGILE DWBI = +
![Page 13: Your Automation Decision: Automation Matrix 2014](https://reader033.vdocuments.net/reader033/viewer/2022051716/6281470ce47bbd279957164b/html5/thumbnails/13.jpg)
© 2014 Genesee Academy, LLC
• Analyze and Quantify your Automation Requirements • Match against available Tools and Approaches
13
Automation Matrix
![Page 14: Your Automation Decision: Automation Matrix 2014](https://reader033.vdocuments.net/reader033/viewer/2022051716/6281470ce47bbd279957164b/html5/thumbnails/14.jpg)
14
![Page 15: Your Automation Decision: Automation Matrix 2014](https://reader033.vdocuments.net/reader033/viewer/2022051716/6281470ce47bbd279957164b/html5/thumbnails/15.jpg)
© 2014 Genesee Academy, LLC
• Header Section
• Main Matrix
• Profile
The Automation Matrix
![Page 16: Your Automation Decision: Automation Matrix 2014](https://reader033.vdocuments.net/reader033/viewer/2022051716/6281470ce47bbd279957164b/html5/thumbnails/16.jpg)
© 2014 Genesee Academy, LLC
• Header Section
The Automation Matrix
• Capture name, note and date
• Categorize based on – Tool - Software tool,
application. – Method –
Methodology, PM, framework
• Scope of Automation – What part of the
program supported.
![Page 17: Your Automation Decision: Automation Matrix 2014](https://reader033.vdocuments.net/reader033/viewer/2022051716/6281470ce47bbd279957164b/html5/thumbnails/17.jpg)
© 2014 Genesee Academy, LLC
Source ETL in RAW BDW ETL out Marts
Scope of Automation
17
CBC
![Page 18: Your Automation Decision: Automation Matrix 2014](https://reader033.vdocuments.net/reader033/viewer/2022051716/6281470ce47bbd279957164b/html5/thumbnails/18.jpg)
© 2014 Genesee Academy, LLC 18
Scope of Automation
• The Header Section: Scope of Automation
![Page 19: Your Automation Decision: Automation Matrix 2014](https://reader033.vdocuments.net/reader033/viewer/2022051716/6281470ce47bbd279957164b/html5/thumbnails/19.jpg)
© 2014 Genesee Academy, LLC
• Main Matrix Section
The Automation Matrix
• Plot the Functions and Features of
a) Requirements b) Capabilities
![Page 20: Your Automation Decision: Automation Matrix 2014](https://reader033.vdocuments.net/reader033/viewer/2022051716/6281470ce47bbd279957164b/html5/thumbnails/20.jpg)
© 2014 Genesee Academy, LLC
• Consider the following classification criteria: Templates for ETL Manage Data Modeling Generation of Mappings Automation of Testing
• For each one, consider them in the context of some of the tools and techniques presented earlier today.
This process of contemplating criteria in the context of particular tools and techniques is the purpose of the automation matrix
Classification Criteria
![Page 21: Your Automation Decision: Automation Matrix 2014](https://reader033.vdocuments.net/reader033/viewer/2022051716/6281470ce47bbd279957164b/html5/thumbnails/21.jpg)
© 2014 Genesee Academy, LLC
• There are two parts to each classification criteria… Templates for ETL Managing the Data Modeling Generation of Mappings Automation of Testing
• The LEFT side items are tool or technique Features
• The RIGHT side items are DWBI Functions
Classification Criteria
![Page 22: Your Automation Decision: Automation Matrix 2014](https://reader033.vdocuments.net/reader033/viewer/2022051716/6281470ce47bbd279957164b/html5/thumbnails/22.jpg)
© 2014 Genesee Academy, LLC
• Manage Assists in the management of this function • Structure Provides structure and structural components • Automate Automates components of the function • Generate Actual generation of artifacts related to the function • Templates Templates to provide consistency & to expedite • Document Creates or provides documentation related to function • Speeds up Enables agility and performance improvements
Features
![Page 23: Your Automation Decision: Automation Matrix 2014](https://reader033.vdocuments.net/reader033/viewer/2022051716/6281470ce47bbd279957164b/html5/thumbnails/23.jpg)
© 2014 Genesee Academy, LLC
• Analysis • Design • Data Modeling • Build ETL / Deploy DB • Run ETL / Load DB
Functions
• Mapping • Transformations • Testing • Metadata • Documentation
![Page 24: Your Automation Decision: Automation Matrix 2014](https://reader033.vdocuments.net/reader033/viewer/2022051716/6281470ce47bbd279957164b/html5/thumbnails/24.jpg)
© 2014 Genesee Academy, LLC 24
Automation Matrix Functions/Features
![Page 25: Your Automation Decision: Automation Matrix 2014](https://reader033.vdocuments.net/reader033/viewer/2022051716/6281470ce47bbd279957164b/html5/thumbnails/25.jpg)
© 2014 Genesee Academy, LLC
• Combinations of these Classification Criteria help us to form sets of Automation Categories
• While there are some obvious ones to consider (ETL code generators, etc.) we are also able to assemble a custom set of criteria for our own automation category.
• Note that these capabilities will often require a set of tools versus a single tool.
Automation Categories
![Page 26: Your Automation Decision: Automation Matrix 2014](https://reader033.vdocuments.net/reader033/viewer/2022051716/6281470ce47bbd279957164b/html5/thumbnails/26.jpg)
© 2014 Genesee Academy, LLC
• Profile Section
The Automation Matrix
• Establish the scope, architecture, approach and general theories and methodologies concerning the Automation.
![Page 27: Your Automation Decision: Automation Matrix 2014](https://reader033.vdocuments.net/reader033/viewer/2022051716/6281470ce47bbd279957164b/html5/thumbnails/27.jpg)
© 2014 Genesee Academy, LLC 27
Profile Section
![Page 28: Your Automation Decision: Automation Matrix 2014](https://reader033.vdocuments.net/reader033/viewer/2022051716/6281470ce47bbd279957164b/html5/thumbnails/28.jpg)
© 2014 Genesee Academy, LLC 28
Architectural Layers & Processes
![Page 29: Your Automation Decision: Automation Matrix 2014](https://reader033.vdocuments.net/reader033/viewer/2022051716/6281470ce47bbd279957164b/html5/thumbnails/29.jpg)
© 2014 Genesee Academy, LLC 29
Profile Section
Customize this Matrix to meet your specific needs. For example if you have SOA, Big Data, MDM, Industry Reference Models and other connected requirements then these should also be included for your Matrix Analysis.
![Page 30: Your Automation Decision: Automation Matrix 2014](https://reader033.vdocuments.net/reader033/viewer/2022051716/6281470ce47bbd279957164b/html5/thumbnails/30.jpg)
© 2014 Genesee Academy, LLC
Data Vault EXAMPLE
30
![Page 31: Your Automation Decision: Automation Matrix 2014](https://reader033.vdocuments.net/reader033/viewer/2022051716/6281470ce47bbd279957164b/html5/thumbnails/31.jpg)
© 2014 Genesee Academy, LLC
About Data Vault Ensemble
31
Estimated 800 + Data Vault based Data Warehouses around the world
![Page 32: Your Automation Decision: Automation Matrix 2014](https://reader033.vdocuments.net/reader033/viewer/2022051716/6281470ce47bbd279957164b/html5/thumbnails/32.jpg)
© 2014 Genesee Academy, LLC 32
![Page 33: Your Automation Decision: Automation Matrix 2014](https://reader033.vdocuments.net/reader033/viewer/2022051716/6281470ce47bbd279957164b/html5/thumbnails/33.jpg)
© 2014 Genesee Academy, LLC 33
CDVDM ReConnect Event
![Page 34: Your Automation Decision: Automation Matrix 2014](https://reader033.vdocuments.net/reader033/viewer/2022051716/6281470ce47bbd279957164b/html5/thumbnails/34.jpg)
© 2014 Genesee Academy, LLC
Links and Information
CDVDM Data Vault Certification
www.GeneseeAcademy.com [email protected]
gohansgo
Book DataVaultBook.blogspot.com
HansHultgren.WordPress.com
HansHultgren
34
Online video-lesson training
DataVaultAcademy.com
DataVaultAcademy