where the warehouse ends: a new age of information access
DESCRIPTION
The Briefing Room with Barry Devlin and Composite Software Live Webcast May 21, 2013 All good things must come to an end, and even though the data warehouse will remain a prominent force in the information age, the handwriting is all over the enterprise: the center of gravity is moving. Whether due to Big Data or real-time demands, Cloud computing or globalization, today's leading organizations have analytical needs that the warehouse simply cannot accommodate. That's why data virtualization continues to attract attention. Register for this episode of The Briefing Room to hear veteran Analyst Barry Devlin explain why the traditional model for data warehousing is being outmoded by a range of more flexible methods for accessing and analyzing information assets. He'll be briefed by David Besemer of Composite Software who will discuss how his company's data virtualization platform can be used to provide access to all manner of information sources, including data warehouses, Big Data silos, as well as partner and public data sources on demand. Visit: http://www.insideanalysis.comTRANSCRIPT
The Briefing Room
Twitter Tag: #briefr
The Briefing Room
! Reveal the essential characteristics of enterprise software, good and bad
! Provide a forum for detailed analysis of today’s innovative technologies
! Give vendors a chance to explain their product to savvy analysts
! Allow audience members to pose serious questions... and get answers!
Mission
Twitter Tag: #briefr
The Briefing Room
MAY: Integration
June: DATABASE
July: CLOUD
August: HIGH PERFORMANCE ANALYTICS
Twitter Tag: #briefr
The Briefing Room
Processing Monitoring
Integration
MOBILE
M a c h i n e - g e n e r a t e d
RFID
SINGLE VIEW
Applications +
Web Services
Excel +
Flat files
Hadoop +
Big Data
OLAP Cubes +
Data Warehouse
XML
RDBMS
Twitter Tag: #briefr
The Briefing Room
Analyst: Barry Devlin
Barry Devlin is the founder and principal of
9sight Consulting
Twitter Tag: #briefr
The Briefing Room
! Composite Software takes the data virtualization approach to the data integration challenge, providing an agile, relatively low cost solution with rapid deployment and quick iterations
! Its platform unifies data from multiple, disparate sources into a logical virtual data layer and readies data for consumption
! Composite’s Analytic Sandbox and Analytic Hub allow analysts the flexibility to perform purposeful analytics
Composite Software
Twitter Tag: #briefr
The Briefing Room
David Besemer
David Besemer is the CTO of Composite Software. For over twenty-five years, David has architected and engineered leading-edge software technologies and companies. Before joining Composite he was CTO in residence for several venture firms, CTO of eStyle and Product Marketing Director at NeXT Computer. Prior to that he built program trading systems on Wall Street and researched natural language processing systems at GE’s Corporate R&D center. David holds a BS in computer science from Michigan State University and an MS in computer science from Rensselaer Polytechnic Institute.
9 © 2013 Composite Software, Inc., Composite Proprietary
Data Integration for Analytics
The Briefing Room David Besemer
CTO Composite Software
10 © 2013 Composite Software, Inc., Composite Proprietary
OTHER BUSINESSES
Business Leaders Take Advantage of Their Data
OBJECTIVES: • Agility • Cost Reduction • Competitive Advantage
BUSINESS LEADERS
11 © 2013 Composite Software, Inc., Composite Proprietary
Data Warehouses
Supplying Data for Analytics Used To Be Easier
The Business
12 © 2013 Composite Software, Inc., Composite Proprietary
Data Warehouses
Operational Databases
Enterprise Applications
Today Data for Analytics Presents A Bigger Challenge
The Business
“The Cloud”
“Big Data”
Third Party Data
13 © 2013 Composite Software, Inc., Composite Proprietary
Data Warehouses
Composite Lets You Take Big Advantage of Your Data
Operational Databases
Enterprise Applications “The Cloud”
“Big Data”
Third Party Data
The Business
14 © 2013 Composite Software, Inc., Composite Proprietary
Organizations That Gain Big Advantage Using Composite
How to Solve the Analyst’s Data Problem
16 © 2013 Composite Software, Inc., Composite Proprietary
The Analyst’s “Data Problem”
Find the Data
Access the
Data
Build a Sandbox for the
Data
Build the Model
Analyze the
Results
Develop the
Business Insight
“Analysts spend more than half their time pulling
together their data”
17 © 2013 Composite Software, Inc., Composite Proprietary
Iterate, Iterate, Iterate….. Agility Is Critical
Find the Data
Access the
Data
Build a Sandbox for the
Data
Build the Model
Analyze the
Results
Develop the
Business Insight
18 © 2013 Composite Software, Inc., Composite Proprietary
Addressing the Analyst’s Data Problem
• Identify local, enterprise and external data sources
• Flexibly group, sort and search sources
Find the Data
Access the
Data
Build a Sandbox for the
Data
• Connect various source data types and data shapes
• Explore live data
• Create a unified data model
• Filter, transform and aggregate data sets
• Selectively materialize into sandbox host
19 © 2013 Composite Software, Inc., Composite Proprietary
Data Warehouses
Deployment Options: Analytic Sandboxes & Data Hubs
Operational Databases
Enterprise Applications “The Cloud”
“Big Data”
Third Party Data
Analytic Data Hub
Analytic Data Hub • Agility • Self-service • Recurring analyses • Broader use • Central control
Analytic Sandbox • Agility • Self-service • One-off analyses • Personal use • Local control
Analytic Sandbox
20 © 2013 Composite Software, Inc., Composite Proprietary
Benefits
• Faster time to analysis ◦ Simplify access to enterprise and local data ◦ Accelerate insight and business impact
• Self-service data integration ◦ Empower analytic users ◦ New role for IT as data provider
• Improved data consistency and quality ◦ Promote reuse of proven datasets • Share data integration logic across analytic tools
21 © 2013 Composite Software, Inc., Composite Proprietary
Gain More Insights By Leveraging All Your Data
$21M in Services Upsell Revenue
$9M Increase in PlayStation Revenue
22 © 2013 Composite Software, Inc., Composite Proprietary
Respond Faster To Ever Changing Analytics Needs
“Hours or Days, Not Weeks or Months…
That’s Agility!”
“10 Times Faster Response to Executive Information
Requests”
23 © 2013 Composite Software, Inc., Composite Proprietary
Save 50-75% Over Data Replication And Consolidation
“$4.5M in savings on first project”
“Spent 80% Less”
24 © 2013 Composite Software, Inc., Composite Proprietary
Composite Provides a Complete Analytics Data Integration Solution
Discovery
Active Cluster
Composite Information Server Monitor
Manager
Studio
PerformancePlus Adapters
Development Environment
Runtime Server Environment
Management Environment
XML
Packaged Apps RDBMS Excel Files Data Warehouse OLAP Cubes Hadoop / “Big Data” XML Docs Flat Files Web Services
Composite 6.2 Data Virtualization Platform
Human Capital Management
Governance, Risk &
Compliance Business
Intelligence Customer
Experience Management
Mergers & Acquisitions
Single View of Enterprise Data
Supply Chain Management Analytics
25 © 2013 Composite Software, Inc., Composite Proprietary
Data Virtualization Leadership Blog
Data Virtualization Case Study Book
For More Information
Data Virtualization Day
Analyst Webinars & White Papers
The Data Virtualization Channel
Data Virtualization Community
Data Virtualization Microsite
Enterprise Information Insight
THE BIG DATA ADVANTAGE: TAKE BIG ADVANTAGE OF YOUR DATA
Barry Devlin
27 Copyright © 2013 9sight Consulting
Founder and Principal 9sight Consulting, www.9sight.com
Dr. Barry Devlin is a founder of the data warehousing industry and among the foremost authorities worldwide on business intelligence (BI) and beyond. He is a widely respected consultant, lecturer and author of “Data Warehouse—from Architecture to Implementation”. Barry has 30 years of experience in the IT industry, previously with IBM, as an architect, consultant, manager and software evangelist. As founder and principal of 9sight Consulting (www.9sight.com), Barry provides strategic consulting and thought-leadership to buyers and vendors of BI solutions. He is currently developing a new architectural model for fully consistent business support—from informational to operational and collaborative—Business Integrated Insight (BI2). Based in Cape Town, South Africa, Barry’s knowledge and expertise are in demand both locally and internationally.
Email: [email protected] Twitter: @BarryDevlin
Copyright © 2013 9sight Consulting, All Rights Reserved
Dr Barry Devlin Founder & Principal
9sight Consulting
The Integration Dilemma
The Briefing Room, 21 May 2013
Everybody’s integrating something…always
29 Copyright © 2013 9sight Consulting
Integration is the key IT enabler for the business process… [and] touches and connects all areas of the business, its
customers, suppliers and partners. Jason Hill, partner, Glue Reply via
http://blogs.computerworlduk.com/management-briefing/2012/10/the-dangers-of-taking-your-eye-
off-integration/index.htm
The dilemma is…
…everybody thinks its something different
So, let’s review…
30 Copyright © 2013 9sight Consulting
Prior integration – during data warehouse population
§ The original goal – consistency
§ Bespoke programming
§ Extract – Transform – Load (ETL)
§ Highly technical focus on data and process of operational systems
§ Reducing in popularity… but not going away
31 Copyright © 2013 9sight Consulting
§ The Prodigal Son returns – timeliness / agility
§ Federation becomes Virtualization
§ Also driven by “big data” volume and variety
§ Growing in popularity… but not the only answer
32 Copyright © 2013 9sight Consulting
Immediate integration – at query time
“Where the warehouse ends…” means:
§ Logical boundary to the scope and purpose of the data warehouse
§ Consistency still matters
§ Information and data for analytics and operations beyond this boundary
§ Timeliness is key
§ For more on this architectural picture see: http://bit.ly/OpAn-A2Z
33 Copyright © 2013 9sight Consulting
Core Reporting & Analytic
Data
Fast Analytic
Data
Prior Integration
Core Business
Data
Deep Analytic
Info
Specialty Analytic
Data
Specialty Analytic
Data
Operational Systems Machine-generated
Data Process-mediated Data Human-sourced
Information
Business Analytics and Administrative Tools
Integrated information platform
Metadata
Data Virtualization (Immediate Integration)
Events Transactions Communications
Concept integration – from information to data
§ Data is information dumbed down for computers
§ Information contains the human context
§ Integration must first occur conceptually at the business level – Modeling, text analytics, etc.
§ Common metadata needed for prior and immediate integration
34 Copyright © 2013 9sight Consulting
Copyright © 2013 9sight Consulting, All Rights Reserved
Dr Barry Devlin Founder & Principal
9sight Consulting
Questions (1)
1. What is Composite’s take on the title of the webinar “Where the Warehouse Ends?”
2. The Analyst’s “Data Problem” has been around forever and everybody has claimed to tackle it one time or another. Why would Composite succeed where others have failed?
3. Conceptually, I understand the distinction you’re making between the “analytic sandbox” and “analytic data hub.” However, in implementation terms, they seem very similar or perhaps even identical. Can you clarify, please?
4. Data virtualization is very much part of the “plumbing business.” How do you convince the CMO that it’s as sexy as Hadoop? How do you position yourself vs. the “Yellow Elephant Solution” to all the world’s data needs and opportunities?
5. The phrase “self-service data integration” worries me even more than “self-service BI.” Do you really think business users can do this well? How can you help them to do so?
36 Copyright © 2013 9sight Consulting
Questions (2)
6. What do you see as the biggest challenges for a business new to data virtualization? How does Composite address them?
7. I position (roughly) ETL for consistency and data virtualization for agility. How do you see that distinction? Does Composite have functions (or plans) that would drive enhanced data consistency in a virtualized environment?
8. You claim 50-75% savings over data replication and consolidation. Is this a short-term benefit of the first project or is it repeatable? My observation is that in the longer term, investment in consistency (via replication and consolidation) will pay dividends. What is your view?
37 Copyright © 2013 9sight Consulting
Twitter Tag: #briefr
The Briefing Room
Twitter Tag: #briefr
The Briefing Room
June: DATABASE
July: CLOUD
August: HIGH PERFORMANCE ANALYTICS
Upcoming Topics
www.insideanalysis.com
Twitter Tag: #briefr
The Briefing Room
Thank You for Your
Attention