webinar on mongodb bi connectors
TRANSCRIPT
Get the Inside Story on MongoDB BI
Connectors
Sumit Sarkar
Chief Data Evangelist
Progress DataDirect
Gene Arnold
Senior Sales Engineer
TIBCO Jaspersoft
© 2015 Progress Software Corporation. All rights reserved.2
Audio Bridge Options & Question Submission
Get the Inside Story on MongoDB BI
Connectors
Sumit Sarkar
Chief Data Evangelist
Progress DataDirect
Gene Arnold
Senior Sales Engineer
TIBCO Jaspersoft
© 2015 Progress Software Corporation. All rights reserved.4
Agenda
What to consider for BI with MongoDB?
When to utilize MongoDB's Connector for BI versus
Progress DataDirect's solution
How TIBCO Jaspersoft selected a MongoDB
connector for their Embedded BI platform
© 2015 Progress Software Corporation. All rights reserved.5
© 2015 Progress Software Corporation. All rights reserved.6
What to consider for BI with MongoDB?
© 2015 Progress Software Corporation. All rights reserved.7
What is MongoDB?
MongoDB is an open source, document-oriented NoSQL
database designed with both scalability and developer
agility in mind. Instead of storing your data in tables and
rows as you would with a relational database, in
MongoDB you store JSON-like documents with dynamic
schemas.
© 2015 Progress Software Corporation. All rights reserved.8
Why do we need a BI connector for MongoDB?
MongoDB is a NoSQL database making it scalable and
flexible for building applications, but the BI ecosytem
expects SQL.
MongoDB document structures can include deeply
nested data that do not have equivalents in the
relational model
MongoDB native queries have limited support for SQL
JOINs across different collections.
© 2015 Progress Software Corporation. All rights reserved.9
MongoDB Survey: How complex are documents?
© 2015 Progress Software Corporation. All rights reserved.10
MongoDB Survey: Depth of arrays/document nesting?
© 2015 Progress Software Corporation. All rights reserved.11
You’re doing something right when you need BI Connectivity
Business Intelligence Data Integration
ODBC/JDBC
© 2015 Progress Software Corporation. All rights reserved.12
BI Connectors for MongoDB vs RDBMS
Important to run performance stress tests on BI servers for workloads
Different BI tools require specific properties such as max varchar sizes
on string data types, or field names that start with underscore.
Must sample data to generate schema on read – need to configure this
value “ColumnDiscoverySampleSize”
Flexible data model where data types can vary row to row and case
sensitive naming collisions can occur during normalization
© 2015 Progress Software Corporation. All rights reserved.13
When to utilize MongoDB'sConnector for BI versus Progress DataDirect's solution
© 2015 Progress Software Corporation. All rights reserved.14
MongoDB 3.2 Connector for BI (released Q4 2015)
Visualize and explore multi-dimensional
documents using SQL-based BI tools. The
connector does the following:
• Provides the BI tool with the schema of the
MongoDB collection to be visualized
• Translates SQL statements issued by the BI tool
into equivalent MongoDB queries that are sent to
MongoDB for processing
• Converts the results into the tabular format
expected by the BI tool, which can then visualize
the data based on user requirements
© 2015 Progress Software Corporation. All rights reserved.15
Location & Flow of Data
MongoD
B BI
Connecto
r
Mapping meta-data Application data
{name:
“Andrew”,
address:
{street:…
}}
DocumentTableAnalytics & visualization
© 2015 Progress Software Corporation. All rights reserved.16
DataDirect MongoDB ODBC and JDBC drivers (released Q1 2014)
First Reliable MongoDB Connector (Unlimited
Normalization) and only one certified by MongoDB, Inc.
Picked up latest MongoDB features such as
WiredTiger Engine Support, Aggregate Framework,
Security such as SSL
Support across Windows, Linux, AIX, Solaris, HP-UX
© 2015 Progress Software Corporation. All rights reserved.17
Progress DataDirect & Flow of Data
Application dataAnalytics & visualization
© 2015 Progress Software Corporation. All rights reserved.18
How Normalization works from Progress DataDirect?
Table Name: users_list
_id userid first
name
last
name
nick
name
gender time
zone
post
code
country height height
unit
… da50… Burris Harmon Yesenia Male PT 94110 US 70 inches
steps_id count_generated_id Hour steps
da50… {…} 16 2792
da50.. {…} 17 2078
Table Name: steps_count
_id userid date
… da50… 10-29-2014
Table Name: steps
© 2015 Progress Software Corporation. All rights reserved.19
CASE STUDY
CHALLENGE
MongoDB became a production database in Killik & Co’s
infrastructure, and the team began to move many processes from
SQL to MongoDB. Various departments began asking for data for
reporting purposes, which necessitated real-time connectivity
between SQL Server and MongoDB.
The SOLUTION
Using Progress DataDirect Connect for ODBC, Killik & Co will can
expose the data in the MongoDB database as normalized relational
tables, enabling the team to query, sort and aggregate data from
both systems to gain a far more comprehensive view of its
customers
© 2015 Progress Software Corporation. All rights reserved.20
Geek Bit - End to End
{
"_id": "c792351c-05b3-4794-b9e3-9cddccc1fb0f",
"audit": {
"created": "2014-09-03T18:06:27+01:00",
"userCreated": "Cater, Simon"
},
"data": {
"code": "G1234567G",
"name": "Dr S A Cater",
"type": "MPG",
"properties": {
"objective": "Killik Growth",
"reportTitle": "Dr S A Cater",
"modelResult": {
"rules": "Passed",
"guidelines": "Passed",
"lastRun": "2015-10-29T06:40:55+00:00",
"lastPassed": "2015-10-29T06:40:55+00:00"
},
"equityTarget": "85",
"nonEquityTarget": "15"
},
"scope": {
"clientReportScope": "CATER1,CATER2,-A123511:Managed Portfolio"
}
},
"owner": "Ipswich"
}
{
"_id": "c792351c-05b3-4794-b9e3-9cddccc1fb0f",
"audit": {
"created": "2014-09-03T18:06:27+01:00",
"userCreated": "Cater, Simon"
},
"data": {
"code": "G1234567G",
"name": "Dr S A Cater",
"type": "MPG",
"properties": {
"objective": "Killik Growth",
"reportTitle": "Dr S A Cater",
"modelResult": {
"rules": "Passed",
"guidelines": "Passed",
"lastRun": "2015-10-29T06:40:55+00:00",
"lastPassed": "2015-10-29T06:40:55+00:00"
},
"equityTarget": "85",
"nonEquityTarget": "15"
},
"scope": {
"clientReportScope": "CATER1,CATER2,-A123511:Managed Portfolio"
}
},
"owner": "Ipswich"
}
© 2015 Progress Software Corporation. All rights reserved.21
MongoDB BI Connector from Progress DataDirect vs MongoDB
MongoDB (Q4 2015) Progress DataDirect (Q1 2014)
Supported Versions MongoDB Enterprise Advanced 3.2 Supported with v2.2, 2.4, 2.6, 3.0,3.2
Free Software Foundation's GNU AGPL v3.0
MongoDB Professioal
MongoDB Enterprise Advanced
Known Workloads Data Visualization (extract) Data Visualization (extract)
Connect-Live
Operational BI
Data Federation
Deployment BI Desktop and/or Application Server
BI Connector on Linux Server Node(s)
BI Desktop and/or Application Server
Interface Postgres xDBC ANSI SQL MongoDB xDBC ANSI SQL
Fully Embeddable n/a Yes
Certification MongoDB MongoDB
DataDirect OVS/JVS (includes ISV suites)
Open source No No
Client Support Postgres open source community Commercial (includes TSANet Multi Vendor
Support)
© 2015 Progress Software Corporation. All rights reserved.22
Try it out
https://www.progress.com/odbc/mongodb
https://www.progress.com/jdbc/mongodb
https://www.mongodb.com/products/bi-connector
https://www.tableau.com/support/drivers
https://odbc.postgresql.org/
https://jdbc.postgresql.org/
© 2015 Progress Software Corporation. All rights reserved.23
Embedded Reports, Dashboards and Analyticswith TIBCO Japersoft & Progress
© 2015 Progress Software Corporation. All rights reserved.24
What is Embedded BI w/ TIBCO Jaspersoft?
The Old Way
Your apps
Analytics
Consumer
The Right Way
Put answers
in context
Increase
adoption of BI
Give consumers
actionable data
Embedded BI with TIBCO Jaspersoft
© 2015 Progress Software Corporation. All rights reserved.25
Where are the the Opportunities of Embedded BI w/ MongoDB?
Opportunity #2
Make your app competitive by
providing visualization and
reporting capabilities
demanded by end users
Opportunity #4
Save capital and use a
solution designed for modern
architectures
Spend more time developing
your core product and less
time handling report requests
Opportunity #1
Reduce time spent maintaining
home grown BI technologies
and deliver greater value with
a best-in-class solution
Opportunity #3
© 2015 Progress Software Corporation. All rights reserved.26
TIBCO Jaspersoft’s Journey with MongoDB
Native MongoDBDriver
ETL
In-Memory
Virtualization
Embedded
Progress
Driver
• Reports
created by
IT/Dev
• Requires
knowledge of
MongoDB
native query
language
• Extract data
from
MongoDB
• Good to
blend with
other data but
not using
power of
MongoDB
• Allows
blending data
and end user
driven reports
& analytics
• Slow, hard to
model data
• Full reporting,
dashboards,
analytics driven
by end users
• Easy metadata
• Use full power
of MongoDB
with complex
schemas
2015201320122011
Demonstration
User Self-ServiceDashboardsReports
Metadata Layer
Driver Layer
Data Layer
© 2015 Progress Software Corporation. All rights reserved.28
Attend a Weekly Demo
Watch a Webinar
Attend a live Event
Download Trial or Launch on AWS
Interested in TIBCO Jaspersoft?
Visit us at
www.jaspersoft.com
Our users LOVE Jaspersoft ad hoc reporting and
the performance of the system built on MongoDB
and Redshift
- Russ Davis, Founder and CEO
© 2015 Progress Software Corporation. All rights reserved.29
Welcome MongoDB connectivity to the DataDirect family
Big Data/NoSQL
Apache Hadoop Hive
Cloudera
Hortonworks
Pivotal HD
MapR
EMR
Pivotal HAWQ
Cloudera Impala
MongoDB
Spark SQL
Cassandra (preview)
SAP HANA (ODBC preview)
Data Warehouses
Amazon Redshift
SAP Sybase IQ
Teradata
Pivotal Greenplum
Relational
Oracle DB
Microsoft SQL Server
IBM DB2
MySQL
PostgreSQL
IBM Informix
SAP Sybase
Pervasive SQL
Progress OpenEdge
Progress Rollbase
SaaS/Cloud
Salesforce.com
Database.com
FinancialForce
Veeva CRM
ServiceMAX
Any Force.com App
Hubspot
Marketo
Microsoft Dynamics CRM
Microsoft SQL Azure
Oracle Eloqua
Oracle Service Cloud
Google Analytics
EDI/XML/Text
EDIFACT
EDIG@S
EANCOM
X12
IATA
Healthcare EDI: X12, HIPAA,
ICD-10, HL7
Custom EDI
Flat files: CSV, TSV, dBase,
Clipper, Foxpro, Paradox
Text Files
Any
SDK
SequeLink Socket Server
Customer Engineering
Q&A
Sumit Sarkar
Chief Data Evangelist
Progress DataDirect
Gene Arnold
Senior Sales Engineer
TIBCO Jaspersoft