pentaho analytics for mongodb - presentation from mongodb world 2014

26
© 2013, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-7555 1 Bo Borland VP, Field Technical Sales Blending disparate data into a single MongoDB view for analytics Pentaho Analytics for MongoDB

Upload: pentaho

Post on 20-Aug-2015

2.934 views

Category:

Business


3 download

TRANSCRIPT

Page 1: Pentaho Analytics for MongoDB - presentation from MongoDB World 2014

© 2013, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-75551

Bo BorlandVP, Field Technical Sales

Blending disparate data into a single MongoDB view for analytics

Pentaho Analytics for

MongoDB

Page 2: Pentaho Analytics for MongoDB - presentation from MongoDB World 2014

© 2013, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-75552

Page 3: Pentaho Analytics for MongoDB - presentation from MongoDB World 2014

© 2013, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-75553

Tesla Motors Inc

$34/per share

$229/per share

January 2013 thru June 20, 2014

Page 4: Pentaho Analytics for MongoDB - presentation from MongoDB World 2014

© 2013, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-75554

Tesla Motors IncCurrent month stock performance

Tesla announces it will share all patents in spirt of open source movementSource: http://www.teslamotors.com/blog/all-our-patent-are-belong-you

June 12th -Open Source

Announcement

1. Attract and motivate the world’s most talented engineers

2. Collaborate with auto-makers on a common, rapidly evolving technology platform (the charging station network)

3. Accelerate the creation and advancement of electronic vehicles (sustainable transport) to address carbon crises

10% increase

Page 5: Pentaho Analytics for MongoDB - presentation from MongoDB World 2014

© 2013, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-75555

Tesla Motors IncMixed reaction to open source news

June 12th -Open Source

Announcement

June 12, 2014 - Tesla Motors Inc. to Give Away Patents -- Good or Bad for Investors?

June 15, 2014 - Electric car groups eye collaboration over charging technology

Page 6: Pentaho Analytics for MongoDB - presentation from MongoDB World 2014

© 2013, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-75556

Supercharger Charging StationsOpen Now & By 2015

June 16, 2014 - Tesla Motors, Inc. Stock Jumps on News of Possible Charging Collaboration

“Tesla stock is up about 3% this morning (at the time of this writing) after Financial Times author Henry Foy reported that Tesla, Nissan, and BMW, the world's three largest manufacturers of electric vehicles, are in "keen talks" regarding a new level of collaboration on charging networks, according to sources at all three companies.”

Page 7: Pentaho Analytics for MongoDB - presentation from MongoDB World 2014

© 2013, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-75557

Market-Moving InsightsBlending sources that can influence stocks and financial markets

Twitter Sentiment issued by corporations, executives, government officials, economist, commentators,

media outlets.

High-quality news from various news organizations and industry bloggers

Intra-day buy/sell stock quote data

Page 8: Pentaho Analytics for MongoDB - presentation from MongoDB World 2014

© 2013, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-75558

• Web service api call for live intraday equity quote data• Level 1, tick-by-tick quote data for given stock and date range• Enrich the data and load to MongoDB• Relevant fields:

• Date• Time• Bid Price• Offer Price• Bid Qty• Offer Qty

Intraday Equity Quotes

Page 9: Pentaho Analytics for MongoDB - presentation from MongoDB World 2014

© 2013, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-75559

• Live Twitter API search query for Telsa Motor stock• Unstructured search result is parsed• Enriched with Pentaho predictive analytics model to derive

sentiment score• Enriched dataset loaded to MongoDB• Relevant fields:

• User• Tweet text• Retweet count• Followers• Search term• Sentiment index

Twitter Sentiment Data

+1 (Positive)

0 (Neutral)

-1 (Negative)

Advanced Analytics

Data Science Pack: Pentaho 5.1 capability with a text classification predictive model to score each tweet and load the tweets and scores into MongoDB.

Page 10: Pentaho Analytics for MongoDB - presentation from MongoDB World 2014

© 2013, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-755510

Market-Moving Insights

• Intra-day buy/sell stock quote data provided by a web service

• Real time Twitter data provided by Twitter API

• Pentaho Data Integration to blend disparate data sources

• Pentaho Predictive Analytics to enrich data with twitter sentiment score

Single MongoDB view with Pentaho Analysis to make

stock investment decisions

Page 11: Pentaho Analytics for MongoDB - presentation from MongoDB World 2014

© 2013, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-755511

Analyzer for MongoDB

Released Today as part of Pentaho 5.1 Release

Analyze and visualize MongoDB data thru a drag-n-drop interface.

• Native OLAP analysis on real-time data in MongoDB

• Easy to use, award-winning OLAP interface for building visualizations that can be added to dashboards

• Native integration with MongoDB leveraging the power of the MongoDB query language and aggregation framework.

Analyze blended June data to make an investment decision on Tesla Motors?

Page 12: Pentaho Analytics for MongoDB - presentation from MongoDB World 2014

© 2013, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-755512

Analyzer Demonstration

Page 13: Pentaho Analytics for MongoDB - presentation from MongoDB World 2014

© 2013, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-755513

Market-Moving InsightsBlending sources that can influence stocks and financial markets

Twitter Sentiment issued by corporations, executives, government officials, economist, commentators,

media outlets.

High-quality news from various news organizations and industry bloggers

Intra-day buy/sell stock quote data

BlendEnrichPredictLoad

QueryAggregate

NotifyInform

Page 14: Pentaho Analytics for MongoDB - presentation from MongoDB World 2014

© 2013, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-755514

mongoDBclusterPDI ETL

Analytics

Broad ConnectivityBroad connectivity combined with powerful data integration

Page 15: Pentaho Analytics for MongoDB - presentation from MongoDB World 2014

© 2013, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-755515

Concept – Data Transformations

INPUT(S) – PROCESS(ES) – OUTPUT(S)

Page 16: Pentaho Analytics for MongoDB - presentation from MongoDB World 2014

© 2013, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-755516

Data Integration Demonstration

Page 17: Pentaho Analytics for MongoDB - presentation from MongoDB World 2014

© 2013, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-755517

Pentaho Visual DevelopmentEliminates the Need for Complex Coding

Would you rather do this?

Scheduling

Modeling

Ingestion / Manipulation / Integration

… or this?

Page 18: Pentaho Analytics for MongoDB - presentation from MongoDB World 2014

© 2013, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-755518

Equity Data Ingestion

INPUT(S) – PROCESS(ES) – OUTPUT(S)

Page 19: Pentaho Analytics for MongoDB - presentation from MongoDB World 2014

© 2013, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-755519

Twitter API Data Ingestion

INPUT(S) – PROCESS(ES) – OUTPUT(S)

Page 20: Pentaho Analytics for MongoDB - presentation from MongoDB World 2014

© 2013, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-755520

Pentaho Job Automates Data Load Sequence

START – CHECK – WATCH – EXECUTE – NOTIFY - FINISH

Page 21: Pentaho Analytics for MongoDB - presentation from MongoDB World 2014

© 2013, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-755521

Equity Quotes SchemaEliminates the need for table joins

RDBMS Star Schema

(6-9 tables)

Mongo Hierarchy Schema

(1 collection)

quotes

tweets

company dimension

date dimension

time dimension

tweet dimension

record type

dmension

Page 22: Pentaho Analytics for MongoDB - presentation from MongoDB World 2014

© 2013, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-755522

Entity 360 – NoSQL ArchitectureA Blended View to Drive Revenue Growth and Service Improvements

MongoDB

CRM System

Claims

Admin. Info

PDI

Online Transactions

Documents & Images

PDI

Advanced Analytics

Business Analysis

Analyzer for MongoDB

Data Science

Pack

Aggregation

Framework

Data Science

Pack

Page 23: Pentaho Analytics for MongoDB - presentation from MongoDB World 2014

© 2013, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-755523 © 2013, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-755523

OPERATIONAL DATA BIG DATA DATA STREAMPUBLIC/PRIVATE CLOUDS

DBA/ETL/BI DEVELOPER BUSINESS USER BUSINESS/DATA ANALYST

Data Integration +

Analytics + Predictive

Extensive community of

developers

Pluggable, extensible, java

architecture

Single, Open Platform for Analytics

Page 24: Pentaho Analytics for MongoDB - presentation from MongoDB World 2014

© 2013, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-755524

Pentaho Analytics for MongoDB

Page 25: Pentaho Analytics for MongoDB - presentation from MongoDB World 2014

© 2013, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-755525

Learn more: http://www.pentaho.com/analytics-for-mongodb

Watch demo:

http://www.pentaho.com/resource/analyzer-on-mongodb-video

Download: http://www.pentaho.com/testdrive

Resources & Links of Interest

Page 26: Pentaho Analytics for MongoDB - presentation from MongoDB World 2014

© 2013, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-755526

Bo BorlandVP, Field Technical [email protected]

Thank You