Working with the Microsoft Business Intelligence EcosystemJohn P Whitejpw@unlimitedviz.com@diverdown1964http://whitepages.unlimitedviz.com

John WhiteCTO/Co-Founder of UnlimitedVizSharePoint Server MVP, SQL Server v-TS

jpw@unlimitedviz.comhttp://whitepages.unlimitedviz.com@diverdown1964

Agenda

The Microsoft BI Stack

Business Intelligence 101

ToolingArchitecture Tips and tricks

BI in action

The state of the world

The Microsoft BI Stack

Microsoft BI

PerformancePoint Services

for

Office 365

Business Intelligence containers

Office

SQL Server

SharePoint

On Premises Cloud

Azure IAAS

Excel ServicesPower BI

ExcelPower PivotPower ViewPower QueryPower Map

DB EngineSSASSSRSSSISData Tools

SSRS SP ModePerformancePointPowerPivot for SharePointFiltersReport Builder

Business Intelligence 101

“One does not simply walk into Mordor report on live data”

- Boromir

BI Architecture 101Data Marts

Extract, Transform, and Load (ETL)

Middleware Server(s)Data

Warehouse

Storage Design and Visualization

Data Cubes and Tabular

Models

E

T

L

Reporting Server(s)

BI and Designer Clients

Source data

Microsoft enterprise (classic) BISQL Server DBSQL Server

Integration Services (SSIS)

SharePoint (with)• Excel Services• PowerPivot for

SharePoint• SSRS SharePoint Mode• PerformancePoint

SQL Server DB

Storage Design and Visualization

SQL Server Analysis Services

Multidimensional and Tabular modes

L

SQL Server Reporting Services (SSRS)

ExcelSQL Data ToolsReport Builder3rd party tools

ETL

E

T

Source data

Microsoft personal BI (All in Excel)Worksheets

Tabular Data Model (xVelocity)

Pivot Charts and Tables

Power View (Analytic reports)

Power Map (Geospatial and time series data)

Power Pivot (Model design)

Power Query (ETL)

Power Pivot Import (EL)

SharePoint IS the deployment platform

Power Pivot Worksheets• Pivot Tables and

Charts• Power View

Data Marts and other

Data Cubes and Tabular

Models

Standard Worksheets• Pivot Tables and

Charts

PerformancePoint Reports• Analytic Charts and Grids• Decomposition treesSQL Server Reporting Services Reports• Standard• Power View

PerformancePoint Scorecards and KPIs

Architecture

Standard 2 server SharePoint farm

Server OS

SharePoint Foundation

FE ProfileExcel Servic

esSearc

h …….

Server OS

SQL Server

DB SSAS

SSIS

BI integration – classic mistake

Server OS

SharePoint Foundation

FE ProfileExcel Servic

esSearc

h …….

Server OS

SQL Server

SharePoint Foundation

DB SSAS

SSIS

SSRS PP

BI integration – 2 server farm

Server OS

SharePoint Foundation

WFE ProfileExcel Servic

esSearc

h ……. SSRS PP

Server OS

SQL Server

DB SSAS

SSIS

Large farm deployment

Server OS

SharePoint Foundation

Profile Indexer

Search ……. SSRS

Server OSSQL Server

DB SSAS SSIS

Server OS

SharePoint Foundation

FE

Server OS

SQL Server

Analysis Services – SharePoint Mode

Server OS

SharePoint Foundation

Profile Indexer

Search ……. SSRS

Server OS

SharePoint Foundation

Profile Indexer

Search ……. SSRS

Server OS

SharePoint Foundation

ProfileExcel

Services

Search ……. SSRS

Server OS

SharePoint Foundation

FE

Server OS

SharePoint Foundation

FE

Server OS

SharePoint Foundation

FE

Server OS

SQL Server

Analysis Services – SharePoint Mode

Server OS

SQL Server

Analysis Services – SharePoint Mode

Server OS

SQL Server

Analysis Services – SharePoint ModePP

Power BI – Data Management Gateway

Browser

Data Management Gateway

Internal data source

PowerPivot for SharePoint vs Power BI

Feature PowerPivot for SharePoint

Power BI

Interaction with Embedded Models

Yes Yes

Power View rendering Yes (with export) YesUse embedded model as data source

Yes No

Auto refresh Yes Yes (limited)Model size limit 2Gb 250 MbThumbnail gallery Yes YesPre-optimize workbooks No YesPublish OData feeds No YesNatural language query No YesMobile client No Yeshttp://whitepages.unlimitedviz.com/2013/12/whither-power-pivot-for-sharepoint-a-comparison-with-power-bi/

Tooling

Data Acquisition (ETL)

Power Pivot Import

SQL Server Integration Services

Power Query

Visualizations (on prem)

ExcelSQL Server

SharePoint

Pivot Charts/TablesPower ViewPower Map

SSRS Native ModePerformancePoint Scorecards Analytic Charts/Grids Dashboard DesignerExcel Services Web PartSSRS Web PartPower View (SSRS)

Visualizations (Office 365)

ExcelOffice 365

Pivot Charts/TablesPower ViewPower Map

Excel Services Web PartFiltersPower Q&APower BI for Windows 8.1

Dashboarding

Excel OnlyPerformancePoint*SSRS Only*

SharePoint Mashup

* On-prem only

Demo – the tools

Acquisition and visualization

Tips and tricks

It’s a little known fact

Not everything that counts can be counted, and not everything that can be counted counts.Albert Einstein

Requirements gathering

Minimum Viable Product

MVP

Define target

audience groups

Exclude less important

groups

Define use cases

Prioritize Use Cases

Translate into

requirements

Test with target

audience

Translate requirements

into functionality

Draw wire frames

Test with target

audience

MVP definition

Funding

Technology

Source: JumpStartCTO - http://jumpstartcto.com/how-do-you-gather-and-prioritize-the-requirements-and-functionality-for-a-minimal-viable-product/

Authorization

KerberosSSRSExcel Direct ConnectPerformancePoint

BISMPowerView in SSRS

SetUser()SSRS DB Reports

EffectiveUserName()Excel ServicesPerformancePoint

Per User

Excel Services

SSRS SharePoint Mode

Document Level

Impersonation in SSRS

Impersonation Options

SQL Server Analysis Services Analysis Services SharePoint Mode

Excel Services No Yes NoReporting Services Yes Yes NoPower View N/A Yes NoPerformancePoint No Yes No

Both SETUSER() and EFFECTIVEUSERNAME require elevated permissions (Administrator for AS, dbowner or sysadmin for SQL)

Data freshnessCo

st

Data Latency

Data freshness

StreamInsightDirectQuery

PowerPivot for SharePoint*Power BI

Real time Periodic Daily

SQL Server Integration Services

* Hackable – For more granularity, see Ian Smith’s blog:http://smithicus.wordpress.com/2011/08/09/using-a-custom-data-refresh-schedule-in-powerpivot-for-sharepoint/

Power BI

Licensing

Excel OnlyPerformancePoint

SSRS Only SharePoint

On Premises Office 365

PerformancePoint

SharePoint Enterprise

Excel Only

SharePoint EnterpriseSQL Server Standard (basic)SQL Server BI (tabular or PowerPivot)

SSRS Only

SharePoint FoundationSQL Server Express or above Power BI

Licensing

Excel OnlyPerformancePoint

SSRS Only SharePoint

On Premises Office 365

Turn OFF Rendering for xlsx filesOffice Web Apps

New-SPWOPISuppression –extension xlsx –action view

http://blogs.technet.com/b/excel_services__powerpivot_for_sharepoint_support_blog/archive/2013/01/31/powerpivot-for-sharepoint-browser-refresh-fails-data-refresh-not-supported-in-office-web-apps.aspx

Power Query data load options

Default is this Should be this

Power BI Boundaries

SharePoint storage

Power BI ModelMaximum workbook size

Excel Services rendering

2 Gb

10 Mb 250 Mb

260 Mb

Browser editing

30 Mb

http://whitepages.unlimitedviz.com/2013/08/power-bi-office-365-and-file-size-limits-be-careful/

Reporting Services does it nativelySQL Server Integration Services

WarehousingOperational efficiency

SharePoint List Source and Destination (Codeplex Project)

http://sqlsrvintegrationsrv.codeplex.com/releases/view/17652 (Download)http://dataqueen.unlimitedviz.com/2011/06/how-to-use-a-sharepoint-list-as-a-data-source-in-your-ssis-package/ (How to)

OData Source for Microsoft SQL Server 2012 (Official)http://www.microsoft.com/en-us/download/details.aspx?id=42280 (Download)http://whitepages.unlimitedviz.com/2014/03/using-the-odata-source-connector-with-sharepoint-online-authentication/ (How to)

SharePoint as a data source

Good Tool, but too many false positivesPowerPivot has special rulesCorrect the real problems, disable the othersHow to

http://whitepages.unlimitedviz.com/2012/06/the-health-analyzer-and-powerpivot-for-sharepoint/

Health Analyzer

DBI-B323 Power Query in Modern Corporate BI – today @ 3:15 Related content

DBI-B322 Improving Power Pivot Data Models for Microsoft Power BI – Thurs @ 8:30DBI-B210 Building the Modern Analytics Architecture: HDInsight and Power BI – Thu @ 1:00

Find me at MSE today at

Q&A

@diverdown1964whitepages.unlimitedviz.com

ResourcesLearning

Microsoft Certification & Training Resourceswww.microsoft.com/learning

msdnResources for Developers

http://microsoft.com/msdn

TechNetResources for IT Professionals

http://microsoft.com/technet

Sessions on Demandhttp://channel9.msdn.com/Events/TechEd

Complete an evaluation and enter to win!

Evaluate this sessionScan this QR code to evaluate this session.

Twitter: @diverdown1964 blog: whitepages.unlimitedviz.com email: jpw@unlimitedviz.com

© 2014 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.