bi in the cloud
DESCRIPTION
TalkTRANSCRIPT
Lynn LangitPractioner, Author, Instructor
Business Intelligence in the Cloud“psst…it’s about Data Mining”
History (Better Reporting drives BI)
Make OLTP more ‘readable’• Add indexes• Duplicate the data (‘the reporting database’)• Replicate or distribute parts of the data
We can write T-SQL queries• We can train analysts to write great T-SQL• Client tools ‘mask’ (generate) T-SQL
Let’s just give up and buy something• Proprietary, expensive and inflexible
Current State
• I define my OLAP • Maybe it’s a read-only copy of my OLTP –OR-• Maybe it’s a cube• Maybe it uses some data mining too
Let’s all OLAP
• I’ll keep it on premises• I’ll secure it, tune queries, back it up, etc.It’s my data
• Too difficult, expensive, proprietary….
Data Mining really?
Do you use Data Mining?
Current State Questions
Why did this happen?
When did this happen?
Where did this happen?
Who is responsible?
What might happen to this one value in the future?
Can you write me a report for…?
BI Data Landscape
StorageProcessing
Query
Presentation
Adding the Cloud…
• Host Data in the Cloud• Process & Query Data in the Cloud– Click to query and (data) mine– Return the data locally– Use Self-service BI visualizers
• Enjoy new Client tools and formats– Mash-up results
NoSQL and Cloud-based BI
• The Elephant in the room…Hadoop• Over 120+ types of noSQL databases– http://nosql-database.org/
Can’t We All Play Together?
Data in the Cloud - Microsoft
Windows Azure DataMarket
Amazon AWS
Google App Engine Data
New on Google – MySQL++
I am a Data Scientist
Some BI Query Languages
Microsoft
• MDX, DMX, T-SQL, DAX, XMLA -- data• Infer.Net --programmer
Open Sour
ce
• R, Hive (SQL-like) --data• MapReduce (Java) --programmer
R-Language
Becoming a Data Scientist
• O’Reily books / videos• Conferences– Strata / Data Scientist Summit– CloudCamp
HortonWorks, Cloudera…
Karmasphere Studio for Amazon Elastic MapReduce
Excel PowerPivot
Power Pivot in action
More PowerPivot
Self-Service Data Mining Predixion
QlikView
QlikView on iPad
BigData = Next Questions
• What could happen?• Why didn’t this happen?• When will the next new thing
happen?• What will the next new thing
be?
Collecting MORE than
transactional data
Splunk
Mining Log Files
Presenting the results
BI vNext for Microsoft?SQL Server 2012 - New BI tools and semantic model• Data Quality Services• Master Data Services• Semantic Search• PowerView
SQL Azure vNext - Federations,
features, max. size increase
Full BI IN the cloud (SSAS, SSIS, SSRS)
More new tools for BigData
BI >BigData ‘To Do ListStore some (more) data on the cloud• Relational and non-relational
Process some data in the cloud• Try data mining• Learn about Data Science
Update your client tools• New UI (touch, gestures)• Click to Query• New form factors (phone, tablet)
Is Data Science your next Career?
Deeper Comparison Chart
www.TeachingKidsProgramming.org
• Do a Recipe Teach a Kid (Ages 10 ++)• Microsoft SmallBasic Free Courseware (recipes)
Keep up with Big Data
Follow me @LynnLangit
RSS my blog www.LynnLangit.com
Hire me• To help build your BI/Big Data solution• To teach your team next gen BI