the big data revolution - eit conference, rennes, 2015

© 2015 INTERNATIONAL BUSINESS MACHINES CORPORATION

The Big Data Revolution:

welcome to the

Cognitive Era.

Yves Eychenne, Cloud Advisor, IBM

Email: [email protected]

@yeychenne

mailto:[email protected]

Agenda

• Big Data and Cloud

– An Open Innovation Revolution

– Cloud Standards Customer Council

• From Big Data to the Cognitive Era

– IBM Watson

– Watson Developer Cloud

© 2015 IBM Corporation3

A growing Interconnected and Instrumented World

2+

billionpeople

on the

Web by

end 2011

30 billion RFID

tags today

(1.3B in 2005)

4.6

billioncamera

phones

world

wide

100s of

millions

of GPS

enableddevices

sold

annually

76 million smart

meters in 2009…

200M by 2014

500+ Millionusers posting 55 Million

tweets every day

1+ Billion active users

spending 700 Million minutes per

month

1.2

T

rill

ion

s

ea

rch

es


Industry

Transformation

DevOps,Agility

Capex

Reduction

Cloud 1.0 Cloud 2.0 Cloud 3.0

DataScientist

BusinessAnalyst

CXO

Industry Analytics Cloud

Security and Compliance are becoming paramount

Cognitive Era

Data originates in Cloud

Big Data workloads create high east-west datacenter traffic and often require large, low latency storage

A A

~5:1

A A A

S S S

S

S S

S

S

AR AR

CRCR

A A A A A A

~40:1

~200:1

S

S

ARAR

S

A

Challenge 1 Challenge 2 Challenge 3

Fragmented and complex security controls

Sophisticated threats and attackers

Increased attack surface due to agile and composablesystems

Cloud is becoming the home of Analytics, Big Data and Cognitive systems


Apache Spark is an open

source cluster computing

framework with in-

memory primitives to

significantly outperform

Hadoop deployments

IBM has significant

interests in Spark and has

pledged 3.5k researchers

to work related projects &

education for 1m data

scientists. Additionally,

IBM plans to donate its

SystemML machine

learning to Spark.

Top Initiatives

• Complete the donation of SystemML as OSS

• Spark as a Service on Bluemix

• Establish the Spark Technology Center

Open Innovation Revolution: Open Source.

Open Governance. Memory centric. Real-time.

Containers. Scripts.

World Class Cloud Infrastructure

Cloud Business AppsOAuth

Digital Innovation Platform


User access

New data added

Verify & normalize

Real time events

Access control

Discover, align & analyze

Report & share insight

Transform & deliver

Decide & take action

Big Data value is about use cases, not just technologies. Cloud Standards Customer Council Fraud and Identity Theft Scenarios

6

© 2015 IBM Corporation7 7

Cloud Customer Architecture for Big Data & Analytics –Mapper on IBM Bluemix PaaS

Agenda

• Big Data and Cloud

– An Open Innovation Revolution

– Cloud Standards Customer Council

• From Big Data to the Cognitive Era

– IBM Watson

– Watson Developer Cloud

© 2015 IBM Corporation9Natural, Intuitive or Automated Interaction

Co

nte

xt S

pe

cifi

c U

sage

- Focus on cost, speed and scale

- Win on Innovation

- Focus on time to business value through context specific data, methods, workflow.

InformationIntegration

RDBMS

ECM

Big DataPlatforms

StandardReports

Ad HocReports

DrilldownQuery

Alerts

StatisticalAnalysis

Forecasting

PredictiveModeling

Rules

Optimization

Natural Language

Reasoning

Learning

Beyond Big Data – Cognitive systems

Insights drives the business value


Multiple interpretations

Hundreds of answer sources

• Primary search

• Candidate answer

generation

Tens of thousands of evidence sources

and scores

• Answer scoring

• Evidence retrieval

• Deep evidence scoring

Learned models

• Combine and weigh evidence

Inquiry analysis Decomposition Hypothesis generation SynthesisHypothesis and

evidence scoring

Final confidence

merging and rankingQuestion Answer

? !

Watson: an example of a Cognitive System

Understands Natural LanguageWatson can read and understand millions

and millions of documents.

• Medical Texts

• Evidence-Based Guidelines

• Peer-reviewed Articles

• Clinical records

Generates and EvaluatesWatson searches, extracts candidate

recommendations scores and ranks decisions

Learns and AdaptsDecisions being made by leading

Physicians feed the engine

Watson and MeUnderstands and engages me

Learns and improves over time

Helps me discover

Establishes trust

Has endless capacity for insight

Operates in a timely fashion

Watson: Health

© 2015 IBM Corporation12© 2015 International Business Machines Corporation

Watson Developer Cloud provides developers easy access to

expertise via a collection of REST APIs & SDKs

Ibm.com/WatsonDeveloperCloudAccess the site to see the latest additions and updates.

http://www.ibm.com/smarterplanet/us/en/ibmwatson/developercloud/


The services can be mixed and matched to address

pressing use case needs like:

© 2015 International Business Machines Corporation

Wealth and Information Management CRM (AlchemyLanguage, Concept

Expansion, Relationship Extraction, Personality Insights, etc...)

Watson ExplorerBuild a 360 view of all your

information

Q&AAsk a natural language

question about your data: “Which portfolio is

growing the fastest?”

Relationship Extraction- Find

new connections between News and investments

Tradeoff

Analytics- Which

stocks are affected most

by different market

information variables.

Personality Insights-What personality insights can I gain through public articles about ownership?

AlchemyLanguage-find people, places, timelines

from all major news and financial sites

Watson Cloud – The App Gallery

http://www.ibm.com/smarterplanet/us/en/ibmwatson/developercloud/gallery.html

https://vimeo.com/ibmwatson/review/130135196/ededb6b90f?cm_mc_uid=32750628264614449820055&cm_mc_sid_50200000=1445113582


Watson Developer Cloud Enterprise

Can I use it?

© 2015 International Business Machines Corporation

• Free access to Bluemix platform for 30 days

• Free Beta & Experimental services - fixed content

• Pay-as-you-go GA services after free ‘xxx’ API Calls/Month (priced individually)

• Use of custom Content varies by service

• Custom Content Q&A service - 10 users; 10Gb of data

• Watson Developer Cloud GA services --30% of subscription*

• Onsite Training - 60 Hours^

• Monthly Mentoring - 10 Hours^

*GA services only^ Additional training/mentoring available.