spark, nosql and real time processing by oscar mendez at big data spain 2014

Post on 09-Jul-2015

179 Views

Category:

Technology

1 Downloads

Preview:

Click to see full reader

DESCRIPTION

Big Data Spain welcomes everyone. The event will be a two-day intense conference. We will meet many people, learn a lot and have fun. Data is value. In this third edition of the conference we talk about real-time processes, machine learning, NoSql databases and how fast we can process the data using Spark technologies. Session presented at Big Data Spain 2014 Conference 17th Nov 2014 Kinépolis Madrid http://www.bigdataspain.org Event promoted by: http://www.paradigmatecnologico.com Abstract: http://www.bigdataspain.org/2014/conference/welcome-keynote https://www.youtube.com/watch?v=1ew-CUH93A4

TRANSCRIPT

WELCOME NOTE BDS14

ÓSCAR MÉNDEZCEO STRATIO AND PARADIGMA TECNOLÓGICO

Big Data Spain 2.014

Big Data Spain third edition36 SPEAKERS

10 WORKSHOPS500 ATTENDEES

DATA = VALUE

Actualmente el valor de lasempresas se mide por sus datos

467.142Mill $

373.608Mill $

150.211 Mill $

148.210Mill $

1 3 20 21

Data Value

DowJones PER2014 = 13

Facebook PER2014 = 48

Differentiation 35

PER = PER + PDR+

PER = 13 + 35 = 48+

TECHNOLOGY

Technology

At the beginning it was batch

Then came InteractiveDiscovery of data

< 40 secondsTo analyze petabytes in seconds

Enable decisions on real-time data

Real time Data Streaming Analysis

Machine LearningAlgorithms

Future Data

COMBINATIONPAST DATA > STORED

CURRENT DATA FLOWS > REAL-TIME DATA STREAMING

FUTURE DATA > MACHINE LEARNING & ALGORITHMS

NoSQL databasesTHE BEST OF BOTH WORLDS

COMBINED

“Two plus two is four? Sometimes… Sometimes it is five.” G. ORWELL

NoSQLdatabases

BD Processing

SIMPLIFICATION: Visual tools

Simplify Building Process

Clear Data Visualization

New ways of Data Visualization

IT THIRD GENERATION

CURRENT IT PARADIGM

CRM

E-COMMERCE

LOGISTIC

SALES

APPLICATION

SPECIALIZED

APPLICATIONS BI

DASHBOARD

REPORTING

R, SPS, SAS

BA

TERADATA

DW

DATA REPLICATION

HUMAN INTERVENTION

Current it paradigm

OPERATIONAL INFORMATIONAL

NEW IT PARADIGM

OPERATIONAL

DATA LAYER

INFORMATIONAL

Data layer Integration between Operational and Informational Applications

The spoon

Data exists by itself

OPERATIONAL

DATA

INFORMATIONAL

Companies will buy data, sell data, trade data andMake specific deals and partnerships to share or get data

Already Happening: RTB

THE ORACLE: THE FUTURE OF DATA

Millions of data analyzed in real time

Wearables & Mobile: One ring to rule them allThe small heart of the big system

Wearables: Sensors all around us

Nano Data Meets Big Data

CONCLUSSIONS

Take the Red pill and see reality: World is data, and data is your value

17TH ~ 18th NOV 2014MADRID (SPAIN)

top related