engineering and ow2 big data initiative: an open approach to the data-driven economy
TRANSCRIPT
Engineering and OW2 Big Data Initiative:
an open approach to the data-driven economy
Workshop on
Embracing Potential of Big Data
BIGDATA 2014
12 December 2014
Pisa, Italy
Who is Engineering
Engineering’s approach to Big Data
Extracting value from datavalue from data is the economy driver in
21st century
An olysticolystic and collaborative approachand collaborative approach is
necessary which combines skills and technologies to
obtain best results
A Big Data competency centerBig Data competency center is a key factor to
monitor technologies and to develop projects and
collaborations with vendors, academia and open source
communities
The specific value of openness
Some activities and initiatives
Hadoop User Group Italy
@HUG_Italy
Big Data Value Association
Industry-led contractual counterpart to the European
Commission for the implementation of the Big Data
Value PPP. A basic principle is openness,
transparency and inclusiveness
Engineering Tributi
Applying semantic technologies and ontology to
properly join and cross data about and around
citizens, coming from different administrations and
different means with a focus on territorial data
Engineering Finance
From Big Data to Right Data. Enriching business
and transactional data with data coming from social
media bridging governance and business
requirements so as to better synchronize financial
institutions with the marketLeading the OW2 Big Data Initiative
What is OW2
OW2 and Collaborative R&D Projects
OW2 provides community support and
dissemination services to OSS collaborative projectsTechnical platform
Community building
Events and media
Disseminations collateral
The OW2 Initiatives
Why the Big Data Initiative
Attract a vibrant ecosystemvibrant ecosystem around Big Data
technologies
Create an environment where interinter--disciplinary disciplinary
competencescompetences are expressed in joint projects
DefineDefine synergiessynergies and contribute to similar initiatives
Members
Some Addressed Topics
Data Data MiningMining
AdvancedAdvanced visualisationvisualisation
IntelligentIntelligent data data capturecapture
Social media Social media analysisanalysis
CollaborationCollaboration
LinkedLinked (open) data(open) data
StreamStream ProcessingProcessing
Example: social listening
Example: social listening, intelligent data capture
Data preparation Warehouse Processing Final Reports / Quality Check
Hadoop ClusterAnticipated quality check
Identification of key records
Uncompressed data loading directly
into the DWH Staging
Optimized loading
Example: social listening, analysis
Dataset
Cassandra
Neo4j
mongoDB
OrientDB
HDFS
Hive
HBase
Impala
Available data sources:
Example: social listening, visualization
Hashtags and Topics Cloud
Networks
Locations
Leveraging the federation of enterprise
and social data with Machine Learning
to support predictive analysis
How to join
Visit the OW2 Big Data Initiative web site
www.ow2.org/www.ow2.org/viewview//Big_DataBig_Data