linked data big data

21
The Value of Linked Data in the Age of Big Data Andreas Blumauer CEO & Managing Partner Semantic Web Company

Upload: semantic-web-company

Post on 08-Sep-2014

1.477 views

Category:

Spiritual


1 download

DESCRIPTION

Andreas Blumauer's talk at the Vienna Semantic Web Meetup 19.07.2012

TRANSCRIPT

Page 1: Linked data   big data

The Value of Linked Datain the Age of Big Data

Andreas Blumauer

CEO & Managing PartnerSemantic Web Company

Page 2: Linked data   big data

http://www.poolparty.biz/

• Founded as „punkt. netServices“ 1998 in Vienna

• Focus: Semantic (web) technologies & search applications

– 1st project based on semantic technologies in 2001

– Foundation of Semantic Web School in 2004 Semantic Web Company since 2008

– PoolParty development started in 2007

• PoolParty on the market since 2009

• Privately held, currently 20 specialists

About us

Page 3: Linked data   big data

http://www.poolparty.biz/

Volatility

Uncertainty

Complexity

Ambiguity

VUCA Worlds S

ee also: http://w

ww

.slideshare.net/dcaron/its-a-vuca-w

orld-cips-cio-march-5-2009-draft

Page 4: Linked data   big data

http://www.poolparty.biz/

A brief history of ‚Data‘

1990 2012

Volatility … The information needed today is different from the information needed tomorrow, next week or next month. Changes come from everywhere: internal strategy changes, competitive pressures, new regulatory requirements

Uncertainty

… Companies are increasingly drawing on data from outside their organization. They’re pulling together information from supply chain partners, from customers, from social media sites, from websites and public web databases.

Complexity

… Decision makers are relying on data buried in spreadsheets, in emails, in Access databases and in documents.

Ambiguity … Key enterprise data assets are no longer confined to predictably structured transactional databases and data warehouses.

Page 5: Linked data   big data

http://www.poolparty.biz/

Big Data: A Definition

See also: Jeffrey Layton, http://bit.ly/NZb4Yi (Enterprise Storage Forum)

Big Data is about

tools to examine

•large•distributed•unstructured•unrelated and•quickly growing

pools of data

to create information & knowledge from it.

Page 6: Linked data   big data

http://www.poolparty.biz/

Big Data: Another Definition

Big Data is about

tools that pull together

•large•distributed•unstructured•unrelated and•quickly growing

pools of data

to create an even bigger and less flexible data silowhich creates an even bigger lock-in effect for the customer.

Page 7: Linked data   big data

http://www.poolparty.biz/

Big Data: An example

Youtube: 3TIER, http://www.youtube.com/watch?v=iqSNXZL8GFk

3TIER has conducted feasibility studies for over 650 wind projects on 6 continents,

representing over 20GW of production potential.

In 2011 alone, 3TIER conducted risk analysis that helped secure over $4.1 billion in public and private financing for utility-scale solar projects in the US, India, and Australia.

Page 8: Linked data   big data

http://www.poolparty.biz/

Hunch: The power of correlation

See also: Hunch.com, http://blog.hunch.com/?p=47384

Hunch’s Taste Graph is the foundation that powers Hunch’s predictions. The graph is fast growing, constantly-improving and built upon a massive data structure.

Page 9: Linked data   big data

http://www.poolparty.biz/

Correlation vs. Causation

Sleeping with one's shoes on is strongly correlated with waking up with a headache

OR

Sleeping with one's shoes on causeswaking up with a headache?

Show me all drugs - related to asthma that - are linked to a curated molecular interaction in the literature - where the protein is known to cause inflammatory response

Page 10: Linked data   big data

http://www.poolparty.biz/

Centralized vs. Decentralized

centralized decentralized distributed

ETL

Page 11: Linked data   big data

http://www.poolparty.biz/

Example: Querying decentralized systems

How many people work at SWC?

SWC = Semantic Web Company

20 people workat Semantic Web Company

20 people work at SWC!

No central data hub needed!!!

Page 12: Linked data   big data

http://www.poolparty.biz/

How decentralization can contribute to cope with VUCA?

Volatility:Higher agility when managed units are smaller

Uncertainty:Make use of algorithms based on correlation

Complexity: Breaking down into smaller modules, crowd-sourcing and self organization

Ambiguity:Better understanding of specialities of sub-domains & local needs

Page 13: Linked data   big data

http://www.poolparty.biz/

Linked Data infrastructure -Technology

Page 14: Linked data   big data

http://www.poolparty.biz/

PoolParty components

PPT:Management of Metadata & Linked DataThesaurus & Vocabulary ManagementLinked Open Data Publishing

PPX: Text Mining & Extraction Metadata Mapping & HarmonizingData Integration

Page 15: Linked data   big data

http://www.poolparty.biz/

PoolParty components

PPP:Semantic IndexingTag Recommendation & Content Recommendation

PPS: Structured & Semantic SearchIntegrated ViewsContent Recommendation

Page 16: Linked data   big data

http://www.poolparty.biz/

PoolParty architecture

Page 17: Linked data   big data

http://www.poolparty.biz/

SKOSsy: Use ‚Big Data‘ to Generate knowledge models

Automatic generationof seed-thesauri fromlinked data

Page 18: Linked data   big data

http://www.poolparty.biz/

Knowledge Visualisation

  

Relation Browser Treeview

Page 19: Linked data   big data

http://www.poolparty.biz/

Data Visualisation

  

Extended Relation Browser Treemap

Page 20: Linked data   big data

http://www.poolparty.biz/

Fast and consistent classification of content

  

Page 21: Linked data   big data

http://www.poolparty.biz/

Semantic Web Company GmbHMariahilfer Strasse 70/81070 ViennaAustria

http://www.semantic-web.at/ http://poolparty.biz

Mag. Andreas [email protected]

Get in contact!