drupal for big data - is it ready? (european drupal days 2015)

51
© Ibuildings 2014/2015 - All rights reserved #DrupalDaysEU Drupal for big data - is it ready?

Upload: ibuildings-italia

Post on 16-Jul-2015

210 views

Category:

Internet


2 download

TRANSCRIPT

Page 1: Drupal for Big Data - is it ready? (European Drupal Days 2015)

© Ibuildings 2014/2015 - All rights reserved

#DrupalDaysEU

Drupal for big data - is it ready?

Page 2: Drupal for Big Data - is it ready? (European Drupal Days 2015)

#DrupalDaysEU

© Ibuildings 2014/2015 - All rights reserved

Gold Sponsors

Page 3: Drupal for Big Data - is it ready? (European Drupal Days 2015)

#DrupalDaysEU

© Ibuildings 2014/2015 - All rights reserved

Media Sponsors

Silver Sponsors

Page 4: Drupal for Big Data - is it ready? (European Drupal Days 2015)

© Ibuildings 2014/2015 - All rights reserved

Janis Janovskis

Drupal architect and entrepreneurworked > 100 frameworks, led > 55 guys

janis.janovskis@passivemanagement@PASSIVUS

CTO of Passive Management

Page 5: Drupal for Big Data - is it ready? (European Drupal Days 2015)

#DrupalDaysEU

© Ibuildings 2014/2015 - All rights reserved

passivemanagement.net

Page 6: Drupal for Big Data - is it ready? (European Drupal Days 2015)

#DrupalDaysEU

© Ibuildings 2014/2015 - All rights reserved

Page 7: Drupal for Big Data - is it ready? (European Drupal Days 2015)

#DrupalDaysEU

© Ibuildings 2014/2015 - All rights reserved

Page 8: Drupal for Big Data - is it ready? (European Drupal Days 2015)

#DrupalDaysEU

© Ibuildings 2014/2015 - All rights reserved

Page 9: Drupal for Big Data - is it ready? (European Drupal Days 2015)

#DrupalDaysEU

© Ibuildings 2014/2015 - All rights reserved

Page 10: Drupal for Big Data - is it ready? (European Drupal Days 2015)

#DrupalDaysEU

© Ibuildings 2014/2015 - All rights reserved

Big Data???

@Wikipedia

Big data is a broad term for data sets so large or complex that traditional data processing applications are inadequate. Challenges include analysis, capture, curation, search, sharing, storage, transfer, visualisation, and information privacy. The term often refers simply to the use of predictive analytics or other certain advanced methods to extract value from data, and seldom to a particular size of data set.

Page 11: Drupal for Big Data - is it ready? (European Drupal Days 2015)

#DrupalDaysEU

© Ibuildings 2014/2015 - All rights reserved

Volume

Page 12: Drupal for Big Data - is it ready? (European Drupal Days 2015)

#DrupalDaysEU

© Ibuildings 2014/2015 - All rights reserved

Velocity

Page 13: Drupal for Big Data - is it ready? (European Drupal Days 2015)

#DrupalDaysEU

© Ibuildings 2014/2015 - All rights reserved

Variety

Page 14: Drupal for Big Data - is it ready? (European Drupal Days 2015)

© Ibuildings 2014/2015 - All rights reserved

Hang on…. What is Drupal?

Page 15: Drupal for Big Data - is it ready? (European Drupal Days 2015)

#DrupalDaysEU

© Ibuildings 2014/2015 - All rights reserved

Page 16: Drupal for Big Data - is it ready? (European Drupal Days 2015)

#DrupalDaysEU

© Ibuildings 2014/2015 - All rights reserved

Page 17: Drupal for Big Data - is it ready? (European Drupal Days 2015)

#DrupalDaysEU

© Ibuildings 2014/2015 - All rights reserved

Page 18: Drupal for Big Data - is it ready? (European Drupal Days 2015)

#DrupalDaysEU

© Ibuildings 2014/2015 - All rights reserved

DataBase

Page 19: Drupal for Big Data - is it ready? (European Drupal Days 2015)

#DrupalDaysEU

© Ibuildings 2014/2015 - All rights reserved

Web server

Page 20: Drupal for Big Data - is it ready? (European Drupal Days 2015)

#DrupalDaysEU

© Ibuildings 2014/2015 - All rights reserved

Structure

Page 21: Drupal for Big Data - is it ready? (European Drupal Days 2015)

#DrupalDaysEU

© Ibuildings 2014/2015 - All rights reserved

Page 22: Drupal for Big Data - is it ready? (European Drupal Days 2015)

#DrupalDaysEU

© Ibuildings 2014/2015 - All rights reserved

@Data Science for businesses

The fundamental concepts of data science are drawn form many fields that study data analytics …

Page 23: Drupal for Big Data - is it ready? (European Drupal Days 2015)

#DrupalDaysEU

© Ibuildings 2014/2015 - All rights reserved

Unstructured data

Page 24: Drupal for Big Data - is it ready? (European Drupal Days 2015)

© Ibuildings 2014/2015 - All rights reserved

Can We parse unstructured data with Drupal???

Page 25: Drupal for Big Data - is it ready? (European Drupal Days 2015)

#DrupalDaysEU

© Ibuildings 2014/2015 - All rights reserved

function my_analysis_external_views_plugins() { $plugin = array();

$plugin['query']['my_analysis_master_plugin_query'] = array();

….. }

Views???

Page 26: Drupal for Big Data - is it ready? (European Drupal Days 2015)

#DrupalDaysEU

© Ibuildings 2014/2015 - All rights reserved

Views???

public function query($get_count = FALSE){

}

Page 27: Drupal for Big Data - is it ready? (European Drupal Days 2015)

#DrupalDaysEU

© Ibuildings 2014/2015 - All rights reserved

function execute(&$view){

$data = drupal_http_request(“what so ever”);

}

Views???

https://www.lullabot.com/blog/article/building-views-query-plugins-part-2

Page 28: Drupal for Big Data - is it ready? (European Drupal Days 2015)

#DrupalDaysEU

© Ibuildings 2014/2015 - All rights reserved

Page 29: Drupal for Big Data - is it ready? (European Drupal Days 2015)

© Ibuildings 2014/2015 - All rights reserved

https://www.drupal.org/project/feeds_crawler

Page 30: Drupal for Big Data - is it ready? (European Drupal Days 2015)

#DrupalDaysEU

© Ibuildings 2014/2015 - All rights reserved

Page 31: Drupal for Big Data - is it ready? (European Drupal Days 2015)

#DrupalDaysEU

© Ibuildings 2014/2015 - All rights reserved

Pros

• Great community

• Support

• Reputation

• Myriad of vendors

Page 32: Drupal for Big Data - is it ready? (European Drupal Days 2015)

#DrupalDaysEU

© Ibuildings 2014/2015 - All rights reserved

Cons

• Too robust

• Slow

• No lazy loading

• Single threaded

• Heavy

• Structured

Page 33: Drupal for Big Data - is it ready? (European Drupal Days 2015)

© Ibuildings 2014/2015 - All rights reserved

Case Studies

Page 34: Drupal for Big Data - is it ready? (European Drupal Days 2015)

#DrupalDaysEU

© Ibuildings 2014/2015 - All rights reserved

Page 35: Drupal for Big Data - is it ready? (European Drupal Days 2015)

#DrupalDaysEU

© Ibuildings 2014/2015 - All rights reserved

Page 36: Drupal for Big Data - is it ready? (European Drupal Days 2015)

#DrupalDaysEU

© Ibuildings 2014/2015 - All rights reserved

Page 37: Drupal for Big Data - is it ready? (European Drupal Days 2015)

#DrupalDaysEU

© Ibuildings 2014/2015 - All rights reserved

Page 38: Drupal for Big Data - is it ready? (European Drupal Days 2015)

#DrupalDaysEU

© Ibuildings 2014/2015 - All rights reserved

Page 39: Drupal for Big Data - is it ready? (European Drupal Days 2015)

#DrupalDaysEU

© Ibuildings 2014/2015 - All rights reserved

Only ~2000 nodes???

Page 40: Drupal for Big Data - is it ready? (European Drupal Days 2015)

#DrupalDaysEU

© Ibuildings 2014/2015 - All rights reserved

Page 41: Drupal for Big Data - is it ready? (European Drupal Days 2015)

#DrupalDaysEU

© Ibuildings 2014/2015 - All rights reserved

Used to track search results with nodes???

Page 42: Drupal for Big Data - is it ready? (European Drupal Days 2015)

#DrupalDaysEU

© Ibuildings 2014/2015 - All rights reserved

Page 43: Drupal for Big Data - is it ready? (European Drupal Days 2015)

#DrupalDaysEU

© Ibuildings 2014/2015 - All rights reserved

Visualizing Big Data In Drupal: Using Data Visualizations to Drive Knowledge Discovery

Page 44: Drupal for Big Data - is it ready? (European Drupal Days 2015)

#DrupalDaysEU

© Ibuildings 2014/2015 - All rights reserved

Page 45: Drupal for Big Data - is it ready? (European Drupal Days 2015)

#DrupalDaysEU

© Ibuildings 2014/2015 - All rights reserved

Page 46: Drupal for Big Data - is it ready? (European Drupal Days 2015)

#DrupalDaysEU

© Ibuildings 2014/2015 - All rights reserved

Page 47: Drupal for Big Data - is it ready? (European Drupal Days 2015)

#DrupalDaysEU

© Ibuildings 2014/2015 - All rights reserved

Page 48: Drupal for Big Data - is it ready? (European Drupal Days 2015)

#DrupalDaysEU

© Ibuildings 2014/2015 - All rights reserved

https://www.drupal.org/sandbox/cilefen/1858412

Page 49: Drupal for Big Data - is it ready? (European Drupal Days 2015)

© Ibuildings 2014/2015 - All rights reserved

Drupal for big data - is it … ?

Page 50: Drupal for Big Data - is it ready? (European Drupal Days 2015)

#DrupalDaysEU

© Ibuildings 2014/2015 - All rights reserved

Acknowledgements

• Nicolas Roberts - [email protected]

• http://www.westridge.com/media/series/out-of-the-box

• Florian Loretan

• My Wife

• Drupal Community

• Organisers - Lenka especially

Page 51: Drupal for Big Data - is it ready? (European Drupal Days 2015)

#DrupalDaysEU

© Ibuildings 2014/2015 - All rights reserved

Grazie

@PassiveManage

passivemanagement.net/contact