data visualization on the tech side

DATA VISUALIZATION ON THETECH SIDE

#dbtalks

languages - tools - ideas

Mathieu ELIEData Visualization Freelance

@mathieuelhttp://www.mathieu-elie.net

#dbtalks

DATA VISUALIZATION

#dbtalks

Infinite number of tools, because dataviz domain is infinite.

From data art, system administration, led walls to business intelligence.

Lets see some trending tools, and explore some ideas !

CHAPTERS

#dbtalks

- d3.js the web standard, not so alone

- ELK stack, system and BI dataviz super fast

- WebGL, 3d dataviz entry point

- R, explore data like a data scientist boss !

- 3d printing, dataviz in real life

- processing - meet the data art

- open refine, import csv, enrich, export

D3.JS

#dbtalkshttp://d3js.org/

D3.JS

#dbtalks

THINK D3 AS:

- a javascript library with helpers

- dom, array, scales, color swatches etc...

- a dom manipulation library

- a low level lib: make a bart chart maybe painfull at the beginning

- but you can make really advanced visualization, with full control

D3.JS / EXAMPLES

#dbtalks

D3.JS / EXAMPLES

#dbtalks

D3.JS / EXAMPLES

#dbtalks

D3.JS / EXAMPLES

#dbtalks

D3.JS

#dbtalks

As you can see, every examples are made of

graphic svg primitives like square, path and so on.

Possibilities are infinite and can be stuning but quite lot of work.

D3.JS

#dbtalks

d3 is a great tools for dataviz experts, or those who want to lear basics.

For your own need you can use more high level tools like d3 wrapper lib, or lib focused on specific viz (bar chart, map etc..).

WEBGL

#dbtalks

Low level 3d API in browser (HTML5).

three.js : the perfect lib to go on.

Not really the job of d3.

WEBGL : EXAMPLES

#dbtalks

WEBGL : EXAMPLES

#dbtalks

WEBGL : EXAMPLES

#dbtalks

WEBGL : EXAMPLES

#dbtalks

WEBGL : EXAMPLES

#dbtalks

WEBGL

#dbtalks

Many possibilities.

3d and data works together too.

so dont miss WebGL for your dataviz projects

ELK STACK

#dbtalks

ELK STACK

#dbtalks

- logstash -> elasticsearch -> kibana

- extra cheap dataviz and stuning

- but ! you can query es too -> d3.js

- elasticsearch + aggregations framework

ajax call -> amazing stats to d3.js !- explore timeline data quickly: very handy

R

#dbtalksouch ! ready to console ??

R

#dbtalks

- explore large sets of data- load csv and so on

- explore data, aggregate, apply stats, find max, min, percentiles, and so on..

- produce graphs

- R is not for producing dataviz

- it is the perfect tool to explore your data

R GRAPH EXAMPLE

#dbtalks

OPEN REFINE

#dbtalks

- when you have large / inconsistent csv

- explore, correct, enrich

- export templates: json / es / php, anything text based !!!

OPEN REFINE

#dbtalks

OPEN REFINE

#dbtalks

- ok for non programmers

- not similar to R: has its own advantage

- open source / free : run in browser

- export templates are really amazing , endless possibilities

- any time you have csv, think «open refine»

PROCESSING

#dbtalks

- not a dataviz standard tool but...

- great community including data art

- so i think you should care....

- .... and open your mind !

PROCESSING : EXAMPLE

#dbtalks

#dbtalks

PROCESSING : EXAMPLE

PROCESSING

#dbtalks

- community give more insights on the visual part of your dataviz

- imagine some part of this graph are drived by data:

- length of some path ?

- brightness of some points ?

- add maybe 3d or geo located data ?

3D PRINTING

#dbtalks

so ? why not 3d print data ?

- print bars / histogram 3d- print curves: think about lines chart in 3d- and many possibilities...

3D PRINTING EXAMPLE

#dbtalksObama 3d voice print

USE CASE : LASTFM HISTORY

#dbtalkshttp://www.mathieu-elie.net

USE CASE : LASTFM HISTORY

#dbtalks

1 ) grab lastfm api data from ruby

2 ) store in csv

3 ) import in open refine

4 ) export to elasticseach

5 ) call elasticsearch with ajax

6 ) display data with d3.js

#dbtalks

QUESTIONS ?HELP ?

Mathieu ELIEData Visualization Freelance

@mathieuelhttp://www.mathieu-elie.net