VISUALISING DATA

S.ANAND@GRAMENER .COM, CHIEF DATA SCIENTIST

A DATA VISUALISATION

CHALLENGE

You will see 3 questions.You have 30 seconds.Try it!

Your timerstarts now

HOW MANY NUMBERS ARE ABOVE 100?

1

23 32 71 72 58 87 11 77 70 1617 21 56 44 68 51 84 20 60 40

37 8 107 14 12 41 69 14 18 71

62 55 59 64 33 55 71 58 103 92

101 56 45 34 43 15 73 78 6 93

39 53 22 26 26 94 60 82 99 74

11 12 36 67 70 71 97 59 73 99

75 74 69 69 51 48 2 66 92 98

15 10 41 58 104 94 92 84 74 82

12 52 10 57 33 77 88 81 81 91

15 56 25 30 21 7 66 66 78 87

29 23 5 34 11 96 74 99 99 88

37 10 43 15 50 71 65 60 101 98

46 34 19 102 57 70 95 84 63 91

3 34 39 37 60 81 65 63 9 71

48 46 25 50 22 64 91 76 71 79

HOW MANY NUMBERS ARE BELOW 10?2

23 32 71 72 58 87 11 77 70 1617 21 56 44 68 51 84 20 60 40

37 8 107 14 12 41 69 14 18 71

62 55 59 64 33 55 71 58 103 92

101 56 45 34 43 15 73 78 6 93

39 53 22 26 26 94 60 82 99 74

11 12 36 67 70 71 97 59 73 99

75 74 69 69 51 48 2 66 92 98

15 10 41 58 104 94 92 84 74 82

12 52 10 57 33 77 88 81 81 91

15 56 25 30 21 7 66 66 78 87

29 23 5 34 11 96 74 99 99 88

37 10 43 15 50 71 65 60 101 98

46 34 19 102 57 70 95 84 63 91

3 34 39 37 60 81 65 63 9 71

48 46 25 50 22 64 91 76 71 79

WHICH QUADRANT HAS HIGHEST TOTAL?

3

23 32 71 72 58 87 11 77 70 1617 21 56 44 68 51 84 20 60 40

37 8 107 14 12 41 69 14 18 71

62 55 59 64 33 55 71 58 103 92

101 56 45 34 43 15 73 78 6 93

39 53 22 26 26 94 60 82 99 74

11 12 36 67 70 71 97 59 73 99

75 74 69 69 51 48 2 66 92 98

15 10 41 58 104 94 92 84 74 82

12 52 10 57 33 77 88 81 81 91

15 56 25 30 21 7 66 66 78 87

29 23 5 34 11 96 74 99 99 88

37 10 43 15 50 71 65 60 101 98

46 34 19 102 57 70 95 84 63 91

3 34 39 37 60 81 65 63 9 71

48 46 25 50 22 64 91 76 71 79

The same questions again.But with a few visual cues.See how long it takes now.

Your timerstarts now

A DATA VISUALISATION

CHALLENGE

HOW MANY NUMBERS ARE ABOVE 100?

1

23 32 71 72 58 87 11 77 70 1617 21 56 44 68 51 84 20 60 40

37 8 107 14 12 41 69 14 18 71

62 55 59 64 33 55 71 58 103 92

101 56 45 34 43 15 73 78 6 93

39 53 22 26 26 94 60 82 99 74

11 12 36 67 70 71 97 59 73 99

75 74 69 69 51 48 2 66 92 98

15 10 41 58 104 94 92 84 74 82

12 52 10 57 33 77 88 81 81 91

15 56 25 30 21 7 66 66 78 87

29 23 5 34 11 96 74 99 99 88

37 10 43 15 50 71 65 60 101 98

46 34 19 102 57 70 95 84 63 91

3 34 39 37 60 81 65 63 9 71

48 46 25 50 22 64 91 76 71 79

HOW MANY NUMBERS ARE BELOW 10?2

23 32 71 72 58 87 11 77 70 16

17 21 56 44 68 51 84 20 60 40

37 8 107 14 12 41 69 14 18 71

62 55 59 64 33 55 71 58 103 92

101 56 45 34 43 15 73 78 6 93

39 53 22 26 26 94 60 82 99 74

11 12 36 67 70 71 97 59 73 99

75 74 69 69 51 48 2 66 92 98

15 10 41 58 104 94 92 84 74 82

12 52 10 57 33 77 88 81 81 91

15 56 25 30 21 7 66 66 78 87

29 23 5 34 11 96 74 99 99 88

37 10 43 15 50 71 65 60 101 98

46 34 19 102 57 70 95 84 63 91

3 34 39 37 60 81 65 63 9 71

48 46 25 50 22 64 91 76 71 79

WHICH QUADRANT HAS HIGHEST TOTAL?

23 32 71 72 58 87 11 77 70 16

17 21 56 44 68 51 84 20 60 40

37 8 107 14 12 41 69 14 18 71

62 55 59 64 33 55 71 58 103 92

101 56 45 34 43 15 73 78 6 93

39 53 22 26 26 94 60 82 99 74

11 12 36 67 70 71 97 59 73 99

75 74 69 69 51 48 2 66 92 98

15 10 41 58 104 94 92 84 74 82

12 52 10 57 33 77 88 81 81 91

15 56 25 30 21 7 66 66 78 87

29 23 5 34 11 96 74 99 99 88

37 10 43 15 50 71 65 60 101 98

46 34 19 102 57 70 95 84 63 91

3 34 39 37 60 81 65 63 9 71

48 46 25 50 22 64 91 76 71 79

3

You will be shown a set of numbersalong with a summary (average, etc)Can you make sense of the figures?

WHY VISUALISE?

So is the variance in sales.Variance in price is the same.

Average sales is the same too.Average price is the same.

Take a look at the sales report alongside. A company has branches in 4 cities, and each branch changes the product price every month. This leads to a corresponding change in the sales.

Here is the performance of the 4 branches with their monthly price and sales for each month.

Looking at the average, the four branches have an identical performance.

2010 Boston Chicago Detroit New York

Month Price Sales Price Sales Price Sales Price Sales

Jan 10.0 8.04 10.0 9.14 10.0 7.46 8.0 6.58

Feb 8.0 6.95 8.0 8.14 8.0 6.77 8.0 5.76

Mar 13.0 7.58 13.0 8.74 13.012.7

48.0 7.71

Apr 9.0 8.81 9.0 8.77 9.0 7.11 8.0 8.84

May 11.0 8.33 11.0 9.26 11.0 7.81 8.0 8.47

Jun 14.0 9.96 14.0 8.10 14.0 8.84 8.0 7.04

Jul 6.0 7.24 6.0 6.13 6.0 6.08 8.0 5.25

Aug 4.0 4.26 4.0 3.10 4.0 5.39 19.012.5

0

Sep 12.010.8

412.0 9.13 12.0 8.15 8.0 5.56

Oct 7.0 4.82 7.0 7.26 7.0 6.42 8.0 7.91

Nov 5.0 5.68 5.0 4.74 5.0 5.73 8.0 6.89

Average 9.0 7.50 9.0 7.50 9.0 7.50 9.0 7.50

Variance 10.0 3.75 10.0 3.75 10.0 3.75 10.0 3.75

DO THESE FOUR CITIES LOOK IDENTICAL TO YOU?

DO YOU AGREE?

ARE THEY REALLY IDENTICAL? CHECK AGAIN…

But in fact, the four cities are totally different in behaviour.

Boston’s sales has generally increased with price.

Detroit has a nearly perfect increase in sales with price, except for one aberration.

Chicago shows a decline in sales beyond a price of 10.

New York’s sales fluctuates despite a nearly constant price.

Boston Chicago

New YorkDetroit

10

0 Y

EA

RS

OF

IN

DIA

’S

WE

AT

HE

R1901

1911

1921

1931

1941

1951

1961

1971

1981

1991

2001

Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec

WINNING PARTIES

In the 2004 election to Lok Sabha there were 1,351 candidates from 6 National parties, 801 candidates from 36 State parties, 898 candidates from officially recognised parties and 2385 Independent candidates.

The Congress (INC) won 145 seats in the 2004 elections. BJP won 138, coming a close second.

The constituencies where each party won is shown here.

Party BJP BSP CPM INC RJD SP

Party BJP BSP CPM INC RJD SPWINNING PARTIES

It is not often easy to see which party won the overall elections on a map.

In the previous page, BJP (in red), which won in constituencies with a large physical area (Rajasthan, Madhya Pradesh), appeared to have swept the elections.

This cartogram resizes the constituencies proportional to the number of voters, and it’s easier to see that the Congress (in blue) won about as many seats as the BJP.

The Candidate

Their Caste

Their Party

What do people consider important when voting?Karnataka, Assembly Elections 2008

Top 1/3rd

Next 1/3rd

Lowest 1/3rd

Sarvagnanagar: 35.7% out of 107941(K J George, INC)

Low polling

Low polling

Hosakote: 89.3% out of 141953

What was the polling percentage?Karnataka, Assembly Elections 2008

2 4 6 8 10 12 14 16 180%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

# contestants

Win

ner m

argi

n

More contestants did not reduce the winner marginKarnataka, Assembly Elections 2008

2 4 6 8 10 12 14 16 180%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

# contestants

Rune

r-up

mar

gin

More contestants did reduce the runner-up marginKarnataka, Assembly Elections 2004

CRICKET

FASTEST SCORERS

“I’ve always been curious… who among India’s prolific one-day run-getters had the best strike rate?

Sachin?

Sehwag?

What about the rest of the world?

INDIAN ODI BATTING

http://gramener.com/cricket

http://gramener.com/cricket

Here are all public Indian companies, grouped by Industry. The size of the box indicates revenue (2012) and the colour indicates

net profit(red is low, green is high). Click on the group to see companies

below.

Here are all public Indian companies, grouped by Industry. The size of the box indicates revenue (2012) and the colour indicates

net profit(red is low, green is high). Click on the group to see companies

below.

68% correlation between AUD &

EUR

Plot of 6 month daily AUD - EUR

values

Block of correlated currencies

… clustered hierarchically

PRE-2009 2009 AND AFTER

Decisions to increase the number of lanes on highways grew

significantly post-2009, especially as part of the CCI (Cabinet

Committee on Infrastructure) decisions

A significant rise in the number of decisions related to the

States is seen post 2009 – in contrast with the focus on

“Central” pre-2009

The number of international agreements has declined dramatically between pre-2009 and post-2009

Decisions related to intervention, assistance and relief were almost entirely concentrated in pre-2009

Adult Educatio

n

Adminisrative

Reforms

Agricultural

Marketing

AgricultureAnimal

Husbandry

Cooperative

Excise

Finance

Fisheries

Fisheries & Inland water

transport

Food & Civil

Supplies

Forest

Fuel

Haz & Wakf

Health and family

welfare

Higher Educatio

n

Home

Horticulture

Housing

Information &

Technology

Kannada &

Culture

Labour

Law & Human Rights

Major & Medium

Industries

Medical Educati

on

Medium and Large Industries

Mines & Geology

Minor Irrigatio

n

Muzrai

P.W.D.

Parliamentary Affairs

and Human Rights

Planning

Planning and

Statistics

Primary and

Secondary Education

Primary Educatio

n

Prison

Public Library

Revenue

Rural Development

and Panchayat Raj

Rural Water Supply

Rural Water

Supply and Sanitation

Sericulture

Small Scale

Industries

Small Industri

es

Social Welfare

Sugar

Textile

Tourism

Transport

Transportation

Urban Develop

ment

Water Resourc

es

Woman & Child

Development

Youth and

Sports

Youth Service

& Sports

BJP focus

JD(S)focus

INC focus

What topics did parties focus on during questions?Karnataka, 2008-2012

P.W.D.

Health and family

welfare

Revenue

Rural Development

and Panchayat Raj

Social Welfare

Urban Develop

ment

Water Resourc

es

Minor Irrigatio

n

Fuel

Housing

Agriculture

Primary Educatio

n

Primary and

Secondary Education

Woman & Child

Development

Higher Educati

on

HomeCoope

rative

Forest

Adminisrative

Reforms

Labour

Food & Civil

Supplies

Tourism

Finance

Animal Husban

dry

Transportation

Horticulture

Muzrai

Haz & Wakf

Transport

Medical Educati

on

Medium and Large Industries

Excise

Major & Medium

Industries

Kannada &

Culture

Textile

Fisheries

Parliamentary Affairs

and Human Rights

Adult Educatio

n

Rural Water Supply and Sanitation

Mines & Geology

Small Industri

es

Youth and

Sports

Sugar

Planning and

Statistics

Agricultural

Marketing

Rural Water Supply

Fisheries & Inland water

transport

Small Scale

Industries

Youth Service

& Sports

Sericulture

Law & Human Rights

Prison

Planning

Information &

Technology

Public Library

What topics did the young & old focus on during questions?Karnataka, 2008-2012

Young Old

VISUALISING THE MAHABHARATHA

The only other such times were Feb 23, 2008 (28 decisions) &Dec 26, 2008 (23 decisions).

Nearly two-thirds of decisions are taken on Thursday sessions, which is also visible on the calendar alongside.

UPA's best cabinet performance was last Friday, with a record 23 decisions taken in a single day, including some long pending key reform measures.

PARLIAMENT DECISIONS (CABINET + CCEA* + CCI**)

* CCEA: Cabinet Committee on Economic Affairs** CCI: Cabinet Committee on Infrastructure

Mon 63 5%Tue 56 4%Wed 105 8%Thu 854 65%Fri 223 17%Sat 6 0%

EDUCATION

PREDICTING MARKS

What determines a child’s marks?

Do girls score better than boys?

Does the choice of subject matter?

Does the medium of instruction matter?

Does community or religion matter?

Does their birthday matter?

Does the first letter of their name matter?

District

Gender G B

Month Sep Nov Oct Dec Aug Feb Mar Jan Apr May Jul Jun

Caste OTHERS CAT-1 ST SC

Govt False True

Medium E K U MHLT

WHAT INFLUENCES STUDENTS’ MARKS?

ENGLISH

0 3 6 9 12 15 18 21 24 27 30 33 36 39 42 45 48 51 54 57 60 63 66 69 72 75 78 81 84 87 90 93 96 990

5,000

10,000

15,000

20,000

25,000

30,000

35,000

40,000

0 3 6 9 12 15 18 21 24 27 30 33 36 39 42 45 48 51 54 57 60 63 66 69 72 75 78 81 84 87 90 93 96 990

5,000

10,000

15,000

20,000

25,000

30,000

35,000

40,000

SOCIAL SCIENCE

0 3 6 9 12 15 18 21 24 27 30 33 36 39 42 45 48 51 54 57 60 63 66 69 72 75 78 81 84 87 90 93 96 990

5,000

10,000

15,000

20,000

25,000

30,000

35,000

40,000

LANGUAGE

0 3 6 9 12 15 18 21 24 27 30 33 36 39 42 45 48 51 54 57 60 63 66 69 72 75 78 81 84 87 90 93 96 990

5,000

10,000

15,000

20,000

25,000

30,000

35,000

40,000

SCIENCE

0 3 6 9 12 15 18 21 24 27 30 33 36 39 42 45 48 51 54 57 60 63 66 69 72 75 78 81 84 87 90 93 96 990

5,000

10,000

15,000

20,000

25,000

30,000

35,000

40,000

MATHEMATICS

 

Based on the results of the 20 lakh students taking the Class XII exams at Tamil Nadu over the last 3 years, it appears that the month you were born in can make a difference of as much as 120 marks out of 1,200.

June borns score the

lowest

The marks shoot up for Aug borns

… and peaks for Sep-borns

120 marks out of 1200

explainable by month of birth

An identical pattern was observed in 2009 and 2010…

… and across districts, gender, subjects, and class X & XII.

“It’s simply that in Canada the eligibility cutoff for age-class hockey is January 1. A boy who turns ten on January 2, then, could be playing alongside someone who doesn’t turn ten until the end of the year—and at that age, in preadolescence, a twelve-month gap in age represents an enormous difference in physical maturity.”

-- Malcolm Gladwell, Outliers

BOOKS BY EDWARD TUFTE

We handle terabyte-size data

via non-traditional analytics and visualise it in real-time.

Gramener visualises your data

Gramener transforms your data into concise dashboardsthat make your business problem & solution visually obvious.We help you find insights quickly, based on cognitive research,and our visualisations guide you towards actionable decisions.

A data analytics and visualisation company

WHAT WE OFFER

PLATFORM CUSTOM APPS SERVICES

Buy & create your own visualisations using our library of visual and analytical components

WHO’D USE THIS?

If you have a strong analytics & technology team, and want to customise visualisations based on your needs

We build your domain-specific BI solutions to integrate visualisations with your platform

WHO’D USE THIS?

If your business needs are clear, you require regular visual intelligence, but prefer to outsource development

We take your data, analyse it, and share insights that you can re-create with revised data yourself

WHO’D USE THIS?

If your needs are unclear, or ad-hoc, and you need a partner to help extract actionable insights quickly out of existing data.

We handle terabyte-size data

via non-traditional analytics and visualise it in real-time.

Gramener visualises your data

Gramener transforms your data into concise dashboardsthat make your business problem & solution visually obvious.We help you find insights quickly, based on cognitive research,and our visualisations guide you towards actionable decisions.

A data analytics and visualisation company

s.anand@gramener.com

+91 9741 552 552