the grammar of graphics, for isko uk
Post on 29-Oct-2014
16 Views
Preview:
DESCRIPTION
TRANSCRIPT
with Conrad Taylor
ISKO UK seminar on ‘The Shape of Knowledge’ at the London College of Communication, 4 September 2012
1
Conrad Taylor
www.conradiator.com
conradtaylorbcs.googlemail.com
2
3
4
5
6
the set ofshends
things thatare lipe
the set ofthings thatare umpty
Memories of the New Maths, Scotland,1960s…
‘All lipe shends are umpty’
Draw aVenn Diagramin which theabove statementis true
7
the shapeof knowledge
8
Images via Wikipedia Commons: Wegmann (bushbaby), Nobu Tamura (Dienonychus, FireFly5 (Cuttlefish), Mpinedag (‘Lucy’)
9
10
Graphic Representations
of Data and Knowledge
a form of information
11
Teaching about heart disease12
13
Storyboarding Web interaction
14
15
16
ACTION-REFLECT:
Based on Participatory Rural Assessment…
‘Lines in the Dust’ with found-object markers…
a Freireian approach to promoting literacy with empowerment.
17
www.youtube.com/watch?v=F5xzpuydxjA
18
graphic representationsand visualisations:
a flying history
19
SubstanceSupreme genus:
material immaterial
BodySubordinate genera:
animate inanimate
LivingSubordinate genera:
sensitive insensitive
AnimalProximate genera:
rational irrational
Human
Spirit
Mineral
Plant
BeastSpecies:
Socrates Plato Aristotle etcIndividuals:
Porphyry: diagramming ontology
20
Ibn al-Nafis
Pictures ‘doctored’ to assist with teaching, to assist memory
21
Ibn al-Nafis
Agricola De Re Metallica 155622
23
Drawings, but with:
– artificial points of view
– simplification
– labelling of parts
– measurements
– sequence of operations
24
25
Note —a ‘vocabulary’ of line types and line weights
shading and highlighting (here exploiting tints and solids of two ink colours)
26
Ebstorfer ‘Mappa Mundi’
a flat earth, a surrounding ocean, centred on Jerusalem
27
Ebstorfer ‘Mappa Mundi’
28
Ebstorfer ‘Mappa Mundi’
29
Tabula Rogeriana, drawn 1154 by Mohammad Al-Idrissi, for King Roger II of Sicily
30
Tabula Rogeriana, drawn 1154 by Mohammad Al-Idrissi, for King Roger II of Sicily
31
Astrolabe, an interactive diagram of the heavens
32
Ortelius’ Atlas of 157033
34
Joseph Priestley — 1760 — ‘Timelines’ of biography, engraved & printed
time as a line…35
William Playfair invented the line chart, bar chart, pie chart
36
Charles Joseph Minard, 1869: celebrated multivariable schematic map / timeline diagram about Napoleon’s advance on and retreat from Moscow in the winter of 1812–1813
37
38
Charles Joseph Minard: ‘From where in France does Paris get its supplies of different kinds & quantities of meat?’
39
Charles Joseph Minard: ‘From where in France does Paris get its supplies of different kinds & quantities of meat?’
– colour identifies which Départements are involved in the trade
– those involved have a ‘meat pie chart’ associated
– colour divided the pies by proportion of types of meat
– size of pies reflects quantity
40
Charles Dupin, 1826: First ever choropleth map, highlighting regions with problems of illiteracy
41
Dr John Snow:
Dot-map of fatalities from cholera in the 1854 outbreak in Soho.
Clustering suggested a link to the Broad St water-pump
Investigation of outliers & anomalies confirmed the link.
Beginnings of science of epidemiology!
42
Detail of John Snow’s dot map: colour added
43
44
Florence Nightingale’s ‘Coxcomb’ charts: causes of mortality among British soldiers in the Crimean War
45
Areas are proportionate to death by cause of:
RED: wounds
BLUE-GREY: ‘Preventable or Mitigable Zymotic diseases’
BLACK: all other causes
46
The ISOTYPE approach to educational quantitative graphics: Otto and Marie Neurath
47
ISOTYPE multiples of standardised graphics, largely designed by Gerd Arntz
48
ISOTYPE multiples of standardised graphics, largely designed by Gerd Arntz
Skuravy, c. 1932, cutting out linocut-printed symbols for paste-up assembly into chart artwork
49
Køpenhavn network diagram for the ‘S-Tog’ urban rail service
50
51
The ‘Linked and Open Data Graph’ — which just keeps getting more complicated…52
The ‘Linked and Open Data Graph’ — which just keeps getting more complicated…53
Where is the theory about what makes
graphic representations of knowledge and data
WORK?
54
literature review
(& personalities)
55
Edward Tufte
‘The Visual Display of
Quantitative
Information’1998
Clive Richards‘Diagrammatics’
1998
Michael Twyman‘Schema for Study ofGraphic Languages’
1979
B Tversky‘Cognitive Origins of Graphic Conventiions’
1995
Gene Zelazny‘Say it with Charts’1985
Jan V White
‘Charts and Graphs’1980
Jacques Bertin‘La Semiologie
Graphique’1967
Doig Simmonds, Ed‘Charts and Graphs’1980
56
Edward Tufte
‘The Visual Display of
Quantitative
Information’1998
Clive Richards‘Diagrammatics’
1998
Michael Twyman‘Schema for Study ofGraphic Languages’
1979
L Wilkinson‘The Grammar of
Graphics’1999
B Tversky‘Cognitive Origins of Graphic Conventiions’
1995
Card, Mackinlay, Schneidermann (Eds)
‘Information Visualization’
1999
Robert Horn‘Visual Language’
1998
Gene Zelazny‘Say it with Charts’1985
Jan V White
‘Charts and Graphs’1980
Jacques Bertin‘La Semiologie
Graphique’1967
Doig Simmonds, Ed‘Charts and Graphs’1980
57
58
59
Edward Tufte
‘The Visual Display of
Quantitative
Information’1998
Clive Richards‘Diagrammatics’
1998
Michael Twyman‘Schema for Study ofGraphic Languages’
1979
L Wilkinson‘The Grammar of
Graphics’1999
Yuri Engelhardt‘The Language of Graphics’
2002
B Tversky‘Cognitive Origins of Graphic Conventiions’
1995
Colin Ware‘Information Visualization’
2000
Card, Mackinlay, Schneidermann (Eds)
‘Information Visualization’
1999
Robert Horn‘Visual Language’
1998
Gene Zelazny‘Say it with Charts’1985
Doig Simmonds, Ed‘Charts and Graphs’1980
Jan V White
‘Charts and Graphs’1980
Jacques Bertin‘La Semiologie
Graphique’1967
David McCandless ‘Information Is
Beautiful’200?
Alan MacEachren‘How Maps Work’
2000
60
Yuri Engelhardt
The Language of Graphicsa framework for the analysis
of syntax and meaningin maps, charts and diagrams
University of AmsterdamInstitute for Logic, Language and
Computation
61
definitions,analyses
62
Graphic representation:
a visible artifacton a more or less flat surfacethat was created in orderto express information
Yuri Engelhardt
63
Graphic representation:
a visible artifacton a more or less flat surfacethat was created in orderto express information
Yuri Engelhardt
64
Compositionality of meaning
Part of what a sentence means depends upon its separate words, and part depends on how those words are arranged
Marvin Minsky
65
Compositionality of meaning
Part of what a sentence means depends upon its separate words, and part depends on how those words are arranged
Marvin Minsky
‘Frege’s Principle’ after the mathematician, logician & philosopher Friedrich Ludwig Gottlob Frege
66
Compositionality of meaning
A grammar is the set of rules for combining symbols, whether the symbols are words or pictures.
W K Horton (1994) The Icon Book: Visual Symbols for computer systems and documentation
67
Composite graphic objects: three samples
– a map with information overlay
– a graph of quantitative data
– a network diagram
68
69
1 2 3 4Fr Sa Su Mo Tu We Th Fr Sa Su Mo Tu We Th Fr Sa Su Mo Tu We Th Fr Sa Su Mo Tu We Th Fr Sa
5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30
June 2012
0
5
10
15
20 a.m. — 34p.m. — 32
a.m. — 42p.m. — 40
a.m. — 36p.m. — 34
Daily blood glucose measurementsSubject: Conrad Taylormillimoles per litre measured by portable monitor
Early morning measurements
Early evening measurements
Onset of new targets forinsulin injection
a.m. — xp.m. — y
70
PCT proposal to remove the Walk-in Centre service at Tollgate Lodge Healthcare Centre – an issues mapprepared by Conrad Taylor to assist discussion
Where do out-of-hours andlocum GP services �t in?
What bene�ts/demerits ofGP/nurse teleconsultations?
What are bene�ts/demeritsof NHS Direct?
How to expand North HackneyGP services?
What access do out-of-hoursand locum GP services have
to the patient medical record?
To be seen withoutan appointment
For a second opinion Wound dressings
Quicker appointments
Evening appointments
Weekend appointments
Small casualties andminor emergenciesin the community
Frontline services forHealth Protection e.g.response vaccination
Paediatric ‘worry’ casesat short notice
To be seen in theevenings or at
weekends
Do WiC usage records clearlyidentify where patients are
registered with a GP?
Which of these user-types can be satis�ed by expanding local GP services?Which of these can be replaced adequately by expanding local GP services?
How can the other usages be met, while not overloading Homerton Hospitalor causing discomfort, travel problems and distress to patients?
Which types would su�er disproportionately if walk-in service withdrawn?
What alternative forms of provision can ensure the vulnerable are looked after?
Are WiC usage records coded,such that reasons for use canbe extracted and analysed?
By what strategy, methodsand incentives will the PCT
GUARANTEE the expansionof North Hackney GP servicesto satisfy registered patients
seeking consultations at shortnotice, evenings or weekends?
What is the PCT strategy formeeting those health needs
of Walk-in Centre users whichCANNOT adequately be met
by expanding North HackneyGP services?
(and how will the unmet need inother-PCT GP services be met?)
Unregistered patients Visitors from afar
Elsewhere in the UK
Rest of the world
EU, other countries withreciprocal arrangements
Those whocould easily
register
Homeless,transient,
hard-to-reach
Registered locally
At Tollgate Lodge
City & Hackney surgeries
Other PCT surgeries
BREAKDOWN OF WALK-IN CENTRE USERS BY ORIGINBREAKDOWN OF TYPES OF USAGE OF WALK-IN SERVICES (incomplete)
ALTERNATIVE MINOR ACUTE CARE SOLUTIONS IN THE COMMUNITY?
Adequate alternative provision (see yellow boxes below)must be in place BEFORE WiC services are withdrawn;even then, some WiC provision may still be justi�ed.
It is probable that a GP-ledwalk-in local service at thepoint of community need isstill the best way to meetcertain kinds of minor butacute health needs.
71
a composite graphic object
a graphic space graphic objects graphic relations
consists of
72
a composite graphic object
a graphic space graphic objects
object-to-object relations
object-to-space relations
graphic relations
consists of
73
a composite graphic object
a graphic space graphic objects
object-to-object relations
object-to-space relations
graphic relations
consists of
Relations are achieved (represented) visually using ‘gestalt principles’ and techniques such as proximity, similarity, common region (enclosure), connectedness, good continuation (alignment), assumed closure
74
75
1 2 3 4Fr Sa Su Mo Tu We Th Fr Sa Su Mo Tu We Th Fr Sa Su Mo Tu We Th Fr Sa Su Mo Tu We Th Fr Sa
5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30
June 2012
0
5
10
15
20 a.m. — 34p.m. — 32
a.m. — 42p.m. — 40
a.m. — 36p.m. — 34
Daily blood glucose measurementsSubject: Conrad Taylormillimoles per litre measured by portable monitor
Early morning measurements
Early evening measurements
Onset of new targets forinsulin injection
a.m. — xp.m. — y
76
PCT proposal to remove the Walk-in Centre service at Tollgate Lodge Healthcare Centre – an issues mapprepared by Conrad Taylor to assist discussion
Where do out-of-hours andlocum GP services �t in?
What bene�ts/demerits ofGP/nurse teleconsultations?
What are bene�ts/demeritsof NHS Direct?
How to expand North HackneyGP services?
What access do out-of-hoursand locum GP services have
to the patient medical record?
To be seen withoutan appointment
For a second opinion Wound dressings
Quicker appointments
Evening appointments
Weekend appointments
Small casualties andminor emergenciesin the community
Frontline services forHealth Protection e.g.response vaccination
Paediatric ‘worry’ casesat short notice
To be seen in theevenings or at
weekends
Do WiC usage records clearlyidentify where patients are
registered with a GP?
Which of these user-types can be satis�ed by expanding local GP services?Which of these can be replaced adequately by expanding local GP services?
How can the other usages be met, while not overloading Homerton Hospitalor causing discomfort, travel problems and distress to patients?
Which types would su�er disproportionately if walk-in service withdrawn?
What alternative forms of provision can ensure the vulnerable are looked after?
Are WiC usage records coded,such that reasons for use canbe extracted and analysed?
By what strategy, methodsand incentives will the PCT
GUARANTEE the expansionof North Hackney GP servicesto satisfy registered patients
seeking consultations at shortnotice, evenings or weekends?
What is the PCT strategy formeeting those health needs
of Walk-in Centre users whichCANNOT adequately be met
by expanding North HackneyGP services?
(and how will the unmet need inother-PCT GP services be met?)
Unregistered patients Visitors from afar
Elsewhere in the UK
Rest of the world
EU, other countries withreciprocal arrangements
Those whocould easily
register
Homeless,transient,
hard-to-reach
Registered locally
At Tollgate Lodge
City & Hackney surgeries
Other PCT surgeries
BREAKDOWN OF WALK-IN CENTRE USERS BY ORIGINBREAKDOWN OF TYPES OF USAGE OF WALK-IN SERVICES (incomplete)
ALTERNATIVE MINOR ACUTE CARE SOLUTIONS IN THE COMMUNITY?
Adequate alternative provision (see yellow boxes below)must be in place BEFORE WiC services are withdrawn;even then, some WiC provision may still be justi�ed.
It is probable that a GP-ledwalk-in local service at thepoint of community need isstill the best way to meetcertain kinds of minor butacute health needs.
77
‘Symbology’the search for the visual morpheme,the ‘primitive graphic object’
78
‘Symbology’the search for the visual morpheme,the ‘primitive graphic object’
79
‘Symbology’the search for the visual morpheme,the ‘primitive graphic object’
80
81
82
83
signification-carrying
variables
84
English edition Translated by William J Berg Univrsity of Wisconsin Press
1983
Jacques BertinLa Semiologie Graphique1967
85
2PD: the two dimensions of the graphic planeSi: sizeV: ‘value’ – tint, tone?T: ‘grain’ or ‘texture’C: colourOr: orientationSh: shape
Jacques Bertin’s retinal variables
86
Bertin’s positionalvariable
87
‘Colour’ and‘Value’…a distinction that isbehind the times?
88
‘Value’ in the world of print is made of tints (dot patterns &c) of the ink colour.
This cartoon wasshaded with tinted adhesive ‘Letratone’films.
89
24-bit RGB= 16,777,216 colours
Colour and valuereplaced by Hue andBrightness and Saturation…
90
Linda Reynolds study for UK Air Traffic Control: Beyond the green vectorscope — how to make use of display colour?
91
Contiguous zones:can use very small changes in colour
Backgrounds: desaturatedcolour is best
92
Colour for identification of foreground objects: few, well-differentiated colours
93
With computed transparency, we can overlay corridors on the map without hiding borders underneath
94
It may be possible with today’sgraphic systems to modulatetransparency in real time
95
Optional display features can be called up or dismissedas the need requires
96
Linda Reynolds : Colour Displays and how to make the most of themhttp://www.ingenia.org.uk/ingenia/ articles.aspx?Index=106
97
‘Texture’ and‘Orientation’…‘Texture’ may be a mis-translation of Bertin’s ‘grain’
Orientation: more significant as symbols
(e.g. for wind direction) than as shadings
98
Hachure: texture to indicate land relief
99
Hachure: texture to indicate land relief
100
Texture used incolour map printing
using ‘special’ colours (not CMYK process)
101
Colour and texture combineto give a range of relief heightsand depths
102
In print, you canuse whatever colours you can mix!
…in this example, Black plus a special Green defined as Pantone 363103
Some reprographic systemswill represent Bertin’s Value and Colourusing overlaid dot-tints or ‘screens’from component ink systemssuch as CMYK
Displaying solid colours, not tints, preserves the ability to render fine details104
Coarse textures useful for coarse print techniques!
105
Adobe Illustrator let me create a meaningful symbolic texture andfill areas with it…
106
‘Size’…
107
Size as a signifier:
not without its problems
do we compare area or height?
how to relate a large height-significant component to a small location?
108
Size as a signifier:
not without its problems
do we compare area or height?
how to relate a large height-significant component to a small location?
‘Countable variants’:
ISOTYPE-style array can also have problems of ‘fitting’
Might the ‘spread-out’ version be confused for a proper dot-map?
109
Shapes are poor signifiers of value, but work well as distinguishable symbols
Simmonds, et al. warn against symbols that are hard to distinguish innormal reading conditions
110
What is Texture and what is Symbol?111
The stuff that connects things!
Particularly important for qualifying linkages in network diagrams:
Mind maps Organisation charts File plans Hierarchical taxonomies Ontologies Debate / argument maps Entity–Relationship Diagrams State diagrams … and more…
112
‘Retinal variables’ for lines?
Line thickness and colour
Shape, direction of line
‘Terminals’
Duplication
Various dot patterns
113
LINE ITEM PURCHASE ORDER PARTY
CASE*Method data model, using Ellis-Barker notation
114
LINE ITEM
Line numberQuantityActual price
#●
●
PURCHASE ORDER
PO NumberOrder date
#●
PARTY
Party IDName
#●
CASE*Method data model, using Ellis-Barker notation
115
LINE ITEM
Line numberQuantityActual price
#●
●
PURCHASE ORDER
PO NumberOrder date
#●
PARTY
Party IDName
#●
PERSONSurnameQuali�cation
●
❍
COMPANYRegistration●
CASE*Method data model, using Ellis-Barker notation
116
LINE ITEM
Line numberQuantityActual price
#●
●
PURCHASE ORDER
PO NumberOrder date
#●
PARTY
Party IDName
#●
PERSONSurnameQuali�cation
●
❍
COMPANYRegistration●
part of
composed of vendor in
issued to
CASE*Method data model, using Ellis-Barker notation
117
LINE ITEM
Line numberQuantityActual price
#●
●
PURCHASE ORDER
PO NumberOrder date
PRODUCT
Product codeDescriptionUnit price
#●
●
SERVICE
Service codeDescriptionRate per hour
#●
●
#●
PARTY
Party IDName
#●
PERSONSurnameQuali�cation
●
❍
COMPANYRegistration●
part of
for
bought via bought via
for
composed of vendor in
issued to
CASE*Method data model, using Ellis-Barker notation
118
LINE ITEM
Line numberQuantityActual price
#●
●
PURCHASE ORDER
PO NumberOrder date
PRODUCT
Product codeDescriptionUnit price
#●
●
SERVICE
Service codeDescriptionRate per hour
#●
●
#●
PARTY
Party IDName
#●
PERSONSurnameQuali�cation
●
❍
COMPANYRegistration●
part of
for
bought via bought via
for
composed of vendor in
issued to
CASE*Method data model, using Ellis-Barker notation
119
120
Debategraph.org 121
Debategraph.org 122
animation, interaction,
computation
123
Animated presentation…
…to change the viewer’s focus
124
Animated presentation…
…to change the viewer’s focus
125
Animated presentation…
…to build up layers of knowledge about a graphic
126
World Health Organisation – interactive map, incidence by country of death rate from Non Communicable Disease (males)
See http://www.who.int/gho/map_gallery/en/index.html for this and other Global Health Observatory maps
127
World Health Organisation – interactive map, incidence by country of death rate from Non Communicable Disease (males)
See http://www.who.int/gho/map_gallery/en/index.html for this and other Global Health Observatory maps
128
Gapminder — see http://www.gapminder.org — download and install the desktop edition
Gapminder.orgHans Rosling
129
Gapminder — see http://www.gapminder.org — download and install the desktop edition 130
Gapminder — see http://www.gapminder.org — download and install the desktop edition 131
Gapminder — see http://www.gapminder.org — download and install the desktop edition 132
Gapminder — see http://www.gapminder.org — download and install the desktop edition 133
Gapminder — see http://www.gapminder.org — download and install the desktop edition 134
Conrad Taylor
www.conradiator.com
conradtaylorbcs.googlemail.com
the endother talks from the ISKO UK events at http://www.iskouk.org
135
top related