assessing the quality of communication in statistics: the application of a model filomena maggino 1,...
TRANSCRIPT
![Page 1: Assessing the quality of communication in statistics: the application of a model Filomena Maggino 1, Marco Fattore 2, Marco Trapani 1 UNECE Paris - June](https://reader033.vdocuments.net/reader033/viewer/2022051416/56649ed15503460f94bdfc01/html5/thumbnails/1.jpg)
Assessing the quality of Assessing the quality of communication in statistics: communication in statistics:
the application of a modelthe application of a modelFilomena Maggino1, Marco Fattore2, Marco Trapani1
UNECE
Paris - June 29 – July 2, 2010
1 Università degli Studi di Firenze, Italy2 Università degli Studi di Milano-Bicocca, Italy
Contact: [email protected]
![Page 2: Assessing the quality of communication in statistics: the application of a model Filomena Maggino 1, Marco Fattore 2, Marco Trapani 1 UNECE Paris - June](https://reader033.vdocuments.net/reader033/viewer/2022051416/56649ed15503460f94bdfc01/html5/thumbnails/2.jpg)
1. The conceptual model
2. The application
Contents
![Page 3: Assessing the quality of communication in statistics: the application of a model Filomena Maggino 1, Marco Fattore 2, Marco Trapani 1 UNECE Paris - June](https://reader033.vdocuments.net/reader033/viewer/2022051416/56649ed15503460f94bdfc01/html5/thumbnails/3.jpg)
1. The conceptual model A. The dimensions to evaluate: the codes
Contents
B. The evaluating criteria
C. The components of the transmission process
![Page 4: Assessing the quality of communication in statistics: the application of a model Filomena Maggino 1, Marco Fattore 2, Marco Trapani 1 UNECE Paris - June](https://reader033.vdocuments.net/reader033/viewer/2022051416/56649ed15503460f94bdfc01/html5/thumbnails/4.jpg)
1. The conceptual model A. The dimensions to evaluate: the codes
Contents
B. The evaluating criteria
C. The components of the transmission process
![Page 5: Assessing the quality of communication in statistics: the application of a model Filomena Maggino 1, Marco Fattore 2, Marco Trapani 1 UNECE Paris - June](https://reader033.vdocuments.net/reader033/viewer/2022051416/56649ed15503460f94bdfc01/html5/thumbnails/5.jpg)
The codes
(i) Outline telling statistics(ii) Tools depicting statistics(iii)Clothes dressing
statistics
A. The dimensions to evalute
![Page 6: Assessing the quality of communication in statistics: the application of a model Filomena Maggino 1, Marco Fattore 2, Marco Trapani 1 UNECE Paris - June](https://reader033.vdocuments.net/reader033/viewer/2022051416/56649ed15503460f94bdfc01/html5/thumbnails/6.jpg)
INVENTIO
DISPOSITIO
ELOCUTIO
ACTIO
START
The codes: (i) outline
A. The dimension sto evalute
![Page 7: Assessing the quality of communication in statistics: the application of a model Filomena Maggino 1, Marco Fattore 2, Marco Trapani 1 UNECE Paris - June](https://reader033.vdocuments.net/reader033/viewer/2022051416/56649ed15503460f94bdfc01/html5/thumbnails/7.jpg)
1- Inventio (invention)allows arguments to be argued
WhoWhatWhen
WhereWhy
A. The dimensions to evalute
the subject of tellingthe fact the time locationthe field locationthe causes
The codes: (i) outline
![Page 8: Assessing the quality of communication in statistics: the application of a model Filomena Maggino 1, Marco Fattore 2, Marco Trapani 1 UNECE Paris - June](https://reader033.vdocuments.net/reader033/viewer/2022051416/56649ed15503460f94bdfc01/html5/thumbnails/8.jpg)
2 - Dispositio (layout)allows topics to be put in sequence
•deductive •inductive •time-progression•problems-related
•advantages-disadvantages•from-points-of-view•top-down approaches
A. The dimensions to evalute
The codes: (i) outline
![Page 9: Assessing the quality of communication in statistics: the application of a model Filomena Maggino 1, Marco Fattore 2, Marco Trapani 1 UNECE Paris - June](https://reader033.vdocuments.net/reader033/viewer/2022051416/56649ed15503460f94bdfc01/html5/thumbnails/9.jpg)
3 - Elocutio (expression)allows each piece of the presentation to be prepared by selecting words and
constructing sentences
Language should be• appropriate to the audience• consistent with the message
•wording•languages•tongues
A. The dimensions to evalute
The codes: (i) outline
![Page 10: Assessing the quality of communication in statistics: the application of a model Filomena Maggino 1, Marco Fattore 2, Marco Trapani 1 UNECE Paris - June](https://reader033.vdocuments.net/reader033/viewer/2022051416/56649ed15503460f94bdfc01/html5/thumbnails/10.jpg)
4 - Actio (execution)concerns the way in which the telling
is managed
in terms of
A. The dimensions to evalute
The codes: (i) outline
• introduction • developments• comments• time space use• ending
{
![Page 11: Assessing the quality of communication in statistics: the application of a model Filomena Maggino 1, Marco Fattore 2, Marco Trapani 1 UNECE Paris - June](https://reader033.vdocuments.net/reader033/viewer/2022051416/56649ed15503460f94bdfc01/html5/thumbnails/11.jpg)
The codes: (ii) tools
Refer to all instruments aimed at depicting statistics
•graphs•tables•pictograms
The tools should preserve the message
A. The dimensions to evalute
![Page 12: Assessing the quality of communication in statistics: the application of a model Filomena Maggino 1, Marco Fattore 2, Marco Trapani 1 UNECE Paris - June](https://reader033.vdocuments.net/reader033/viewer/2022051416/56649ed15503460f94bdfc01/html5/thumbnails/12.jpg)
The codes: (iii) clothes
Refer to the process of dressing statistics
With reference to:
balanceharmonyproportionelegancestyle
Different aspects: text arrangementcharacters and fontscolours…
A. The dimensions to evalute
![Page 13: Assessing the quality of communication in statistics: the application of a model Filomena Maggino 1, Marco Fattore 2, Marco Trapani 1 UNECE Paris - June](https://reader033.vdocuments.net/reader033/viewer/2022051416/56649ed15503460f94bdfc01/html5/thumbnails/13.jpg)
1. The conceptual model A. The dimensions to evaluate: the codes
B. The evaluating criteria
C. The components of the transmission process
Contents
![Page 14: Assessing the quality of communication in statistics: the application of a model Filomena Maggino 1, Marco Fattore 2, Marco Trapani 1 UNECE Paris - June](https://reader033.vdocuments.net/reader033/viewer/2022051416/56649ed15503460f94bdfc01/html5/thumbnails/14.jpg)
B. The evaluting criteria
They refer to the transmitter’s ability to use the codes in terms of
Evaluating scale
(A) appropriateness pertinence
(B) correctness accuracy(C) clarity
Polarity Labels Scores
BipolarNo 0
Yes 1
![Page 15: Assessing the quality of communication in statistics: the application of a model Filomena Maggino 1, Marco Fattore 2, Marco Trapani 1 UNECE Paris - June](https://reader033.vdocuments.net/reader033/viewer/2022051416/56649ed15503460f94bdfc01/html5/thumbnails/15.jpg)
1. The conceptual model A. The dimensions to evaluate: the codes
B. The evaluating criteria
C. The components of the transmission process
Contents
![Page 16: Assessing the quality of communication in statistics: the application of a model Filomena Maggino 1, Marco Fattore 2, Marco Trapani 1 UNECE Paris - June](https://reader033.vdocuments.net/reader033/viewer/2022051416/56649ed15503460f94bdfc01/html5/thumbnails/16.jpg)
C. The components of the transmission process
(i) Audience tourists, harvesters, miners (*)
(ii) Channel auditory, visual, ….(iii) Context seminars, conferences, books,
booklets, …
But also- Topic (+ data) message - Noise
![Page 17: Assessing the quality of communication in statistics: the application of a model Filomena Maggino 1, Marco Fattore 2, Marco Trapani 1 UNECE Paris - June](https://reader033.vdocuments.net/reader033/viewer/2022051416/56649ed15503460f94bdfc01/html5/thumbnails/17.jpg)
(i) Audience
- experts- politicians and policy makers- students- statistical data users- not specialized
(ii) Channel
- auditory channel (“listening”, requiring oral explanation)
- visual channel (“looking”, requiring explicative slides)
- kinetic channel (“doing”, requiring practical exercises)
(iii) Context
- occasions (seminars, conferences, meetings, press conferences, …)- settings (rooms, tables, …)
C. The components of the transmission process
![Page 18: Assessing the quality of communication in statistics: the application of a model Filomena Maggino 1, Marco Fattore 2, Marco Trapani 1 UNECE Paris - June](https://reader033.vdocuments.net/reader033/viewer/2022051416/56649ed15503460f94bdfc01/html5/thumbnails/18.jpg)
The assessment model
The dimensions have to be evaluated with reference to the of the code -through the defined crieria- components of the
transmission process
1. Outline2. Tools3. Clothes
A. Appropriateness ( pertinence)B. Correctness ( accuracy) C. Clarity
i. Audienceii. Channeliii. Contextiv. Topicv. Data
![Page 19: Assessing the quality of communication in statistics: the application of a model Filomena Maggino 1, Marco Fattore 2, Marco Trapani 1 UNECE Paris - June](https://reader033.vdocuments.net/reader033/viewer/2022051416/56649ed15503460f94bdfc01/html5/thumbnails/19.jpg)
2. The application A. The assessing table
B. Study planning and data collection
C. Data analysis
Contents
![Page 20: Assessing the quality of communication in statistics: the application of a model Filomena Maggino 1, Marco Fattore 2, Marco Trapani 1 UNECE Paris - June](https://reader033.vdocuments.net/reader033/viewer/2022051416/56649ed15503460f94bdfc01/html5/thumbnails/20.jpg)
2. The application A. The assessing table
B. Study planning and data collection
C. Data analysis
Contents
![Page 21: Assessing the quality of communication in statistics: the application of a model Filomena Maggino 1, Marco Fattore 2, Marco Trapani 1 UNECE Paris - June](https://reader033.vdocuments.net/reader033/viewer/2022051416/56649ed15503460f94bdfc01/html5/thumbnails/21.jpg)
each judge can evaluate presence (1) or absence (0)
….
A. The assessing table
The conceptual model can be consistently assessed by developing
an Assessing Tablethrough which
![Page 22: Assessing the quality of communication in statistics: the application of a model Filomena Maggino 1, Marco Fattore 2, Marco Trapani 1 UNECE Paris - June](https://reader033.vdocuments.net/reader033/viewer/2022051416/56649ed15503460f94bdfc01/html5/thumbnails/22.jpg)
of the criterion(A) appropriateness (B) correctness (C) clarity
…..
in each code
1. outline 2. tools 3. clothes
with reference to(i) audience (ii) channel (iii) context (iv) topic (v) data
A. The assessing table
![Page 23: Assessing the quality of communication in statistics: the application of a model Filomena Maggino 1, Marco Fattore 2, Marco Trapani 1 UNECE Paris - June](https://reader033.vdocuments.net/reader033/viewer/2022051416/56649ed15503460f94bdfc01/html5/thumbnails/23.jpg)
A. The assessing table
Assessing Table I
![Page 24: Assessing the quality of communication in statistics: the application of a model Filomena Maggino 1, Marco Fattore 2, Marco Trapani 1 UNECE Paris - June](https://reader033.vdocuments.net/reader033/viewer/2022051416/56649ed15503460f94bdfc01/html5/thumbnails/24.jpg)
Assessing Table II
synthesis of the previous one
A. The assessing table
![Page 25: Assessing the quality of communication in statistics: the application of a model Filomena Maggino 1, Marco Fattore 2, Marco Trapani 1 UNECE Paris - June](https://reader033.vdocuments.net/reader033/viewer/2022051416/56649ed15503460f94bdfc01/html5/thumbnails/25.jpg)
2. The application A. The assessing table
B. Study planning and data collection
C. Data analysis
Contents
![Page 26: Assessing the quality of communication in statistics: the application of a model Filomena Maggino 1, Marco Fattore 2, Marco Trapani 1 UNECE Paris - June](https://reader033.vdocuments.net/reader033/viewer/2022051416/56649ed15503460f94bdfc01/html5/thumbnails/26.jpg)
B. Study planning and data collection
Judges selected
competence in
survey methodology and statistical issues
![Page 27: Assessing the quality of communication in statistics: the application of a model Filomena Maggino 1, Marco Fattore 2, Marco Trapani 1 UNECE Paris - June](https://reader033.vdocuments.net/reader033/viewer/2022051416/56649ed15503460f94bdfc01/html5/thumbnails/27.jpg)
• Central Statistical Office (2009) Poland in the European Union, Central Statistical Office, Warsaw.
• Eurostat (2008) Statistical Portrait of the European Union – European Year of Intercultural Dialogue, Eurostat, Statistical Books, Luxembourg.
• Federal Statistical Office (2009) Statistical Data on Switzerland, Federal Statistical Office, NeuChâtel, Switzerland.
• Kazakhstan Statistics (2008) The Statistical Guidebook, Agency of the Republic of Kazakhstan on Statistics (Astana).
• ISTAT (2009) Italy in Figures, Rome, Italy• United Nations – Economic Commission for Europe (2009) UNECE.
Countries in Figures, United Nations, New York – Geneva.
Selected publications for the study (collected at the UNECE Work Session on Communication and Dissemination of Statistics held in Warsaw, Poland – 13-15 May 2009):
B. Study planning and data collection
![Page 28: Assessing the quality of communication in statistics: the application of a model Filomena Maggino 1, Marco Fattore 2, Marco Trapani 1 UNECE Paris - June](https://reader033.vdocuments.net/reader033/viewer/2022051416/56649ed15503460f94bdfc01/html5/thumbnails/28.jpg)
2. The applicationA. The assessing table
B. Study planning and data collection
C. Data analysis
Contents
![Page 29: Assessing the quality of communication in statistics: the application of a model Filomena Maggino 1, Marco Fattore 2, Marco Trapani 1 UNECE Paris - June](https://reader033.vdocuments.net/reader033/viewer/2022051416/56649ed15503460f94bdfc01/html5/thumbnails/29.jpg)
SOLUTION
PROBLEM
OBJECTIVE
C. data analysis
assessing each statistical publicationthrough binary data & ordinal dimensions
how to combine the evaluationson each quality dimension
into a final quality assessment
computing quality assessmentsrespecting the ordinal nature of data
through a fuzzy approachbased on the use of partial order theory
OBJECTIVE
PROBLEM
SOLUTION
![Page 30: Assessing the quality of communication in statistics: the application of a model Filomena Maggino 1, Marco Fattore 2, Marco Trapani 1 UNECE Paris - June](https://reader033.vdocuments.net/reader033/viewer/2022051416/56649ed15503460f94bdfc01/html5/thumbnails/30.jpg)
Each publication has a sequence of [0/1] for each criterion
PROFILE Best configuration 111111 …Worst configuration 000000 …
The analysis was performed for each criterion. We will show just the results concerning appropriateness and clarity.
C. data analysis
EVALUATING CRITERIA
(A) APPROPRIATENESS
(B) CORRECTNESS
(C) CLARITY
with reference to
(i)a
udie
nce
(ii)
channel
(iii)c
onte
xt
(i)a
udie
nce
(ii)
channel
(iii)c
onte
xt
(i)a
udie
nce
(ii)
channel
(iii)c
onte
xt
1. OUTLINE 0 1 0
2. TOOLS 1 1 1
3. CLOTHES 1 1 1
![Page 31: Assessing the quality of communication in statistics: the application of a model Filomena Maggino 1, Marco Fattore 2, Marco Trapani 1 UNECE Paris - June](https://reader033.vdocuments.net/reader033/viewer/2022051416/56649ed15503460f94bdfc01/html5/thumbnails/31.jpg)
Hasse diagrams of quality configurations audience appropriateness (left) and audience clarity (right)
for the publication outlinesLinked nodes are ordered from top to bottom.
Not linked nodes represent incomparable quality (appropriateness or clarity) configurations.
C. data analysis
![Page 32: Assessing the quality of communication in statistics: the application of a model Filomena Maggino 1, Marco Fattore 2, Marco Trapani 1 UNECE Paris - June](https://reader033.vdocuments.net/reader033/viewer/2022051416/56649ed15503460f94bdfc01/html5/thumbnails/32.jpg)
Definition of thresholds (subjective choices)
which element in the sequence is related with
• high quality configuration (quality degree = 1) s2
• poor quality configuration (quality degree = 0) s1
Given such thresholds, what quality degrees do other configurations receive, in the appropriateness and clarity posets respectively?
C. data analysis
![Page 33: Assessing the quality of communication in statistics: the application of a model Filomena Maggino 1, Marco Fattore 2, Marco Trapani 1 UNECE Paris - June](https://reader033.vdocuments.net/reader033/viewer/2022051416/56649ed15503460f94bdfc01/html5/thumbnails/33.jpg)
P2 and P5 are above the high quality threshold, in both posets,
they receive quality degree 1 in both appropriateness and clarity
C. data analysis
![Page 34: Assessing the quality of communication in statistics: the application of a model Filomena Maggino 1, Marco Fattore 2, Marco Trapani 1 UNECE Paris - June](https://reader033.vdocuments.net/reader033/viewer/2022051416/56649ed15503460f94bdfc01/html5/thumbnails/34.jpg)
P4 is below the poor quality threshold, in appropriateness,
It receives appropriateness degree = 0
C. data analysis
![Page 35: Assessing the quality of communication in statistics: the application of a model Filomena Maggino 1, Marco Fattore 2, Marco Trapani 1 UNECE Paris - June](https://reader033.vdocuments.net/reader033/viewer/2022051416/56649ed15503460f94bdfc01/html5/thumbnails/35.jpg)
P6 is below the poor quality threshold, in clarity,
It receives clarity degree = 0
C. data analysis
![Page 36: Assessing the quality of communication in statistics: the application of a model Filomena Maggino 1, Marco Fattore 2, Marco Trapani 1 UNECE Paris - June](https://reader033.vdocuments.net/reader033/viewer/2022051416/56649ed15503460f94bdfc01/html5/thumbnails/36.jpg)
By analysing how frequently a configuration is above the high quality threshold
(or below the poor quality threshold) in the set of complete orders
we can determine the degree of appropriateness and clarity
of each configuration ( publication)
C. data analysis
![Page 37: Assessing the quality of communication in statistics: the application of a model Filomena Maggino 1, Marco Fattore 2, Marco Trapani 1 UNECE Paris - June](https://reader033.vdocuments.net/reader033/viewer/2022051416/56649ed15503460f94bdfc01/html5/thumbnails/37.jpg)
Final ranking scatterplotfuzzy membership functions
C. data analysis
Publication Audience
appropriateness
Audience
clarity
P1 0.6 0.6
P2 1.0 1.0
P3 0.9 0.9
P4 0.0 0.2
P5 1.0 1.0
P6 0.6 0.0
![Page 38: Assessing the quality of communication in statistics: the application of a model Filomena Maggino 1, Marco Fattore 2, Marco Trapani 1 UNECE Paris - June](https://reader033.vdocuments.net/reader033/viewer/2022051416/56649ed15503460f94bdfc01/html5/thumbnails/38.jpg)
The presented work summarizes the second stage of our study, aimed at
assessing the quality of communication in statistics.
The way forward …
The goal is to keep improving
- the conceptual model
- the evaluation procedure
by discussing with all the colleagues.
![Page 39: Assessing the quality of communication in statistics: the application of a model Filomena Maggino 1, Marco Fattore 2, Marco Trapani 1 UNECE Paris - June](https://reader033.vdocuments.net/reader033/viewer/2022051416/56649ed15503460f94bdfc01/html5/thumbnails/39.jpg)
Final goal is to assess standardized methods and techniques
in order to improve the impact of communication in statistics
Developing and adopting standardized codes allow transmitters to warrant:
Objectivity of data presentation, by avoiding introduction of any subjective component
Comparability between different presentations and along time
Economicity and efficiency
in preparing presentation
Generalization by avoiding any kind of “adaptability” of codes to “subjective” messages
Understanding of data structure
The way forward …