crowdsourcing scholarly data and universality of impact ...€¦ · diep thi hoang, jasleen kaur,...
TRANSCRIPT
![Page 1: Crowdsourcing Scholarly Data and Universality of Impact ...€¦ · Diep Thi Hoang, Jasleen Kaur, Filippo Radicchi, Xiaoling Sun, Snehal Patil, Lino Possamai, Mohsen Jafari-Asbagh,](https://reader034.vdocuments.net/reader034/viewer/2022052021/603670ae5a8ba1339c42c63c/html5/thumbnails/1.jpg)
Diep Thi Hoang, Jasleen Kaur, Filippo Radicchi, Xiaoling Sun, Snehal Patil, Lino Possamai, Mohsen Jafari-Asbagh,
Filippo Menczer
Crowdsourcing Scholarly Data and Universality of Impact Metrics
![Page 2: Crowdsourcing Scholarly Data and Universality of Impact ...€¦ · Diep Thi Hoang, Jasleen Kaur, Filippo Radicchi, Xiaoling Sun, Snehal Patil, Lino Possamai, Mohsen Jafari-Asbagh,](https://reader034.vdocuments.net/reader034/viewer/2022052021/603670ae5a8ba1339c42c63c/html5/thumbnails/2.jpg)
![Page 4: Crowdsourcing Scholarly Data and Universality of Impact ...€¦ · Diep Thi Hoang, Jasleen Kaur, Filippo Radicchi, Xiaoling Sun, Snehal Patil, Lino Possamai, Mohsen Jafari-Asbagh,](https://reader034.vdocuments.net/reader034/viewer/2022052021/603670ae5a8ba1339c42c63c/html5/thumbnails/4.jpg)
![Page 5: Crowdsourcing Scholarly Data and Universality of Impact ...€¦ · Diep Thi Hoang, Jasleen Kaur, Filippo Radicchi, Xiaoling Sun, Snehal Patil, Lino Possamai, Mohsen Jafari-Asbagh,](https://reader034.vdocuments.net/reader034/viewer/2022052021/603670ae5a8ba1339c42c63c/html5/thumbnails/5.jpg)
![Page 6: Crowdsourcing Scholarly Data and Universality of Impact ...€¦ · Diep Thi Hoang, Jasleen Kaur, Filippo Radicchi, Xiaoling Sun, Snehal Patil, Lino Possamai, Mohsen Jafari-Asbagh,](https://reader034.vdocuments.net/reader034/viewer/2022052021/603670ae5a8ba1339c42c63c/html5/thumbnails/6.jpg)
![Page 7: Crowdsourcing Scholarly Data and Universality of Impact ...€¦ · Diep Thi Hoang, Jasleen Kaur, Filippo Radicchi, Xiaoling Sun, Snehal Patil, Lino Possamai, Mohsen Jafari-Asbagh,](https://reader034.vdocuments.net/reader034/viewer/2022052021/603670ae5a8ba1339c42c63c/html5/thumbnails/7.jpg)
authortags
citation data
![Page 8: Crowdsourcing Scholarly Data and Universality of Impact ...€¦ · Diep Thi Hoang, Jasleen Kaur, Filippo Radicchi, Xiaoling Sun, Snehal Patil, Lino Possamai, Mohsen Jafari-Asbagh,](https://reader034.vdocuments.net/reader034/viewer/2022052021/603670ae5a8ba1339c42c63c/html5/thumbnails/8.jpg)
authortags
citation data
impact measuresbib records
networkwidget
API
![Page 9: Crowdsourcing Scholarly Data and Universality of Impact ...€¦ · Diep Thi Hoang, Jasleen Kaur, Filippo Radicchi, Xiaoling Sun, Snehal Patil, Lino Possamai, Mohsen Jafari-Asbagh,](https://reader034.vdocuments.net/reader034/viewer/2022052021/603670ae5a8ba1339c42c63c/html5/thumbnails/9.jpg)
![Page 10: Crowdsourcing Scholarly Data and Universality of Impact ...€¦ · Diep Thi Hoang, Jasleen Kaur, Filippo Radicchi, Xiaoling Sun, Snehal Patil, Lino Possamai, Mohsen Jafari-Asbagh,](https://reader034.vdocuments.net/reader034/viewer/2022052021/603670ae5a8ba1339c42c63c/html5/thumbnails/10.jpg)
![Page 11: Crowdsourcing Scholarly Data and Universality of Impact ...€¦ · Diep Thi Hoang, Jasleen Kaur, Filippo Radicchi, Xiaoling Sun, Snehal Patil, Lino Possamai, Mohsen Jafari-Asbagh,](https://reader034.vdocuments.net/reader034/viewer/2022052021/603670ae5a8ba1339c42c63c/html5/thumbnails/11.jpg)
X. Sun & al: Ambiguous Author Query Detection using Crowdsourced Digital Library Annotations. Information Processing &
Management 49:454-464, 2013
![Page 12: Crowdsourcing Scholarly Data and Universality of Impact ...€¦ · Diep Thi Hoang, Jasleen Kaur, Filippo Radicchi, Xiaoling Sun, Snehal Patil, Lino Possamai, Mohsen Jafari-Asbagh,](https://reader034.vdocuments.net/reader034/viewer/2022052021/603670ae5a8ba1339c42c63c/html5/thumbnails/12.jpg)
Reliability heuristics
J. Kaur & al: Scholarometer: A Social Framework for Analyzing Impact across Disciplines. PLoS ONE 7(9):e43235, 2012
![Page 13: Crowdsourcing Scholarly Data and Universality of Impact ...€¦ · Diep Thi Hoang, Jasleen Kaur, Filippo Radicchi, Xiaoling Sun, Snehal Patil, Lino Possamai, Mohsen Jafari-Asbagh,](https://reader034.vdocuments.net/reader034/viewer/2022052021/603670ae5a8ba1339c42c63c/html5/thumbnails/13.jpg)
Linked Open Data & API
![Page 14: Crowdsourcing Scholarly Data and Universality of Impact ...€¦ · Diep Thi Hoang, Jasleen Kaur, Filippo Radicchi, Xiaoling Sun, Snehal Patil, Lino Possamai, Mohsen Jafari-Asbagh,](https://reader034.vdocuments.net/reader034/viewer/2022052021/603670ae5a8ba1339c42c63c/html5/thumbnails/14.jpg)
![Page 15: Crowdsourcing Scholarly Data and Universality of Impact ...€¦ · Diep Thi Hoang, Jasleen Kaur, Filippo Radicchi, Xiaoling Sun, Snehal Patil, Lino Possamai, Mohsen Jafari-Asbagh,](https://reader034.vdocuments.net/reader034/viewer/2022052021/603670ae5a8ba1339c42c63c/html5/thumbnails/15.jpg)
![Page 16: Crowdsourcing Scholarly Data and Universality of Impact ...€¦ · Diep Thi Hoang, Jasleen Kaur, Filippo Radicchi, Xiaoling Sun, Snehal Patil, Lino Possamai, Mohsen Jafari-Asbagh,](https://reader034.vdocuments.net/reader034/viewer/2022052021/603670ae5a8ba1339c42c63c/html5/thumbnails/16.jpg)
![Page 17: Crowdsourcing Scholarly Data and Universality of Impact ...€¦ · Diep Thi Hoang, Jasleen Kaur, Filippo Radicchi, Xiaoling Sun, Snehal Patil, Lino Possamai, Mohsen Jafari-Asbagh,](https://reader034.vdocuments.net/reader034/viewer/2022052021/603670ae5a8ba1339c42c63c/html5/thumbnails/17.jpg)
![Page 18: Crowdsourcing Scholarly Data and Universality of Impact ...€¦ · Diep Thi Hoang, Jasleen Kaur, Filippo Radicchi, Xiaoling Sun, Snehal Patil, Lino Possamai, Mohsen Jafari-Asbagh,](https://reader034.vdocuments.net/reader034/viewer/2022052021/603670ae5a8ba1339c42c63c/html5/thumbnails/18.jpg)
![Page 19: Crowdsourcing Scholarly Data and Universality of Impact ...€¦ · Diep Thi Hoang, Jasleen Kaur, Filippo Radicchi, Xiaoling Sun, Snehal Patil, Lino Possamai, Mohsen Jafari-Asbagh,](https://reader034.vdocuments.net/reader034/viewer/2022052021/603670ae5a8ba1339c42c63c/html5/thumbnails/19.jpg)
![Page 20: Crowdsourcing Scholarly Data and Universality of Impact ...€¦ · Diep Thi Hoang, Jasleen Kaur, Filippo Radicchi, Xiaoling Sun, Snehal Patil, Lino Possamai, Mohsen Jafari-Asbagh,](https://reader034.vdocuments.net/reader034/viewer/2022052021/603670ae5a8ba1339c42c63c/html5/thumbnails/20.jpg)
a.
0 20 40 60 80 100global rank by h
loca
l ran
k
0
20
40
60
80
100
●●●●●●●●●●●
●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●
●●●●●●●●●●
●●●●
●●
●●
●●
●●●
●●
●●●●
●●●●●●●●
●●
●●
●
●●●
●●
●●●●●●●●
●●●●
●●
●●
●●●
●●●
●●
●●
●●●●●●●
●●●●●●●●●●●●●●●●
●●●
●●●●●●●●●●●●●●●●●●●●●●●●●
●●●●●
●●●●●●●●●●●●●●●
●●
●●●●
●●●●●●●
●●●●●
●●
●●
●
●●
●●●
●●●●●●●●
●●●●●●
●●
●●●
●●●●
●●
●●
●●●●●●●
●●●●
●●●●
●●●●●
●●●●
●●●●
●●●●
●
0 20 40 60 80 100global rank by hs
0
20
40
60
80
100
●●●●
●●●●● ●●
●●●●●●●●●
●●●●●●●●●●
●●●●●●●●●●●
●●●●●●●●●●
●●●●
●●
●●●●
●●●
●●
●●
●●
●●●●
●●
●●
●●
●●
●
●●●
●●
●●●●
●●●●
●●
●●
●●
●●
●●●
●●●
●●
●●
●●
●●
●●●
●●●●●●●●●●●●●●●●
●●●
●●●●●●●●●●●●●●●●●●
●●●●●●●
●●●●●
●●●●●●●●●●●●●●●
●●
●●●●
●●●
●●●●
●●●●●
●●
●●
●
●●●●●
●●●
●●
●●●
●●
●●
●●
●●
●●
●
●●●●
●●
●●
●●●●●●●
●●●●
●●
●●
●●●●●
●●●●
●●●●
●●●●
●
●
●
●●●●●●●
biologymathematicseconomicspsychologysociologylibrary sciencesbiochemistry
a.
0 20 40 60 80 100global rank by h
loca
l ran
k
0
20
40
60
80
100
●●●●●●●●●●●
●●●●●●●●●●●●●●●●●●●●●●●●●●●●●●
●●●●●●●●●●
●●●●
●●
●●
●●
●●●
●●
●●●●
●●●●●●●●
●●
●●
●
●●●
●●
●●●●●●●●
●●●●
●●
●●
●●●
●●●
●●
●●
●●●●●●●
●●●●●●●●●●●●●●●●
●●●
●●●●●●●●●●●●●●●●●●●●●●●●●
●●●●●
●●●●●●●●●●●●●●●
●●
●●●●
●●●●●●●
●●●●●
●●
●●
●
●●
●●●
●●●●●●●●
●●●●●●
●●
●●●
●●●●
●●
●●
●●●●●●●
●●●●
●●●●
●●●●●
●●●●
●●●●
●●●●
●
0 20 40 60 80 100global rank by hs
0
20
40
60
80
100
●●●●
●●●●● ●●
●●●●●●●●●
●●●●●●●●●●
●●●●●●●●●●●
●●●●●●●●●●
●●●●
●●
●●●●
●●●
●●
●●
●●
●●●●
●●
●●
●●
●●
●
●●●
●●
●●●●
●●●●
●●
●●
●●
●●
●●●
●●●
●●
●●
●●
●●
●●●
●●●●●●●●●●●●●●●●
●●●
●●●●●●●●●●●●●●●●●●
●●●●●●●
●●●●●
●●●●●●●●●●●●●●●
●●
●●●●
●●●
●●●●
●●●●●
●●
●●
●
●●●●●
●●●
●●
●●●
●●
●●
●●
●●
●●
●
●●●●
●●
●●
●●●●●●●
●●●●
●●
●●
●●●●●
●●●●
●●●●
●●●●
●
●
●
●●●●●●●
biologymathematicseconomicspsychologysociologylibrary sciencesbiochemistry
![Page 21: Crowdsourcing Scholarly Data and Universality of Impact ...€¦ · Diep Thi Hoang, Jasleen Kaur, Filippo Radicchi, Xiaoling Sun, Snehal Patil, Lino Possamai, Mohsen Jafari-Asbagh,](https://reader034.vdocuments.net/reader034/viewer/2022052021/603670ae5a8ba1339c42c63c/html5/thumbnails/21.jpg)
Universality
![Page 22: Crowdsourcing Scholarly Data and Universality of Impact ...€¦ · Diep Thi Hoang, Jasleen Kaur, Filippo Radicchi, Xiaoling Sun, Snehal Patil, Lino Possamai, Mohsen Jafari-Asbagh,](https://reader034.vdocuments.net/reader034/viewer/2022052021/603670ae5a8ba1339c42c63c/html5/thumbnails/22.jpg)
Universality
![Page 23: Crowdsourcing Scholarly Data and Universality of Impact ...€¦ · Diep Thi Hoang, Jasleen Kaur, Filippo Radicchi, Xiaoling Sun, Snehal Patil, Lino Possamai, Mohsen Jafari-Asbagh,](https://reader034.vdocuments.net/reader034/viewer/2022052021/603670ae5a8ba1339c42c63c/html5/thumbnails/23.jpg)
b.
% a
utho
rs
2
3
4
5
6
7
biolo
gy
ec
onom
ics
ps
ycholo
gy
bioch
emistr
y
so
ciolog
y
math
emati
cs
library
scien
ces
●
●
●●
●
●
●
● hsh
![Page 24: Crowdsourcing Scholarly Data and Universality of Impact ...€¦ · Diep Thi Hoang, Jasleen Kaur, Filippo Radicchi, Xiaoling Sun, Snehal Patil, Lino Possamai, Mohsen Jafari-Asbagh,](https://reader034.vdocuments.net/reader034/viewer/2022052021/603670ae5a8ba1339c42c63c/html5/thumbnails/24.jpg)
Fluctuations: hypergeometric
distribution
b.
% a
utho
rs
2
3
4
5
6
7
biolo
gy
ec
onom
ics
ps
ycholo
gy
bioch
emistr
y
so
ciolog
y
math
emati
cs
library
scien
ces
●
●
●●
●
●
●
● hsh
![Page 25: Crowdsourcing Scholarly Data and Universality of Impact ...€¦ · Diep Thi Hoang, Jasleen Kaur, Filippo Radicchi, Xiaoling Sun, Snehal Patil, Lino Possamai, Mohsen Jafari-Asbagh,](https://reader034.vdocuments.net/reader034/viewer/2022052021/603670ae5a8ba1339c42c63c/html5/thumbnails/25.jpg)
c.
u(z=5%)0.5 0.7 0.9
cavgh
ctotal1 2hmi10ghf
(c c0)avghi, norm
hs
Which metrics are universal?
![Page 26: Crowdsourcing Scholarly Data and Universality of Impact ...€¦ · Diep Thi Hoang, Jasleen Kaur, Filippo Radicchi, Xiaoling Sun, Snehal Patil, Lino Possamai, Mohsen Jafari-Asbagh,](https://reader034.vdocuments.net/reader034/viewer/2022052021/603670ae5a8ba1339c42c63c/html5/thumbnails/26.jpg)
c.
u(z=5%)0.5 0.7 0.9
cavgh
ctotal1 2hmi10ghf
(c c0)avghi, norm
hsh / <h>
Batista
New Crown Indicator a.k.a. FNCS
Radicchi & al.
Egghe
Schreiber
Redner
Which metrics are universal?
![Page 27: Crowdsourcing Scholarly Data and Universality of Impact ...€¦ · Diep Thi Hoang, Jasleen Kaur, Filippo Radicchi, Xiaoling Sun, Snehal Patil, Lino Possamai, Mohsen Jafari-Asbagh,](https://reader034.vdocuments.net/reader034/viewer/2022052021/603670ae5a8ba1339c42c63c/html5/thumbnails/27.jpg)
Universality Index
![Page 28: Crowdsourcing Scholarly Data and Universality of Impact ...€¦ · Diep Thi Hoang, Jasleen Kaur, Filippo Radicchi, Xiaoling Sun, Snehal Patil, Lino Possamai, Mohsen Jafari-Asbagh,](https://reader034.vdocuments.net/reader034/viewer/2022052021/603670ae5a8ba1339c42c63c/html5/thumbnails/28.jpg)
e.
d.
z
u(z)
3 10 20 30 40 50 60 70 80 90 99
0.4
0.5
0.6
0.7
0.8
0.9
1.0
metrichshi, norm(c c0)avghmhfgctotal1 2
i10hcavg
u0.940.940.880.880.860.850.850.840.830.74
![Page 29: Crowdsourcing Scholarly Data and Universality of Impact ...€¦ · Diep Thi Hoang, Jasleen Kaur, Filippo Radicchi, Xiaoling Sun, Snehal Patil, Lino Possamai, Mohsen Jafari-Asbagh,](https://reader034.vdocuments.net/reader034/viewer/2022052021/603670ae5a8ba1339c42c63c/html5/thumbnails/29.jpg)
e.
d.
z
u(z)
3 10 20 30 40 50 60 70 80 90 99
0.4
0.5
0.6
0.7
0.8
0.9
1.0
metrichshi, norm(c c0)avghmhfgctotal1 2
i10hcavg
u0.940.940.880.880.860.850.850.840.830.74
![Page 30: Crowdsourcing Scholarly Data and Universality of Impact ...€¦ · Diep Thi Hoang, Jasleen Kaur, Filippo Radicchi, Xiaoling Sun, Snehal Patil, Lino Possamai, Mohsen Jafari-Asbagh,](https://reader034.vdocuments.net/reader034/viewer/2022052021/603670ae5a8ba1339c42c63c/html5/thumbnails/30.jpg)
Diep Thi Hoang, Jasleen Kaur, Filippo Radicchi, Xiaoling Sun, Snehal Patil, Lino Possamai, Mohsen Jafari-Asbagh, Filippo Menczer
Thanks: Geoffrey Fox, Filippo Radicchi, Santo Fortunato, Alex Vespignani, Johan Bollen, Rajasee Rege, Heather Roinestad, Alessandro Flammini,
Networks & agents Network, NSF Award IIS-0811994
![Page 31: Crowdsourcing Scholarly Data and Universality of Impact ...€¦ · Diep Thi Hoang, Jasleen Kaur, Filippo Radicchi, Xiaoling Sun, Snehal Patil, Lino Possamai, Mohsen Jafari-Asbagh,](https://reader034.vdocuments.net/reader034/viewer/2022052021/603670ae5a8ba1339c42c63c/html5/thumbnails/31.jpg)
Diep Thi Hoang, Jasleen Kaur, Filippo Radicchi, Xiaoling Sun, Snehal Patil, Lino Possamai, Mohsen Jafari-Asbagh, Filippo Menczer
Thanks: Geoffrey Fox, Filippo Radicchi, Santo Fortunato, Alex Vespignani, Johan Bollen, Rajasee Rege, Heather Roinestad, Alessandro Flammini,
Networks & agents Network, NSF Award IIS-0811994
scholarometer.indiana.edu