fairness on the web: alternatives to the power law

19
Web Science and Technologies University of Koblenz–Landau, Germany Fairness on the Web: Alternatives to the Power Law Jérôme Kunegis University of Koblenz–Landau (with Julia Preusse) GESIS Cologne, Mai 2012

Upload: jerome-kunegis

Post on 26-Jan-2015

111 views

Category:

Education


1 download

DESCRIPTION

This paper presents several measures of fairness and inequality based on the degreedistribution in networks, as alternatives to the well-established power-law exponent.Networks such as social networks, communication networks and the WorldWide Web itself are often characterized by their unequal distribution ofedges: Few nodes are attached to many edges, while many nodes areattached to only few edges. The inequality of such network structures istypically measured using the power-law exponent, stating that the number ofnodes with a given degree is proportional to that degree taken to acertain exponent. However, this approach has several weaknesses, suchas its narrow applicability and expensive computational complexity. Beyond the fact that power laws are by far not auniversal phenomenon on the Web, the power-law exponent has thesurprising property of being negatively correlated with the usualnotion of inequality, making it unintuitive as a fairness measure. Asalternatives, we propose several measures based on the Lorenz curve,which is used in economics but rarely in networks study, and on theinformation-theoretical concept of entropy. We show in experiments on alarge collection of online networks that these measures do not suffer underthe drawbacks of the power-law exponent.

TRANSCRIPT

Page 1: Fairness on the Web:  Alternatives to the Power Law

Web Science and Technologies

University of Koblenz–Landau, Germany

Fairness on the Web:Alternatives to the Power Law

Jérôme KunegisUniversity of Koblenz–Landau

(with Julia Preusse)GESIS Cologne, Mai 2012

Page 2: Fairness on the Web:  Alternatives to the Power Law

Jérôme [email protected]

Fairness on the Web: Alternatives to the Power Law2 / 19

Page 3: Fairness on the Web:  Alternatives to the Power Law

Jérôme [email protected]

Fairness on the Web: Alternatives to the Power Law3 / 19

UNFAIR

Page 4: Fairness on the Web:  Alternatives to the Power Law

Jérôme [email protected]

Fairness on the Web: Alternatives to the Power Law4 / 19

Edge distribution Degree distribution

Page 5: Fairness on the Web:  Alternatives to the Power Law

Jérôme [email protected]

Fairness on the Web: Alternatives to the Power Law5 / 19

Power-law degree distribution

C(n) ~ n−γ

Page 6: Fairness on the Web:  Alternatives to the Power Law

Jérôme [email protected]

Fairness on the Web: Alternatives to the Power Law6 / 19

TODO

Page 7: Fairness on the Web:  Alternatives to the Power Law

Jérôme [email protected]

Fairness on the Web: Alternatives to the Power Law7 / 19

todo

Flickr Digg

Page 8: Fairness on the Web:  Alternatives to the Power Law

Jérôme [email protected]

Fairness on the Web: Alternatives to the Power Law8 / 19

The Pareto Principle

20% of people own 80% of land.

(In 1920 Italy)

Page 9: Fairness on the Web:  Alternatives to the Power Law

Jérôme [email protected]

Fairness on the Web: Alternatives to the Power Law9 / 19

8.9% of bands make up 91.1% of plays on Last.fm.

14.6% of user groups account for 75.4% of group memberships on Flickr.

17.4% of movies receive 82.6% of ratings on MovieLens.

17.7% of profiles receive 82.3% of ratings on Czech dating site Libimseti.cz.

20.3% of all users receive 79.7% of “friend” and “foe” links on Slashdot.

21.3% of users receive 78.7% of wall posts on Facebook.

22.9% of users make up 77.1% of all “@” mentions on Twitter.

23.1% of projects receive 76.9% of project memberships on Github.

27.3% of users receive 72.7% of replies on Digg.

30.4% of all sites receive 69.6% of all hyperlinks on the Web.

Page 10: Fairness on the Web:  Alternatives to the Power Law

Jérôme [email protected]

Fairness on the Web: Alternatives to the Power Law10 / 19

Gini Coefficient – Lorenz Curve

Page 11: Fairness on the Web:  Alternatives to the Power Law

Jérôme [email protected]

Fairness on the Web: Alternatives to the Power Law11 / 19

todo

Page 12: Fairness on the Web:  Alternatives to the Power Law

Jérôme [email protected]

Fairness on the Web: Alternatives to the Power Law12 / 19

Zeta distribution C(n) = n−γ / ζ(γ)

Page 13: Fairness on the Web:  Alternatives to the Power Law

Jérôme [email protected]

Fairness on the Web: Alternatives to the Power Law13 / 19

Random Edge→Vertex

P(u) = d(u) / 2|E|

Page 14: Fairness on the Web:  Alternatives to the Power Law

Jérôme [email protected]

Fairness on the Web: Alternatives to the Power Law14 / 19

Entropy

Page 15: Fairness on the Web:  Alternatives to the Power Law

Jérôme [email protected]

Fairness on the Web: Alternatives to the Power Law15 / 19

Maximum Entropy

max He = ln |V|

Page 16: Fairness on the Web:  Alternatives to the Power Law

Jérôme [email protected]

Fairness on the Web: Alternatives to the Power Law16 / 19

Normalized Entropy

Page 17: Fairness on the Web:  Alternatives to the Power Law

Jérôme [email protected]

Fairness on the Web: Alternatives to the Power Law17 / 19

Page 18: Fairness on the Web:  Alternatives to the Power Law

Jérôme [email protected]

Fairness on the Web: Alternatives to the Power Law18 / 19

Generality

Interpretation

Runtime

Coverage

Power Law

Power-law

–––

Slow

d(u) ≥ dmin

Gini

All networks

Economy

Fast

All

Norm. Entropy

All networks

Physical

Fast

All

Comparison

Page 19: Fairness on the Web:  Alternatives to the Power Law

Jérôme [email protected]

Fairness on the Web: Alternatives to the Power Law19 / 19

http://konect.uni-koblenz.de/plots/degree_distribution

http://konect.uni-koblenz.de/plots/lorenz_curve

Thank You!→ 22 - 24 June, Web Science Conference

Dr. Jérôme Kunegis<[email protected]>Institute for Web Science and TechnologiesUniversity of Koblenz–Landau (Campus Koblenz)