bad things happen on the web…web.stanford.edu/class/cs124/lec/hamilton-reddit-cs124.pdf · bad...

25
Anti-social behavior in online spaces 1 [Reference: Kumar, Hamilton, Leskovec, and Jurafsky. Community Interaction and Conflict on the Web. WWW 2018. https://goo.gl/17jtGj] Bad things happen on the web…

Upload: others

Post on 30-Sep-2020

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Bad things happen on the web…web.stanford.edu/class/cs124/lec/hamilton-reddit-cs124.pdf · Bad things happen on the web… Anti-social behavior in online spaces 1 [Reference: Kumar,

Anti-social behavior in online spaces

1

[Reference: Kumar, Hamilton, Leskovec, and Jurafsky. Community Interaction and Conflict on the Web. WWW 2018. https://goo.gl/17jtGj]

Bad things happen on the web…

Page 2: Bad things happen on the web…web.stanford.edu/class/cs124/lec/hamilton-reddit-cs124.pdf · Bad things happen on the web… Anti-social behavior in online spaces 1 [Reference: Kumar,

Anti-social behavior in online spaces

1

[Reference: Kumar, Hamilton, Leskovec, and Jurafsky. Community Interaction and Conflict on the Web. WWW 2018. https://goo.gl/17jtGj]

Misinformation

Bad things happen on the web…

Page 3: Bad things happen on the web…web.stanford.edu/class/cs124/lec/hamilton-reddit-cs124.pdf · Bad things happen on the web… Anti-social behavior in online spaces 1 [Reference: Kumar,

Anti-social behavior in online spaces

1

[Reference: Kumar, Hamilton, Leskovec, and Jurafsky. Community Interaction and Conflict on the Web. WWW 2018. https://goo.gl/17jtGj]

Misinformation

Radicalization

Bad things happen on the web…

Page 4: Bad things happen on the web…web.stanford.edu/class/cs124/lec/hamilton-reddit-cs124.pdf · Bad things happen on the web… Anti-social behavior in online spaces 1 [Reference: Kumar,

Anti-social behavior in online spaces

1

[Reference: Kumar, Hamilton, Leskovec, and Jurafsky. Community Interaction and Conflict on the Web. WWW 2018. https://goo.gl/17jtGj]

Misinformation

Radicalization

Hate-speech

Bad things happen on the web…

Page 5: Bad things happen on the web…web.stanford.edu/class/cs124/lec/hamilton-reddit-cs124.pdf · Bad things happen on the web… Anti-social behavior in online spaces 1 [Reference: Kumar,

Anti-social behavior in online spaces

1

[Reference: Kumar, Hamilton, Leskovec, and Jurafsky. Community Interaction and Conflict on the Web. WWW 2018. https://goo.gl/17jtGj]

Misinformation

Radicalization

Hate-speech

Bad things happen on the web…

Page 6: Bad things happen on the web…web.stanford.edu/class/cs124/lec/hamilton-reddit-cs124.pdf · Bad things happen on the web… Anti-social behavior in online spaces 1 [Reference: Kumar,

Intercommunity conflict

2

What leads to intercommunity conflict on the web?

“Come look at all the brainwashed idiots in r/Documentaries….”

r/conspiracy r/Documentaries

post negative/hateful content

vote manipulation,

etc….

long-term decrease in engagement (and

presumably well-being)

Page 7: Bad things happen on the web…web.stanford.edu/class/cs124/lec/hamilton-reddit-cs124.pdf · Bad things happen on the web… Anti-social behavior in online spaces 1 [Reference: Kumar,

Reddit dataset

3

100+ million users

40 months (2014-2017)

1.8 billion comments

20,000+ communities

Page 8: Bad things happen on the web…web.stanford.edu/class/cs124/lec/hamilton-reddit-cs124.pdf · Bad things happen on the web… Anti-social behavior in online spaces 1 [Reference: Kumar,

Defining conflict: intercommunity mobilizations

4

Source community links to target community.

Page 9: Bad things happen on the web…web.stanford.edu/class/cs124/lec/hamilton-reddit-cs124.pdf · Bad things happen on the web… Anti-social behavior in online spaces 1 [Reference: Kumar,

Defining conflict: intercommunity mobilizations

4

Source community links to target community.

“Come look at all the brainwashed idiots in r/Documentaries….”

sentiment analysis

Page 10: Bad things happen on the web…web.stanford.edu/class/cs124/lec/hamilton-reddit-cs124.pdf · Bad things happen on the web… Anti-social behavior in online spaces 1 [Reference: Kumar,

Defining conflict: intercommunity mobilizations

4

Source community links to target community.

Users from source mobilize to target (with potential negative consequences)

*conflict/interaction

“Come look at all the brainwashed idiots in r/Documentaries….”

sentiment analysis

Page 11: Bad things happen on the web…web.stanford.edu/class/cs124/lec/hamilton-reddit-cs124.pdf · Bad things happen on the web… Anti-social behavior in online spaces 1 [Reference: Kumar,

Conflict: the three stages

5

*conflict/interaction

attack!!!

users driven away!

1. Initiation 2. Interaction 3. Impact

~20,000 detected cases of intercommunity conflict in our data.

x xx x

x

Page 12: Bad things happen on the web…web.stanford.edu/class/cs124/lec/hamilton-reddit-cs124.pdf · Bad things happen on the web… Anti-social behavior in online spaces 1 [Reference: Kumar,

Initiation: Which communities start conflicts?

6

−100 −80 −60 −40 −20 0 20 40 60 80−80

−60

−40

−20

0

20

40

60

80

TECHNOLOGY

SPORTS TEAMS

GAMING

CONTROVERSIAL TOPICS

MUSIC

US CITIES

MOVIESPOPULAR/

MEMES

PORNOGRAPHY

PSYCHOLOGY/ADVICE

COMMERCE

blue = “initiates less conflict”

red = “initiates more conflict”

74% of conflicts are started by 1% of

communities

Page 13: Bad things happen on the web…web.stanford.edu/class/cs124/lec/hamilton-reddit-cs124.pdf · Bad things happen on the web… Anti-social behavior in online spaces 1 [Reference: Kumar,

Initiation: Which users start conflicts?

7

Highly active “core” members start conflicts, but “peripheral” members carry them out.

Users with more within-community posts are better at mobilizing others.

Page 14: Bad things happen on the web…web.stanford.edu/class/cs124/lec/hamilton-reddit-cs124.pdf · Bad things happen on the web… Anti-social behavior in online spaces 1 [Reference: Kumar,

Interaction: What happens during conflicts?

8

Conflicts tend to involve lots of anger words, etc… …but who are the central users in these interactions?

Idea: PageRank on who-replies-to-who networks

Finding: “Attackers” tend to be more central

Page 15: Bad things happen on the web…web.stanford.edu/class/cs124/lec/hamilton-reddit-cs124.pdf · Bad things happen on the web… Anti-social behavior in online spaces 1 [Reference: Kumar,

Interaction: “Echochambers” during conflicts

9

Idea: “Attacker” and “Defender” PageRanks

Run PageRank but restrict the teleport set to just attackers/defenders:

Quantifies centrality from perspective of

only defenders/attackers.

Page 16: Bad things happen on the web…web.stanford.edu/class/cs124/lec/hamilton-reddit-cs124.pdf · Bad things happen on the web… Anti-social behavior in online spaces 1 [Reference: Kumar,

Interaction: “Echochambers” during conflicts

9

Idea: “Attacker” and “Defender” PageRanks

Run PageRank but restrict the teleport set to just attackers/defenders:

Quantifies centrality from perspective of

only defenders/attackers.

Page 17: Bad things happen on the web…web.stanford.edu/class/cs124/lec/hamilton-reddit-cs124.pdf · Bad things happen on the web… Anti-social behavior in online spaces 1 [Reference: Kumar,

Interaction: “Echochambers” during conflicts

9

Idea: “Attacker” and “Defender” PageRanks

Run PageRank but restrict the teleport set to just attackers/defenders:

Quantifies centrality from perspective of

only defenders/attackers.

Page 18: Bad things happen on the web…web.stanford.edu/class/cs124/lec/hamilton-reddit-cs124.pdf · Bad things happen on the web… Anti-social behavior in online spaces 1 [Reference: Kumar,

Interaction: “Echochambers” during conflicts

9

Idea: “Attacker” and “Defender” PageRanks

Run PageRank but restrict the teleport set to just attackers/defenders:

??

?? ??

??

????

Quantifies centrality from perspective of

only defenders/attackers.

Page 19: Bad things happen on the web…web.stanford.edu/class/cs124/lec/hamilton-reddit-cs124.pdf · Bad things happen on the web… Anti-social behavior in online spaces 1 [Reference: Kumar,

Interaction: “Echochambers” during conflicts

9

Idea: “Attacker” and “Defender” PageRanks

Run PageRank but restrict the teleport set to just attackers/defenders:

??

????

Quantifies centrality from perspective of

only defenders/attackers.

Page 20: Bad things happen on the web…web.stanford.edu/class/cs124/lec/hamilton-reddit-cs124.pdf · Bad things happen on the web… Anti-social behavior in online spaces 1 [Reference: Kumar,

Interaction: “Echochambers” during conflicts

9

Idea: “Attacker” and “Defender” PageRanks

Run PageRank but restrict the teleport set to just attackers/defenders:

Quantifies centrality from perspective of

only defenders/attackers.

Page 21: Bad things happen on the web…web.stanford.edu/class/cs124/lec/hamilton-reddit-cs124.pdf · Bad things happen on the web… Anti-social behavior in online spaces 1 [Reference: Kumar,

Interaction: “Echochambers” during conflicts

10

Idea: “Attacker” and “Defender” PageRanks

Conflicts form echochambers!!

E.g., attackers are only central to other attackers.

Page 22: Bad things happen on the web…web.stanford.edu/class/cs124/lec/hamilton-reddit-cs124.pdf · Bad things happen on the web… Anti-social behavior in online spaces 1 [Reference: Kumar,

Impact: How do conflicts impact the target users?

11

[WWW 2018]

Attackers “colonize” the target community and defenders leave.

Page 23: Bad things happen on the web…web.stanford.edu/class/cs124/lec/hamilton-reddit-cs124.pdf · Bad things happen on the web… Anti-social behavior in online spaces 1 [Reference: Kumar,

Impact: How do conflicts impact the target users?

11

[WWW 2018]

Attackers “colonize” the target community and defenders leave.

What prevents this?

Page 24: Bad things happen on the web…web.stanford.edu/class/cs124/lec/hamilton-reddit-cs124.pdf · Bad things happen on the web… Anti-social behavior in online spaces 1 [Reference: Kumar,

Impact: What makes a “successful” defense?

12

[WWW 2018]

Page 25: Bad things happen on the web…web.stanford.edu/class/cs124/lec/hamilton-reddit-cs124.pdf · Bad things happen on the web… Anti-social behavior in online spaces 1 [Reference: Kumar,

… conclusions and other fun stuff

13

NLP and network analysis can give us social insights!!

We also built a deep learning model to predict conflict.

Srijan Kumar Postdoc, Stanford CS

Jure Leskovec Associate Prof., Stanford CS

Collaborators (besides me and Dan):

check out our paper https://goo.gl/17jtGj for more details!

[Reference: Kumar, Hamilton, Leskovec, and Jurafsky. Community Interaction and Conflict on the Web. WWW 2018. https://goo.gl/17jtGj]

https://www.reddit.com/r/MachineLearning/comments/841lhj/d_community_interaction_and_conflict_on_the_web/

Discussion happening on Reddit right now!!