![Page 1: causing its decline The rise and decline of an open ...halfaker/publications/The_Rise_and... · The rise and decline of an open collaboration system: How Wikipedia's reaction to popularity](https://reader034.vdocuments.net/reader034/viewer/2022051919/600c250129df3d6e5640bd5c/html5/thumbnails/1.jpg)
The rise and decline of an open collaboration system:
How Wikipedia's reaction to popularity is causing its decline
...and other SCIENCE with Aaron.
![Page 2: causing its decline The rise and decline of an open ...halfaker/publications/The_Rise_and... · The rise and decline of an open collaboration system: How Wikipedia's reaction to popularity](https://reader034.vdocuments.net/reader034/viewer/2022051919/600c250129df3d6e5640bd5c/html5/thumbnails/2.jpg)
whoami?
![Page 3: causing its decline The rise and decline of an open ...halfaker/publications/The_Rise_and... · The rise and decline of an open collaboration system: How Wikipedia's reaction to popularity](https://reader034.vdocuments.net/reader034/viewer/2022051919/600c250129df3d6e5640bd5c/html5/thumbnails/3.jpg)
whoami?
● Staff Researcher ○ Working with Dario, Oliver & Fabrice on AFTv5
![Page 4: causing its decline The rise and decline of an open ...halfaker/publications/The_Rise_and... · The rise and decline of an open collaboration system: How Wikipedia's reaction to popularity](https://reader034.vdocuments.net/reader034/viewer/2022051919/600c250129df3d6e5640bd5c/html5/thumbnails/4.jpg)
whoami?
● Staff Researcher ○ Working with Dario, Oliver & Fabrice on AFTv5
● PhD Candidate @ UMN○ Live in the tundra* & telecommute
*Minnesota's mean temperature is similar to SF -- much larger standard deviation.
![Page 5: causing its decline The rise and decline of an open ...halfaker/publications/The_Rise_and... · The rise and decline of an open collaboration system: How Wikipedia's reaction to popularity](https://reader034.vdocuments.net/reader034/viewer/2022051919/600c250129df3d6e5640bd5c/html5/thumbnails/5.jpg)
whoami?
● Staff Researcher ○ Working with Dario, Oliver & Fabrice on AFTv5
● PhD Candidate @ UMN○ Live in the tundra* & telecommute
● WSOR intern lead last summer
*Minnesota's mean temperature is similar to SF -- much larger standard deviation.
![Page 6: causing its decline The rise and decline of an open ...halfaker/publications/The_Rise_and... · The rise and decline of an open collaboration system: How Wikipedia's reaction to popularity](https://reader034.vdocuments.net/reader034/viewer/2022051919/600c250129df3d6e5640bd5c/html5/thumbnails/6.jpg)
whoami?
● Staff Researcher ○ Working with Dario, Oliver & Fabrice on AFTv5
● PhD Candidate @ UMN○ Live in the tundra* & telecommute
● WSOR intern lead last summer● Wikipedian
○ Volunteer on Research:Committee○ User scripts○ Gnome
*Minnesota's mean temperature is similar to SF -- much larger standard deviation.
![Page 7: causing its decline The rise and decline of an open ...halfaker/publications/The_Rise_and... · The rise and decline of an open collaboration system: How Wikipedia's reaction to popularity](https://reader034.vdocuments.net/reader034/viewer/2022051919/600c250129df3d6e5640bd5c/html5/thumbnails/7.jpg)
Agenda
![Page 8: causing its decline The rise and decline of an open ...halfaker/publications/The_Rise_and... · The rise and decline of an open collaboration system: How Wikipedia's reaction to popularity](https://reader034.vdocuments.net/reader034/viewer/2022051919/600c250129df3d6e5640bd5c/html5/thumbnails/8.jpg)
Agenda
1. Introduction
![Page 9: causing its decline The rise and decline of an open ...halfaker/publications/The_Rise_and... · The rise and decline of an open collaboration system: How Wikipedia's reaction to popularity](https://reader034.vdocuments.net/reader034/viewer/2022051919/600c250129df3d6e5640bd5c/html5/thumbnails/9.jpg)
Agenda
1. Introduction2. Recent research (i.e. Rise & Decline)
![Page 10: causing its decline The rise and decline of an open ...halfaker/publications/The_Rise_and... · The rise and decline of an open collaboration system: How Wikipedia's reaction to popularity](https://reader034.vdocuments.net/reader034/viewer/2022051919/600c250129df3d6e5640bd5c/html5/thumbnails/10.jpg)
Agenda
1. Introduction2. Recent research (i.e. Rise & Decline)3. Ongoing/future work
![Page 11: causing its decline The rise and decline of an open ...halfaker/publications/The_Rise_and... · The rise and decline of an open collaboration system: How Wikipedia's reaction to popularity](https://reader034.vdocuments.net/reader034/viewer/2022051919/600c250129df3d6e5640bd5c/html5/thumbnails/11.jpg)
Agenda
1. Introduction2. Recent research (i.e. Rise & Decline)3. Ongoing/future work Stop me if you have a quick question.
![Page 12: causing its decline The rise and decline of an open ...halfaker/publications/The_Rise_and... · The rise and decline of an open collaboration system: How Wikipedia's reaction to popularity](https://reader034.vdocuments.net/reader034/viewer/2022051919/600c250129df3d6e5640bd5c/html5/thumbnails/12.jpg)
Agenda
1. Introduction2. Recent research (i.e. Rise & Decline)3. Ongoing/future work Stop me if you have a quick question. Please wait on discussion.
![Page 13: causing its decline The rise and decline of an open ...halfaker/publications/The_Rise_and... · The rise and decline of an open collaboration system: How Wikipedia's reaction to popularity](https://reader034.vdocuments.net/reader034/viewer/2022051919/600c250129df3d6e5640bd5c/html5/thumbnails/13.jpg)
![Page 14: causing its decline The rise and decline of an open ...halfaker/publications/The_Rise_and... · The rise and decline of an open collaboration system: How Wikipedia's reaction to popularity](https://reader034.vdocuments.net/reader034/viewer/2022051919/600c250129df3d6e5640bd5c/html5/thumbnails/14.jpg)
SCIENCE
SCIENCE
SCIENCESCIENCE
SCIENCE
SCIENCE SCIENCE
WSOR
![Page 15: causing its decline The rise and decline of an open ...halfaker/publications/The_Rise_and... · The rise and decline of an open collaboration system: How Wikipedia's reaction to popularity](https://reader034.vdocuments.net/reader034/viewer/2022051919/600c250129df3d6e5640bd5c/html5/thumbnails/15.jpg)
WSOR11: Templates --> newcomers
R. S. Geiger, A. Halfaker, M. Pinchuk & S. Walling, Defense Mechanism or Socialization Tactic, Accepted to ICWSM'12
![Page 16: causing its decline The rise and decline of an open ...halfaker/publications/The_Rise_and... · The rise and decline of an open collaboration system: How Wikipedia's reaction to popularity](https://reader034.vdocuments.net/reader034/viewer/2022051919/600c250129df3d6e5640bd5c/html5/thumbnails/16.jpg)
WSOR2011: Reverts predict survival
![Page 17: causing its decline The rise and decline of an open ...halfaker/publications/The_Rise_and... · The rise and decline of an open collaboration system: How Wikipedia's reaction to popularity](https://reader034.vdocuments.net/reader034/viewer/2022051919/600c250129df3d6e5640bd5c/html5/thumbnails/17.jpg)
WSOR11: Confound
● What if newcomers are getting worse?
![Page 18: causing its decline The rise and decline of an open ...halfaker/publications/The_Rise_and... · The rise and decline of an open collaboration system: How Wikipedia's reaction to popularity](https://reader034.vdocuments.net/reader034/viewer/2022051919/600c250129df3d6e5640bd5c/html5/thumbnails/18.jpg)
WSOR11: Confound
● What if newcomers are getting worse?○ Increased rejection○ Decreased retention == good!○ Warning templates == good!
![Page 19: causing its decline The rise and decline of an open ...halfaker/publications/The_Rise_and... · The rise and decline of an open collaboration system: How Wikipedia's reaction to popularity](https://reader034.vdocuments.net/reader034/viewer/2022051919/600c250129df3d6e5640bd5c/html5/thumbnails/19.jpg)
New results: The decline
● What: Rejection of good newcomers● How: Tools (huggle) that facilitate rejection● Why: Policy/Guidelines calcified against
newcomer input
![Page 20: causing its decline The rise and decline of an open ...halfaker/publications/The_Rise_and... · The rise and decline of an open collaboration system: How Wikipedia's reaction to popularity](https://reader034.vdocuments.net/reader034/viewer/2022051919/600c250129df3d6e5640bd5c/html5/thumbnails/20.jpg)
New results: Rejection & retention
2100 newcomersfrom
2001-2011
Edit session=
First editing experience
Thanks:● Oliver Keyes● Maryana Pinchuk● Steven Walling● Stuart Geiger
Quality:1. Vandals2. Bad-faith3. Good-faith4. Golden
![Page 21: causing its decline The rise and decline of an open ...halfaker/publications/The_Rise_and... · The rise and decline of an open collaboration system: How Wikipedia's reaction to popularity](https://reader034.vdocuments.net/reader034/viewer/2022051919/600c250129df3d6e5640bd5c/html5/thumbnails/21.jpg)
New results: Rejection & retention
Rising rate of rejection Decreasing retentionConsistent quality since 2006
![Page 22: causing its decline The rise and decline of an open ...halfaker/publications/The_Rise_and... · The rise and decline of an open collaboration system: How Wikipedia's reaction to popularity](https://reader034.vdocuments.net/reader034/viewer/2022051919/600c250129df3d6e5640bd5c/html5/thumbnails/22.jpg)
New results: Rejection & retention
Quality newcomers X Rejection = Decreased retention
![Page 23: causing its decline The rise and decline of an open ...halfaker/publications/The_Rise_and... · The rise and decline of an open collaboration system: How Wikipedia's reaction to popularity](https://reader034.vdocuments.net/reader034/viewer/2022051919/600c250129df3d6e5640bd5c/html5/thumbnails/23.jpg)
New results: Rejection & retention
Logistic regression model: What predicts survival?● Determines significance (i.e. non-random)● Compare the amount of effect● Controls for confounding factors
![Page 24: causing its decline The rise and decline of an open ...halfaker/publications/The_Rise_and... · The rise and decline of an open collaboration system: How Wikipedia's reaction to popularity](https://reader034.vdocuments.net/reader034/viewer/2022051919/600c250129df3d6e5640bd5c/html5/thumbnails/24.jpg)
New results: Rejection & retention
Logistic regression model: What predicts survival?● Determines significance (i.e. non-random)● Compare the amount of effect● Controls for confounding factors
Confounds: - editor quality - temporal effects - investment - rejection type (reverted, deleted) - sent a message (e.g. welcomed or warned)
![Page 25: causing its decline The rise and decline of an open ...halfaker/publications/The_Rise_and... · The rise and decline of an open collaboration system: How Wikipedia's reaction to popularity](https://reader034.vdocuments.net/reader034/viewer/2022051919/600c250129df3d6e5640bd5c/html5/thumbnails/25.jpg)
New results: Rejection & retention
Logistic regression model: What predicts survival?● Determines significance (i.e. non-random)● Compare the amount of effect● Controls for confounding factors
Confounds: - editor quality - temporal effects - investment - rejection type (reverted, deleted) - sent a message (e.g. welcomed) Rejection still a significant negative effect!
![Page 26: causing its decline The rise and decline of an open ...halfaker/publications/The_Rise_and... · The rise and decline of an open collaboration system: How Wikipedia's reaction to popularity](https://reader034.vdocuments.net/reader034/viewer/2022051919/600c250129df3d6e5640bd5c/html5/thumbnails/26.jpg)
New results: Wiki-Tools
● Hypothesis: Quality control tools like huggle are exacerbating the negative effect of rejection.
![Page 27: causing its decline The rise and decline of an open ...halfaker/publications/The_Rise_and... · The rise and decline of an open collaboration system: How Wikipedia's reaction to popularity](https://reader034.vdocuments.net/reader034/viewer/2022051919/600c250129df3d6e5640bd5c/html5/thumbnails/27.jpg)
New results: Wiki-ToolsModel: Significant, negative effect.● reverted (coef: -0.48, p=0.01)
● reverted-with-tool (coef: -2.51, p=0.02) ○ 5X MORE BAD*!
* Measured as a decrease in the log-odds of survival
![Page 28: causing its decline The rise and decline of an open ...halfaker/publications/The_Rise_and... · The rise and decline of an open collaboration system: How Wikipedia's reaction to popularity](https://reader034.vdocuments.net/reader034/viewer/2022051919/600c250129df3d6e5640bd5c/html5/thumbnails/28.jpg)
New results: Wiki-ToolsModel: Significant, negative effect.● reverted (coef: -0.48, p=0.01)
● reverted-with-tool (coef: -2.51, p=0.02) ○ 5.5X MORE BAD*!
* Measured as a decrease in the log-odds of survival
ON THE RISE!
![Page 29: causing its decline The rise and decline of an open ...halfaker/publications/The_Rise_and... · The rise and decline of an open collaboration system: How Wikipedia's reaction to popularity](https://reader034.vdocuments.net/reader034/viewer/2022051919/600c250129df3d6e5640bd5c/html5/thumbnails/29.jpg)
New results: Wiki-Tools
● Are reverting tools like huggle part of the problem?
Yes. Why?
![Page 30: causing its decline The rise and decline of an open ...halfaker/publications/The_Rise_and... · The rise and decline of an open collaboration system: How Wikipedia's reaction to popularity](https://reader034.vdocuments.net/reader034/viewer/2022051919/600c250129df3d6e5640bd5c/html5/thumbnails/30.jpg)
Bold -> Revert -> Discuss Cycle
Bold edit
reverted?
consensus?
Discuss
No
Yes
No Yes
![Page 31: causing its decline The rise and decline of an open ...halfaker/publications/The_Rise_and... · The rise and decline of an open collaboration system: How Wikipedia's reaction to popularity](https://reader034.vdocuments.net/reader034/viewer/2022051919/600c250129df3d6e5640bd5c/html5/thumbnails/31.jpg)
Bold -> Revert -> Discuss Cycle
Bold edit
reverted?
consensus?
Discuss
No
Yes
No Yes
1. Boldly make the edit you think is right.2. If you get reverted, talk about it on the
discussion page.3. Form consensus and move on.
![Page 32: causing its decline The rise and decline of an open ...halfaker/publications/The_Rise_and... · The rise and decline of an open collaboration system: How Wikipedia's reaction to popularity](https://reader034.vdocuments.net/reader034/viewer/2022051919/600c250129df3d6e5640bd5c/html5/thumbnails/32.jpg)
Bold -> Revert -> Discuss Cycle
Bold edit
reverted?
consensus?
Discuss
No
Yes
No Yes
1. Boldly make the edit you think is right.2. If you get reverted, talk about it on the
discussion page.3. Form consensus and move on.
● Initiation: Reverted editor posts on talk page
● Reciprocation: Reverting editor responds
![Page 33: causing its decline The rise and decline of an open ...halfaker/publications/The_Rise_and... · The rise and decline of an open collaboration system: How Wikipedia's reaction to popularity](https://reader034.vdocuments.net/reader034/viewer/2022051919/600c250129df3d6e5640bd5c/html5/thumbnails/33.jpg)
Bold -> Revert -> Discuss Cycle
Initiation
Reciprocation
![Page 34: causing its decline The rise and decline of an open ...halfaker/publications/The_Rise_and... · The rise and decline of an open collaboration system: How Wikipedia's reaction to popularity](https://reader034.vdocuments.net/reader034/viewer/2022051919/600c250129df3d6e5640bd5c/html5/thumbnails/34.jpg)
New results: Wiki-Tools
![Page 35: causing its decline The rise and decline of an open ...halfaker/publications/The_Rise_and... · The rise and decline of an open collaboration system: How Wikipedia's reaction to popularity](https://reader034.vdocuments.net/reader034/viewer/2022051919/600c250129df3d6e5640bd5c/html5/thumbnails/35.jpg)
New results: Wiki-Tools
humans
![Page 36: causing its decline The rise and decline of an open ...halfaker/publications/The_Rise_and... · The rise and decline of an open collaboration system: How Wikipedia's reaction to popularity](https://reader034.vdocuments.net/reader034/viewer/2022051919/600c250129df3d6e5640bd5c/html5/thumbnails/36.jpg)
New results: Wiki-Tools
humans
hugglers
![Page 37: causing its decline The rise and decline of an open ...halfaker/publications/The_Rise_and... · The rise and decline of an open collaboration system: How Wikipedia's reaction to popularity](https://reader034.vdocuments.net/reader034/viewer/2022051919/600c250129df3d6e5640bd5c/html5/thumbnails/37.jpg)
New results: Wiki-Tools
humans
hugglers
robots
![Page 38: causing its decline The rise and decline of an open ...halfaker/publications/The_Rise_and... · The rise and decline of an open collaboration system: How Wikipedia's reaction to popularity](https://reader034.vdocuments.net/reader034/viewer/2022051919/600c250129df3d6e5640bd5c/html5/thumbnails/38.jpg)
![Page 39: causing its decline The rise and decline of an open ...halfaker/publications/The_Rise_and... · The rise and decline of an open collaboration system: How Wikipedia's reaction to popularity](https://reader034.vdocuments.net/reader034/viewer/2022051919/600c250129df3d6e5640bd5c/html5/thumbnails/39.jpg)
Notice: Someone you reverted wants to ask you why! Click here to tell them they're wrong.
![Page 40: causing its decline The rise and decline of an open ...halfaker/publications/The_Rise_and... · The rise and decline of an open collaboration system: How Wikipedia's reaction to popularity](https://reader034.vdocuments.net/reader034/viewer/2022051919/600c250129df3d6e5640bd5c/html5/thumbnails/40.jpg)
Why are conditions getting so bad for newbies?
![Page 41: causing its decline The rise and decline of an open ...halfaker/publications/The_Rise_and... · The rise and decline of an open collaboration system: How Wikipedia's reaction to popularity](https://reader034.vdocuments.net/reader034/viewer/2022051919/600c250129df3d6e5640bd5c/html5/thumbnails/41.jpg)
Why are conditions getting so bad for newbies?
● Political economist Elinor Ostrom:
Rules must be...a. well-matched to local circumstances b. malleable by the governed individuals
![Page 42: causing its decline The rise and decline of an open ...halfaker/publications/The_Rise_and... · The rise and decline of an open collaboration system: How Wikipedia's reaction to popularity](https://reader034.vdocuments.net/reader034/viewer/2022051919/600c250129df3d6e5640bd5c/html5/thumbnails/42.jpg)
Why are conditions getting so bad for newbies?
● Political economist Elinor Ostrom:
Rules must be...a. well-matched to local circumstances b. malleable by the governed individuals
Policies & Guidelines ~ Rules of governance Is it getting harder for newbies to affect them? And what about essays? (less formal norms)
![Page 43: causing its decline The rise and decline of an open ...halfaker/publications/The_Rise_and... · The rise and decline of an open collaboration system: How Wikipedia's reaction to popularity](https://reader034.vdocuments.net/reader034/viewer/2022051919/600c250129df3d6e5640bd5c/html5/thumbnails/43.jpg)
![Page 44: causing its decline The rise and decline of an open ...halfaker/publications/The_Rise_and... · The rise and decline of an open collaboration system: How Wikipedia's reaction to popularity](https://reader034.vdocuments.net/reader034/viewer/2022051919/600c250129df3d6e5640bd5c/html5/thumbnails/44.jpg)
Model: Logistic regressionWhat predicts rejection? ● Contributions to essays reverted less overall● Contributing getting harder over time
○ Except for essays● Younger editors reverted more
○ Except for essays
All reported effects are statistically significant.
![Page 45: causing its decline The rise and decline of an open ...halfaker/publications/The_Rise_and... · The rise and decline of an open collaboration system: How Wikipedia's reaction to popularity](https://reader034.vdocuments.net/reader034/viewer/2022051919/600c250129df3d6e5640bd5c/html5/thumbnails/45.jpg)
Model: Logistic regressionWhat predicts rejection? ● Contributions to essays reverted less overall● Contributing getting harder over time
○ Except for essays● Younger editors reverted more
○ Except for essays
All reported effects are statistically significant.
![Page 46: causing its decline The rise and decline of an open ...halfaker/publications/The_Rise_and... · The rise and decline of an open collaboration system: How Wikipedia's reaction to popularity](https://reader034.vdocuments.net/reader034/viewer/2022051919/600c250129df3d6e5640bd5c/html5/thumbnails/46.jpg)
Summary!
![Page 47: causing its decline The rise and decline of an open ...halfaker/publications/The_Rise_and... · The rise and decline of an open collaboration system: How Wikipedia's reaction to popularity](https://reader034.vdocuments.net/reader034/viewer/2022051919/600c250129df3d6e5640bd5c/html5/thumbnails/47.jpg)
Summary!
● Reverts scare away newbies○ Good newbies are getting reverted more
![Page 48: causing its decline The rise and decline of an open ...halfaker/publications/The_Rise_and... · The rise and decline of an open collaboration system: How Wikipedia's reaction to popularity](https://reader034.vdocuments.net/reader034/viewer/2022051919/600c250129df3d6e5640bd5c/html5/thumbnails/48.jpg)
Summary!
● Reverts scare away newbies○ Good newbies are getting reverted more
● Huggle reverts are worse○ Tool users don't discuss their reverts
![Page 49: causing its decline The rise and decline of an open ...halfaker/publications/The_Rise_and... · The rise and decline of an open collaboration system: How Wikipedia's reaction to popularity](https://reader034.vdocuments.net/reader034/viewer/2022051919/600c250129df3d6e5640bd5c/html5/thumbnails/49.jpg)
Summary!
● Reverts scare away newbies○ Good newbies are getting reverted more
● Huggle reverts are worse○ Tool users don't discuss their reverts
● Newbies can't affect the rules that govern them○ They seem to have turned to essays, but essays
don't carry the same weight.
![Page 50: causing its decline The rise and decline of an open ...halfaker/publications/The_Rise_and... · The rise and decline of an open collaboration system: How Wikipedia's reaction to popularity](https://reader034.vdocuments.net/reader034/viewer/2022051919/600c250129df3d6e5640bd5c/html5/thumbnails/50.jpg)
So what?
● Can't stop reverting bad edits - Quality
![Page 51: causing its decline The rise and decline of an open ...halfaker/publications/The_Rise_and... · The rise and decline of an open collaboration system: How Wikipedia's reaction to popularity](https://reader034.vdocuments.net/reader034/viewer/2022051919/600c250129df3d6e5640bd5c/html5/thumbnails/51.jpg)
So what?
● Can't stop reverting bad edits - Quality● Can't stop using tools - Efficiency
![Page 52: causing its decline The rise and decline of an open ...halfaker/publications/The_Rise_and... · The rise and decline of an open collaboration system: How Wikipedia's reaction to popularity](https://reader034.vdocuments.net/reader034/viewer/2022051919/600c250129df3d6e5640bd5c/html5/thumbnails/52.jpg)
So what?
● Can't stop reverting bad edits - Quality● Can't stop using tools - Efficiency● Can't open up policy - Consistency
![Page 53: causing its decline The rise and decline of an open ...halfaker/publications/The_Rise_and... · The rise and decline of an open collaboration system: How Wikipedia's reaction to popularity](https://reader034.vdocuments.net/reader034/viewer/2022051919/600c250129df3d6e5640bd5c/html5/thumbnails/53.jpg)
So what?
● Can't stop reverting bad edits - Quality● Can't stop using tools - Efficiency● Can't open up policy - Consistency ● HuggleSnuggle
○ If we know how to find bad new users, we know how to find the good ones too.
![Page 54: causing its decline The rise and decline of an open ...halfaker/publications/The_Rise_and... · The rise and decline of an open collaboration system: How Wikipedia's reaction to popularity](https://reader034.vdocuments.net/reader034/viewer/2022051919/600c250129df3d6e5640bd5c/html5/thumbnails/54.jpg)
Newbies
Huggle&
Snuggle
![Page 55: causing its decline The rise and decline of an open ...halfaker/publications/The_Rise_and... · The rise and decline of an open collaboration system: How Wikipedia's reaction to popularity](https://reader034.vdocuments.net/reader034/viewer/2022051919/600c250129df3d6e5640bd5c/html5/thumbnails/55.jpg)
What's next?
● Experimental interfaces○ Wikignome [http://en.wikipedia.org/wiki/User:EpochFail/Wikignome/Sandbox]○ Mr. Clean [http://en.wikipedia.org/wiki/User:EpochFail/MrClean/Sandbox]
● Blurring the divide between reader and editor○ Readers have value (AFTv5)
■ Informs value of visual editor○ Building tools for readers:
■ History - Reading list - Watchlist● Community health
○ Predict future declines○ Survival models - Needs a visualization
![Page 56: causing its decline The rise and decline of an open ...halfaker/publications/The_Rise_and... · The rise and decline of an open collaboration system: How Wikipedia's reaction to popularity](https://reader034.vdocuments.net/reader034/viewer/2022051919/600c250129df3d6e5640bd5c/html5/thumbnails/56.jpg)
Thanks!
SCIENCE
SCIENCE
SCIENCESCIENCE
SCIENCE
SCIENCE SCIENCE
Aaron Halfaker
User:EpochFail