michael s. bernstein, mark s. ackerman, ed h. chi, robert c. miller
DESCRIPTION
Michael S. Bernstein, Mark S. Ackerman, Ed H. Chi, Robert C. Miller. Ratio of “Understanding Users” papers to “Systems, Tools, Architectures and Infrastructure” papers submitted to the Interaction Beyond the Individual track at CHI 2011. 4:1. Trouble: Exponential Growth. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Michael S. Bernstein, Mark S. Ackerman, Ed H. Chi, Robert C. Miller](https://reader036.vdocuments.net/reader036/viewer/2022062305/568162a2550346895dd31bce/html5/thumbnails/1.jpg)
Michael S. Bernstein, Mark S. Ackerman, Ed H. Chi, Robert C. Miller
![Page 2: Michael S. Bernstein, Mark S. Ackerman, Ed H. Chi, Robert C. Miller](https://reader036.vdocuments.net/reader036/viewer/2022062305/568162a2550346895dd31bce/html5/thumbnails/2.jpg)
4:1
Ratio of “Understanding Users” papersto “Systems, Tools, Architectures and Infrastructure” papers submitted to the Interaction Beyond the Individual track at CHI 2011.
![Page 3: Michael S. Bernstein, Mark S. Ackerman, Ed H. Chi, Robert C. Miller](https://reader036.vdocuments.net/reader036/viewer/2022062305/568162a2550346895dd31bce/html5/thumbnails/3.jpg)
Trouble: Exponential GrowthYour usage data is not really compelling because only a small fraction of Facebook is using the application. Worse, your numbers aren’t growing in anything like an exponential fashion.
– CHI metareviewer, paraphrased
![Page 4: Michael S. Bernstein, Mark S. Ackerman, Ed H. Chi, Robert C. Miller](https://reader036.vdocuments.net/reader036/viewer/2022062305/568162a2550346895dd31bce/html5/thumbnails/4.jpg)
Suggestion: Exponential GrowthSeparate evaluation of spread from steady-state.
Which claim is the paper making?
![Page 5: Michael S. Bernstein, Mark S. Ackerman, Ed H. Chi, Robert C. Miller](https://reader036.vdocuments.net/reader036/viewer/2022062305/568162a2550346895dd31bce/html5/thumbnails/5.jpg)
Trouble: Snowball SamplingThe authors’ choice of study method – snowball sampling their system by advertising within their own social network – potentially leads to serious problems with validity.– CHI metareviewer, paraphrased
![Page 6: Michael S. Bernstein, Mark S. Ackerman, Ed H. Chi, Robert C. Miller](https://reader036.vdocuments.net/reader036/viewer/2022062305/568162a2550346895dd31bce/html5/thumbnails/6.jpg)
Suggestion: Snowball SamplingSnowballing is inevitable in social systems. It is fundamental to how they operate.
![Page 7: Michael S. Bernstein, Mark S. Ackerman, Ed H. Chi, Robert C. Miller](https://reader036.vdocuments.net/reader036/viewer/2022062305/568162a2550346895dd31bce/html5/thumbnails/7.jpg)
![Page 8: Michael S. Bernstein, Mark S. Ackerman, Ed H. Chi, Robert C. Miller](https://reader036.vdocuments.net/reader036/viewer/2022062305/568162a2550346895dd31bce/html5/thumbnails/8.jpg)
NoveltyBetween a Rock and a Hard Science
![Page 9: Michael S. Bernstein, Mark S. Ackerman, Ed H. Chi, Robert C. Miller](https://reader036.vdocuments.net/reader036/viewer/2022062305/568162a2550346895dd31bce/html5/thumbnails/9.jpg)
sociotechnical
![Page 10: Michael S. Bernstein, Mark S. Ackerman, Ed H. Chi, Robert C. Miller](https://reader036.vdocuments.net/reader036/viewer/2022062305/568162a2550346895dd31bce/html5/thumbnails/10.jpg)
sociotechnicalstudiersbuilders
![Page 11: Michael S. Bernstein, Mark S. Ackerman, Ed H. Chi, Robert C. Miller](https://reader036.vdocuments.net/reader036/viewer/2022062305/568162a2550346895dd31bce/html5/thumbnails/11.jpg)
sociotechnicalstudiersbuildersFatal Flaw Fallacy [Olsen]Ecological validity at the cost of internal validity
[Ackerman 2000], [Barkhuus and Rode 2007], [Chi 2009], [Greenberg and Buxton 2008], [Kaye and Sengers 2007], [Landay 2009], [Lieberman 2003], [Olsen 2007], [Zhai 2003]
![Page 12: Michael S. Bernstein, Mark S. Ackerman, Ed H. Chi, Robert C. Miller](https://reader036.vdocuments.net/reader036/viewer/2022062305/568162a2550346895dd31bce/html5/thumbnails/12.jpg)
sociotechnicalstudiersbuilders
Show us elegant complexity.(simple ideas that enable complex scenarios)
That’s it? What is possible now that wasn’t before?Nothing — but focus on emergent social activity.
Can you add multitouch?Not using IE8.
We let people type messages up to 140 characters.
![Page 13: Michael S. Bernstein, Mark S. Ackerman, Ed H. Chi, Robert C. Miller](https://reader036.vdocuments.net/reader036/viewer/2022062305/568162a2550346895dd31bce/html5/thumbnails/13.jpg)
socio technicalstudiers builders
Build a technically interesting system (that is hard to spread or evaluate), or
Simplify to a system with socially interesting outcomes (that builders find less novel).
![Page 14: Michael S. Bernstein, Mark S. Ackerman, Ed H. Chi, Robert C. Miller](https://reader036.vdocuments.net/reader036/viewer/2022062305/568162a2550346895dd31bce/html5/thumbnails/14.jpg)
Build a technically interesting system (that is hard to spread or evaluate), or
Simplify to a system with socially interesting outcomes (that builders find less novel).
The contribution needs to take one strong stance or another. Either it describes a novel system or a novel social interaction. If it’s a system, then I question the novelty. If it’s a social interaction, it needs more development.
– CHI metareviewer, paraphrased
![Page 15: Michael S. Bernstein, Mark S. Ackerman, Ed H. Chi, Robert C. Miller](https://reader036.vdocuments.net/reader036/viewer/2022062305/568162a2550346895dd31bce/html5/thumbnails/15.jpg)
Create a shared understandingof research contributions
![Page 16: Michael S. Bernstein, Mark S. Ackerman, Ed H. Chi, Robert C. Miller](https://reader036.vdocuments.net/reader036/viewer/2022062305/568162a2550346895dd31bce/html5/thumbnails/16.jpg)
social technicalNew forms of social interaction
Shared organizational memory [Ackerman 1994]Designs that impact social interactions
Increasing online contribution [Beenen et al. 2004]
Enable fluent social interaction in a new domainSocially translucent systems [Erickson and Kellogg 2000]
![Page 17: Michael S. Bernstein, Mark S. Ackerman, Ed H. Chi, Robert C. Miller](https://reader036.vdocuments.net/reader036/viewer/2022062305/568162a2550346895dd31bce/html5/thumbnails/17.jpg)
social technicalDesigns collecting or powered by social
dataWikidashboard [Suh et al. 2008]; sense.us [Heer et al. 2007]Algorithms to coordinate crowds or derive signal from social data
Collaborative Filtering [Resnick et al. 1994]; Iterate-and-Vote [Little et al. 2010]
Platforms and infrastructuresTurKit [Little et al. 2010]
![Page 18: Michael S. Bernstein, Mark S. Ackerman, Ed H. Chi, Robert C. Miller](https://reader036.vdocuments.net/reader036/viewer/2022062305/568162a2550346895dd31bce/html5/thumbnails/18.jpg)
social technicalPaired contributions can increase each
others’ value
×ManyEyes
[Viégas et al. 2007]
![Page 19: Michael S. Bernstein, Mark S. Ackerman, Ed H. Chi, Robert C. Miller](https://reader036.vdocuments.net/reader036/viewer/2022062305/568162a2550346895dd31bce/html5/thumbnails/19.jpg)
In conclusion introduction:What are our millennium challenges? What is our relationship with industry
and walled gardens?How can (and should) we evolve
our standards of proof?
![Page 20: Michael S. Bernstein, Mark S. Ackerman, Ed H. Chi, Robert C. Miller](https://reader036.vdocuments.net/reader036/viewer/2022062305/568162a2550346895dd31bce/html5/thumbnails/20.jpg)
Michael S. Bernstein, Mark S. Ackerman, Ed H. Chi, Robert C. Miller
![Page 21: Michael S. Bernstein, Mark S. Ackerman, Ed H. Chi, Robert C. Miller](https://reader036.vdocuments.net/reader036/viewer/2022062305/568162a2550346895dd31bce/html5/thumbnails/21.jpg)