moving the crowd: incentives for ureport uganda. “i beseech you, in the bowels of christ, think it...

25
Moving the Crowd: Incentives for Ureport Uganda

Upload: river-hamlin

Post on 15-Dec-2015

217 views

Category:

Documents


2 download

TRANSCRIPT

Page 1: Moving the Crowd: Incentives for Ureport Uganda. “I beseech you, in the bowels of Christ, think it possible that you might be Mistaken.” ~Oliver Cromwell

Moving the Crowd:Incentives for Ureport Uganda

Moving the Crowd:Incentives for Ureport Uganda

Page 2: Moving the Crowd: Incentives for Ureport Uganda. “I beseech you, in the bowels of Christ, think it possible that you might be Mistaken.” ~Oliver Cromwell

“I beseech you, in the bowels of Christ, think it possible that you

might be Mistaken.”~Oliver Cromwell

“I beseech you, in the bowels of Christ, think it possible that you

might be Mistaken.”~Oliver Cromwell

Page 3: Moving the Crowd: Incentives for Ureport Uganda. “I beseech you, in the bowels of Christ, think it possible that you might be Mistaken.” ~Oliver Cromwell

Ushahidi’s Crisis Crowdsourcing

Ushahidi’s Crisis Crowdsourcing

SMS for rapid disaster response:

Kenyan election violence

Haiti earthquake

Gulf Oil Spill

Next step for SMS-based crowdsourcing:

Normal, non-crisis settings

©Ushahidi

Ory Okolloh

Page 4: Moving the Crowd: Incentives for Ureport Uganda. “I beseech you, in the bowels of Christ, think it possible that you might be Mistaken.” ~Oliver Cromwell

Outcomes of InterestOutcomes of InterestUreport: SMS-text system to aggregate citizen feedback

Currently: 33,000 Ureporters

Weekly polls: e.g., child labor

Three questions:

1. Best method to recruit?

2. How to motivate reports?

3. Ureport’s effects on substantive development outcomes?

Page 5: Moving the Crowd: Incentives for Ureport Uganda. “I beseech you, in the bowels of Christ, think it possible that you might be Mistaken.” ~Oliver Cromwell

Randomized Controlled Trial (RCT)

Randomized Controlled Trial (RCT)

Intervention or treatment.

Randomly assigned to a relatively large group of subjects.

In expectation, randomization balances observable and unobservable confounding factors. Duflo & Hannah (2003) RCT

used photos to reduce teacher absenteeism

Page 6: Moving the Crowd: Incentives for Ureport Uganda. “I beseech you, in the bowels of Christ, think it possible that you might be Mistaken.” ~Oliver Cromwell

What motivates the crowd?

What motivates the crowd?

Intrinsic: The action is its own reward

Extrinsic: Additional material rewards

Possibilities:

Intrinsic and extrinsic motives may have an additive effect.

Or, extrinsic rewards may crowd out intrinsic motives.

Page 7: Moving the Crowd: Incentives for Ureport Uganda. “I beseech you, in the bowels of Christ, think it possible that you might be Mistaken.” ~Oliver Cromwell

Selected districts receive no intervention (but do receive polls & automated responses as usual)

Justification: Provides comparison or baseline observations for all treatments

ControlGroupControlGroup

Page 8: Moving the Crowd: Incentives for Ureport Uganda. “I beseech you, in the bowels of Christ, think it possible that you might be Mistaken.” ~Oliver Cromwell

Treatments to Recruit Ureporters

Treatments to Recruit Ureporters

Page 9: Moving the Crowd: Incentives for Ureport Uganda. “I beseech you, in the bowels of Christ, think it possible that you might be Mistaken.” ~Oliver Cromwell

RadioAds

RadioAds

Treatment: 5 ads per day over 5 days

Justification: Intrinsic motivations to perform a pro-social activity.

Page 10: Moving the Crowd: Incentives for Ureport Uganda. “I beseech you, in the bowels of Christ, think it possible that you might be Mistaken.” ~Oliver Cromwell

Radio LotteryRadio Lottery

Treatment: Radio ads (5x 5 days) + promise of entry into lottery to win solar charger

Justification: Adds extrinsic incentive to intrinsic motive

Page 11: Moving the Crowd: Incentives for Ureport Uganda. “I beseech you, in the bowels of Christ, think it possible that you might be Mistaken.” ~Oliver Cromwell

Treatments to Motivate Reports

Treatments to Motivate Reports

Page 12: Moving the Crowd: Incentives for Ureport Uganda. “I beseech you, in the bowels of Christ, think it possible that you might be Mistaken.” ~Oliver Cromwell

Human FeedbackHuman

FeedbackTreatment: Researchers respond to each Ureport:

Thanks

Follow up

Nudge back to topic

Justification: Connection with actual human being enhances intrinsic motive.

Page 13: Moving the Crowd: Incentives for Ureport Uganda. “I beseech you, in the bowels of Christ, think it possible that you might be Mistaken.” ~Oliver Cromwell

Response Lottery

Response LotteryTreatment: Ureporters who answer every poll are entered in lottery to win solar charger (1 winner per district)

Justification: Addition of extrinsic incentive

Page 14: Moving the Crowd: Incentives for Ureport Uganda. “I beseech you, in the bowels of Christ, think it possible that you might be Mistaken.” ~Oliver Cromwell

“Twitter™” Networks“Twitter™” Networks

Treatment: Through moderated groups, Ureporters communicate on specific topics of interest

Justification: Peer-to-peer interaction to heighten intrinsic incentives

Page 15: Moving the Crowd: Incentives for Ureport Uganda. “I beseech you, in the bowels of Christ, think it possible that you might be Mistaken.” ~Oliver Cromwell
Page 16: Moving the Crowd: Incentives for Ureport Uganda. “I beseech you, in the bowels of Christ, think it possible that you might be Mistaken.” ~Oliver Cromwell

ResultsResults

Page 17: Moving the Crowd: Incentives for Ureport Uganda. “I beseech you, in the bowels of Christ, think it possible that you might be Mistaken.” ~Oliver Cromwell

Preliminary Results on Recruitment

Preliminary Results on Recruitment

Radio

Radio Lottery

National Radio

Page 18: Moving the Crowd: Incentives for Ureport Uganda. “I beseech you, in the bowels of Christ, think it possible that you might be Mistaken.” ~Oliver Cromwell

Preliminary Results for at least One ResponsePreliminary Results for

at least One Response

Condition

ResponsePercent

Control 44%

Radio 63%

Radio Lottery 73%

Human Feedback 58%

Response Lottery 75%

"Twitter" 53%

Total Subjects 9,440

Control

Radio

Radio Lottery

Human FeedbackResponse Lottery“Twitter”

Page 19: Moving the Crowd: Incentives for Ureport Uganda. “I beseech you, in the bowels of Christ, think it possible that you might be Mistaken.” ~Oliver Cromwell

Preliminary Results for Total Number of Responses

Preliminary Results for Total Number of Responses

Condition Avg.Control 2.9Radio 3.6Radio Lottery 5.4Human Feedback

4.9

Response Lottery

6.4

"Twitter" 4.5Total Messages

30,058

Control

Radio

Radio Lottery

Human FeedbackResponse Lottery“Twitter”

Page 20: Moving the Crowd: Incentives for Ureport Uganda. “I beseech you, in the bowels of Christ, think it possible that you might be Mistaken.” ~Oliver Cromwell

Error Corrections?Error Corrections?The crowd is pretty motivated already

Intrinsic + extrinsic incentives appear additive

A lot left to learn about and from crowdsourcing

Next step for Ureport: Stock-outs of ACTs

Next step for us: Keep thinking we might be mistaken Kenya’s iHub

Page 21: Moving the Crowd: Incentives for Ureport Uganda. “I beseech you, in the bowels of Christ, think it possible that you might be Mistaken.” ~Oliver Cromwell

AidData Enhanced Project View

AidData Enhanced Project View

Page 22: Moving the Crowd: Incentives for Ureport Uganda. “I beseech you, in the bowels of Christ, think it possible that you might be Mistaken.” ~Oliver Cromwell

Enhanced Project View and Crowd-

sourcing

Enhanced Project View and Crowd-

sourcingINSERT IMAGES OF ENHANCED PROJECT VIEW

MOCK-UPS HERE

Page 23: Moving the Crowd: Incentives for Ureport Uganda. “I beseech you, in the bowels of Christ, think it possible that you might be Mistaken.” ~Oliver Cromwell

Enhanced Project View and Crowd-

sourcing

Enhanced Project View and Crowd-

sourcingINSERT IMAGES OF ENHANCED PROJECT VIEW

MOCK-UPS HERE

Page 24: Moving the Crowd: Incentives for Ureport Uganda. “I beseech you, in the bowels of Christ, think it possible that you might be Mistaken.” ~Oliver Cromwell

Enhanced Project View and Crowd-

sourcing

Enhanced Project View and Crowd-

sourcingINSERT IMAGES OF ENHANCED PROJECT VIEW

MOCK-UPS HERE

Page 25: Moving the Crowd: Incentives for Ureport Uganda. “I beseech you, in the bowels of Christ, think it possible that you might be Mistaken.” ~Oliver Cromwell

Enhanced Project View and Crowd-

sourcing

Enhanced Project View and Crowd-

sourcingINSERT IMAGES OF ENHANCED PROJECT VIEW

MOCK-UPS HERE