Crowdsourcing Fact-Checking

https://veri.ly/about

Is this Rome?

Crowdsourced Information Gathering

Red Balloon Challenge Tag Challenge

Successful Evidence Gathering?

Disinformation Age

http://www.nytimes.com/2015/06/07/magazine/the-agency.html

Successful Fact-Checking:Crowdsourcing Critical Thinking

evidence not opinions avoid tools like “like” and upvotes for

answering questions

do not create bias by displaying popular content at the top

Pilot Experiment July 2014

9

Deployment in Nepal

Crowdsourcing Questions

Why Crowdsourcing

• People are everywhere.• Don’t need that many people to reach the

person who knows the answer:– Tag Challenge (500 unique visitors)– Verily Pilot (2,000 unique visitors)

crowdsourcing

machinelearning

compute reputationdisplay relevant tweets/articles/images

relevant verification requests to users

submit evidenceevaluate evidenceask friends to find the answer

Next: political fact-checking

• Real-time fact-checking at veri.ly• Email contact@very.ly to suggest an event to

fact check.

https://veri.ly/crisis/1/question/15-is-this-in-rome