how user research helped wikipedia double its online fundraising (techweek 2012)

37
How user research helped Wikipedia double its online fundraising Billy Belchev Webitects.com Peter Gehres Wikimedia Foundation TechWeek 2012 June 23

Upload: billy-belchev

Post on 01-Nov-2014

1.221 views

Category:

Design


2 download

DESCRIPTION

Billy Belchev from Webitects and Peter Gehres from the Wikimedia Foundation present on results from the conversion optimization during 2010 and 2011 fundraising, including user research, live testing, banners and UX iterative design.

TRANSCRIPT

Page 1: How user research helped Wikipedia double its online fundraising (TechWeek 2012)

How user research helped Wikipedia double its online fundraising

Billy Belchev Webitects.com

Peter Gehres Wikimedia Foundation

TechWeek 2012 June 23

Page 2: How user research helped Wikipedia double its online fundraising (TechWeek 2012)

Source: http://wikimediafoundation.org/wiki/Special:FundraiserStatistics

Fundraiser statistics 2009-2011 (Daily amounts raised, Nov-Jan)

2009: $8,592,136 2010: $14,584,517 2011: $22,308,784

Up 70% Up 53%

Page 3: How user research helped Wikipedia double its online fundraising (TechWeek 2012)

Source: http://wikimediafoundation.org/wiki/Special:FundraiserStatistics

Fundraiser statistics 2009-2011 (YTD daily amounts, Nov-Jan)

2009: $34.32 Average donation 2010: $27.85 2011: $27.47

Page 4: How user research helped Wikipedia double its online fundraising (TechWeek 2012)
Page 5: How user research helped Wikipedia double its online fundraising (TechWeek 2012)
Page 6: How user research helped Wikipedia double its online fundraising (TechWeek 2012)
Page 7: How user research helped Wikipedia double its online fundraising (TechWeek 2012)

People tell you what they think you’d like to hear or what they wish were true.

You focus on what people actually do.

Page 8: How user research helped Wikipedia double its online fundraising (TechWeek 2012)
Page 9: How user research helped Wikipedia double its online fundraising (TechWeek 2012)

Streamline the donation flow with the goal of increasing the conversion rate.

Lightweight usability testing and interviews.

Iterating through form designs.

Live testing of different form versions for 1 hour on EN.Wikipedia.com

Wikipedia

Page 10: How user research helped Wikipedia double its online fundraising (TechWeek 2012)
Page 11: How user research helped Wikipedia double its online fundraising (TechWeek 2012)

Wikipedia—donation process optimization

Page 12: How user research helped Wikipedia double its online fundraising (TechWeek 2012)

Wikipedia—donation process optimization

Thank you

PayPal Credit card

Landing Banner

One-step

Workflow may vary for other payment methods (bank transfer, direct debit)

Page 13: How user research helped Wikipedia double its online fundraising (TechWeek 2012)
Page 14: How user research helped Wikipedia double its online fundraising (TechWeek 2012)

Deciding which fields to keep on the form

Every removed field increased the conversion rate.

If some fields are really needed, they can be on a second page.

*Depending on the test parameters. Data at: http://meta.wikimedia.org/wiki/Fundraising_2010/Banner_testing

Page 15: How user research helped Wikipedia double its online fundraising (TechWeek 2012)

Between 40-50% of Wikipedia donations come via PayPal.

Page 16: How user research helped Wikipedia double its online fundraising (TechWeek 2012)
Page 17: How user research helped Wikipedia double its online fundraising (TechWeek 2012)
Page 18: How user research helped Wikipedia double its online fundraising (TechWeek 2012)
Page 19: How user research helped Wikipedia double its online fundraising (TechWeek 2012)

Giving the two buttons equal prominence and visual treatment produced the best overall conversion.

Results

Any other combination hurt the overall conversions.

Page 20: How user research helped Wikipedia double its online fundraising (TechWeek 2012)
Page 21: How user research helped Wikipedia double its online fundraising (TechWeek 2012)

Usability test comments

I didn’t know they are a non-profit. I am not sure where my money goes. What will it be used for?

I appreciate having this long letter from Jimmy... But I am not going to read it. I’m skimming.

Page 22: How user research helped Wikipedia double its online fundraising (TechWeek 2012)

Where your donation goes

I'm a volunteer.

I don't get paid a cent for my work at Wikipedia, and neither do our thousands of other volunteer authors and editors. When I founded Wikipedia, I could have made it into a for-profit company with advertising banners, but I decided to do something different.

Commerce is fine. Advertising is not evil. But it doesn't belong here. Not in Wikipedia.

Wikipedia is something special. It is like a library or a public park. It is like a temple for the mind. It is a place we can all go to think, to learn, to share our knowledge with others. It is a unique human project, the first of its kind in history. It is a humanitarian project to bring a free encyclopedia to every single person on the planet. Every single person.

If all of Wikipedia's 400 million users would donate $1 each, we would have 20 times the amount of money we need. We're a small organization, and I've worked hard over the years to keep us lean and tight. We fulfill our mission, and leave waste to others.

To do this without resorting to advertising, we need you. It is you who keep this dream alive. It is you who have created Wikipedia. It is you who believe that a place of calm reflection and learning is worth having.

This year, please consider making a donation of $20, $35, $50 or whatever you can to protect and sustain Wikipedia.

Thanks,

Jimmy Wales Wikipedia Founder

From Wikipedia founder Jimmy Wales

Donate by Credit Card

Donate via PayPal

$ $ $ $

$ $ $ $

Make your donation now

Where your donation goes:

• People

• …

• Technology

• …

Page 23: How user research helped Wikipedia double its online fundraising (TechWeek 2012)

Where your donation goes

Page 24: How user research helped Wikipedia double its online fundraising (TechWeek 2012)

Where your donation goes

Page 25: How user research helped Wikipedia double its online fundraising (TechWeek 2012)

Where your donation goes

Best!

Page 26: How user research helped Wikipedia double its online fundraising (TechWeek 2012)
Page 27: How user research helped Wikipedia double its online fundraising (TechWeek 2012)

Wikipedia—donation process optimization

Page 28: How user research helped Wikipedia double its online fundraising (TechWeek 2012)

Wikipedia—donation process optimization

Better!

Page 29: How user research helped Wikipedia double its online fundraising (TechWeek 2012)

Donation process and latency

Page 30: How user research helped Wikipedia double its online fundraising (TechWeek 2012)

The 1-step form had promising indicators, but wasn’t able to surpass the 2-step in live testing. We strongly suspect it had to do with the high latency of the platform behind the 1-step.

Donation process and latency

Page 31: How user research helped Wikipedia double its online fundraising (TechWeek 2012)
Page 32: How user research helped Wikipedia double its online fundraising (TechWeek 2012)

Including images of the authors of the appeals always helped. Tremendously.

Banners

Page 33: How user research helped Wikipedia double its online fundraising (TechWeek 2012)

The most effective banners may not have the best overall effect.

We got some very high click-through rates with very poor conversion rates.

It’s a balance game.

Banners

Page 34: How user research helped Wikipedia double its online fundraising (TechWeek 2012)

Some movement, such as a thermometer or bar, yielded higher click rates on banners.

But performance depended on how full the bar was. Donation motivation increased only when the bar was closer to full.

Banners

Page 35: How user research helped Wikipedia double its online fundraising (TechWeek 2012)

It’s not just about the money...

Community matters most.

Banners

Page 36: How user research helped Wikipedia double its online fundraising (TechWeek 2012)
Page 37: How user research helped Wikipedia double its online fundraising (TechWeek 2012)

Billy Belchev [email protected] @bbelchev

Peter Gehres [email protected] @in2thats12