Impact of translations on access to Cochrane reviews

Juliane Ried1, Gavin Stewart2, David Hives2, Martin Janczyk3, Lorne Becker4

1Cochrane Innovations, Germany; 2The Cochrane Library, Wiley, UK; 3Cochrane Web Team, Germany; 4Cochrane

Innovations, USA

Disclosure

Financial interest, arrangement, or affiliation that could be perceived as a direct/indirect conflict of interest in the context/content of the subject of this presentation:

• MJ and JR are employees of The Cochrane Collaboration

• DH and GS are employees of Wiley

Translation projects & numbers

English5400

Spanish5400 French

3800

Japanese1400

Traditional Chinese

3800

Indonesian90

Croatian 90

Portuguese 40

Simplified Chinese

100

Translation projects & numbers

SPANISH5400 FRENCH

3800

Croatian 90

Portuguese 40

ENGLISH5400

Here’s what it looks like

summaries.cochrane.org

How do we measure impact?

1. USAGE –Do people access the translations?

2. AUDIENCE –Are we reaching the intended audience?

3. BUTTERFLY EFFECT –Do translations impact on the uptake of the full English Cochrane reviews?

Also interesting

4. GATEWAYS –How do people find our translations?

5. TOP OF THE POPS –Are some languages more popular than others? Why?

Promotion

• Monthly CEU bulletins

• CCInfo & Cochrane mailing lists Mid-July, taken up by social media

Limited internal audience

There’s room to grow

Languages & translation projects

ESPAÑOL: 3rd in the world

FRANÇAIS: 11th

PORTUGUÊS: 8th

HRVATSKI: ?

http://en.wikipedia.org/wiki/List_of_languages_by_total_number_of_speakers

0

10000

20000

30000

40000

50000

60000

70000

80000

90000

Mar

-12

Ap

r-1

2

May

-12

Jun

-12

Jul-

12

Au

g-1

2

Sep

-12

Oct

-12

No

v-1

2

Dec

-12

Jan

-13

Feb

-13

Mar

-13

Ap

r-1

3

May

-13

Jun

-13

Jul-

13

Au

g-1

3

Monthly page views by language

FR

ES

PT

HR

1. USAGE

FR & ES:

Tens of thousands of page views, increasing with # of (new) translations

Make up 10-15% of all Summaries page views each

0

500

1000

1500

2000

2500

3000

3500

Apr-13 May-13 Jun-13 Jul-13 Aug-13

Monthly page views by language

HR

PT

1. USAGE

PT & HR:

Less substantial increase

0

10000

20000

30000

40000

50000

60000

Mar

-12

Ap

r-1

2

May

-12

Jun

-12

Jul-

12

Au

g-1

2

Sep

-12

Oct

-12

No

v-1

2

Dec

-12

Jan

-13

Feb

-13

Mar

-13

Ap

r-1

3

May

-13

Jun

-13

Jul-

13

Au

g-1

3

Monthly visits by browser languages

FR

ES

HR

PT

2. AUDIENCE (I)

FR & ES:

Tens of thousands of visits, increase with # of (new) translations

Make up 15-20% of all Summaries visits each

0

500

1000

1500

2000

2500

3000

3500

4000

Mar-12 Apr-12 May-12 Jun-12 Jul-12

Monthly visits by browser languages

HR

PT

2. AUDIENCE (I)

PT & HR:

Less substantial increase

0

10000

20000

30000

40000

50000

60000

Mar

-12

Ap

r-1

2

May

-12

Jun

-12

Jul-

12

Au

g-1

2

Sep

-12

Oct

-12

No

v-1

2

Dec

-12

Jan

-13

Feb

-13

Mar

-13

Ap

r-1

3

May

-13

Jun

-13

Jul-

13

Au

g-1

3

Monthly visits by countries

FR

ES

PT

HR

2. AUDIENCE (II)

FR & ES:

Tens of thousands of visits

Make up 20-25% of all Summaries visits each

France now ranking 2nd in the country statistics

PT & HR:

Less significant increase

3. BUTTERFLY EFFECT

3. BUTTERFLY EFFECT

0

200

400

600

800

1000

1200

1400

1600

1800

Clicks through to English

FR

ES

PT

HR

FR & ES & HR: about every 50th visitor

PT: every 300th visitor

English: roughly every 20th visitor

4. GATEWAYS

FR & ES PT HR EN

1. Google –80-82%

2. (direct) –10-13%

3. cochrane.org – 1-2%

4. Bing/Ask – 1%

1. cochrane.org – 25%

2. Facebook –30%

3. (direct) – 20%4. Google – 18%

1. Google – 40%2. cochrane.org

– 33%3. (direct) – 11%4. plivamed.net

– 4%

1. Google – 40%2. cochrane.org

– 27%3. (direct) – 13%4. Bing – 3%

FR & ES: + mostly other kinds of search enginesmost people likely come by coincidence

EN, PT & HR: + other Cochrane & health sites, (social) media, Wikipedia etc.more people actually come deliberately

5. TOP OF THE POPS

1. Spanish2. French3. Portuguese4. Croatian

Spanish. 500French. 200

Portuguese. 240

Croatian. 5 # of speakers in million Spanish. 5400

French. 3800

Portuguese. 40

Croatian. 90

# of translations

Conclusions

1. USAGE – YES

2. AUDIENCE – YES

3. BUTTERFLY EFFECT – small, but yes

4. GATEWAYS – (un)intentionally (?)

5. TOP OF THE POPS

The more translations, the higher the usage

The more speakers & translations, the bigger the audience

What’s next?

• Central Cochrane translation strategy– WHO languages (ES, FR, RU, AR, ZH)

– crowd-sourcing & machine translation

• PLOS Medicine, Sept 2013:

http://www.plosmedicine.org/article/info%3Adoi%2F10.1371%2Fjournal.pmed.1001516

Many thanks!¡Muchas gracias!

Merci beaucoup !Mnogo hvala!

Muito obrigado!

juliane.ried@cochrane.org

Thanks to:– my co-authors– Elise Diard, French Cochrane Centre – Ivan Solà and Maroussia Tzanova, Iberoamerican

Cochrane Centre