scientific integrity and transparency under scrutiny: lessons from retraction watch

39
Scientific Integrity and Transparency Under Scrutiny: Lessons from Retraction Watch 3 rd World Conference on Research Integrity Montreal May 7, 2013 Ivan Oransky Co-founder, Retraction Watch http://retractionwatch.com @ivanoransky

Upload: ivan-oransky

Post on 20-Aug-2015

9.052 views

Category:

Technology


0 download

TRANSCRIPT

Page 1: Scientific Integrity and Transparency Under Scrutiny: Lessons from Retraction Watch

Scientific Integrity and Transparency Under Scrutiny:

Lessons from Retraction Watch

3rd World Conference on Research IntegrityMontreal

May 7, 2013

Ivan OranskyCo-founder, Retraction Watch

http://retractionwatch.com@ivanoransky

Page 2: Scientific Integrity and Transparency Under Scrutiny: Lessons from Retraction Watch

Always Another Story…

Page 3: Scientific Integrity and Transparency Under Scrutiny: Lessons from Retraction Watch

Retractions on the Rise

http://pmretract.heroku.com/byyear

Page 4: Scientific Integrity and Transparency Under Scrutiny: Lessons from Retraction Watch

Most Retractions Due to Misconduct

PNAS online October 1, 2012

Page 5: Scientific Integrity and Transparency Under Scrutiny: Lessons from Retraction Watch
Page 6: Scientific Integrity and Transparency Under Scrutiny: Lessons from Retraction Watch

How Long Do Retractions Take?

Page 7: Scientific Integrity and Transparency Under Scrutiny: Lessons from Retraction Watch

How Long Do Retractions Take?

Page 8: Scientific Integrity and Transparency Under Scrutiny: Lessons from Retraction Watch

How Long Do Retractions Take?

Page 9: Scientific Integrity and Transparency Under Scrutiny: Lessons from Retraction Watch

How Long Do Retractions Take?

Page 10: Scientific Integrity and Transparency Under Scrutiny: Lessons from Retraction Watch

What Happens to Retracted Papers’ Citations?

-Assn of College & Research Libraries 2011

Page 11: Scientific Integrity and Transparency Under Scrutiny: Lessons from Retraction Watch

What Happens to Retracted Papers’ Citations?

Budd et al, 1999: • Retracted articles received more than 2,000 post-

retraction citations; less than 8% of citations acknowledged the retraction

• Preliminary study of the present data shows that continued citation remains a problem

• Of 391 citations analyzed, only 6% acknowledge the retraction

Page 12: Scientific Integrity and Transparency Under Scrutiny: Lessons from Retraction Watch

What Happens to Retracted Papers’ Citations?

Page 13: Scientific Integrity and Transparency Under Scrutiny: Lessons from Retraction Watch

What Happens to Retracted Papers’ Citations?

“…annual citations of an article drop by 65% following retraction, controlling for article age and calendar year. In the years prior to retraction, there is no such decline, implying that retractions are unanticipated by the scientific community.”

Page 14: Scientific Integrity and Transparency Under Scrutiny: Lessons from Retraction Watch

Do Journals Get the Word Out?

Page 15: Scientific Integrity and Transparency Under Scrutiny: Lessons from Retraction Watch

Do Journals Get the Word Out?

“Journals often fail to alert the naïve reader; 31.8% of retracted papers were not noted as retracted in any way.”

Page 16: Scientific Integrity and Transparency Under Scrutiny: Lessons from Retraction Watch

Do Journals Get the Word Out?

How the Naïve Reader is Alerted to Retractions

Where retraction noted Retracted papers, n (%)

Watermark on pdf 305 (41.1)

Journal website 248 (33.4)

Not noted anywhere 236 (31.8)

Note appended to pdf 128 (17.3)

pdf deleted from website 98 (13.2)

Page 17: Scientific Integrity and Transparency Under Scrutiny: Lessons from Retraction Watch
Page 18: Scientific Integrity and Transparency Under Scrutiny: Lessons from Retraction Watch

The Euphemisms

“unattributed overlap”

Page 19: Scientific Integrity and Transparency Under Scrutiny: Lessons from Retraction Watch

The Euphemisms

“unattributed overlap”an “approach”

Page 20: Scientific Integrity and Transparency Under Scrutiny: Lessons from Retraction Watch

The Euphemisms

“unattributed overlap”an “approach”“a duplicate of a paper that has already been

published”…by other authors

Page 21: Scientific Integrity and Transparency Under Scrutiny: Lessons from Retraction Watch

The Euphemisms

“unattributed overlap”an “approach”“a duplicate of a paper that has already been

published”…by other authors“significant originality issue”

Page 22: Scientific Integrity and Transparency Under Scrutiny: Lessons from Retraction Watch

The Euphemisms

“unattributed overlap”an “approach”“a duplicate of a paper that has already been

published”…by other authors“significant originality issue”“Some sentences…are directly taken from other

papers, which could be viewed as a form of plagiarism”

Page 23: Scientific Integrity and Transparency Under Scrutiny: Lessons from Retraction Watch

Puzzling Policies

Page 24: Scientific Integrity and Transparency Under Scrutiny: Lessons from Retraction Watch

Puzzling Policies

Page 25: Scientific Integrity and Transparency Under Scrutiny: Lessons from Retraction Watch

Trend: Mega-Corrections

Page 26: Scientific Integrity and Transparency Under Scrutiny: Lessons from Retraction Watch

Trend: Mega-CorrectionsIn this Letter we made errors in representative image choice, including mislabelling of images or choosing an image from the inappropriate genotype. In all cases, choice of images was completely independent of the data analysis and so none of the conclusions in our original Letter are affected. We apologise for any confusion these errors may have caused.

Page 27: Scientific Integrity and Transparency Under Scrutiny: Lessons from Retraction Watch

Trend: Mega-CorrectionsIn this Letter we made errors in representative image choice, including mislabelling of images or choosing an image from the inappropriate genotype. In all cases, choice of images was completely independent of the data analysis and so none of the conclusions in our original Letter are affected. We apologise for any confusion these errors may have caused.

Figure 1a depicts a Tbr1 staining of the adult mouse cortex for four different genotypes. In the process of choosing representative pictures that reflect the results of our analysis shown in Fig. 1b, cropped images from original pictures were inadvertently mislabelled and used incorrectly. We provide below a corrected version of Fig. 1a with new representative images for the following genotypes: WT and Reln1/1;Efnb32/2. A new high-magnification picture for WT is also shown in the two rightmost panels. Original images for every genotype and additional examples are shown in the Supplementary Information of this Corrigendum.

Figure 1a depicts a Tbr1 staining of the adult mouse cortex for four different genotypes. In the process of choosing representative pictures that reflect the results of our analysis shown in Fig. 1b, cropped images from original pictures were inadvertently mislabelled and used incorrectly. We provide below a corrected version of Fig. 1a with new representative images for the following genotypes: WT and Reln1/1;Efnb32/2. A new high-magnification picture for WT is also shown in the two rightmost panels. Original images for every genotype and additional examples are shown in the Supplementary Information of this Corrigendum.

Page 28: Scientific Integrity and Transparency Under Scrutiny: Lessons from Retraction Watch

Trend: Mega-CorrectionsIn this Letter we made errors in representative image choice, including mislabelling of images or choosing an image from the inappropriate genotype. In all cases, choice of images was completely independent of the data analysis and so none of the conclusions in our original Letter are affected. We apologise for any confusion these errors may have caused.

Figure 1a depicts a Tbr1 staining of the adult mouse cortex for four different genotypes. In the process of choosing representative pictures that reflect the results of our analysis shown in Fig. 1b, cropped images from original pictures were inadvertently mislabelled and used incorrectly. We provide below a corrected version of Fig. 1a with new representative images for the following genotypes: WT and Reln1/1;Efnb32/2. A new high-magnification picture for WT is also shown in the two rightmost panels. Original images for every genotype and additional examples are shown in the Supplementary Information of this Corrigendum.

Figure 1a depicts a Tbr1 staining of the adult mouse cortex for four different genotypes. In the process of choosing representative pictures that reflect the results of our analysis shown in Fig. 1b, cropped images from original pictures were inadvertently mislabelled and used incorrectly. We provide below a corrected version of Fig. 1a with new representative images for the following genotypes: WT and Reln1/1;Efnb32/2. A new high-magnification picture for WT is also shown in the two rightmost panels. Original images for every genotype and additional examples are shown in the Supplementary Information of this Corrigendum.

Figure 1c depicts a Brn1 staining of the E17.5 mouse cortex for five different genotypes. In the process of figure assembly cropped images from original pictures were inadvertently mislabelled and used incorrectly. We provide below a corrected Fig. 1c with a new image for Reln1/1; Efnb3–/–. In the ephrinB3 compound mice (Reln1/2; Efnb32/2) Brn11 cells aberrantly accumulate in the lower layers of the cortex and do not migrate to the upper layers, resembling the Reeler (Reln2/2) phenotype. Original pictures and additional examples are shown in the Supplementary Information of this Corrigendum, where arrows indicate the distribution of Brn11 cells. We have also included results from a new, reproduced experiment recently performed with an additional cohort of animals that shows exactly the same results.

Figure 1c depicts a Brn1 staining of the E17.5 mouse cortex for five different genotypes. In the process of figure assembly cropped images from original pictures were inadvertently mislabelled and used incorrectly. We provide below a corrected Fig. 1c with a new image for Reln1/1; Efnb3–/–. In the ephrinB3 compound mice (Reln1/2; Efnb32/2) Brn11 cells aberrantly accumulate in the lower layers of the cortex and do not migrate to the upper layers, resembling the Reeler (Reln2/2) phenotype. Original pictures and additional examples are shown in the Supplementary Information of this Corrigendum, where arrows indicate the distribution of Brn11 cells. We have also included results from a new, reproduced experiment recently performed with an additional cohort of animals that shows exactly the same results.

Page 29: Scientific Integrity and Transparency Under Scrutiny: Lessons from Retraction Watch

Trend: Mega-CorrectionsIn this Letter we made errors in representative image choice, including mislabelling of images or choosing an image from the inappropriate genotype. In all cases, choice of images was completely independent of the data analysis and so none of the conclusions in our original Letter are affected. We apologise for any confusion these errors may have caused.

Figure 1a depicts a Tbr1 staining of the adult mouse cortex for four different genotypes. In the process of choosing representative pictures that reflect the results of our analysis shown in Fig. 1b, cropped images from original pictures were inadvertently mislabelled and used incorrectly. We provide below a corrected version of Fig. 1a with new representative images for the following genotypes: WT and Reln1/1;Efnb32/2. A new high-magnification picture for WT is also shown in the two rightmost panels. Original images for every genotype and additional examples are shown in the Supplementary Information of this Corrigendum.

Figure 1a depicts a Tbr1 staining of the adult mouse cortex for four different genotypes. In the process of choosing representative pictures that reflect the results of our analysis shown in Fig. 1b, cropped images from original pictures were inadvertently mislabelled and used incorrectly. We provide below a corrected version of Fig. 1a with new representative images for the following genotypes: WT and Reln1/1;Efnb32/2. A new high-magnification picture for WT is also shown in the two rightmost panels. Original images for every genotype and additional examples are shown in the Supplementary Information of this Corrigendum.

Figure 1c depicts a Brn1 staining of the E17.5 mouse cortex for five different genotypes. In the process of figure assembly cropped images from original pictures were inadvertently mislabelled and used incorrectly. We provide below a corrected Fig. 1c with a new image for Reln1/1; Efnb3–/–. In the ephrinB3 compound mice (Reln1/2; Efnb32/2) Brn11 cells aberrantly accumulate in the lower layers of the cortex and do not migrate to the upper layers, resembling the Reeler (Reln2/2) phenotype. Original pictures and additional examples are shown in the Supplementary Information of this Corrigendum, where arrows indicate the distribution of Brn11 cells. We have also included results from a new, reproduced experiment recently performed with an additional cohort of animals that shows exactly the same results.

Figure 1c depicts a Brn1 staining of the E17.5 mouse cortex for five different genotypes. In the process of figure assembly cropped images from original pictures were inadvertently mislabelled and used incorrectly. We provide below a corrected Fig. 1c with a new image for Reln1/1; Efnb3–/–. In the ephrinB3 compound mice (Reln1/2; Efnb32/2) Brn11 cells aberrantly accumulate in the lower layers of the cortex and do not migrate to the upper layers, resembling the Reeler (Reln2/2) phenotype. Original pictures and additional examples are shown in the Supplementary Information of this Corrigendum, where arrows indicate the distribution of Brn11 cells. We have also included results from a new, reproduced experiment recently performed with an additional cohort of animals that shows exactly the same results.

In Fig. 1d, the second panel, labelled ‘Reln1/1;Efnb3–/–’ should instead be labelled ‘Reln1/2’. In the Methods summary section ‘Stimulation of neurons’, ‘‘Cortical neurons from E14.5 were grown….’’ should instead read ‘‘Cortical neurons from E15.5 were grown….’’.

(There were mistakes in the supplementary online material, too.)

In Fig. 1d, the second panel, labelled ‘Reln1/1;Efnb3–/–’ should instead be labelled ‘Reln1/2’. In the Methods summary section ‘Stimulation of neurons’, ‘‘Cortical neurons from E14.5 were grown….’’ should instead read ‘‘Cortical neurons from E15.5 were grown….’’.

(There were mistakes in the supplementary online material, too.)

Page 30: Scientific Integrity and Transparency Under Scrutiny: Lessons from Retraction Watch

Anonymous Whistleblowers Step Up

http://www.labtimes.org

Page 31: Scientific Integrity and Transparency Under Scrutiny: Lessons from Retraction Watch

Blogs Get Aggressive

http://abnormalscienceblog.wordpress.com/

Page 32: Scientific Integrity and Transparency Under Scrutiny: Lessons from Retraction Watch

Blogs Get Aggressive

Page 33: Scientific Integrity and Transparency Under Scrutiny: Lessons from Retraction Watch

Blogs Get Aggressive

http://md-anderson-cc.blogspot.com

Page 34: Scientific Integrity and Transparency Under Scrutiny: Lessons from Retraction Watch

Blogs Get Aggressive

http://www.science-fraud.org/

Page 35: Scientific Integrity and Transparency Under Scrutiny: Lessons from Retraction Watch

Journals Are Listening

Page 36: Scientific Integrity and Transparency Under Scrutiny: Lessons from Retraction Watch

Journals Are Listening

Page 37: Scientific Integrity and Transparency Under Scrutiny: Lessons from Retraction Watch

Journals Are Listening

Page 38: Scientific Integrity and Transparency Under Scrutiny: Lessons from Retraction Watch

Journals Are Listening

Page 39: Scientific Integrity and Transparency Under Scrutiny: Lessons from Retraction Watch

Contact Info

[email protected]

http://retractionwatch.com

@ivanoransky

Thanks to Nancy Lapid, Reuters Health