increasing openness and transparency · increasing openness and transparency in academic research...
TRANSCRIPT
![Page 1: Increasing Openness and Transparency · Increasing Openness and Transparency in Academic Research John Lurquin. Open Science Interest Group (OSIG) Overview for today •Open access](https://reader030.vdocuments.net/reader030/viewer/2022041100/5ed7878af3c1446fa9657378/html5/thumbnails/1.jpg)
Increasing Openness and Transparencyin
Academic Research
John Lurquin
![Page 2: Increasing Openness and Transparency · Increasing Openness and Transparency in Academic Research John Lurquin. Open Science Interest Group (OSIG) Overview for today •Open access](https://reader030.vdocuments.net/reader030/viewer/2022041100/5ed7878af3c1446fa9657378/html5/thumbnails/2.jpg)
Open ScienceInterest Group
(OSIG)
![Page 3: Increasing Openness and Transparency · Increasing Openness and Transparency in Academic Research John Lurquin. Open Science Interest Group (OSIG) Overview for today •Open access](https://reader030.vdocuments.net/reader030/viewer/2022041100/5ed7878af3c1446fa9657378/html5/thumbnails/3.jpg)
Overview for today
• Open access• Macro level
• OA at the micro level• Individual research
• Transparency
• Open data
![Page 4: Increasing Openness and Transparency · Increasing Openness and Transparency in Academic Research John Lurquin. Open Science Interest Group (OSIG) Overview for today •Open access](https://reader030.vdocuments.net/reader030/viewer/2022041100/5ed7878af3c1446fa9657378/html5/thumbnails/4.jpg)
Open Access at CU
• Institutional repository (CU Scholar)• Open Access Policy
![Page 5: Increasing Openness and Transparency · Increasing Openness and Transparency in Academic Research John Lurquin. Open Science Interest Group (OSIG) Overview for today •Open access](https://reader030.vdocuments.net/reader030/viewer/2022041100/5ed7878af3c1446fa9657378/html5/thumbnails/5.jpg)
Open Access
• Open, unrestricted
access
journalarticles book
chapters
conferencepapers
theses
Research output
Generalpublic
Students
Otherresearchers
![Page 6: Increasing Openness and Transparency · Increasing Openness and Transparency in Academic Research John Lurquin. Open Science Interest Group (OSIG) Overview for today •Open access](https://reader030.vdocuments.net/reader030/viewer/2022041100/5ed7878af3c1446fa9657378/html5/thumbnails/6.jpg)
Open Access
• Open and unrestricted access
Details of scientific research
• Increase transparency
• Increase confidence in reported research findings
![Page 7: Increasing Openness and Transparency · Increasing Openness and Transparency in Academic Research John Lurquin. Open Science Interest Group (OSIG) Overview for today •Open access](https://reader030.vdocuments.net/reader030/viewer/2022041100/5ed7878af3c1446fa9657378/html5/thumbnails/7.jpg)
Replication
• Another research team conducts the same study
• Do they produce the same results?
![Page 8: Increasing Openness and Transparency · Increasing Openness and Transparency in Academic Research John Lurquin. Open Science Interest Group (OSIG) Overview for today •Open access](https://reader030.vdocuments.net/reader030/viewer/2022041100/5ed7878af3c1446fa9657378/html5/thumbnails/8.jpg)
Replication crisis
![Page 9: Increasing Openness and Transparency · Increasing Openness and Transparency in Academic Research John Lurquin. Open Science Interest Group (OSIG) Overview for today •Open access](https://reader030.vdocuments.net/reader030/viewer/2022041100/5ed7878af3c1446fa9657378/html5/thumbnails/9.jpg)
Replication crisis
![Page 10: Increasing Openness and Transparency · Increasing Openness and Transparency in Academic Research John Lurquin. Open Science Interest Group (OSIG) Overview for today •Open access](https://reader030.vdocuments.net/reader030/viewer/2022041100/5ed7878af3c1446fa9657378/html5/thumbnails/10.jpg)
What’s going on?
A. Publication bias
B. Pressure to publish
C. Flexibility in research
![Page 11: Increasing Openness and Transparency · Increasing Openness and Transparency in Academic Research John Lurquin. Open Science Interest Group (OSIG) Overview for today •Open access](https://reader030.vdocuments.net/reader030/viewer/2022041100/5ed7878af3c1446fa9657378/html5/thumbnails/11.jpg)
A. Publication bias
• Reluctance to publish null findings.
• Preference for flashy findings.
![Page 12: Increasing Openness and Transparency · Increasing Openness and Transparency in Academic Research John Lurquin. Open Science Interest Group (OSIG) Overview for today •Open access](https://reader030.vdocuments.net/reader030/viewer/2022041100/5ed7878af3c1446fa9657378/html5/thumbnails/12.jpg)
B. Pressure to publish
• Hiring and promotion
• Funding
• More PhDs awarded now than ever
![Page 13: Increasing Openness and Transparency · Increasing Openness and Transparency in Academic Research John Lurquin. Open Science Interest Group (OSIG) Overview for today •Open access](https://reader030.vdocuments.net/reader030/viewer/2022041100/5ed7878af3c1446fa9657378/html5/thumbnails/13.jpg)
C. Flexibility in research
Researchquestion
Consultliterature
Develophypotheses
Selectmeasures
Start datacollection
Stop datacollection
Process thedata
Outliers?
Determineanalysis plan
RejectH0?
Selectjournal
Reviewers’comments
ReviseResubmit
![Page 14: Increasing Openness and Transparency · Increasing Openness and Transparency in Academic Research John Lurquin. Open Science Interest Group (OSIG) Overview for today •Open access](https://reader030.vdocuments.net/reader030/viewer/2022041100/5ed7878af3c1446fa9657378/html5/thumbnails/14.jpg)
C. Flexibility in research
![Page 15: Increasing Openness and Transparency · Increasing Openness and Transparency in Academic Research John Lurquin. Open Science Interest Group (OSIG) Overview for today •Open access](https://reader030.vdocuments.net/reader030/viewer/2022041100/5ed7878af3c1446fa9657378/html5/thumbnails/15.jpg)
C. Flexibility in research
![Page 16: Increasing Openness and Transparency · Increasing Openness and Transparency in Academic Research John Lurquin. Open Science Interest Group (OSIG) Overview for today •Open access](https://reader030.vdocuments.net/reader030/viewer/2022041100/5ed7878af3c1446fa9657378/html5/thumbnails/16.jpg)
C. Flexibility in research
![Page 17: Increasing Openness and Transparency · Increasing Openness and Transparency in Academic Research John Lurquin. Open Science Interest Group (OSIG) Overview for today •Open access](https://reader030.vdocuments.net/reader030/viewer/2022041100/5ed7878af3c1446fa9657378/html5/thumbnails/17.jpg)
Replication crisis
Publicationbias
Pressure topublish
Selectivereporting
![Page 18: Increasing Openness and Transparency · Increasing Openness and Transparency in Academic Research John Lurquin. Open Science Interest Group (OSIG) Overview for today •Open access](https://reader030.vdocuments.net/reader030/viewer/2022041100/5ed7878af3c1446fa9657378/html5/thumbnails/18.jpg)
Replication crisis
Falsepositives
![Page 19: Increasing Openness and Transparency · Increasing Openness and Transparency in Academic Research John Lurquin. Open Science Interest Group (OSIG) Overview for today •Open access](https://reader030.vdocuments.net/reader030/viewer/2022041100/5ed7878af3c1446fa9657378/html5/thumbnails/19.jpg)
Openness and transparency
• Pre-registration
• Open materials
• Open data
• Overall benefits• Documenting research workflow• Encouraging attention to details when planning• More details when reporting• Good for replication• Good for meta-analyses
![Page 20: Increasing Openness and Transparency · Increasing Openness and Transparency in Academic Research John Lurquin. Open Science Interest Group (OSIG) Overview for today •Open access](https://reader030.vdocuments.net/reader030/viewer/2022041100/5ed7878af3c1446fa9657378/html5/thumbnails/20.jpg)
Openness and transparency
![Page 21: Increasing Openness and Transparency · Increasing Openness and Transparency in Academic Research John Lurquin. Open Science Interest Group (OSIG) Overview for today •Open access](https://reader030.vdocuments.net/reader030/viewer/2022041100/5ed7878af3c1446fa9657378/html5/thumbnails/21.jpg)
Openness and transparency
• Organizations are endorsing
![Page 22: Increasing Openness and Transparency · Increasing Openness and Transparency in Academic Research John Lurquin. Open Science Interest Group (OSIG) Overview for today •Open access](https://reader030.vdocuments.net/reader030/viewer/2022041100/5ed7878af3c1446fa9657378/html5/thumbnails/22.jpg)
Openness and transparency
• Journals are endorsing
• 3% shared data before
• 25% shared data after
![Page 23: Increasing Openness and Transparency · Increasing Openness and Transparency in Academic Research John Lurquin. Open Science Interest Group (OSIG) Overview for today •Open access](https://reader030.vdocuments.net/reader030/viewer/2022041100/5ed7878af3c1446fa9657378/html5/thumbnails/23.jpg)
Openness and transparency
Journals are mandating
• PLoS open data policy
• Cortex: Registered Reports
![Page 24: Increasing Openness and Transparency · Increasing Openness and Transparency in Academic Research John Lurquin. Open Science Interest Group (OSIG) Overview for today •Open access](https://reader030.vdocuments.net/reader030/viewer/2022041100/5ed7878af3c1446fa9657378/html5/thumbnails/24.jpg)
Openness and transparency
• Researchers are publicly committing
![Page 25: Increasing Openness and Transparency · Increasing Openness and Transparency in Academic Research John Lurquin. Open Science Interest Group (OSIG) Overview for today •Open access](https://reader030.vdocuments.net/reader030/viewer/2022041100/5ed7878af3c1446fa9657378/html5/thumbnails/25.jpg)
Openness and transparency
![Page 26: Increasing Openness and Transparency · Increasing Openness and Transparency in Academic Research John Lurquin. Open Science Interest Group (OSIG) Overview for today •Open access](https://reader030.vdocuments.net/reader030/viewer/2022041100/5ed7878af3c1446fa9657378/html5/thumbnails/26.jpg)
Openness and transparency
![Page 27: Increasing Openness and Transparency · Increasing Openness and Transparency in Academic Research John Lurquin. Open Science Interest Group (OSIG) Overview for today •Open access](https://reader030.vdocuments.net/reader030/viewer/2022041100/5ed7878af3c1446fa9657378/html5/thumbnails/27.jpg)
TOP Guidelines
• Signatories• 756 journals
• 63 organizations
![Page 28: Increasing Openness and Transparency · Increasing Openness and Transparency in Academic Research John Lurquin. Open Science Interest Group (OSIG) Overview for today •Open access](https://reader030.vdocuments.net/reader030/viewer/2022041100/5ed7878af3c1446fa9657378/html5/thumbnails/28.jpg)
TOP at the university
• Nature surveyed 1,576 researchers (2016)
Is there a replication crisis?
YES: 90%
![Page 29: Increasing Openness and Transparency · Increasing Openness and Transparency in Academic Research John Lurquin. Open Science Interest Group (OSIG) Overview for today •Open access](https://reader030.vdocuments.net/reader030/viewer/2022041100/5ed7878af3c1446fa9657378/html5/thumbnails/29.jpg)
TOP at the university
93.5%
![Page 30: Increasing Openness and Transparency · Increasing Openness and Transparency in Academic Research John Lurquin. Open Science Interest Group (OSIG) Overview for today •Open access](https://reader030.vdocuments.net/reader030/viewer/2022041100/5ed7878af3c1446fa9657378/html5/thumbnails/30.jpg)
TOP at the university
• Measures of research quality
1. Amount of research
2. Citations
3. Openness and transparency
![Page 31: Increasing Openness and Transparency · Increasing Openness and Transparency in Academic Research John Lurquin. Open Science Interest Group (OSIG) Overview for today •Open access](https://reader030.vdocuments.net/reader030/viewer/2022041100/5ed7878af3c1446fa9657378/html5/thumbnails/31.jpg)
TOP at CU
• CU Libraries
![Page 32: Increasing Openness and Transparency · Increasing Openness and Transparency in Academic Research John Lurquin. Open Science Interest Group (OSIG) Overview for today •Open access](https://reader030.vdocuments.net/reader030/viewer/2022041100/5ed7878af3c1446fa9657378/html5/thumbnails/32.jpg)
TOP at CU
• CU students
• Publishing datasets in publicly-available repositories
![Page 33: Increasing Openness and Transparency · Increasing Openness and Transparency in Academic Research John Lurquin. Open Science Interest Group (OSIG) Overview for today •Open access](https://reader030.vdocuments.net/reader030/viewer/2022041100/5ed7878af3c1446fa9657378/html5/thumbnails/33.jpg)
TOP at CU
• Trust
![Page 34: Increasing Openness and Transparency · Increasing Openness and Transparency in Academic Research John Lurquin. Open Science Interest Group (OSIG) Overview for today •Open access](https://reader030.vdocuments.net/reader030/viewer/2022041100/5ed7878af3c1446fa9657378/html5/thumbnails/34.jpg)
Open data at CU
• Get out ahead of changing standards
• Increase confidence in our research
• Increase public trust
• Good for science!
![Page 35: Increasing Openness and Transparency · Increasing Openness and Transparency in Academic Research John Lurquin. Open Science Interest Group (OSIG) Overview for today •Open access](https://reader030.vdocuments.net/reader030/viewer/2022041100/5ed7878af3c1446fa9657378/html5/thumbnails/35.jpg)
Open data at CU
• Push-back
• “I’m not finished with the data.”
![Page 36: Increasing Openness and Transparency · Increasing Openness and Transparency in Academic Research John Lurquin. Open Science Interest Group (OSIG) Overview for today •Open access](https://reader030.vdocuments.net/reader030/viewer/2022041100/5ed7878af3c1446fa9657378/html5/thumbnails/36.jpg)
Open data at CU
• Push-back
• “My data is sensitive.”
![Page 37: Increasing Openness and Transparency · Increasing Openness and Transparency in Academic Research John Lurquin. Open Science Interest Group (OSIG) Overview for today •Open access](https://reader030.vdocuments.net/reader030/viewer/2022041100/5ed7878af3c1446fa9657378/html5/thumbnails/37.jpg)
Open data at CU
• Discipline-specific needs?
• Barriers?
• Incentives?
![Page 38: Increasing Openness and Transparency · Increasing Openness and Transparency in Academic Research John Lurquin. Open Science Interest Group (OSIG) Overview for today •Open access](https://reader030.vdocuments.net/reader030/viewer/2022041100/5ed7878af3c1446fa9657378/html5/thumbnails/38.jpg)
Open ScienceInterest Group
(OSIG)