systematic review data repository (srdr) annual report ...2015+annual+report.pdfproviding further...
TRANSCRIPT
Systematic Review Data Repository (SRDR) Annual Report
December 2014 to November 2015
Prepared for:
The Agency for Healthcare Research and Quality
Rockville, MD
Prepared by:
Brown Evidence-based Practice Center
Providence, RI
Authors:
Bryant T. Smith, MPH, CPH
Jens Jap, BS
Joseph Lau, MD
Summary
This report summarizes trends in traffic and usage of the Systematic Review Data
Repository Web site (srdr.ahrq.gov) between December 1, 2014 and November 30, 2015. Where
relevant, data is summarized back to June 2012, when SRDR was released to the public.
As of November 2015, a significant jump in the number of visits made to the site was
observed beginning in July, 2015 and extending through November 2015. For example, in June
2015, 7125 visits to SRDR were recorded, compared to 15,524 in July and 36,431 in November.
Coinciding with this jump in the number of visits, the user base of SRDR also grew
significantly as evidenced by the expansion in the number of countries from which requests for
new user accounts originated in 2015. Specifically, in 2015, requests for new user accounts
originated from 144 different countries (up from the 80 countries from which requests originated
in 2014) with the most requests coming from the US (6958 requests), followed by China (3012
requests), and finally, France (509).
Providing further evidence of the expansion of the SRDR user base in 2015, as of
November 2015, 592 project contributor accounts were certified in 2015 (up from 372 as of
December 2014). Furthermore, as of November 2015, 391 projects were initiated in SRDR with
48 published to SRDR (up from 230 project initiated in SRDR as of December 2014, with 20
projects having been published.
! 1!
Table of contents
A.#Introduction#......................................................................................................................................#2!B.#Data#source#and#data#collection#method#.................................................................................#3!C.#Results#..................................................................................................................................................#4!D.#Training#sessions#and#training#site#........................................................................................#26!E.#SRDR#usage#by#Evidence#Based#Practice#Centers#...............................................................#32!Appendix#A!Appendix#A.1.##Complete!list!of!unpublished!projects!(321)!currently!in!SRDR!as!of!November!2015#...................................................................................................................................#AF1!Appendix#A.2.#Complete!list!of!published!projects!(48)!currently!in!SRDR!as!of!November!2015#.......................................................................................................................................................#AF2!
! 2!
A. Introduction
Development of the Systematic Review Data Repository (SRDR) started in July 2010, and the
system was released for general use by EPCs and the public in June 2012. This resource serves as both an
archive and data extraction tool, is shared among organizations and individuals producing systematic
reviews worldwide, and enables the creation of a central database of systematic review data. This
database is collaboratively vetted, is freely accessible, and aims to integrate seamlessly with existing
workflows. The ultimate goal of SRDR is to facilitate the efficient generation and update of evidence
reviews, thus speeding up and improving policymaking with regards to health care. An introductory
article describing the goals, rationale, challenges, and benefits of SRDR has been published.1 During the
report time period, three categories of user access to SRDR have been defined: non-registered public
viewers, registered public commentators, and certified project contributors. A more detailed description
of the system users and their levels of access are provided in each relevant section.
This report describes the usage and growth of SRDR mainly during the last 12 months (December
2014 to November 2015). When possible, we have provided data back to June 2012 when the site was
first launched for public use.
1!Ip!S,!Hadar!N,!Keefe!S,!et!al.!A!WebKbased!archive!of!systematic!review!data.!Syst!Rev!2012;1(1):15.!
! 3!
B. Data source and data collection method
The SRDR database administrators at the Brown EPC wrote custom MySQL queries that were
executed on the SRDR production and training databases to collect information regarding the growth of
the SRDR database on a monthly basis. Using this method, we collected statistics regarding new user
registrations, newly initiated projects, and the number of studies residing in the system. In addition to the
in-house summary data production, we track individual site visit data by parsing webserver log files
obtained from the server on which the SRDR Web site is hosted.
! 4!
C. Results
SRDR usage data is collected by executing MySQL queries directly on the production server.
This method allows us to account for two types of users: those certified as project contributors and those
who have registered public commentator accounts, both of which enable users to download data from
projects published to SRDR, as well as leave comments on published projects. However, users simply
browsing published content do not require registration and therefore are not traceable by our querying
method. In order to account for these users, we parse Web server log files directly. These files contain
data for all visitors to the site (by unique IP address, page requested, and response status), regardless of
account type.
In summary, the number and geographic distribution of visits to the SRDR Web site increased
greatly over the period of December 2014 to November 2015. Over this period, the SRDR site was visited
an average of 13,541 times per month (Range: 7,125 to 36,431 visits) with an average of 445 visits per
day. This represents a two-fold increase in the number of visits recorded to the site over a similar period
last year (December 2013 to November 2014) when SRDR was visited an average of 7500 times per
month (Range: 1506 to 10847 visits) with an average of 246 visits per day. In addition to the increased
traffic on the SRDR site, visits to SRDR over 2015 were recorded from a total of 144 different countries
(up from the 80 countries recorded in 2014).
From these 144 countries, individuals requested 480 public commentator accounts and 1641
project contributor accounts. As of November 2015, 592 researchers had completed the required training
and were certified as project contributors and 391 projects had been initiated in the repository (48
published, 321 ongoing, and 22 initiated for training/demonstration purposes). Users that were not
certified yet were referred to the training site (http://srdr.training.ahrq.gov/) to try out the available tools
and features. Between January 2013 and November 2015, 857 users have explored using SRDR via the
training site (srdr.training.ahrq.gov). The usage of the SRDR site among the Evidence Based Practice
Centers (EPCs) is discussed in section E of this report.
The following information is provided in this report:
!! General statistics (e.g., visits, visitors, site pages, and hits) by month from December
2014 to November 2015 (Table 1)
!! Average visits per day for each month from December 2014 to November 2015 (Figure
1)
!! Number of visits by hour of the day (UTC) by month from December 2014 to November
2015 (Figure 2)
! 5!
!! Total number of visits by hour of the day (UTC) recorded over the period of December
2014 to November 2015 (Figure 3)
!! Geographic distribution of SRDR Users as of December 2015 (Figure 4)
!! Number of requests for SRDR user accounts by country of origin (including requests for
public commentators and project contributor accounts) as of December 2015 (Table 2)
!! The Top-10 Ranked Countries by number of requests for SRDR user accounts as of
December 2015 (Table 3)
!! Cumulative number of requests for public commentator accounts by month from June
2012 to November 2015 (Figure 5)
!! Cumulative number of requests for project contributor accounts by month from June
2012 to November 2015 (Figure 6)
!! Cumulative number of certified project contributors by month from June 2012 to
November 2015 (Figure 7)
!! Cumulative number of projects initiated in SRDR by month from June 2012 to November
2015 (Figure 8)
!! Cumulative number of projects published in SRDR by month from June 2012 to
November 2015 (Figure 9)
!! Characteristics of SRDR projects currently in SRDR as of November 2015 (Table 4)
!! Characteristics of projects published in SRDR as of November 2015 (Table 5)
!! Cumulative number of requests for training accounts by month from January 2013 to
November 2015 (Figure 10)
!! Certified User Training Status of EPCs funded by AHRQ between December 2014-2015
(Table 6)
!! EPC-IV systematic reviews and technical briefs due for submission on or before March
2015 and their status in SRDR as of November 2015 (Table 7)
! 6!
C.1. Public viewers2
C.1.a General Statistic
Table 1. General statistics by month from December 2014 to November 2015
(Data Source: SRDR production log file)
* Site Hits: A "hit" is not a visit to the Web site, but a hit on the Web server. A hit on the Web server can
2This user type can view and download published systematic reviews data. They are not able to comment,
edit, or supplement any deposited data. Registration with SRDR is voluntary.
!
Category Dec 2014
Jan 2015
Feb 2015
Mar 2015
Apr 2015
May 2015
Jun 2015
Site visits statistic
Visits 7569 8642 8455 16736 8641 6984 7125
Average per day 244 279 302 540 288 225 238 Site visitors
Unique visitors 2152 2003 2274 2584 2383 2070 1973
Visitors who visited once 1237 1087 1303 1371 1382 1104 1026
Visitors with >1 visit 915 916 971 1213 1001 966 947
Average number of visitors per day 69 65 81 83 79 67 66
Site Hits*
Total hits 60554 69141 67642 133889 69135 55877 57001
Successful hits (as percent) 100% 100% 100% 100% 100% 100% 100%
Jul 2015
Aug 2015
Sep 2015
Oct 2015
Nov 2015
Site visits statistic
Visits 15524 16452 9282 20646 36431
Average per day 501 531 309 666 1214
Site visitors
Unique visitors 6210 6305 5642 6469 6654
Visitors who visited once 3657 3780 3270 3654 3456
Visitors with >1 visit 2553 2525 2372 2815 3198
Average number of visitors per day 4006 4246 2475 5328 9715
Site Hits*
Total hits 124193 131619 74257 165169 291466
Successful hits (as percent) 100% 100% 100% 100% 100%
! 7!
be a graphic, java applet, the html file, etc. So, if a site has 79 small graphics on the page, every visitor to
the site registers as 80 hits on the server (79 graphics plus the html file). In this case, 80,000 hits
translate to 1,000 visitors;
Figure 1. Average visits per day for each month from December 2014 to November 2015
(Data Source: SRDR production log file)
0
200
400
600
800
1000
1200
1400
Average###visits
! 8!
Figure 2. Number of visits by hour of the day (UTC) for each month from December 2014 to November
2015
December 2014
January 2015
0
5000
10000
15000
20000
25000
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
5000
10000
15000
20000
25000
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
! 9!
February 2015
March 2015
April 2015
0
5000
10000
15000
20000
25000
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
5000
10000
15000
20000
25000
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
5000
10000
15000
20000
25000
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
! 10!
May 2015
June 2015
July 2015
0
5000
10000
15000
20000
25000
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
5000
10000
15000
20000
25000
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
0
5000
10000
15000
20000
25000
0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23
! 11!
August 2015
September 2015
October 2015
0
5000
10000
15000
20000
25000
0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23
0
5000
10000
15000
20000
25000
0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23
0
5000
10000
15000
20000
25000
0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23
! 12!
Note: The peak at 8:00 UTC in October 2015 exceeded 25,000 visits at 39,006 visits. We are confident
that this peak does not the reflect number of visits from SRDR users that were recorded at this hour and
may be artificially inflated by other factors which have yet to be identified.
November 2015
Note: The peak at 9:00 UTC in November 2015 exceeded 25,000 visits at 68,392 visits. We are confident
that this peak does not the reflect number of visits from SRDR users that were recorded at this hour and
may be artificially inflated by other factors which have yet to be identified.
(Data Source: SRDR production log file)
Figure 3. Total number of visits by hour of the day (UTC) recorded over the period of December 2014 to
November 2015
(Data Source: SRDR production log file)
0
5000
10000
15000
20000
25000
0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23
0
10000
20000
30000
40000
50000
60000
70000
80000
90000
100000
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
! 13!
C.1.b Geographic Distribution of SRDR Users
Figure 4. Geographic distribution of SRDR users as of December 2015
Note: Blue shading represents countries in which SRDR users were located when they registered for a
public commentator or project contributor SRDR account)
Table 2. Number of requests for SRDR user accounts by country of origin (including requests for public
commentators and project contributor accounts) as of December 2015
Country # of
Requests Country # of
Requests Country # of
Requests Albania 10 Gibraltar 1 Philippines 28
Algeria 6 Greece 103 Pitcairn 1
Angola 2 Guatemala 2 Poland 105
Antigua and Barbuda
2 Haiti 2 Portugal 17
Argentina 16 Hong Kong 37 Puerto Rico 3
Armenia 9 Hungary 1 Qatar 5
Asia/Pacific Region
2 Iceland 5 Romania 147
! 14!
Australia 114 India 213 Russian Federation 225
Austria 32 Indonesia 28 Rwanda 2
Azerbaijan 4 Iran, Islamic Republic of
25 Saint Lucia 1
Bahamas 9 Iraq 16 Saudi Arabia 17
Bahrain 1 Ireland 40 Senegal 7
Bangladesh 9 Israel 30 Serbia 17
Belarus 4 Italy 78 Seychelles 15
Belgium 42 Jamaica 1 Singapore 33
Bosnia and Herzegowina
3 Japan 91 Slovakia 15
Brazil 227 Jordan 8 Slovenia 13
Brunei Darussalam
1 Kazakhstan 8 Somalia 1
Bulgaria 16 Kenya 10 South Africa 27
Canada 421 Kiribati 1 Spain 86
Cape Verde 9 Korea, Republic of
61 Sri Lanka 6
Chad 7 Latvia 12 Sudan 1
Chile 15 Lebanon 7 Swaziland 1
China 3012 Lithuania 7 Sweden 85
Colombia 26 Luxembourg 3 Switzerland 42
Costa Rica 4 Macao 12 Syrian Arab Republic
2
Côte D'ivoire 3 Macedonia 11 Taiwan, Province of China
58
Croatia 13 Madagascar 1 Tajikistan 1
Cuba 1 Malawi 1 Tanzania, United Republic of
7
Czech Republic 36 Malaysia 48 Thailand 77
! 15!
Denmark 33 Malta 1 Tunisia 2
Djbouti 4 Mexico 17 Turkey 109
Dominica 1 Moldova, Republic of
8 Turkmenistan 1
Dominican Republic
1 Monaco 1 Turks and Caicos Islands
1
Ecuador 5 Montenegro 1 Uganda 3
Egypt 34 Morocco 14 Ukraine 214
Estonia 27 Nepal 1 United Arab Emirates
12
Ethiopia 4 Netherlands 169 United Kingdom 409
European Union 40 New Zealand 23 United States 6958
Falkland Islands 1 Nicaragua 1 Uruguay 8
Fiji 2 Nigeria 8 Uzbekistan 1
Finland 8 Norway 17 Vanuatu 7
France 509 Oman 1 Venezuela 63
French Guiana 4 Pakistan 42 Viet Nam 32
Gambia 1 Palestine, State of
4 Virgin Islands 1
Georgia 4 Panama 2 Yemen 5
Germany 387 Paraguay 3 Zambia 2
Ghana 2 Peru 15 Zimbabwe 3
(Data Source: SRDR site via MySQL queries)
! 16!
Table 3. The Top-10 Ranked Countries by number of requests for SRDR user accounts as of December
2015
Ranking Country # of Requests
1 United States 6958 2 China 3012 3 France 509 4 Canada 421 5 United Kingdom 409 6 Germany 387 7 Brazil 227 8 Russian Federation 225 9 Ukraine 214 10 India 213
(Data Source: SRDR site via MySQL queries)
C.1.c Published data view statistic
Prior to June 2015, we did not record either the identity of users who downloaded data from published
projects or the number of times data has been downloaded. Beginning in June 2015, we incorporated a
feature to keep track of these information and made it available to contributing authors. Building on this
feature, we will develop SQL queries to tabulate the number of times data is download from each
published project and plan to present this data in future SRDR annual reports.
! 17!
C.2. Registered Public Commentator3
C.2.a Registered public commentator accounts growth
Figure 5. Cumulative number of requests for public commentator accounts by month from June 2012 to
November 2015
(Total number of users = 480; Data Source: SRDR site via MySQL queries)
C.2.b Comments on Published Systematic Review project’s data
No comments were posted by any of the registered public commentators.
3 An SRDR user with permission to post comments on published deposited systematic reviews data entries. Such
users would have to register on the SRDR Web site, providing basic identifying and contact information, including
their name, affiliated organization, and a valid email address. Following email verification, newly registered
commentators are asked to accept the terms of use for the repository’s discussion features. All comments are vetted
for clarity and adherence to rules by the SRDR operational team prior to posting. !
0
30
60
90
120
150
180
210
240
270
300
330
360
390
420
450
480
Cumulative#Requests#for#Public#Com
mentator#
Accounts
! 18!
C.3. Registered Project Contributor4
C.3.a Registered project contributor accounts growth
Figure 6. Cumulative number of requests for project contributor accounts by month from June 2012 to
November 2015
(Total number of users = 1641; Data Source: SRDR site via MySQL queries)
4 A registered project contributor is an individual who has been given permission to contribute data to a project in
SRDR. Accounts of this type would initially be assigned via certified groups or organizations rather than through
SRDR’s Web registration. EPCs and other groups would be granted rights to contribute data to the SRDR.
Individual contributors who wish to submit evidence reviews not conducted under the auspices of an SRDR-
recognized or -affiliated sponsoring organization would be granted access separately under policies to be established
with guidance from the SRDR governing board.
!
0
200
400
600
800
1000
1200
1400
1600
1800
Cumulative#Requests#for#Project#Contributor#
Accounts
! 19!
Figure 7. Cumulative number of certified project contributors by month from June 2012 to November
2015
(Total number of certified users = 592; Data Source: SRDR site via MySQL queries)
0
100
200
300
400
500
600
700
Cumulative#Nom
ber#of#Certified#Project#
Contributors
! 20!
C.3. Projects in SRDR
C.3.a Projects published in SRDR from June 2012 to November 2015
1.! Blood Pressure Targets in CKD (3 studies) [Tufts EPC]
2.! The lack of evidence for PET or PET/CT surveillance of patients with treated lymphoma,
colorectal cancer, and head and neck cancer (12 studies) [Brown EPC]
3.! Fructose Consumption and Non-alcoholic Fatty Liver Disease (NAFLD) (23 studies) [ILSI5]
4.! Sling surgery for stress urinary incontinence in women: SGS 2013 (104 studies) [Society of
Gynecologic Surgeons]
5.! SGS: Local Estrogen For Genitourinary Complaints in Post-Menopausal (56 studies) [Society of
Gynecologic Surgeons]
6.! Diet and PA for Prevention of Diabetes-Full Data Extraction (50 studies) [Tufts EPC]
7.! Benefits and Harms of Routine Preoperative Testing: Comparative Effectiveness Review 2013
(220 studies) [Tufts EPC]
8.! Therapeutic Management, Delivery, and Postpartum Risk Assessment and Screening in
Gestational Diabetes (43 studies) [Johns Hopkins University EPC]
9.! Sugars and Health - Evidence Map (213 studies) [ILSI5]
10.!Decision Aids for Cancer Screening and Treatment (74 studies) [Cochrane Complementary and
Alternative Medicine Field]
11.! Therapies for Children with Autism Spectrum Disorders (170 studies) [Vanderbilt EPC]
12.!Off-Label Use of Atypical Antipsychotics: An Update (129 studies) [Tufts EPC]
13.! Treatment of Common Hip Fractures (85 studies) [Minnesota EPC]
14.!Dietary Fiber Database, Version 1 (868 studies) [ILSI]
15.! First- and Second- Generation Antipsychotics for Children and Young Adults (81 studies)
[University of Alberta EPC]
16.!Behavioral programs for diabetes mellitus (166 studies) [Alberta EPC]
17.!Catheter ablation for treatment of atrial fibrillation (50 studies) [Pacific Northwest EPC]
18.! Imaging Techniques for Treatment Evaluation for Metastatic Breast Cancer (17 studies) [Pacific
Northwest EPC]
19.! Interventions to Reduce Antibiotic Prescribing for Uncomplicated Acute Respiratory Tract
Infections (133 studies) [Pacific Northwest EPC]
20.! Imaging Techniques for the Diagnosis and Staging of Hepatocellular Carcinoma (281 studies)
5!ILSI!stands!for!the!International!Life!Sciences!Institute!
! 21!
[Pacific Northwest EPC]
21.! Imaging for the Pretreatment Staging of Small Cell Lung Cancer (7 studies) [ECRI EPC]
22.! Second-Generation Antidepressants in the Pharmacologic Treatment of Adult Depression: An
update of the 2007 Comparative Effectiveness Review [Entered Retrospectively] (221 studies)
[RTI-UNC EPC]
23.! Imaging Tests for the Diagnosis and Staging of Pancreatic Adenocarcinoma (121 studies) [ECRI
Institute-Penn Medicine EPC]
24.! Treatment of Primary and Secondary Osteoarthritis of the Knee (77 studies) [Blue Cross and Blue
Shield Association Technology EPC]
25.! Treatment to Prevent Fractures in Men and Women With Low Bone Density or Osteoporosis:
Update of a 2007 Report (182 studies) [RAND Corporation -Southern California EPC]
26.! Effectiveness of Early Diagnosis, Prevention, and Treatment of Clostridium difficile Infection
(112 studies) [Minnesota EPC]
27.! Treatments for Ankyloglossia and Ankyloglossia with Concomitant Lip-tie (43 studies)
[Vanderbilt EPC]
28.!Venous Thromboembolism Prophylaxis in Orthopedic Surgery (149 studies) [University of
Connecticut-Hartford Hospital EPC]
29.!Oral Diabetes Medications for Adults with Type 2 Diabetes: An Update (176 studies) [Johns
Hopkins University EPC]
30.! Procedures for Managing Postpartum Hemorrhage: A Systematic Review (73 studies) [Vanderbilt
EPC]
31.!Management and Outcomes of Binge-Eating Disorder (BED) (84 studies) [RTI-UNC EPC]
32.! Treatments for Fibromyalgia in Adult Subgroups (75 studies) [Minnesota EPC]
33.!Management Strategies to Reduce Psychiatric Readmissions: Technical Brief (72 studies) [RTI-
UNC EPC]
34.! Strategies to Improve Mental Health Care for Children and Adolescents (16 studies) [RTI-UNC
EPC]
35.! Low-calorie sweeteners and body weight and composition: a meta-analysis of randomized
controlled trials and prospective cohort studies (24 studies) [Exponent, Inc.]
36.! Pain Management Injection Therapies for Low-back Pain (92 studies) [Pacific Northwest EPC]
37.! Treatment of Non-Metastatic Muscle-Invasive Bladder Cancer (40 studies) [Pacific Northwest
EPC]
38.! Psychosocial and Pharmacologic Interventions for Disruptive Behavior in Children and
Adolescents (97 studies) [Vanderbilt EPC]
! 22!
39.!Health Information Exchange Public Project Complete (136 studies) [Pacific Northwest EPC]
40.! Emerging Approaches to Diagnosis and Treatment of Non-Muscle-Invasive Bladder Cancer (199
studies) [Pacific Northwest EPC]
41.!Noninvasive Treatments for Low Back Pain [Entered Retrospectively] (156 studies) [Pacific
Northwest EPC]
42.!Home-Based Primary Care Interventions (20 studies) [Pacific Northwest EPC]
43.!Genetic Testing for Developmental Disabilities, Intellectual Disability, and Autism Spectrum
Disorder (141 studies) [ECRI EPC]
44.! Environmental Cleaning for the Prevention of Healthcare-Associated Infections (70 studies)
[ECRI EPC]
45.! Treatments for Fecal Incontinence (117 studies) [Minnesota EPC]
46.! Improving Cultural Competence to Reduce Health Disparities (86 studies) [Minnesota EPC]
47.! Early Diagnosis, Prevention, and Treatment of C. difficile: Update (112 studies) [Minnesota
EPC]
48.!Management of Insomnia Disorder (139 studies) [Minnesota EPC]
! 23!
C.3.b SRDR projects
Figure 8. Cumulative number of projects initiated in SRDR by month from June 2012 to November 2015
(Total number of projects = 391; Data Source: SRDR site via MySQL queries)
Figure 9. Cumulative number of projects published in SRDR by month from June 2012 to November
2015
0
50
100
150
200
250
300
350
400
Cumulative#Num
ber#of#SRD
R#Projects
0
5
10
15
20
25
30
35
40
45
50
Cumulative#Num
ber#of##Published#
Projects
(Total number of published projects = 48; Data Source: SRDR site via MySQL queries)
! 24!
Table 4. Characteristics of SRDR projects˜ currently in SRDR as of November 2015
Category N (%) Range Additional Information
Total number of projects 321 (100%) - 8 projects in average were initiated
per month since June 24th 2012
Total number of studies for all projects 45881 0-19815 - Average of 143 studies per project
when number of projects = 321ˆ
- Average of 51 studies per project
when number of projects = 313˘
Projects with number of studies = 0* 78 (24%) - -
Projects with number of studies = 1* 37 (12%) - -
Projects with number of studies >1 206 (64%) 2-19815 -
Projects with number of studies ≥ 10 150 (47%) 10-19815 -
Projects with number of studies ≥ 30 109 (34%) 30-19815 -
Projects with number of studies ≥ 100 50 (16%) 102-19815 -
Projects with number of studies ≥ 500 15 (5%) 515-19815
Number of extraction form template(s) 411 0-10 Average of 1 extraction form
templates per project
Number of key questions 666 1-13 Average of 2 Key questions per
project
Number of collaborators 998 1-28 Average of 3 collaborator per project
(Data Source: SRDR site via MySQL queries) ˜ Does not include projects that have been published or were created by SRDR staff for testing and demonstration purposes. The status of these projects is tentative as of December 20th 2014. *Projects in SRDR with 0 or 1 study data extractions can indicate one of the following: 1) project is very new and actual data extraction was not started yet; 2) users are just ‘trying out’ the system without an actual project. ˆAll 321 ongoing projects ˘ Only 313 projects were included; the network meta-analysis project with 990 studies, the Perioperative Pregabalin Use Systematic Review and Meta-Analysis with 1501 studies, the Predictive models for Common Cancers project with 930 studies, the Fiber Evidence Map with 918 studies, the InHYPO-DM Systematic Review with 2917 studies, the Alpha Blockade v. Calcium Channel Blockade for Pheochromocytoma Surgery abstract screening project with 1656 studies, the Alpha Blockade v. Calcium Channel Blockade for Pheochromocytoma Surgery full text review project with 1159 studies, and the E-Trials Registry project with 19815 studies were excluded.
See Appendix A.1 for the complete list of projects (321) currently in SRDR. Table 4 data was generated
based on this list.
! 25!
Table 5. Characteristics of projects published˜ in SRDR as of November 2015
Category N (%) Range Additional Information
Total number of projects 48 (100%) - 1 project in average was published per
month since the first project was
published on December 30th 2013
Total number of studies for all projects 5595 3-868 Average of 116 studies per project
Projects with number of studies >1 48 (100%) 3-868 -
Projects with number of studies ≥ 10 46 (96%) 12-868 -
Projects with number of studies ≥ 30 40 (83%) 40-868 -
Projects with number of studies ≥ 100 21 (44%) 104-868
Projects with number of studies ≥ 500 1 (2%) 868
Number of extraction form template(s) 119 1-10 Average of 2 extraction form templates
per project
Number of key questions 215 1-15 Average of 4 key questions per project
Number of collaborators 140 1-13 Average of 3 collaborator per project
(Data Source: SRDR site via MySQL queries) ˜ Includes projects that have been published in the SRDR Web site and are available for viewing by the public.
See Appendix A.2 for complete list of all projects (48) published to SRDR. Table 5 data was generated
based on this list.
! 26!
D. Training sessions and training site
D.1. Training site usage
Figure 10. Cumulative number of requests for training accounts* by month from January 2013 to
November 2015
(Total number of users trained = 857; Data Source: SRDR site via MySQL queries)
* It is assumed that users who submitted training requests followed through with completing either the
Full Training or Data Extraction tutorials necessary to become a certified project contributor.
D.2. Remote Training/Certification of Project Contributors
The SRDR Administrator remotely trained and certified prospective SRDR users for project contributor
accounts, either by email or through use of live video webinar. The SRDR Administrator only conducted
live training sessions with the Brown EPC. The following is a breakdown, by month, of the organizations
whose members submitted requests for project contributor accounts and were certified as project
contributors between December 2014 and November 2015.
0
100
200
300
400
500
600
700
800
900
Cumulative#Num
ber#of#Training#
Account#Requests#
! 27!
December 2014
−! Cochrane Eye and Vision Group
−! Department of Opthamology, University of Ionnina (Ionnina, Greece)
−! Johns Hopkins Center for Alternatives to Animal Testing
−! Department of Surgery, Yale University
−! The Institute of Medicine (IOM)
January 2015
−! Rutgers University students taking systematic review course led by Dr. Scott Parrott
−! Department of Reproductive Health Protection, Scientific Center of Family Health and Human
Reproductions (Irkutsk, Russian Federation)
−! University of Washington
−! Taura Barr Lab, Prevention Research Center, West Virginia University
February 2015
−! Johns Hopkins University Bloomberg School of Public Health students taking systematic review
course led by Tianjing Li and Kay Dickersin
−! University of Sao Paulo (Sao Paulo, Brazil)
−! Maria Fareri Children’s Hospital at Westchester Medical Center, New York Medical College
−! Pacific Northwest Evidence-based Practice Center
−! Wayne State University
−! Centre for Neuro Skills
−! University of South Florida
−! Exponent, Inc.
March 2015
−! Cedar Associates
−! Portland Evidence-based Synthesis Program
−! Medical College of Wisconsin
−! RTI-UNC Evidence-based Practice Center
−! Connecticut Children’s Medical Center
−! Oregon State University
April 2015
−! Johns Hopkins Evidence Based Practice Center
! 28!
−! Pacific Northwest Evidence Based Practice Center
May 2015
−! University of Louisville
−! Evidera
−! Medical University of Vienna (Vienna, Austria)
−! Johns Hopkins University School of Medicine
June 2015
−! University of Louisville
−! Evidera
−! Medical University of Vienna (Vienna, Austria)
−! Johns Hopkins University School of Medicine
−! Tufts University Human Nutrition Research Center on Aging
−! Department of Veterans Affairs
July 2015
−! Icahn School of Medicine at Mount Sinai
−! Perelman School of Medicine, University of Pennsylvania
−! University of Cincinnati College of Pharmacy
−! University of Florida
−! University of Bristol (UK)
−! Thomas Jefferson University
−! Ottawa Hospital Research Institute (Canada)
−! ECRI-Penn Evidence Based Practice Center
−! Brown University School of Public Health August 2015
−! London School of Hygiene and Tropical Medicine
−! ECRI-Penn Evidence Based Practice Center
−! Rutgers University
−! Johns Hopkins University School of Medicine
−! University of Cincinnati College of Pharmacy
−! Johns Hopkins Bloomberg School of Public Health
−! International Life Sciences Institute – North America branch
! 29!
−! University of Aberdeen (UK)
−! Cochrane EVG
−! Manipal University (India)
−! Perelman School of Medicine, University of Pennsylvania September 2015
−! Rutgers University
−! RTI-UNC Evidence Based Practice Center
−! St George's, University of London (UK)
−! Tufts University CTSI
−! University of Maryland
−! Ottawa Hospital Research Institute (Canada) October 2015
−! Atlas Research, Inc.
−! University of Exeter Medical School (UK)
−! Analgesic Solutions
−! Ottawa Hospital Research Institute (Canada)
−! Brown Evidence Based Practice Center
−! University of Minnesota Evidence Based Practice Center
−! Nestle, Nutrition R&D; Rutgers University
−! St George's, University of London
−! CDC, Division of Laboratory Systems
−! Tufts Medical Center
November 2015 −! Cecil G. Sheps Center for Health Services Research, University of North Carolina at Chapel Hill
−! University of Dundee (Scotland, UK)
−! University of Massachusetts Medical School
−! Geisinger Health Systems
−! Emory University
−! MTL Consulting
−! Ottawa Hospital Research Institute (Canada)
−! Doctor Evidence
−! Brown Evidence Based Practice Center
! 30!
D.3. Webinar-based Quarterly Training Sessions
Webinar-based Quarterly Training Sessions hosted by the EPC Learning Network and presented by
SRDR Administrators between April 2013 and December 2015.
April 2013
−! Webinar Topic: "Using SRDR to Develop Data Abstraction Forms for Systematic Review of
RCTs and Observational Studies"
−! Presenter: Nira Hadar
July 2013
−! Webinar Topic: “SRDR Tools for Data Extraction and Creating Summary Tables"
−! Presenter: Nira Hadar
November 2013
−! Webinar Topic: "Using SRDR For Systematic Reviews of Diagnostic Tests"
−! Presenter: Nira Hadar
June 2014
−! Webinar Topic: "Entering Data Retrospectively into SRDR"
−! Presenter: Bryant Smith
September 2014
−! Webinar Topic: "SRDR Data Import Tool: A Tool to Import Data Retrospectively into SRDR"
−! Presenter: Bryant Smith
December 2014
−! Webinar Topic: "SRDR Best Practices: Improving the efficiency, effectiveness, and consistency of
data entry "
−! Presenter: Bryant Smith
June 2015
−! Webinar Topic: "Publishing projects and reusing data and forms in SRDR”
−! Presenter: Bryant Smith
December 2015
−! Webinar Topic: "Forum to improve your experience entering data into SRDR”
−! Presenter: Bryant Smith
! 31!
D.4. Conference Sessions / Workshops presented by SRDR staff
October 2015
−! 2015 AHRQ Research Conference Session: "Tools and Resources for Evidence Synthesis”
−! Presenter: Ethan Balk
! 32!
E. SRDR usage by Evidence Based Practice Centers
During the past year, we prioritized providing training and technical support to current EPCs,
then to major organizations that conduct Systematic Reviews (e.g., Cochrane and researchers based in
academic institutions), before responding to other requests. Since the launch of SRDR in June 2012 and
including the last 12 months of the current contract period, we have provided training to 11 of the 13
EPCs that were funded by AHRQ between December 2013 and December 2014. Table 5 summarizes the
training and Table 6 summarizes the usage status for all EPCs during this time:
Table 6. Certified User Training Status of EPCs funded by AHRQ between December 2014 -2015
EPC Certified Users Training Status Contact Person
Brown University EPC members who requested project contributor accounts were certified
Thomas Trikalinos
Duke University EPC members who requested project contributor accounts were certified
Gillian Schmidler
ECRI Institute-Penn Medicine
EPC members who requested project contributor accounts were certified
Karen Schoelles/Craig Umscheid
Johns Hopkins University
EPC members who requested project contributor accounts were certified
Karen Robinson / Eric B. Bass
Kaiser Permanents Research Affiliates
EPC members who requested project contributor accounts were certified
Jennifer Lin
Mayo Clinic No EPC members have been certified
M. Hassan Murad
Minnesota EPC EPC members who requested project contributor accounts were certified
Mary Butler
Pacific Northwest EPC-Oregon Health & Science University
EPC members who requested project contributor accounts were certified
Elaine Graham
RTI-UNC EPC EPC members who requested project contributor accounts were certified
Nancy Berkman
Southern California EPC-RAND
EPC members who requested project contributor accounts were certified
Aneesa Motala
University of Alberta EPC members who requested project contributor accounts were certified
Jennifer Pillay
University of Connecticut
No EPC members have been certified
Charles White / Craig Coleman
Vanderbilt University EPC members who requested project contributor accounts were certified
Nila Sathe
! 33!
Table 7. EPC-IV systematic review and technical briefs due for submission on or before March 2015 and
their status in SRDR as of November 2015
Report Title AHRQ
Project ID
Final Report
Due Date
EPC Report
Type
In
SRDR?
Published
in SRDR?
Treatments for Ankyloglossia and Ankyloglossia with Concomitant Lip-tie
VBE4500SR
12/10/14
Vanderbilt Systematic Review
Yes Yes
Early Intensive Intervention for
Children with Autism Spectrum
Disorder: A Systematic Review
Update
VBE4200SRU
4/21/14 Vanderbilt Systematic
Review
Yes No
Behavioral Interventions for
anxiety, depression, and agitation
in dementia
MNE4SR3
TBD Minnesota Systematic
Review
Yes No
Behavioral Health Programs for
Diabetes
ABE4200SR 3/10/15 Alberta Systematic
Review
Yes Yes
Treatment of Non-Metastatic
Muscle-Invasive Bladder Cancer
ORE4700SR
1/9/15 Oregon Systematic
Review
Yes Yes
Congestive Heart Failure
Readmissions
RTE4SR2
2/19/14 RTI Systematic
Review
No NA
Core Needle vs Open Bx for Breast
Lesion Update
BWNE4SRU1
2/7/14 Brown Systematic
Review
Yes No
Decision Aid for Advance Care
Planning
MNE4300 2/14/14 Minnesota Technical
Brief
No NA
Decision Aids for Cancer
Screening and Treatment
BWNE4500SR 4/21/14 Brown Systematic
Review
Yes Yes
Diagnosis of Acute Appendicitis BWNE4400SR 7/21/14 Brown Systematic
Review
No No
Imaging Techniques for the
Diagnosis and Staging of
Hepatocellular Carcinoma
ORE4SR1 2/6/14 Oregon Systematic
Review
Yes Yes
Imaging Staging for Colorectal
Cancer
ECE4SR3 12/9/13 ECRI Systematic
Review
No No
Imaging Techniques for Metastatic
Breast Cancer
ORE4500 2/14/14 Oregon Technical
Brief
No No
! 34!
Update of Comparative
Effectiveness of Lipid-Modifying
Agents
JHE4SRU1 9/27/13 JHU Systematic
Review
Yes No
Long-Term Opioid Treatment of
Chronic Pain
ORE4300SR
9/19/14 Oregon Systematic
Review
Yes No
Low Back Pain Treatment MNE4SR4
TBD Minnesota Systematic
Review
No No
Oral Mechanical Bowel
Preparation for Colorectal Surgery
BWNE4SR1 9/27/13 Brown Systematic
Review
Yes No
Medication Management Therapy RTE4SR3 2/25/14 RTI Systematic
Review
No No
Myalgic
Encephalomyelitis/Chronic Fatigue
Syndrome (ME/CFS)
ORE4400SR
10/3/14 Oregon Systematic
Review
No No
Imaging Tests for the Diagnosis
and Staging of Pancreatic
Adenocarcinoma
ECE4SR1 2/27/14 ECRI Systematic
Review
Yes Yes
Pharmacokinetic /
Pharmacodynamic Measures for
Guiding Antibiotic Treatment for
Nosocomial Pneumonia
RTE4SR1 2/11/14 RTI Systematic
Review
No No
Prevention of Contrast Induced
Nephropathy
JHE4300SR
7/21/14 JHU Systematic
Review
Yes No
Prostate Cancer Update ECE4SR2 11/6/13 ECRI Systematic
Review
No No
Radiotherapy Treatments for Head
and Neck Cancer Update
BCE41SR 2/18/14 BCBSA Systematic
Review
Yes No
Reducing Inappropriate Antibiotic
Use in Acute Cough Illness
ORE4800SR 12/10/14 Oregon Systematic
Review
Yes Yes
Benefits and Harms of Routine
Preoperative Testing: Comparative
Effectiveness Review 2013
BWNE4SR2 10/11/13 Brown Systematic
Review
Yes Yes
Survivorship Care RTE4TB1 10/11/13 RTI Technical
Brief
No No
Testing for Celiac Disease RDE4400SR
12/10/14 RAND Systematic
Review
No No
! 35!
Transitions of Care for Children
with Special Health Needs
VBE4300 2/14/14 Vanderbilt Technical
Brief
No No
Treatment for ETOH Misuse
(Pharmacotherapy for Adults With
Alcohol-Use Disorders in
Outpatient Settings)
RTE4SR4 1/14/14 RTI Systematic
Review
No No
Treatment of MS MNE4SR1
TBD Minnesota Systematic
Review
No No
Troponin Cardiac Marker JHE4SR1 12/13/13 JHU Systematic
Review
Yes No
Chronic Urinary Retention (CUR)
treatment
MNE4SR2 11/13/13 MN Systematic
Review
Yes No
Vitamin D and Calcium: A
Systematic Review of Health
Outcomes (Update)
RDE4SR1 2/18/14 RAND Systematic
Review
Yes No
!
Appendix A
! A#1!
Appendix A.1. Complete list of unpublished projects (321) currently in SRDR as of November 2015 Please Note: This table is available upon request. Included in this table, however, are notable outlier projects that were either created as a way to test the system or were created for purposes other than data extraction, such as data screening or using SRDR as a registry of sorts.
! A#2!
Appendix A.2. Complete list of published projects (48) currently in SRDR as of November 2015
Please Note: The number of collaborators recorded in SRDR for each published project may not accurately reflect the number of contributors who
authored the report. This is because the number of collaborators in a given project, as recorded in SRDR, equals the number of SRDR user
accounts that retain access to edit the project on the SRDR Web site.
Project Title Created Date
Published Date
Name of Organization No. of Collaborators
No. of Extraction Forms
No. of Key Questions
No. of Studies
Therapeutic Management, Delivery, and Postpartum Risk Assessment and Screening in Gestational Diabetes
6/18/13 12/30/13 Johns Hopkins University Evidence Based Practice Center
1 3 3 43
Therapies for Children with Autism Spectrum Disorders
8/2/13 12/30/13 Vanderbilt Evidence Based Practice Center
1 2 2 170
Off-Label Use of Atypical Antipsychotics: An Update
8/18/13 12/30/13 Tufts Evidence Based Practice Center
1 1 4 129
Treatment of Common Hip Fractures
9/20/13 12/30/13 Minnesota Evidence Based Practice Center
1 2 8 85
First- and Second- Generation Antipsychotics for Children and Young Adults
12/2/13 12/30/13 University of Alberta Evidence Based Practice Center
1 1 4 81
Blood Pressure Targets in CKD
7/2/12 12/30/13 Tufts Evidence Based Practice Center
3 1 2 3
Sugars and Health - Evidence Map
7/9/13 1/15/14 International Life Sciences Institute
6 2 2 213
Imaging Techniques for Treatment Evaluation for Metastatic Breast Cancer
6/4/14 6/27/14 Pacific Northwest Evidence Based Practice Center
3 1 1 17
Second-Generation Antidepressants in the Pharmacologic Treatment of Adult Depression: An update of the 2007 Comparative Effectiveness Review
7/1/14 7/30/14 RTI-UNC Evidence Based Practice Center
1 2 2 221
! A#3!
Treatment To Prevent Fractures in Men and Women With Low Bone Density or Osteoporosis: Update of a 2007 Report
8/5/14 8/8/14 Southern California Evidence Based Practice Center-RAND Corporation
1 5 5 182
Treatment of Primary and Secondary Osteoarthritis of the Knee
7/25/14 8/14/14 Blue Cross and Blue Shield Association Technology Evidence Based Practice Center
1 5 5 77
The lack of evidence for PET or PET/CT surveillance of patients with treated lymphoma, colorectal cancer, and head and neck cancer
10/25/12 9/5/14 Brown Evidence Based Practice Center
5 1 2 12
Fructose Consumption and Non-alcoholic Fatty Liver Disease (NAFLD)
2/1/13 9/5/14 International Life Sciences Institute
4 4 5 23
Benefits and Harms of Routine Preoperative Testing: Comparative Effectiveness Review 2013
3/14/13 9/5/14 Tufts Evidence Based Practice Center
7 4 4 220
Decision Aids for Cancer Screening and Treatment
7/25/13 9/5/14 Cochrane Complementary and Alternative Medicine Field
6 2 2 74
Imaging Tests for the Diagnosis and Staging of Pancreatic Adenocarcinoma
7/2/14 9/16/14 ECRI Institute-Penn Medicine Evidence Based Practice Center
2 5 6 121
Diet and PA for Prevention of Diabetes-Full Data Extraction
2/12/13 9/25/14 Tufts Evidence Based Practice Center
8 1 1 50
Venous Thromboembolism Prophylaxis in Orthopedic Surgery
11/5/14 11/14/14 University of Connecticut-Hartford Hospital Evidence Based Practice Center
1 8 8 149
Effectiveness of Early Diagnosis, Prevention, and Treatment of Clostridium difficile Infection
9/17/14 12/12/14 Minnesota Evidence Based Practice Center
2 10 10 112
Oral Diabetes Medications for Adults With Type 2 Diabetes: An Update
12/9/14 12/12/14 Johns Hopkins University Evidence Based Practice Center
1 4 4 176
! A#4!
Treatments for Ankyloglossia and Ankyloglossia with Concomitant Lip-tie
10/20/14 1/26/15 Vanderbilt Evidence Based Practice Center
4 2 6 43
Procedures for Managing Postpartum Hemorrhage: A Systematic Review
12/31/14 2/9/15 Vanderbilt Evidence Based Practice Center
1 2 5 73
Low-calorie sweeteners and body weight and composition: a meta-analysis of randomized controlled trials and prospective cohort studies
3/19/15 3/19/15 Exponent, Inc. 1 2 2 24
Psychosocial and Pharmacologic Interventions for Disruptive Behavior in Children and Adolescents
4/9/15 4/13/15 Vanderbilt Evidence Based Practice Center
1 1 2 97
Pain Management Injection Therapies for Low-back Pain
3/27/15 4/21/15 Pacific Northwest Evidence Based Practice Center
2 1 7 92
Dietary Fiber Database, Version 1
4/27/15 4/28/15 International Life Sciences Institute
1 1 1 868
Treatments for Fibromyalgia in Adult Subgroups
2/12/15 5/1/15 Minnesota Evidence Based Practice Center
1 8 12 75
Interventions to Reduce Antibiotic Prescribing for Uncomplicated Acute Respiratory Tract Infections
6/18/14 5/5/15 Pacific Northwest Evidence Based Practice Center
1 1 6 133
Catheter Ablation for Treatment of Atrial Fibrillation
4/22/14 5/19/15 Pacific Northwest Evidence Based Practice Center
10 2 7 50
Health Information Exchange 4/24/15 5/20/15 Pacific Northwest Evidence Based Practice Center
2 1 8 136
Treatment of Non-Metastatic Muscle-Invasive Bladder Cancer
3/27/15 6/10/15 Pacific Northwest Evidence Based Practice Center
2 1 4 40
Emerging Approaches to Diagnosis and Treatment of Non-Muscle-Invasive Bladder Cancer
5/18/15 6/10/15 Pacific Northwest Evidence Based Practice Center
2 1 8 199
! A#5!
Management and Outcomes of Binge-Eating Disorder (BED)
1/8/15 6/30/15 RTI-UNC Evidence Based Practice Center
1 3 15 84
Management Strategies to Reduce Psychiatric Readmissions: Technical Brief
2/26/15 7/10/15 RTI-UNC Evidence Based Practice Center
2 4 4 72
Imaging for the Pretreatment Staging of Small Cell Lung Cancer
6/27/14 7/24/15 ECRI Institute-Penn Medicine Evidence Based Practice Center
2 1 3 7
Strategies to Improve Mental Health Care for Children and Adolescents
3/11/15 7/24/15 RTI-UNC Evidence Based Practice Center
6 1 3 16
Home-Based Primary Care Interventions
7/29/15 9/4/15 Pacific Northwest Evidence Based Practice Center
2 1 3 20
Imaging Techniques for the Diagnosis and Staging of Hepatocellular Carcinoma
6/26/14 9/5/15 Pacific Northwest Evidence Based Practice Center
5 9 9 281
Genetic Testing for Developmental Disabilities, Intellectual Disability, and Autism Spectrum Disorder
7/31/15 9/9/15 ECRI Institute-Penn Medicine Evidence Based Practice Center
1 1 2 141
Behavioral programs for diabetes mellitus
1/29/14 9/21/15 University of Alberta Evidence Based Practice Center
5 2 6 166
Sling surgery for stress urinary incontinence in women: SGS 2013
2/5/13 9/30/15 Society of Gynecologic Surgeons
13 2 2 104
Environmental Cleaning for the Prevention of Healthcare-Associated Infections
9/22/15 10/5/15 ECRI Institute-Penn Medicine Evidence Based Practice Center
1 2 4 70
Treatments for Fecal Incontinence
10/15/15 10/27/15 Minnesota Evidence Based Practice Center
1 1 2 117
SGS: Local Estrogen For Genitourinary Complaints in Post-Menopausal Women
7/25/13 10/28/15 Society of Gynecologic Surgeons
12 1 1 56
Noninvasive Treatments for Low Back Pain
7/23/15 11/10/15 Pacific Northwest Evidence Based Practice Center
2 1 2 156
Management of Insomnia Disorder
10/27/15 11/18/15 Minnesota Evidence Based Practice Center
1 1 2 139
! A#6!
Improving Cultural Competence to Reduce Health Disparities
10/27/15 11/18/15 Minnesota Evidence Based Practice Center
1 1 5 86
Early Diagnosis, Prevention, and Treatment of C. difficile: Update
10/27/15 11/18/15 Minnesota Evidence Based Practice Center
1 1 4 92