5th Biennial National IDeA Symposium of Biomedical Research Excellence _______________________________________________

June 16-18, 2014 Omni Shoreham Hotel

Washington DC Tim Hunter Director, Advanced Genome Technologies Core University of Vermont

Tracking Core Impact Metrics: The ABC’s of Reporting

Advanced Genome Technologies Core

Tim Hunter, Director VCC DNA Analysis Facility Services: •Sanger DNA Sequencing: •Fragment Analysis: –Genotyping, AFLP, T-RFLP, SNaPshot SNP detection •Real-time qPCR: –Gene expression, Allelic Discrimination, PCR Arrays. •Nucleic Acid extractions • Methylation detection •Molecular Imaging: -Phosphorimaging, Fluorescent detection, Fret, DNA and protein stain imaging, Chemiluminescence, Densitometry, and Photo documentation. •BioTek Multi-plate Reader •Experimental design consultation •Troubleshooting •Discounted pricing on reagents •Common Equipment room with

VGN Microarray Facility Services: •Experimental design consultation (jointly with Bioinformatics Group) •Assistance in Nucleic Acid Extractions "LCM, Flow sorted, difficult tissues" •RNA Quality/Quantity assessment •Gene Expression Profiling •DNA Mapping (SNP, LOH, CNV) •Expression profiling using 3', Promoter, Exon and Gene Arrays •Bacterial Identification using PhyloChip(TM) array •Hypothesis testing: gene or pathway-based •Support letters for grant applications; text for publication •Discounted pricing on many consumables and reagents

VCC-COM Massively Parallel Sequencing Facility Services: • Experimental design consultation(jointly with bioinformatics group) • Whole Genome sequencing • mRNA (transcriptome) sequencing • Methylation sequencing • miRNA (ncRNA) sequencing • ChIP sequencing • Metagenomics • Amplicon sequencing • de novo sequencing • Exome sequencing • Targeted capture sequencing • Discounted pricing on many consumables and reagents through core facility negotiations

Core Metrics: Demonstrating Impact

Scientific Community: Are community needs met through easy to access, user-friendly, fully supported services that are delivered appropriately and can meet the changing demands of the technology and clientele that they serve.

Program (Network/Center) Director, Funding Agency, Institute: Determing the impact on research mission through collection of performance/impact metrics, provide upon request (APR, EAC, LCCRO, Institutes, Center). Making a case for strategic spending.

What Core Metrics Should be Collected

to Demonstrate Impact? • Resource Management: budget (surplus/deficit), new personnel, equipment, and new users, delivery of services

• Utilization: growth in user base, use by COBRE, INBRE, BPI

faculty/staff /post docs, graduate, and undergraduate (#INBRE funded, #un-funded, Chargeback applied), # of experimental design consults

• Impact/Outcome: publications by users and grants awarded to

users that included data generated in facility, Letters of Support, historical data.

• Education: involvement in graduate and undergraduate education, development of user workshops, student achievements

• Personnel Successes: Pubs and grants awarded to personnel; promotions,

honors or awards, regional and national initiatives

• Personnel Development: attendance at workshops, technical courses, national meetings; institutional seminar series

• Outreach: open house, pilot testing of new equipment or services,

involvement in K-12 and undergraduate education, student internships

• Communication of Services(Marketing): advertisement, website development and improvements, Regional Open Houses, national meetings

What Metrics Should be Collected?

“Need data on impact of IDeA program”, Jon R. Lorsch,Director, NIGMS-NIH

Mode of Metric Collection: • Scientific Community:

– Assessment tools:

• Annual Customer Survey (Open House)

• User Educational Seminar Series

• Open forums

• Monthly budgeting and Utilization review of services

• Program(Center, Network) Director, Funding agency, Institute/College: – Assessment tools

• Email Solicitation

– Publication acknowledgement

– Grants awarded

• Utilization (billings)

– by group, service, subsidy, % revenue/center/PI/

• Sponsored Projects Admin. Routing form: Facility check

• Core Management Software

Challenges:

– Tracking pubs – Tracking Grants – Core facility acknowledgements – INBRE/COBRE Grant citation

Solutions? -Post citation text on website(pdf) -Consult -Develop Policies for core and grant acknowledgement -Signed Agreement -Email signatures

• Successes:

– Grant award tracking

• Inclusion of Core on OSP grant application

– Grants submitted

– Grants funded

Successes:

Reporting Grants awarded through use of Facility Services

Tracking and Reporting Publications:

Email solicitations Real time collection Pubcrawler/endnote Check pubs for grant and core acknowledgment

Generate three subfolders/categories Acknowledge grant # and core facility Acknowledge grant # or core facility Do not acknowledge grant # or core facility, but clearly used data

generated in core facility

Metric Reporting Format: Uniformity Across Cores!

• APR

– Personnel/efforts

– PI’s/projects/funding agency

– Grants/Pubs

– New equipment/capabalities

– Historical (growing user base)

– Scholarly Activities by staff

– Utilization: #/service

• COBRE

• PI

• External IDeA community

• EAC

– Personnel/efforts

– PI’s/projects/funding agency

– Grants/Pubs

– New equipment/capabalities

– Historical

– Scholarly Activities by staff

– Utilization: #/service

– % revenue by user base/center

• COBRE

• PI

• External IDeA

Reporting Metrics: YTD Customer Base by Revenue (EAC)

Dept/Center Percent use

Immunobiology COBRE 47.52%

Neuroscience COBRE 16.70%

External (MMCRI) 14.11%

Pharmacology 9.80%

OB/Gyn 5.80%

Animal Sciences 4.57%

Molecular Physiology & Biophysics 0.47%

Vermont Cancer Center 0.47%

Plant Biology 0.31%

Medicine 0.08%

Surgery 0.08%

Pathology 0.08%

The VGN Microarray Facility has been supporting 9 projects for the Neuroscience COBRE with 57%( use by revenue) representing one PI who has completed three microarray projects in FY12 YTD. RNA integrity assessment services was accessed by all groups represented.

Ongoing Challenges:

Real time tracking of high impact metrics:

• Database of User Publications

• Database of User Grants/submitted/awarded

– Easier to extract information

AGTC