evaluating fetal death in nyc: how do reporting challenges affect the data? 2014 naphsis annual...
TRANSCRIPT
![Page 1: Evaluating Fetal Death in NYC: How do Reporting Challenges Affect the Data? 2014 NAPHSIS Annual Meeting June 9, 2014 Ann Madsen, PhD, MPH Director, Office](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c935503460f9494eb65/html5/thumbnails/1.jpg)
Evaluating Fetal Death in NYC: How do Reporting Challenges Affect the Data?
2014 NAPHSIS Annual MeetingJune 9, 2014
Ann Madsen, PhD, MPHDirector, Office of Vital Statistics
Bureau of Vital StatisticsNew York City Department of Health and Mental Hygiene
![Page 2: Evaluating Fetal Death in NYC: How do Reporting Challenges Affect the Data? 2014 NAPHSIS Annual Meeting June 9, 2014 Ann Madsen, PhD, MPH Director, Office](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c935503460f9494eb65/html5/thumbnails/2.jpg)
Evaluating Fetal Death in NYC: How do Reporting Challenges Affect the Data?
Research by:Amita Toprani, MD, MPH
(former EIS officer)and
Erica Lee, MPH (former NYC Epi Scholar, current OVS staff)
![Page 3: Evaluating Fetal Death in NYC: How do Reporting Challenges Affect the Data? 2014 NAPHSIS Annual Meeting June 9, 2014 Ann Madsen, PhD, MPH Director, Office](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c935503460f9494eb65/html5/thumbnails/3.jpg)
Overview
• Fetal deaths in NYC
• Perinatal mortality
• Fetal death quality vs. neonatal deaths
• Impact of provider attitudes and knowledge on data quality
• Conclusions/Next Steps
![Page 4: Evaluating Fetal Death in NYC: How do Reporting Challenges Affect the Data? 2014 NAPHSIS Annual Meeting June 9, 2014 Ann Madsen, PhD, MPH Director, Office](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c935503460f9494eb65/html5/thumbnails/4.jpg)
NYC Fetal Deaths 2011Attribute
Total fetal deaths 14 947
# of reporting facilities 52
% reported electronically >99%
Gestational age <13 weeks 13-19 weeks 20-27 weeks ≥ 28 weeks
81%12%5%2%
93%
![Page 5: Evaluating Fetal Death in NYC: How do Reporting Challenges Affect the Data? 2014 NAPHSIS Annual Meeting June 9, 2014 Ann Madsen, PhD, MPH Director, Office](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c935503460f9494eb65/html5/thumbnails/5.jpg)
Perinatal Mortality
Perinatal continuum
Neonatal deaths
Perinatal deaths
BIRTH1st trimester
28 days2nd
trimester3rd
trimesterConception
Third-trimester
fetal deaths
28 weeks
![Page 6: Evaluating Fetal Death in NYC: How do Reporting Challenges Affect the Data? 2014 NAPHSIS Annual Meeting June 9, 2014 Ann Madsen, PhD, MPH Director, Office](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c935503460f9494eb65/html5/thumbnails/6.jpg)
Perinatal mortality
• Third-trimester fetal deaths :– 28% of US perinatal deaths– 25% of NYC perinatal deaths
• Close in time along the perinatal continuum – Causes and preventative targets likely very similar– Research/programming gap between fetal and neonatal deaths
• Both captured through vital events registration
![Page 7: Evaluating Fetal Death in NYC: How do Reporting Challenges Affect the Data? 2014 NAPHSIS Annual Meeting June 9, 2014 Ann Madsen, PhD, MPH Director, Office](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c935503460f9494eb65/html5/thumbnails/7.jpg)
Compared third trimester fetal deaths (n=1930) and neonatal deaths (n=735)• Missing/unknown • Ill-defined causes of death• Pre/post 2011 data completeness• Completeness by reporting facility (FD only)
![Page 8: Evaluating Fetal Death in NYC: How do Reporting Challenges Affect the Data? 2014 NAPHSIS Annual Meeting June 9, 2014 Ann Madsen, PhD, MPH Director, Office](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c935503460f9494eb65/html5/thumbnails/8.jpg)
Selected Results: ill-defined causes of death
• NYCNeonatal 5%Fetal 67%
Literal COD (fetal deaths)• Intrauterine fetal demise • Unknown• Stillbirth/ Stillborn
75%
![Page 9: Evaluating Fetal Death in NYC: How do Reporting Challenges Affect the Data? 2014 NAPHSIS Annual Meeting June 9, 2014 Ann Madsen, PhD, MPH Director, Office](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c935503460f9494eb65/html5/thumbnails/9.jpg)
Selected Results: data completeness
• NYC late-term fetal death certificates lack maternal and pregnancy information compared with neonatal records
• Implementation of electronic reporting system/revised certificate impacted data completeness
• Variability by hospital suggests opportunities for improvement exist
![Page 10: Evaluating Fetal Death in NYC: How do Reporting Challenges Affect the Data? 2014 NAPHSIS Annual Meeting June 9, 2014 Ann Madsen, PhD, MPH Director, Office](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c935503460f9494eb65/html5/thumbnails/10.jpg)
Research Question
What are the causes of deficient data at fetal death reporting facilities?
![Page 11: Evaluating Fetal Death in NYC: How do Reporting Challenges Affect the Data? 2014 NAPHSIS Annual Meeting June 9, 2014 Ann Madsen, PhD, MPH Director, Office](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c935503460f9494eb65/html5/thumbnails/11.jpg)
MethodsSurvey
• One respondent with primary responsibility for fetal death reporting at each of 50 NYC reporting facilities in 2011
• 17 content questions regarding fetal death reporting– Knowledge
– Attitudes
– Practices
– Barriers
• 2 researchers independently categorized open-ended questions into themes
![Page 12: Evaluating Fetal Death in NYC: How do Reporting Challenges Affect the Data? 2014 NAPHSIS Annual Meeting June 9, 2014 Ann Madsen, PhD, MPH Director, Office](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c935503460f9494eb65/html5/thumbnails/12.jpg)
MethodsAssociation between survey responses and 2011 STOP data quality indicators at each facility• Data completeness: Maternal risk factor; Date of last normal
menses; Date of first prenatal care visit; Fetal weight
• Ill-defined causes of fetal death
• Unspecified cause (P95)
• Prematurity (P07.2, P07.3)
![Page 13: Evaluating Fetal Death in NYC: How do Reporting Challenges Affect the Data? 2014 NAPHSIS Annual Meeting June 9, 2014 Ann Madsen, PhD, MPH Director, Office](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c935503460f9494eb65/html5/thumbnails/13.jpg)
SELECTED RESULTS
![Page 14: Evaluating Fetal Death in NYC: How do Reporting Challenges Affect the Data? 2014 NAPHSIS Annual Meeting June 9, 2014 Ann Madsen, PhD, MPH Director, Office](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c935503460f9494eb65/html5/thumbnails/14.jpg)
Respondent CharacteristicsFinal response rate: 78% (n=39), reporting 84% of all 2011 fetal deaths
• Facilities– 36 hospitals (92%)– 2 private physician offices/clinics (5%)– 1 birthing center (3%)
• Respondents– 23 administrative staff (59%)– 11 birth registrars (28%)– 3 nurses (8%)– 2 midwives (5%)
![Page 15: Evaluating Fetal Death in NYC: How do Reporting Challenges Affect the Data? 2014 NAPHSIS Annual Meeting June 9, 2014 Ann Madsen, PhD, MPH Director, Office](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c935503460f9494eb65/html5/thumbnails/15.jpg)
Reporting Requirements and Data Use
• 32 (82%) understood NYC requires reporting for all gestational ages
• 34 (87%) considered STOP reporting ‘very important’
• 20 (51%) knew how STOP data are used
![Page 16: Evaluating Fetal Death in NYC: How do Reporting Challenges Affect the Data? 2014 NAPHSIS Annual Meeting June 9, 2014 Ann Madsen, PhD, MPH Director, Office](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c935503460f9494eb65/html5/thumbnails/16.jpg)
Variation in Reporting Practices
• Median time to register a STOP: 15min (0-45 min)
• Median staff involved : 4 persons (0-40 persons)
• 12 (31%) use the STOP worksheet for >50% of cases• 23 (59%) use it for <25% of cases
![Page 17: Evaluating Fetal Death in NYC: How do Reporting Challenges Affect the Data? 2014 NAPHSIS Annual Meeting June 9, 2014 Ann Madsen, PhD, MPH Director, Office](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c935503460f9494eb65/html5/thumbnails/17.jpg)
Revision and Electronic Reporting
Transition to Electronic Reporting (EVERS)
• 21 (55%) considered electronic reporting easier
• 17 (45%) thought EVERS reduced the time to reporto 12 (32%) thought it increased reporting time
oReported longer filing times on average (21min vs. 14min, p=0.051)
Revised Cause of Death Section• 15 (38%) thought revision was similarly clear
o 9 (24%) thought revision was clearer and easier to understand
![Page 18: Evaluating Fetal Death in NYC: How do Reporting Challenges Affect the Data? 2014 NAPHSIS Annual Meeting June 9, 2014 Ann Madsen, PhD, MPH Director, Office](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c935503460f9494eb65/html5/thumbnails/18.jpg)
• 6 (15%) reported “no substantial barriers”
• 11 (28%) reported physician’s time and attention
• 9 (23%) reported onerous length and detail
• 8 (21%) reported time required
Reported Barriers
![Page 19: Evaluating Fetal Death in NYC: How do Reporting Challenges Affect the Data? 2014 NAPHSIS Annual Meeting June 9, 2014 Ann Madsen, PhD, MPH Director, Office](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c935503460f9494eb65/html5/thumbnails/19.jpg)
Data Quality Linkage – Registrations with Missing Information
Reported barriers vs. “no substantial barriers”• 37.5% versus 7.9% RR: 4.7 95% CI: 1.6–14.2
Said form was too long/detailed vs. did not mention that barrier• 46.4% versus 30.5% RR: 1.5 95% CI: 1.1–2.1
Considered STOP reporting ‘very important‘ vs. ‘somewhat important’• 30.4% versus 58.1% RR: 0.52 95% CI: 0.38–0.71
![Page 20: Evaluating Fetal Death in NYC: How do Reporting Challenges Affect the Data? 2014 NAPHSIS Annual Meeting June 9, 2014 Ann Madsen, PhD, MPH Director, Office](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c935503460f9494eb65/html5/thumbnails/20.jpg)
Data Quality Linkage – Ill-Defined Cause of Fetal Death
Reported difficulty accessing physicians to complete Cause of Death section and certify registrations vs. those who did not• 70.9% versus 56.6% RR: 1.3 95% CI: 1.1–1.5
Reported that revised Cause of Death section was clearer and easier to understand vs. those who did not• 48.0% versus 65.7% RR: 0.73 95% CI: 0.57–0.94
![Page 21: Evaluating Fetal Death in NYC: How do Reporting Challenges Affect the Data? 2014 NAPHSIS Annual Meeting June 9, 2014 Ann Madsen, PhD, MPH Director, Office](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c935503460f9494eb65/html5/thumbnails/21.jpg)
Lessons Learned – Mitigating Barriers
• Reduce certificate length– Focus on high quality items actively used for research or
surveillance
– Minimize information required for early fetal deaths in NYC (<20wks)
• Facilitate data collection– Mandate worksheet use
– Linkage between EMR’s and electronic vital events systems
– Integrate STOP reporting into physician workflow
![Page 22: Evaluating Fetal Death in NYC: How do Reporting Challenges Affect the Data? 2014 NAPHSIS Annual Meeting June 9, 2014 Ann Madsen, PhD, MPH Director, Office](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c935503460f9494eb65/html5/thumbnails/22.jpg)
85% of respondents requested some sort of training
• Reporting requirements– Difference between elective abortion, fetal death, live birth,
and when to report each event
• Importance and use of fetal death data– Perceived importance was linked to better data quality
• Physician training – Role in reporting as best source of data
– How to correctly complete the revised cause of death section
Lessons Learned – Mitigating Barriers
![Page 23: Evaluating Fetal Death in NYC: How do Reporting Challenges Affect the Data? 2014 NAPHSIS Annual Meeting June 9, 2014 Ann Madsen, PhD, MPH Director, Office](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c935503460f9494eb65/html5/thumbnails/23.jpg)
Limitations
• Respondent may not be primarily responsible for fetal death reporting
• Socially desirable responses
• Restriction to NYC facilities– Reporting requirements
– Electronic reporting system
![Page 24: Evaluating Fetal Death in NYC: How do Reporting Challenges Affect the Data? 2014 NAPHSIS Annual Meeting June 9, 2014 Ann Madsen, PhD, MPH Director, Office](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c935503460f9494eb65/html5/thumbnails/24.jpg)
Conclusions
• EIS/Interns are valuable asset for this kind of research
And,• Users are another important resource and
apparently willing to help system improveBut,• Operationalizing improvements is daily work that
must be prioritized accordingly
![Page 25: Evaluating Fetal Death in NYC: How do Reporting Challenges Affect the Data? 2014 NAPHSIS Annual Meeting June 9, 2014 Ann Madsen, PhD, MPH Director, Office](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c935503460f9494eb65/html5/thumbnails/25.jpg)
“This is a stressful burden on an overworked system. No additional money has been allocated to dedicate more time to this
Required filling [sic].”
![Page 26: Evaluating Fetal Death in NYC: How do Reporting Challenges Affect the Data? 2014 NAPHSIS Annual Meeting June 9, 2014 Ann Madsen, PhD, MPH Director, Office](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c935503460f9494eb65/html5/thumbnails/26.jpg)
Acknowledgements
• NYC DOHMH Bureau of Vital Statistics– Erica Lee, MPH – Melissa Gambatese, MPH– Amita Toprani, MD, MPH– Elizabeth Begier, MD, MPH– Richard Genovese
• NAPHSIS• NCHS
![Page 27: Evaluating Fetal Death in NYC: How do Reporting Challenges Affect the Data? 2014 NAPHSIS Annual Meeting June 9, 2014 Ann Madsen, PhD, MPH Director, Office](https://reader030.vdocuments.net/reader030/viewer/2022032517/56649c935503460f9494eb65/html5/thumbnails/27.jpg)
Questions?