testing data completeness with dqe -c-v2 - ohdsi€¦ · testing data completeness with dqe -c-v2...
TRANSCRIPT
![Page 1: Testing Data Completeness with DQe -c-v2 - OHDSI€¦ · Testing Data Completeness with DQe -c-v2 OHDSI Symposium 2019: Data Quality Workshop 09/17/19 Tim Bergquist, Graduate Research](https://reader033.vdocuments.net/reader033/viewer/2022050120/5f50b700d69a1a7f45142cc3/html5/thumbnails/1.jpg)
TestingDataCompletenesswithDQe-c-v2OHDSISymposium2019:DataQualityWorkshop
09/17/19
TimBergquist,GraduateResearchAssistantBiomedicalInformatics&MedicalEducation
UniversityofWashington
![Page 2: Testing Data Completeness with DQe -c-v2 - OHDSI€¦ · Testing Data Completeness with DQe -c-v2 OHDSI Symposium 2019: Data Quality Workshop 09/17/19 Tim Bergquist, Graduate Research](https://reader033.vdocuments.net/reader033/viewer/2022050120/5f50b700d69a1a7f45142cc3/html5/thumbnails/2.jpg)
WWAMI region Practice & Research Network
• 60+PrimarycareWWAMIclinics• ~20dataconnectedclinics• CHCsandRHCs• Underservedpopulations• Manyservingruralpopulations• Collaborationwithnational
networkofpracticebasedresearchnetworks
• DataQUESTrepresentsover250,000patientshttps://dataquest.iths.org/
![Page 3: Testing Data Completeness with DQe -c-v2 - OHDSI€¦ · Testing Data Completeness with DQe -c-v2 OHDSI Symposium 2019: Data Quality Workshop 09/17/19 Tim Bergquist, Graduate Research](https://reader033.vdocuments.net/reader033/viewer/2022050120/5f50b700d69a1a7f45142cc3/html5/thumbnails/3.jpg)
DataQUEST• 20data-connectedclinicsintheWPRN• Representsover250,000patients
Anelectronichealthdata-sharingarchitecture
acrosscommunity-basedprimarycarepracticesin
theWPRN
![Page 4: Testing Data Completeness with DQe -c-v2 - OHDSI€¦ · Testing Data Completeness with DQe -c-v2 OHDSI Symposium 2019: Data Quality Workshop 09/17/19 Tim Bergquist, Graduate Research](https://reader033.vdocuments.net/reader033/viewer/2022050120/5f50b700d69a1a7f45142cc3/html5/thumbnails/4.jpg)
MeasuringDataQualityFramework
Completeness • Arethedatapresent?
Conformance • Arethedatastandardizedandformatted?
Plausibility • Arethedatabelievable?
Kahnetal.(2016).Aharmonizeddataqualityassessmentterminologyandframeworkforthesecondaryuseofelectronichealthrecorddata.eGEMS,4,1244.https://www.ncbi.nlm.nih.gov/pubmed/27713905
Operationalizingtheframeworkinto:5conceptualtestsand17discretetestsacross:
![Page 5: Testing Data Completeness with DQe -c-v2 - OHDSI€¦ · Testing Data Completeness with DQe -c-v2 OHDSI Symposium 2019: Data Quality Workshop 09/17/19 Tim Bergquist, Graduate Research](https://reader033.vdocuments.net/reader033/viewer/2022050120/5f50b700d69a1a7f45142cc3/html5/thumbnails/5.jpg)
MeasuringDataQualityFramework
Completeness • Arethedatapresent?
Conformance • Arethedatastandardizedandformatted?
Plausibility • Arethedatabelievable?
Kahnetal.(2016).Aharmonizeddataqualityassessmentterminologyandframeworkforthesecondaryuseofelectronichealthrecorddata.eGEMS,4,1244.https://www.ncbi.nlm.nih.gov/pubmed/27713905
Operationalizingtheframeworkinto:5conceptualtestsand17discretetestsacross:
![Page 6: Testing Data Completeness with DQe -c-v2 - OHDSI€¦ · Testing Data Completeness with DQe -c-v2 OHDSI Symposium 2019: Data Quality Workshop 09/17/19 Tim Bergquist, Graduate Research](https://reader033.vdocuments.net/reader033/viewer/2022050120/5f50b700d69a1a7f45142cc3/html5/thumbnails/6.jpg)
MeasuringDataQualityFramework
Completeness • Arethedatapresent?
Conformance • Arethedatastandardizedandformatted?
Plausibility • Arethedatabelievable?
Kahnetal.(2016).Aharmonizeddataqualityassessmentterminologyandframeworkforthesecondaryuseofelectronichealthrecorddata.eGEMS,4,1244.https://www.ncbi.nlm.nih.gov/pubmed/27713905
Operationalizingtheframeworkinto:5conceptualtestsand17discretetestsacross:
![Page 7: Testing Data Completeness with DQe -c-v2 - OHDSI€¦ · Testing Data Completeness with DQe -c-v2 OHDSI Symposium 2019: Data Quality Workshop 09/17/19 Tim Bergquist, Graduate Research](https://reader033.vdocuments.net/reader033/viewer/2022050120/5f50b700d69a1a7f45142cc3/html5/thumbnails/7.jpg)
DataQualityTestsDQFramework
category TEST
COMPLETENESS Gender,Visit,Observationcompleteness(denominatorandproportionwithvaliddata)
COMPLETENESS Keyclinicalstatuscompleteness(denominatorandproportionwithvaliddata):Smokingstatus,alcoholconsumption
COMPLETENESS Measurementcompleteness(denominatorandproportionwithvaliddata):Height,Weight,SBP,DBP
COMPLETENESS CrossreferencetablesthatarepresentincurrentdatasettoexpectedtablesinstandardOMOPCDM
COMPLETENESS LooksforNULLandinvalidvariablevaluesineachcolumnandvisualizespercentmissingness
CONFORMANCE Checkthatprimaryandforeignkeysrelateproperly;HighPriority:Person_ID,Visit_Occurrence_ID
CONFORMANCE Checksthatorphandon'tkeysexist(aforeignkeyispresentinatablebutnoprimarykeyexistsinthereferencetable)
PLAUSIBILITY Comparisonofnewloadtooldload(Numberofobservations,Numberofuniquepatients,Numberoftableswithrows)
PLAUSIBILITY SizeoftablesandrowsacrosstheOMOPCDM
![Page 8: Testing Data Completeness with DQe -c-v2 - OHDSI€¦ · Testing Data Completeness with DQe -c-v2 OHDSI Symposium 2019: Data Quality Workshop 09/17/19 Tim Bergquist, Graduate Research](https://reader033.vdocuments.net/reader033/viewer/2022050120/5f50b700d69a1a7f45142cc3/html5/thumbnails/8.jpg)
OriginalDQe-cToolModulartooldevelopedinRforassessingcompleteness inEHRdatarepositories.Customizationandconfigurationwasdifficult
HardtoaddnewmodulesDifficulttoaddnewCDMs(ornewversionsofCDMs)
![Page 9: Testing Data Completeness with DQe -c-v2 - OHDSI€¦ · Testing Data Completeness with DQe -c-v2 OHDSI Symposium 2019: Data Quality Workshop 09/17/19 Tim Bergquist, Graduate Research](https://reader033.vdocuments.net/reader033/viewer/2022050120/5f50b700d69a1a7f45142cc3/html5/thumbnails/9.jpg)
DQe-c-v2ToolModulartooldevelopedinpythonforassessingcompleteness inEHRdatarepositories.
![Page 10: Testing Data Completeness with DQe -c-v2 - OHDSI€¦ · Testing Data Completeness with DQe -c-v2 OHDSI Symposium 2019: Data Quality Workshop 09/17/19 Tim Bergquist, Graduate Research](https://reader033.vdocuments.net/reader033/viewer/2022050120/5f50b700d69a1a7f45142cc3/html5/thumbnails/10.jpg)
Takesinthedatabasecredentials,CDMversion,andconfigurations.
DQe-c-v2Tool
![Page 11: Testing Data Completeness with DQe -c-v2 - OHDSI€¦ · Testing Data Completeness with DQe -c-v2 OHDSI Symposium 2019: Data Quality Workshop 09/17/19 Tim Bergquist, Graduate Research](https://reader033.vdocuments.net/reader033/viewer/2022050120/5f50b700d69a1a7f45142cc3/html5/thumbnails/11.jpg)
Takesinthedatabasecredentials,CDMversion,andconfigurations.
DQe-c-v2Tool
Simplyenteryourcredentialsandconfigurationsintotheconfig.json file.
![Page 12: Testing Data Completeness with DQe -c-v2 - OHDSI€¦ · Testing Data Completeness with DQe -c-v2 OHDSI Symposium 2019: Data Quality Workshop 09/17/19 Tim Bergquist, Graduate Research](https://reader033.vdocuments.net/reader033/viewer/2022050120/5f50b700d69a1a7f45142cc3/html5/thumbnails/12.jpg)
Takesinthedatabasecredentials,CDMversion,andconfigurations.
DQe-c-v2Tool
Simplyenteryourcredentialsandconfigurationsintotheconfig.json file.
Run:pythonDQe-c.py –c/path/to/config.json
![Page 13: Testing Data Completeness with DQe -c-v2 - OHDSI€¦ · Testing Data Completeness with DQe -c-v2 OHDSI Symposium 2019: Data Quality Workshop 09/17/19 Tim Bergquist, Graduate Research](https://reader033.vdocuments.net/reader033/viewer/2022050120/5f50b700d69a1a7f45142cc3/html5/thumbnails/13.jpg)
DQe-c-v2ToolSetsupthedatabaseconnection,managesreportoutput,andinitiatestheCDMfiles
![Page 14: Testing Data Completeness with DQe -c-v2 - OHDSI€¦ · Testing Data Completeness with DQe -c-v2 OHDSI Symposium 2019: Data Quality Workshop 09/17/19 Tim Bergquist, Graduate Research](https://reader033.vdocuments.net/reader033/viewer/2022050120/5f50b700d69a1a7f45142cc3/html5/thumbnails/14.jpg)
DQe-c-v2ToolAssessesconformancetoaCommonDataModel.Checksformissingtablesandcalculatessizeoftables.
![Page 15: Testing Data Completeness with DQe -c-v2 - OHDSI€¦ · Testing Data Completeness with DQe -c-v2 OHDSI Symposium 2019: Data Quality Workshop 09/17/19 Tim Bergquist, Graduate Research](https://reader033.vdocuments.net/reader033/viewer/2022050120/5f50b700d69a1a7f45142cc3/html5/thumbnails/15.jpg)
![Page 16: Testing Data Completeness with DQe -c-v2 - OHDSI€¦ · Testing Data Completeness with DQe -c-v2 OHDSI Symposium 2019: Data Quality Workshop 09/17/19 Tim Bergquist, Graduate Research](https://reader033.vdocuments.net/reader033/viewer/2022050120/5f50b700d69a1a7f45142cc3/html5/thumbnails/16.jpg)
![Page 17: Testing Data Completeness with DQe -c-v2 - OHDSI€¦ · Testing Data Completeness with DQe -c-v2 OHDSI Symposium 2019: Data Quality Workshop 09/17/19 Tim Bergquist, Graduate Research](https://reader033.vdocuments.net/reader033/viewer/2022050120/5f50b700d69a1a7f45142cc3/html5/thumbnails/17.jpg)
Quicklycheckthatthenewdataisgrowingasexpected
![Page 18: Testing Data Completeness with DQe -c-v2 - OHDSI€¦ · Testing Data Completeness with DQe -c-v2 OHDSI Symposium 2019: Data Quality Workshop 09/17/19 Tim Bergquist, Graduate Research](https://reader033.vdocuments.net/reader033/viewer/2022050120/5f50b700d69a1a7f45142cc3/html5/thumbnails/18.jpg)
DQe-c-v2ToolAssessescompleteness ofallcolumnsintheavailabletablesinthedatabase.Checksfornullandnonsensevalues.
![Page 19: Testing Data Completeness with DQe -c-v2 - OHDSI€¦ · Testing Data Completeness with DQe -c-v2 OHDSI Symposium 2019: Data Quality Workshop 09/17/19 Tim Bergquist, Graduate Research](https://reader033.vdocuments.net/reader033/viewer/2022050120/5f50b700d69a1a7f45142cc3/html5/thumbnails/19.jpg)
IdentifyemptyorusefulcolumnsineachofyourOMOPtables.
![Page 20: Testing Data Completeness with DQe -c-v2 - OHDSI€¦ · Testing Data Completeness with DQe -c-v2 OHDSI Symposium 2019: Data Quality Workshop 09/17/19 Tim Bergquist, Graduate Research](https://reader033.vdocuments.net/reader033/viewer/2022050120/5f50b700d69a1a7f45142cc3/html5/thumbnails/20.jpg)
DQe-c-v2ToolChecksfororphankeys,foreignkeysnotpresentintheprimarytable.
![Page 21: Testing Data Completeness with DQe -c-v2 - OHDSI€¦ · Testing Data Completeness with DQe -c-v2 OHDSI Symposium 2019: Data Quality Workshop 09/17/19 Tim Bergquist, Graduate Research](https://reader033.vdocuments.net/reader033/viewer/2022050120/5f50b700d69a1a7f45142cc3/html5/thumbnails/21.jpg)
![Page 22: Testing Data Completeness with DQe -c-v2 - OHDSI€¦ · Testing Data Completeness with DQe -c-v2 OHDSI Symposium 2019: Data Quality Workshop 09/17/19 Tim Bergquist, Graduate Research](https://reader033.vdocuments.net/reader033/viewer/2022050120/5f50b700d69a1a7f45142cc3/html5/thumbnails/22.jpg)
DQe-c-v2ToolChecksformissingness inclinicalindicators.(Whatpercentofpatientshaveaheartratemeasure,bloodpressuremeasurement,etc.)
![Page 23: Testing Data Completeness with DQe -c-v2 - OHDSI€¦ · Testing Data Completeness with DQe -c-v2 OHDSI Symposium 2019: Data Quality Workshop 09/17/19 Tim Bergquist, Graduate Research](https://reader033.vdocuments.net/reader033/viewer/2022050120/5f50b700d69a1a7f45142cc3/html5/thumbnails/23.jpg)
![Page 24: Testing Data Completeness with DQe -c-v2 - OHDSI€¦ · Testing Data Completeness with DQe -c-v2 OHDSI Symposium 2019: Data Quality Workshop 09/17/19 Tim Bergquist, Graduate Research](https://reader033.vdocuments.net/reader033/viewer/2022050120/5f50b700d69a1a7f45142cc3/html5/thumbnails/24.jpg)
Addinganewindicatortestisstraightforward!
Completionasthepresenceofaconcept.Calculateswhatpercentageofpatientshavetheidentifiedconcept(s).
Completionasthepresenceofanon-null.Calculateswhatpercentageofpatientshaveanon-nullvalueintheidentifiedtable-column.
![Page 25: Testing Data Completeness with DQe -c-v2 - OHDSI€¦ · Testing Data Completeness with DQe -c-v2 OHDSI Symposium 2019: Data Quality Workshop 09/17/19 Tim Bergquist, Graduate Research](https://reader033.vdocuments.net/reader033/viewer/2022050120/5f50b700d69a1a7f45142cc3/html5/thumbnails/25.jpg)
Wecanaddanewindictortestbyjustaddingfivenewfields.
AddingtestingforA1CHemoglobin.CalculateswhatpercentageofpatientshaveahemoglobinA1Cmeasurement.
![Page 26: Testing Data Completeness with DQe -c-v2 - OHDSI€¦ · Testing Data Completeness with DQe -c-v2 OHDSI Symposium 2019: Data Quality Workshop 09/17/19 Tim Bergquist, Graduate Research](https://reader033.vdocuments.net/reader033/viewer/2022050120/5f50b700d69a1a7f45142cc3/html5/thumbnails/26.jpg)
![Page 27: Testing Data Completeness with DQe -c-v2 - OHDSI€¦ · Testing Data Completeness with DQe -c-v2 OHDSI Symposium 2019: Data Quality Workshop 09/17/19 Tim Bergquist, Graduate Research](https://reader033.vdocuments.net/reader033/viewer/2022050120/5f50b700d69a1a7f45142cc3/html5/thumbnails/27.jpg)
DQe-c-v2ToolAllreportsarecombinedintoavisualizationdashboard
![Page 28: Testing Data Completeness with DQe -c-v2 - OHDSI€¦ · Testing Data Completeness with DQe -c-v2 OHDSI Symposium 2019: Data Quality Workshop 09/17/19 Tim Bergquist, Graduate Research](https://reader033.vdocuments.net/reader033/viewer/2022050120/5f50b700d69a1a7f45142cc3/html5/thumbnails/28.jpg)
DQe-c-v2ToolAllthesemodulesoutputcsvreports.TheoutputfoldersaremanagedbyQuery.py
![Page 29: Testing Data Completeness with DQe -c-v2 - OHDSI€¦ · Testing Data Completeness with DQe -c-v2 OHDSI Symposium 2019: Data Quality Workshop 09/17/19 Tim Bergquist, Graduate Research](https://reader033.vdocuments.net/reader033/viewer/2022050120/5f50b700d69a1a7f45142cc3/html5/thumbnails/29.jpg)
DQe-c-v2Tool
Allthesemodulesoutputcsvreports.TheoutputfoldersaremanagedbyQuery.py toaccountfordifferenttestdatesandorganizations.
![Page 30: Testing Data Completeness with DQe -c-v2 - OHDSI€¦ · Testing Data Completeness with DQe -c-v2 OHDSI Symposium 2019: Data Quality Workshop 09/17/19 Tim Bergquist, Graduate Research](https://reader033.vdocuments.net/reader033/viewer/2022050120/5f50b700d69a1a7f45142cc3/html5/thumbnails/30.jpg)
DQe-c-v2NetworkAggregationTool
![Page 31: Testing Data Completeness with DQe -c-v2 - OHDSI€¦ · Testing Data Completeness with DQe -c-v2 OHDSI Symposium 2019: Data Quality Workshop 09/17/19 Tim Bergquist, Graduate Research](https://reader033.vdocuments.net/reader033/viewer/2022050120/5f50b700d69a1a7f45142cc3/html5/thumbnails/31.jpg)
DQe-c-v2NetworkAggregationTool
![Page 32: Testing Data Completeness with DQe -c-v2 - OHDSI€¦ · Testing Data Completeness with DQe -c-v2 OHDSI Symposium 2019: Data Quality Workshop 09/17/19 Tim Bergquist, Graduate Research](https://reader033.vdocuments.net/reader033/viewer/2022050120/5f50b700d69a1a7f45142cc3/html5/thumbnails/32.jpg)
DQe-c-v2NetworkAggregationTool
![Page 33: Testing Data Completeness with DQe -c-v2 - OHDSI€¦ · Testing Data Completeness with DQe -c-v2 OHDSI Symposium 2019: Data Quality Workshop 09/17/19 Tim Bergquist, Graduate Research](https://reader033.vdocuments.net/reader033/viewer/2022050120/5f50b700d69a1a7f45142cc3/html5/thumbnails/33.jpg)
DQe-c-v2NetworkAggregationTool
![Page 34: Testing Data Completeness with DQe -c-v2 - OHDSI€¦ · Testing Data Completeness with DQe -c-v2 OHDSI Symposium 2019: Data Quality Workshop 09/17/19 Tim Bergquist, Graduate Research](https://reader033.vdocuments.net/reader033/viewer/2022050120/5f50b700d69a1a7f45142cc3/html5/thumbnails/34.jpg)
DQe-c-v2ToolReportsarevisualizedintoanHTMLfile.Easytoembedintoawebsite
![Page 35: Testing Data Completeness with DQe -c-v2 - OHDSI€¦ · Testing Data Completeness with DQe -c-v2 OHDSI Symposium 2019: Data Quality Workshop 09/17/19 Tim Bergquist, Graduate Research](https://reader033.vdocuments.net/reader033/viewer/2022050120/5f50b700d69a1a7f45142cc3/html5/thumbnails/35.jpg)
AddingNewModules
![Page 36: Testing Data Completeness with DQe -c-v2 - OHDSI€¦ · Testing Data Completeness with DQe -c-v2 OHDSI Symposium 2019: Data Quality Workshop 09/17/19 Tim Bergquist, Graduate Research](https://reader033.vdocuments.net/reader033/viewer/2022050120/5f50b700d69a1a7f45142cc3/html5/thumbnails/36.jpg)
VocabularySummary
![Page 37: Testing Data Completeness with DQe -c-v2 - OHDSI€¦ · Testing Data Completeness with DQe -c-v2 OHDSI Symposium 2019: Data Quality Workshop 09/17/19 Tim Bergquist, Graduate Research](https://reader033.vdocuments.net/reader033/viewer/2022050120/5f50b700d69a1a7f45142cc3/html5/thumbnails/37.jpg)
VocabularySummary
![Page 38: Testing Data Completeness with DQe -c-v2 - OHDSI€¦ · Testing Data Completeness with DQe -c-v2 OHDSI Symposium 2019: Data Quality Workshop 09/17/19 Tim Bergquist, Graduate Research](https://reader033.vdocuments.net/reader033/viewer/2022050120/5f50b700d69a1a7f45142cc3/html5/thumbnails/38.jpg)
VocabularySummary
![Page 39: Testing Data Completeness with DQe -c-v2 - OHDSI€¦ · Testing Data Completeness with DQe -c-v2 OHDSI Symposium 2019: Data Quality Workshop 09/17/19 Tim Bergquist, Graduate Research](https://reader033.vdocuments.net/reader033/viewer/2022050120/5f50b700d69a1a7f45142cc3/html5/thumbnails/39.jpg)
TemporalPlausibility
![Page 40: Testing Data Completeness with DQe -c-v2 - OHDSI€¦ · Testing Data Completeness with DQe -c-v2 OHDSI Symposium 2019: Data Quality Workshop 09/17/19 Tim Bergquist, Graduate Research](https://reader033.vdocuments.net/reader033/viewer/2022050120/5f50b700d69a1a7f45142cc3/html5/thumbnails/40.jpg)
OperationalizinguseofDQetoolsfordataqualitytesting
*DataQUEST*DARTNet Institute*CD2H
https://github.com/WWAMI-DataQuest/DQe-c_OMOPv4/tree/master/docs
![Page 41: Testing Data Completeness with DQe -c-v2 - OHDSI€¦ · Testing Data Completeness with DQe -c-v2 OHDSI Symposium 2019: Data Quality Workshop 09/17/19 Tim Bergquist, Graduate Research](https://reader033.vdocuments.net/reader033/viewer/2022050120/5f50b700d69a1a7f45142cc3/html5/thumbnails/41.jpg)
Questions?
• Wearelookingforcollaboratorsandcontributors!
• Contactmeifyouneedhelpgettingthetoolupandrunning.
• Wearealwayslookingforfeedback.
ThankstoKariStephens,HosseinEstiri,WPRN,ITHS,andCD2H!
Contact:[email protected]
https://dataquest.iths.org/
https://ctsa.ncats.nih.gov/cd2h/
https://github.com/data2health/DQe-c-v2
CD2HDataQualityProject
https://ctsa.ncats.nih.gov/cd2h/data-quality-methods-and-tools-to-support-ctsa-hub-data-sharing/