quality in forensic service accuracy & reliability are present, just like on csi, right?
DESCRIPTION
Quality in Forensic Service Accuracy & Reliability Are Present, Just Like on CSI, Right?. Carl M. Selavka, Ph.D., D-ABC Director. Massachusetts State Police Crime Laboratory Sudbury, Massachusetts. And Now, A Word From My Sponsor:. Disclaimers. - PowerPoint PPT PresentationTRANSCRIPT
Quality in Quality in Forensic ServiceForensic ServiceAccuracy & Reliability Are Accuracy & Reliability Are Present, Just Like on CSI, Present, Just Like on CSI,
Right?Right?
Massachusetts State Police Crime LaboratorySudbury, Massachusetts
Carl M. Selavka, Ph.D., D-Carl M. Selavka, Ph.D., D-ABCABC
DirectorDirector
And Now,And Now, A Word A Word From My From My Sponsor:Sponsor:
DisclaimersDisclaimersThe opinions The opinions expressed in this expressed in this presentation are presentation are those of the author those of the author and do not necessarily and do not necessarily represent the official represent the official positions of the:positions of the:
Disclaimed Disclaimed AgenciesAgencies
Commonwealth of Commonwealth of MassachusettsMassachusettsExecutive Office of Public Executive Office of Public SafetySafetyDepartment of State PoliceDepartment of State PoliceCrime Laboratory SystemCrime Laboratory System
Disclaimed Disclaimed AgenciesAgencies
NIJNIJ AAFSAAFSDHHSDHHS ASCLDASCLDABCABC NEAFS NEAFS FEPACFEPAC ACSACS
Disclaimed Disclaimed AgenciesAgencies
NCST&NCST&LL
(Participants, Attendees, Those Actually (Participants, Attendees, Those Actually Awake)Awake)
ThatThatTitleTitle
• The Real Forensic The Real Forensic World World • Quality is Easy, Quality is Easy, Right?Right?• Structure from ChaosStructure from Chaos• Legal SynergyLegal Synergy• This is GOOD!This is GOOD!
Presentation Presentation SummarySummary
• From Crime Commission to From Crime Commission to DiscoveryDiscovery• On-Site First-Responders & On-Site First-Responders & InvestigatorsInvestigators• Evidence Recognition, Presentation Evidence Recognition, Presentation to Key to Key Responders, Documentation, Responders, Documentation, Collection Collection & Transport Integrity& Transport Integrity• Triage to Avoid Exhaustive Triage to Avoid Exhaustive ExaminationsExaminations• The Examinations Themselves….The Examinations Themselves….
The Real Forensic The Real Forensic WorldWorld
• Interpretations of Elicited & Missing Interpretations of Elicited & Missing DataData• Contextual Elements Insure Contextual Elements Insure “Probative” “Probative” Forensic ReportsForensic Reports• Iterative Evidentiary Management Iterative Evidentiary Management Yields Yields “Non-Advocacy” Credibility“Non-Advocacy” Credibility• Presentation in Court Provides Presentation in Court Provides Forensic Forensic DefensibilityDefensibility
The Real Forensic The Real Forensic WorldWorld
Quality AssuranceQuality Assurance
• QualityQuality (Webster’s II – 1984)(Webster’s II – 1984)
Essential CharacterEssential Character An Inherent AttributeAn Inherent Attribute Degree of ExcellenceDegree of Excellence
• AssuranceAssurance A Statement Intended to A Statement Intended to Inspire Inspire ConfidenceConfidence
Quality in Forensic Quality in Forensic ScienceScience
Ideal Lab ManagementIdeal Lab Management• Is Our QA Program Is Our QA Program Proper?Proper?• Is the Personnel Is the Personnel System OK?System OK?• Do We Use Good Do We Use Good Science?Science?• Do We Report Do We Report Correctly?Correctly?• Are We Defensible?Are We Defensible?
InfrastructureInfrastructure
Accreditati
Accreditati
onon
Certi
ficat
i
Certi
ficat
i
onon
StandardizatiStandardizationon
Quality Quality ControlControl
QualityQualityAssuranceAssurance
NationalNationalStandardsStandards
InfrastructureInfrastructure
Accreditati
Accreditati
onon
Quality AssuranceQuality Assurance
ASCLD/LAASCLD/LABB
ASCLD / LABASCLD / LABAmerican Society American Society
of Crime of Crime Laboratory Laboratory Directors / Directors / Laboratory Laboratory
Accreditation Accreditation BoardBoard
Other AccreditationsOther Accreditations• ISO 17025 (Guide ISO 17025 (Guide 25)25)• NAME – NAME – Death Death InvestigationInvestigation• IAI – FingerprintsIAI – Fingerprints• AFTE – Firearms, AFTE – Firearms, TMsTMs• ABFT – ToxicologyABFT – Toxicology
Other AccreditationsOther Accreditations• NATA, SCC, NATA, SCC, NAMASNAMAS• See the URL for See the URL for More:More:
www.ascld-lab.org Click On “Resources”Click On “Resources” Click “Forensic Links” Click “Forensic Links” and and you’ll get 36 you’ll get 36 Recognized Sites!!Recognized Sites!!
Why ASCLD / LAB?Why ASCLD / LAB?
• Objective ProcessObjective Process• Impartial ReviewImpartial Review• Consensus Consensus StandardsStandards• Peer-BasedPeer-Based
InfrastructureInfrastructure
Accreditati
Accreditati
onon
Certi
ficat
i
Certi
ficat
i
onon
Is the Personnel System OK?Is the Personnel System OK?
ABC ABC ((www.criminalistics.com)
ABFT ABFT ((www.abft.org)
IAI IAI ((www.theiai.org)
Certification is Certification is NOT an End Unto NOT an End Unto
ItselfItselfCertification is a Certification is a passageway - a passageway - a commitment to commitment to
continued professional continued professional developmentdevelopment
Proficiency Tests (PTs)Proficiency Tests (PTs)
RecognizeRecognizePossiblyPossiblyDeviantDeviantResultsResults
• Differentiate Anecdotal Differentiate Anecdotal Issues Issues From Systemic From Systemic Performance Performance Improvement Improvement OpportunitiesOpportunities• Document Corrective Document Corrective ActionsActions• Reestablish CompetencyReestablish Competency
DocumentationDocumentation
That QA That QA Guarantee…Guarantee…
Change theChange theExaminer’sExaminer’s
JobJob
Why Is This a Good Approach Why Is This a Good Approach to Certification?to Certification?
• Objective ProcessObjective Process• Impartial ReviewImpartial Review• Consensus Consensus StandardsStandards• Peer-BasedPeer-Based
• AccreditationAccreditation – ASCLD/LAB & – ASCLD/LAB & OthersOthers
• CertificationCertificationAAFS Forensic Specialties AAFS Forensic Specialties Accreditation BoardAccreditation Board
2004 NIJ Guide 2004 NIJ Guide – Appendix – Appendix C C
9 FSAB-Recognized Programs9 FSAB-Recognized Programs 14 Organizations Listed14 Organizations Listed
Quality in Forensic Quality in Forensic ScienceScience
InfrastructureInfrastructure
Accreditati
Accreditati
onon
Certi
ficat
i
Certi
ficat
i
onon
StandardizatiStandardizationon
Do We Use Good Science?Do We Use Good Science?Do We Report Correctly?Do We Report Correctly?
T/SWG - T/SWG - ______
ASTMASTM
T / SWGT / SWG
Technical Technical oror Scientific Working Scientific Working
GroupGroupfor / on _____ for / on _____ (18 Total)(18 Total)
Technical WG = NIJTechnical WG = NIJ• TWG-BSITWG-BSI
Bombing Scene Bombing Scene InvestigationInvestigation• TWG-CSITWG-CSI
Crime Scene Crime Scene InvestigationInvestigation• TWG-DITWG-DI
Death InvesigationDeath Invesigation
• TWG-DETWG-DEDigital EvidenceDigital Evidence
• TWG-EYEETWG-EYEEEyewitness Eyewitness
EvidenceEvidence• TWG-FASITWG-FASI
Fire/Arson Scene Fire/Arson Scene InvestigationInvestigation• TWG-MFFITWG-MFFI
Mass Fatality Forensic IDMass Fatality Forensic ID
Scientific WG = FBIScientific WG = FBI• SWG-STAINSWG-STAIN
Bloodstain Pattern Bloodstain Pattern AnalysisAnalysis• SWG-DESWG-DE
Digital EvidenceDigital Evidence• SWG-DAMSWG-DAM
DNA Analysis MethodsDNA Analysis Methods
• SWG-GUNSWG-GUNFirearms and ToolmarksFirearms and Toolmarks
• SWG-FASTSWG-FASTFriction Ridge Friction Ridge
Analysis, Analysis, Study and Study and TechnologyTechnology• SWG-ITSWG-IT
Imaging TechnologiesImaging Technologies
• SWG-MATSWG-MATMaterials AnalysisMaterials Analysis
• SWG-MGFSWG-MGFMicrobial Genetics & Microbial Genetics &
ForensicsForensics• SWG-DOCSWG-DOC
Forensic Document Forensic Document ExamExam
Scientific WG = DEAScientific WG = DEA• SWG-DRUGSWG-DRUG
for thefor the Analysis of Seized Analysis of Seized DrugsDrugs
• TWG-FEXTWG-FEXFire & Explosions Fire & Explosions
InvestigationsInvestigations
Technical WG = NCFSTechnical WG = NCFS
ASTMASTMAmerican Society American Society
for Testing & for Testing & Materials – Materials –
Committee E30 on Committee E30 on Forensic SciencesForensic Sciences
(Now ASTM International)(Now ASTM International)
ASTM InternationalASTM International• 9 E30 Technical 9 E30 Technical GroupsGroups• 6 E30 Specialty 6 E30 Specialty GroupsGroups• 25 E30.01 25 E30.01 Criminalistics Criminalistics StandardsStandards
• Objective ProcessObjective Process• Impartial ReviewImpartial Review• Consensus Consensus StandardsStandards• Peer-BasedPeer-Based
Why Is This a Good Approach Why Is This a Good Approach to Standardization?to Standardization?
• AccreditationAccreditation – ASCLD/LAB & Others– ASCLD/LAB & Others
• Certification Certification – AAFS FSAB & Others– AAFS FSAB & Others
• Standardization Standardization ASTM Committee E30 on Forensic ASTM Committee E30 on Forensic SciencesSciencesNIJ, FBI, DEA and NCFS SponsorsNIJ, FBI, DEA and NCFS Sponsors
2004 NIJ Guide 2004 NIJ Guide – Appendix D– Appendix D 19 Standardization Groups19 Standardization Groups
Quality in Forensic Quality in Forensic ScienceScience
InfrastructureInfrastructure
Accreditati
Accreditati
onon
Certi
ficat
i
Certi
ficat
i
onon
StandardizatiStandardizationon
QualityQualityForensicForensicServicesServices
• National Agencies?National Agencies?• State Agencies?State Agencies?
NY, OK, TX NY, OK, TX Crime LaboratoriesCrime Laboratories Exempt Categories PlentifulExempt Categories Plentiful Examiners = NOExaminers = NO
• Municipal Agencies?Municipal Agencies?• Local Governments?Local Governments?
RequiredRequired Quality Quality AssuranceAssurance
NO!NO!
What You What You Should Should Expect Expect From From
Forensic Forensic PractitionerPractitioner
ss
Practical Practical Quality Quality
GuaranteesGuaranteesWe ProvideWe Provide
FEPACFEPACForensic Forensic Science Science
Education Education Programs Programs
Accreditation Accreditation CommissionCommission
InfrastructureInfrastructureAccreditatiAccreditationon
Cert
ifica
tiCe
rtifi
cati
onon
StandardizatiStandardizationon
QualityQuality ForensicForensic ServicesServices
Educational Educational HarmonizationHarmonization
• Accuracy is NOT EnsuredAccuracy is NOT Ensured• Reliability is NOT Reliability is NOT EnsuredEnsured• In Our Advocacy In Our Advocacy Process, Process, Accuracy & Accuracy & Reliability Rest Reliability Rest in the Eye in the Eye of the Beholderof the Beholder
QA Take-Away:QA Take-Away:
Can You All Now Run Can You All Now Run With the Big Dogs?With the Big Dogs?
Yes, You Can.Yes, You Can.
AcknowledgementAcknowledgementssNCST&L Organizing NCST&L Organizing Committees & Leadership Committees & Leadership TeamTeam - - Professor Carol HendersonProfessor Carol HendersonMassachusetts State Massachusetts State PolicePolice -- Colonel Robbins & Command StaffColonel Robbins & Command Staff -- MSP Crime Lab SystemMSP Crime Lab System