ojjdp performance measurement training 1 presented by: dr. kimberly kempf-leonard school of social...
TRANSCRIPT
OJJDP Performance Measurement Training 1
Presented by:Dr. Kimberly Kempf-Leonard
School of Social SciencesUniversity of Texas at Dallas
Program monitoring & tracking: Research design
issues
OJJDP Performance Measurement Training 2
• Purposes• Quality Control• Tracking of Subjects• Measuring Variables
OJJDP Performance Measurement Training 3
Why are we doing this?
• Monitoring & Assessment
• Improve our juvenile justice systemConvince other systems they can
benefit from what we’ve done
Describe… Explain… Evaluate… Predict…
OJJDP Performance Measurement Training 4
Quality Control of Output & Outcome measures
• Add a time dimension to data collectionlongitudinal data (6-12 months follow-up)
• Precise measures • Reliable measures• Valid measures• Generalizable measures
OJJDP Performance Measurement Training 5
What does tracking & Follow-Up mean?
OJJDP Performance Measurement Training 6
Time-related problems with Subjects
• “Creaming”
• Attrition or “Mortality”
• Solution: assure sample represents total– Know characteristics of those missing
OJJDP Performance Measurement Training 7
Do you work with this system?
OJJDP Performance Measurement Training 8
• Clear, relevant variables• Consistency in measurement both
times• Representative subjects
– Same subjects – sample chosen same way both times– Explain any attrition
• Simple data collection instrument
OJJDP Performance Measurement Training 9
What types of data are collected in longitudinal
designs?• All types!
– Surveys (trends: multiple “waves” of cross-sectional designs)
– Participant observation– Archival records– Experiments– Content analysis– Secondary data & primary data from
a “follow-up”
OJJDP Performance Measurement Training 10