summary of miechv grantee benchmark performance measures · audit alcohol use disorders...

Summary of MIECHV Grantee Benchmark Performance Measures

Department of Health and Human Services

DOHVE TA Resource Document

October 2012

The following document reflects information obtained from MIECHV grantee benchmark plans as to how performance

measures across each of the benchmark constructs are being captured by individual grantees. The government does not

endorse specific models or measurement instruments/items used by MIECHV grantees.

Summary of Grantee Performance Measures

Brief Snapshot Report

Abbreviated Terms

AAP/Bright Futures American Academy of Pediatrics/Bright Futures Recommendation Schedule

AAPI-2 Adult-Adolescent Parenting Inventory, 2nd Ed.

ASQ-3 Ages and Stages Questionnaire - 3rd Edition

ASQ-SE Ages and Stages Questionnaire - Social Emotional

ASEBA Achenbach System of Empirically-Based Assessment

ASSIST Alcohol, Smoking and Substance Involvement Screening Test

AUDIT Alcohol Use Disorders Identification Test

Batelle Battelle Developmental Inventory Screening Test

Bayley Bayley Scale for Infant Development

BASC Behavior Assessment System for Children

BHRST Behavioral Health Risk Screening Tool

BINS Bayley Infant and Nuerodevelopmental Screener

Brigance Brigance Inventory of Early Development

BRFSS Behavioral Risk Factor Surveillance System

CDC Center for Disease Control

CES-D Center for Epidemiological Studies Depression Scale

CTS-2 Conflict Tactics Scale

Dev Profile-3 Developmental Profiles-III

DOVE DOmestic Violence Ended

DV Domestic Violence

E-LAP Early Learning Accomplishment Profile

EPDS Edinburg Postnatal Depression Scale

FAF Family Environment Scale

HOME HOME Inventory

HFPI Healthy Families Parenting Inventory

KIDI Knowledge of Infant Development Inventory

KIPS Keys to Interactive Parenting Scale

Kotelchuck Kotelchuck Index, or Adequacy of Prenatal Care Utilization

LSP Life Skills Progression

MCAFSS Missouri Community Action Family Self Sufficiency Scale

MFSSS Missouri Family Self Sufficiency Scale

Nat'l Health Int. Survey National Health Interview Survey

NCAST Nursing Child Assessment Satellite Training

NCAST-PCI Nursing Child Assessment Satellite Training, Parent-Child Interaction

DOHVE TA 2 of 41



Abbreviated Terms

PCRI Parent-Child Relationship Inventory

Parent Quest. Parent Questionnaire

PFS Protective Factors Survey

PHQ-9 Patient Health Questionaire, 9-item

PICCOLO Parenting Interactions with Children: Checklist of Observations Linked to Outcomes

PSI Parenting Stress Index

PSS Perceived Stress Scale

ROI Release of Information

SBIRT Screening, Brief Intervention, and Referral to Treatment

UNCOPE UNCOPE: A Brief Substance Abuse Screening

WAST Woman Abuse Screening Tool

WEB Women’s Experience with Battering

WebIZ Web Immunization Registry

Nursing Child Assessment Satellite Training, Parent-Child Interaction

DOHVE TA 3 of 41



Number of grantees included in report: 54

Measure Type Data Source Target Population

Process: 5 9% Program Documentation: 5 9% Pregnant Mothers: 54 100%

Outcome: 49 91% Self-Report/Interview: 44 81%

Home Visitor Report: 0 0%

Administrative: 5 9%

Focus

Adequacy of prenatal care: 22 41%

Onset of prenatal care: 26 48%

Onset & Adequacy of prenatal care: 1 2%

Referral to prenatal care provider: 2 4%

Other (prenatal care assessment; provision of information): 3 6%

Instrument / Measure*

Instruments: Non-Instrument Measures: Suggested Schedule:

LSP: 1 2% Program Form: 36 67% Kotelchuck: 8 15%

Parent Quest.: 1 2% Vital Statistics: 5 9% ACOG: 2 4%

* Multiple Instruments/measures may be used across sites

Construct A-1: Prenatal Care

DOHVE TA 4 of 41






Outcome: 35 65% Self-Report/Interview: 33 61% Postpartum Mothers: 3 6%

Home Visitor Report: 1 2% All Mothers: 21 39%

Administrative: 1 2% Other: 10 19%

Focus

Alcohol use or abuse: 7 13%

Tobacco use or abuse: 35 65%

Illicit Drug use or abuse: 0 0%

Combination of Alcohol, Tobacco, and/or Drug use or abuse: 12 22%


Instruments: Non-Instrument Measures:

ASSIST: 1 2% SBIRT: 1 2% Program Form: 38 70%

AUDIT: 2 4% UNCOPE: 2 4% Vital Statistics: 1 2%

BHRST: 1 2% LSP: 4 7%

BRFSS: 2 4% Other Instrument: 4 7%


Construct A-2: Alcohol, Tobacco, & Illicit Drugs

DOHVE TA 5 of 41





Process: 5 9% Program Documentation: 5 9% Postpartum Mothers: 42 78%

Outcome: 49 91% Self-Report/Interview: 47 87% All Mothers: 12 22%



Focus

Postpartum Checkup: 20 37% Access to Care: 1 2%

Routine/WellWoman Exam: 17 31% Medical Home: 1 2%

Contraception Use: 2 4% Referral for Services: 1 2%

Provision of Information: 3 6% Reduction in Tobacco Use 1 2%

Folic Acid: 8 15%

Instrument / Measure

Non-Instrument Measures:

Healthy People 2020: 1 2% Vital Statistics: 1 2%

Nat'l Health Int. Survey: 1 2%

Parent Questionnaire: 1 2%

Program Form: 50 93%

Construct A-3: Preconception Care

DOHVE TA 6 of 41








Administrative: 1 2% Caregivers: 2 4%

Focus

Provision of Info: 24 44% Knowledge: 1 2%

Contraception Use: 14 26% Referral: 1 2%

12 Mo. Preg. Spacing: 11 20%

6 Mo. Preg. Spacing: 2 4%

Preg. Spacing - Other: 1 2%



LSP: 1 2% Vital Statistics: 1 2%



Construct A-4: Inter-Birth Interval

DOHVE TA 7 of 41









Focus

Screening: 47 87%

Referral: 7 13%



EPDS: 44 81% BHRST: 1 2% Program Form: 6 11%

PHQ-9: 9 17% Beck Depression Inventory: 1 2%

CESD: 3 6%

4 P's Plus: 1 2%


Construct A-5: Maternal Depressive Symptoms

DOHVE TA 8 of 41







Home Visitor Report: 0 0% Child: 6 11%


Focus

Initiate: 21 39%

Duration - mean: 11 20%

Duration - 3mos.: 3 6%

Duration - 6mos.: 16 30%

Duration - other: 3 6%



LSP 1 2% Program Form: 51 94%

Vital Statistics: 2 4%

Construct A-6: Breastfeeding

DOHVE TA 9 of 41





Process: 1 2% Program Documentaion: 1 2% Child: 54 100%




Focus

Adherence: 52 96%

Referrals: 1 2%

Provision of information: 1 2%


Instruments: Non-Instrument Measures: Suggested Schedule:

LSP: 4 7% Program Form: 28 52% CDC: 3 6%

State Health Records: 1 2% Medicaid: 5 9%

WebIZ: 2 4% AAP/Bright Futures: 18 33%

Immunization Card: 4 7% State Recommendation: 2 4%


Construct A-7: Well-Child Visits

DOHVE TA 10 of 41




Measure Type Data Source

Process: 4 7% Program Documentation: 2 4%




Focus Target Population

Status Mother & Child: 50 93% Pregnant Mothers: 1 2%

Status Mother: 2 4% Postpartum Mothers: 1 2%

Months Uninsured: 1 2% Mother & Child: 50 93%

Time, App to Receipt: 1 2% All Mothers: 1 2%

Child: 1 2%




State Data System: 1 2%

Hospital/Health Record: 1 2%


Construct A-8: Maternal & Child Health Insurance Status

DOHVE TA 11 of 41





Process: 0 0% Program Documentation: 0 0% Child: 54 100%




Focus

Visits/Incidents: 30 56%

Child: 24 44%




Nat'l Health Int Survey: 1 2%

Hospital/Health Records: 4 7%

Construct B-9: Visits for Children to Emergency Department

DOHVE TA 12 of 41









Focus

Visits/Incidents: 31 57%

Mother: 22 41%

Other (caregivers): 1 2%




Nat'l Health Int Survey: 1 2%


Construct B-10: Visits for Mothers to Emergency Department

DOHVE TA 13 of 41










Provision of Information: 53 98% Postpartum Mothers: 1 2%

Home Safety Checklist: 1 2% All Mothers: 20 37%

Family Unit: 16 30%

Caregivers: 14 26%

Household Members: 3 6%




Test of Safety Knowledge: 1 2%

Safety Checklist: 6 11%


Construct B-11: Information/Training on Prevention of Child Injuries

DOHVE TA 14 of 41









Focus

Visit/Incident: 19 35%

Child: 35 65%



LSP: 1 2% Program Form: 48 89%


Construct B-12: Child Injuries

DOHVE TA 15 of 41





Process: 0 0% Program Documentation: 0 0% Family Unit: 2 4%

Outcome: 54 100% Self-Report/Interview: 7 13% Child: 52 96%



Focus

Report/Incident: 18 33%

Children: 34 63%

Families: 2 4%



Program Form: 9 17%

Child Welfare Data: 47 87%

* Multiple Instruments/measures may be used across sites. Some programs are collecting both child welfare

data as well as self-report data using program forms.

Construct B-13: Reports of Suspected Maltreatment

DOHVE TA 16 of 41









Focus

Report/Incident: 22 41%

Children: 31 57%

Families: 1 2%



Program Form: 7 13%




Construct B-14: Reports of Substantiated Maltreatment

DOHVE TA 17 of 41









Focus

Children: 53 98%

Families: 1 2%



Program Form: 8 15%




Construct B-15: First Time Victims of Maltreatment

DOHVE TA 18 of 41










Support for Learning & Dev: 30 56% Postpartum Mothers: 3 6%

Provides Learning Experiences: 12 22% All Mothers: 11 20%

Supportive Home Environ: 5 9% Family Unit: 7 13%

Receives Info How to Support: 1 2% Caregivers: 32 59%

Completion/Screening: 6 11% Child: 1 2%


Instrument: Child Well Being Scale: 1 2% Non-Instrument Measures:

HOME: 38 70% FAF: 1 2% Program Form: 12 22%

LSP: 3 6% PAT Parent Survey: 1 2%

KIPS: 4 7% NCAST PCI: 2 4%

PICCOLO: 2 4% HFPI: 7 13%


Construct C-16: Parent Support for Child Learning & Development

DOHVE TA 19 of 41










Global Development Knowledge: 21 39% Postpartum Mothers: 5 9% Child: 2 4%

Knowledge of Learning Dev.: 1 2% All Mothers: 10 19%

Demonstration of Knowledge: 5 9% Family Unit: 6 11%

Improved Parenting: 3 6% Caregivers: 30 56%

Provision of Info on Child's Dev: 24 44% Household Members: 1 2%


Instrument: LSP: 3 6% PFS: 1 2%

HOME: 23 43% PICCOLO: 1 2% ASQ-SE: 6 11%

ASQ-3: 18 33% FAF: 1 2% Other Instr.: 15 28%

KIPS: 3 6% HFPI: 2 4% Non-Instr. Measures:

KIDI: 1 2% Child Well Being Scale: 1 2% Program Form: 9 17%


Construct C-17: Parent Knowledge of Child Development

DOHVE TA 20 of 41










Parent-child relationship: 31 57% Postpartum Mothers: 2 4% Child: 1 2%

Responsiveness/acceptance: 16 30% All Mothers: 12 22%

Discipline strategies: 6 11% Family Unit: 6 11%

Parenting: 1 2% Caregivers: 32 59%



Instrument: Non-Instrument Measures:

HOME: 37 69% PICCOLO: 2 4% PAT Parent Survey: 1 2%

KIPS: 4 7% NCAST PCI: 2 4% HIPPY Parent Survey: 1 2%

PCRI: 1 2% HFPI: 10 19% Program Form: 3 6%

LSP: 4 7% Other Instrument: 6 11%


Construct C-18: Parenting Behaviors/Parent-Child Relationship

DOHVE TA 21 of 41





Process: 29 54% Program Documentation: 29 54% Postpartum Mothers: 14 26%

Outcome: 25 46% Self-Report/Interview: 24 44% All Mothers: 11 20%

Home Visitor Report: 1 2% Family Unit: 3 6%


Focus

Depression screening: 20 37% Level of Depression: 1 2%

Referral for +screening: 4 7% Family Functioning

Parental Stress: 19 35% Positive Social Support: 1 2%

Support: 6 11%

Other: 3 6%


Instrument: PHQ-9: 7 13% Other Instrument: 10 19%

AAPI-2: 1 2% PSI: 9 17% Non-Instrument Measures:

EPDS: 21 39% PSS: 2 4% PAT Parent Survey: 1 2%

CESD: 1 2% PFS: 6 11% Program Form: 3 6%

LSP: 2 4% HFPI: 5 9%


Construct C-19: Parent Emotional Well-Being/Parenting Stress

DOHVE TA 22 of 41





Process: 35 65% Program Documentation: 35 65% Caregivers: 2 4%




Focus

Screening: 24 44%

Referral for +screening: 11 20%

Outcome: communication: 19 35%


Instrument:

ASQ-3: 54 100% E-LAP: 1 2%

ASEBA: 0 0% BINS: 1 2%

Batelle: 1 2% BASC: 1 2%

Bayley-III: 1 2% Brigance.: 1 2%


Construct C-20: Child Communication, Language, & Emergent Literacy

DOHVE TA 23 of 41









Focus

Screening: 24 44%


Outcome: problem solving: 15 28%

Outcome: overall development: 3 6%

Outcome: gross and fine motor 1 2%


Instrument:

ASQ-3: 54 100% E-LAP: 1 2%

Batelle: 1 2% Brigance: 1 2%

Bayley-III: 1 2% Dev. Profile-3: 1 2%

BINS: 1 2%


Construct C-21: Child Cognitive Skills

DOHVE TA 24 of 41





Process: 34 63% Program Documentation: 33 61% All Mothers: 1 2%

Outcome: 20 37% Self-Report/Interview: 20 37% Family Unit: 1 2%

Home Visitor Report: 1 2% Caregivers: 2 4%

Administrative: 0 0% Child: 50 93%

Focus

Screening: 22 41%


Outcome: personal-social: 14 26%

Outcome: social-emotional: 1 2%

Other: 6 11%


Instrument: NCAST: 1 2% Non-Instrument Measures:

ASQ-SE: 16 30% Bayley-III: 1 2% Program Form: 2 4%

ASQ-3: 34 63% HOME: 1 2%

E-LAP: 1 2% Brigance: 1 2%

Batelle: 1 2% Dev. Profile-3: 1 2%


Construct C-22: Child Positive Approaches to Learning

DOHVE TA 25 of 41









Focus

Screening: 24 44%


Outcome: social-emotional: 17 31%

Outcome: overall development: 1 2%


Instrument: Non-Instr. Measures:

ASQ-SE: 54 100% Bayley-III: 1 2% Program Form: 3 6%

ASQ-3: 2 4%

ASEBA: 0 0%

Batelle: 1 2%


Construct C-23: Child Social Behavior/Emotional Well-Being

DOHVE TA 26 of 41









Focus

Screen: gross/fine motor: 20 37% Referral for +Screening: 9 17%

Outcome: gross/fine motor: 11 20% Medical Home: 1 2%

Screen: ht/wt/head circum: 4 7% Eligibilty for WIC: 1 2%

Outcome: ht/wt/head circum: 4 7% Smoking Exposure: 1 2%

Up-to-Date Wellness Visits: 1 2% Screening for Delay: 2 4%


Instrument: Non-Instr. Measures:

ASQ-3/ASQ-SE: 41 76% BINS: 1 2% Program Form: 12 22%

ASEBA: 0 0% WIC Program Data: 1 2%

Batelle: 1 2%

Bayley-III: 1 2%


Construct C-24: Child Physical Health & Development

DOHVE TA 27 of 41






Outcome: 2 100% Self-Report: 1 50%



Focus

unit=arrest: 2 100%

unit=mother: 0 0%



Program Form: 1 50%

Crime Records: 1 50%


Construct D-25: Arrests

DOHVE TA 28 of 41









Focus

unit=conviction: 2 100%

unit=mother: 0 0%



Program Form: 1 50%

Crime Records: 1 50%


Construct D-26: Convictions

DOHVE TA 29 of 41










unit=screenings: 5 10% Pregnant Mothers: 1 2%

unit=mother: 46 88% Postpartum Mothers: 1 2%

unit=family: 1 2% All Mothers: 36 69%

Family Unit: 6 12%

Caregivers: 8 15%


Instrument: CTS-2: 2 4% Other: 14 27%

Abusive Assessment Screen: 3 6% 4 P's Plus: 2 4%

Abusive Behavior Inventory: 2 4% DOVE: 5 10% Non-Instrument Measures:

Relationship Assessment: 16 31% WAST: 1 2% Program Form: 20 38%

Difficult Life Circumstance: 1 2% WEB: 4 8%


Construct D-27: Screening for Domestic Violence

DOHVE TA 30 of 41










unit=referral: 7 13% Pregnant Mothers: 2 4% Mothers Screened +: 5 10%

unit=mother: 45 87% Postpartum Mothers: 1 2%

All Mothers: 22 42%

Family Unit: 10 19%

Caregivers: 12 23%



DOVE: 1 2% Program Form: 50 96%

SBIRT: 1 2%

Construct D-28: Referrals for Domestic Violence Services

DOHVE TA 31 of 41










unit=referral: 1 2% Pregnant Mothers: 2 4%

unit=family: 45 87% All Mothers: 23 44%

unit=safety plan: 6 12% Family Unit: 13 25%

Caregivers: 9 17%

Mothers Screened +: 5 10%



DV Enhance Visitation Program: 1 2% Program Form: 49 94%

Family-Wise Safety Plan: 1 2%

Family Violence Prevention Fund: 1 2%

Construct D-29: Domestic Violence - Safety Plan

DOHVE TA 32 of 41






Outcome: 54 100% Self-Report/Interview: 54 100% Family Unit: 15 28%

Home Visitor Report: 0 0% Caregivers: 12 22%

Administrative: 0 0% Household Members: 22 41%

Focus

Income & Benefits: 34 63%

Income, All Sources: 17 31%

Wages Only: 3 6%

Benefits: 0 0%




MFSSS: 1 2%

MCAFSS: 1 2%


Construct E-30: Income & Benefits

DOHVE TA 33 of 41









Focus‡ Target Population

Ed., Enrollment: 23 43% Paid Hours Worked: 5 9% All Mothers: 9 17%

Ed., Attainment: 9 17% Paid Plus Unpaid: 10 19% Family Unit: 5 9%

Diploma/GED: 2 4% Referral if Unemployed: 1 2% Caregivers: 20 37%

Emp+Ed Combined: 9 17% Household Members: 19 35%

Clients Employed: 4 7% Child: 1 2%




MCAFSS: 1 2%

MFSSS: 2 4%

‡ Grantees may have chosen to measure both employment and education.


Construct E-31: Employment or Education

DOHVE TA 34 of 41










Status, Household: 18 33% All Mothers: 2 4% Child: 1 2%

Status, Mother: 2 4% Mother & Child: 33 61%

Status, Mother & Chid: 32 59% Family Unit: 2

Child: 1 2% Caregivers: 1

Months Uninsured: 1 2% Household Members: 15




MCAFSS: 2 4% State Health Records: 2 4%


Construct E-32: Health Insurance Status

DOHVE TA 35 of 41






Outcome: 1 2% Self-Report: 0 0%




Comprehensive Screen: 47 87% Postpartum Mothers: 1 2% Household Members: 3 6%

Single Screen: 7 13% All Mothers: 6 11% Child: 3 6%

Mother & Child: 3 6%

Family Unit: 35 65%

Caregivers: 3 6%

Domain Captured by Screens*

Depressive Symptoms: 9 17% Family Functioning: 2 4%

Child Development: 8 15% Employment: 1 2%

Domestic Violence: 6 11% Education: 1 2%

Substance: 5 9% Family Planning 1 2%

Social Support: 2 4% Unspecified Domain: 38 70%

* Multiple domains may be captured during program screening process

Construct F-33: Identification for Necessary Services

DOHVE TA 36 of 41










unit=referral: 10 19% All Mothers: 5 9% Child: 2 4%

unit=family: 44 81% Mother & Child: 4 7% Mothers Screened +: 1 2%

Caregivers: 4 7%

Family Unit: 36 67%



Non-Instrument Measure:


Construct F-34: Referrals for Necessary Services

DOHVE TA 37 of 41





Process: 54 100% Program Documentation: 54 100% Community Agencies: 54 100%




Focus

# MOUs: 47 87%

% MOUs of

Community Agencies: 7 13%


N/A

Construct F-35: Number of MOUs

DOHVE TA 38 of 41





Process: 54 100% Program Documentation: 54 100% Community Agencies: 54 100%




Focus

Agencies with clear POC: 29 54%

Agencies with info sharing: 9 17%

Agencies with both: 13 24%

Collaborative meetings: 2 4%

ROI signed by family: 1 2%


N/A

Construct F-36: Information Sharing

DOHVE TA 39 of 41










unit=referral: 22 41% All Mothers: 5 9% Child: 3 6%

unit=family: 28 52% Mother & Child: 2 4%

unit=mother: 2 4% Caregivers: 1 2%

unit=child: 2 4% Family Unit: 41 76%



Non-Instrument Measure:


State Data System/ MIS: 5 9%

Referral Data Source MIS: 5 9%

Construct F-37: Receipt of Necessary Services

DOHVE TA 40 of 41



Additional DOHVE TA resources are available at:

http://www.mdrc.org/dohve/dohve_resources.html

For more information about the MIECHV Grantee Benchmark Performance Measures, please

contact a DOHVE1 TA Liaison at:

Susan Zaid, MA Jill Filene, MPH

DOHVE TA Deputy Director DOHVE TA Project Director

James Bell Associates James Bell Associates

3033 Wilson Blvd., Suite 650 3033 Wilson Blvd., Suite 650

Arlington, VA 22201 Arlington, VA 22201

[email protected] [email protected]

1 The purpose of the Design Options for Home Visiting Evaluation (DOHVE) is to provide

research and evaluation support for the Maternal, Infant and Early Childhood Home Visiting

(MIECHV) Program. The project is funded by the Administration for Children and Families

in collaboration with the Health Resources and Services Administration.

DOHVE TA 41 of 41

summary of miechv grantee benchmark performance measures · audit alcohol use disorders...

Documents