asnna justin fast, social initiatives specialist, michigan fitness foundation helen idzorek, snap-ed...

ASNNA

Justin Fast, Social Initiatives Specialist, Michigan Fitness Foundation

Helen Idzorek, SNAP-Ed & EFNEP Coordinator, Cooperative Extension Service, University of Alaska Fairbanks

Shailja Mathur, Senior Project Administrator, NJ SNAP-ED/EFNEP, NJ SNAP-Ed Support Networks, New Jersey Agriculture Experiment Station-RCE, Rutgers, The State University of New Jersey

Ana Claudia Zubieta, Ohio SNAP-Ed Director, Departments of Human Sciences and Extension, The Ohio State University

One Time Interventions

ASNNA

What is a “One Time Intervention” (OTI)?

• Formal or informal messages targeting participants who are not accessible beyond the initial intervention

• Administered to meet very specific needs of a community or in association with another event

• Face to face or using technology

ASNNA

• Great way to increase reach of people

• Reach people in non-traditional setting

• Reach people who lack motivation or face other barriers to attend a formal class

• Motivate participants to participate in more formal nutrition education

Why “One Time Interventions”?

ASNNA

• USDA FNS stresses the need to:– Increase reach– Increase use of practice-tested and evidence-

based interventions– Improve outcome evaluation of all interventions

• SNAP-Ed implements direct or indirect OTI out of necessity

• No evidence base of community of best practices exists

• The introduction of PSE in the FY13 SNAP-Ed guidance has set the stage for expanded use of OTI

What Do We Know?

ASNNA

• OTI are suitable with large and diverse groups (higher reach)

• OTI are problematic to implement with fidelity and evaluate with rigor

• There is a lack of “best practices” on OTI

Why a Survey?

ASNNA

• A workgroup to address these questions was formed after the annual ASNNA conference in February 2014

Justin Fast (Chair)Helen Idzorek Shailja Mathur Ana Claudia Zubieta

• We met via conference call several times• Developed a survey to distribute among SNAP-Ed

and EFNEP list serves • Analyzed and discussed results

How We Did It?

ASNNA

Survey Results

ASNNALead / Administrative Staff Program Staff

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

90.9%

10.9%

What is your role as it relates to nutrition education?

ASNNA

Yes85%

No15%

Do you implement any interventions which are one-time only?

ASNNA

40.5%

33.3%

14.3%

7.1%

4.8%

Component of a broader practice-tested intervention series

Practice-Tested

Research-Tested

None of the above

Component of a broader research-tested interven-tion series

Which situation best describesyour intervention?

ASNNA

2 4 5 10 15 20 30 45 60 80 90 105 120 150 180 2400

2

4

6

8

10

12

14

Minutes

Response F

requency

How long are these interventions?

ASNNA

44%

56%

recruit in advanceengage onsite

How are participants recruited?

ASNNA

2 5 10 15 20 25 30 35 40 45 80 100 200 2500

0.5

1

1.5

2

2.5

3

3.5

4

4.5

Reach (Number of Individuals)

Response F

requency

OTI Reach

ASNNA

Formative Process Outcome Impact (with comparison

group)

None of the above

0%

10%

20%

30%

40%

50%

60%

70%

80%

36.1%

69.4%

50.0%

8.3%

16.7%

Type of Evaluation

ASNNA

Attitudes Knowledge Self-efficacy Intent Consumption None of the above

0%

10%

20%

30%

40%

50%

60%

70%

38.5%

59.0%

25.6%

59.0%

33.3%

7.7%

Perc

ent

of

Resondents

Which outcome indicators are evaluated?

ASNNA

43.6%

5.1%

48.7%

2.6%

Quantitative (numbers)

Qualitative (narrative, sounds, images, etc.)

Mixed method (both numbers and narrative/visuals)

None of the above

What types of data are collected?

ASNNA

15.8%2.6%

36.8%

36.8%

7.9%

pre-post (self-reported)

pre-post (observed)

retrospective only (self-reported)

intent only (self-reported)

None of the above

What is the evaluation design?

ASNNA

73.0%

27.0%

Yes

No

Is demographic information collected?

ASNNA

We collect self-re-ported demographic data directly from

participants

We obtain demo-graphic data via a third party which

has collected it for other purposes (school, pantry, worksite, etc.)

We report observed demographic data

from our interaction with participants

None of the above0%

10%

20%

30%

40%

50%

60%

70%60.0%

28.6%25.7%

8.6%

How is demographic information collected?

ASNNA

Direct Indirect0%

10%

20%

30%

40%

50%

60%

70%

60.7%

46.4%

Are OTI reported to EARS as “Direct” or “Indirect”?

ASNNA

1. Provide information for future planning

2. Assessing needs of the population

3. Parents are more engaged and eager to participate when food tasting with their kids

4. Engaging participants in experiential and relevant learning

Successes of OTI

ASNNA

5. Recommendations for more classes

6. Often the last booth to close 7. Participants indicate intention to use resources

Successes of OTI

ASNNA

1. Lack of top-down support to enable evaluation plan for multi-faceted interventions

2. Difficulties administering evaluation tools

1. Time2. Setting3. Lack of motivation

3. Inability to measure behavior change4. Incapacity to comply with FNS

Challenges

ASNNA

• OTI are widely used and are an important part of SNAP-Ed programming. 

• A proportion of OTI programs implement one or more “best practices” in program implementation or evaluation.

• Establish the evidence base for OTIs required of SNAP-Ed programmers nationwide.

• Some common practices do need to be addressed.

• To ensure comparability between programs, it would be helpful to identify or establish a consistent “inventory” of potential SNAP-Ed outcome indicators from which practitioners could choose. 

Implications for Practitioners

ASNNA

• Validated tools to evaluate very concrete, individual, learning objectives often taught in OTI settings are needed.

• More process evaluations specifically aimed at identifying best practices for performing onsite evaluations in difficult settings are needed.

• Broad program outcome evaluations with internal comparison groups, i.e. “with” and “without” the addition of a OTI component.

Implications for Practitioners

ASNNA

THANK YOU!