evaluation fgdm native

8/10/2019 Evaluation FGDM Native

1/20

An Evaluation of Family Group

Decision Making with Native American Families

Toolkit1

1 Revised: December 1, 2011. For additionalinformation about the FGDM evaluation,please contact Lyscha Marcynyszyn,([email protected]) or Peter Pecora([email protected]) at Casey Family Programs.

D E C E M B E R 1 , 2 0 11


2/20

IntroductionTis oolkit was prepared by Casey FamilyPrograms Research Services, Lakota Oyate WakanyejaOwicakiyapi (LOWO), and Sicangu Child and FamilyServices in South Dakota.

Te oolkit contains a set of surveys and guides to helppeople and organizations start their own evaluations ofFamily Group Decision Making (FGDM) meetings,a child-centered, family engagement process. In theservice of this goal, we have enclosed all evaluationsurveys, consent and assent forms, and proceduralsummaries as examples for communities interested inconducting their own evaluation of this type of work.

All the forms enclosed herein were used to measure the

relationship between participant satisfaction with theFGDM meetings and avoidance of child placementamong families in two tribal nations in South Dakota.

casey family programs | LOWO | Sicangu


3/20

An Evaluation ofFamily Group Decision Makingwith Native American Families

3

Background

Given the high rates of foster care placement experienced among American Indian and Native American families, FGDM represents one viable approach to reduce the number of youth in out-of-home care for this population. Yet the effectiveness of FGDM as an alternative response strategy toplacement has not yet been examined carefully for American Indian children.

FGDM meetings develop and implement permanency plans for a child with the involvement ofrelatives and other signicant persons in the familys life. These meetings were instituted in SouthDakotas Pine Ridge and Rosebud communities as part of developing a tribal practice model forchild welfare services.

The Casey-LOWO-Sicangu Evaluation

Overview

A participant satisfaction survey is completed by youth, caregivers, family members, and otheradults who consent to participate in an evaluation of FGDM meetings within the Pine Ridge andRosebud communities. After collecting a sufcient number of surveys, Casey Research Services staffwill analyze the survey data and create a brief summary of the degree of satisfaction for each tribe.When 40 FGDM participants have completed the consumer satisfaction survey, analyses will beconducted to improve the survey.

Sample

Data collection is ongoing in the Pine Ridge and Rosebud communities.

Data A participant satisfaction survey is used to collect information from youth (ages 12 and older) andfamily members participating in FGDM meetings. For each completed FGDM meeting, we hopeto collect participant satisfaction surveys from at least one parent and one youth. Six months afterthe FGDM occurs, a Child Welfare program staff member, who is not the FGDM facilitator, will callthe parents involved in the meeting to ask about their perceptions of the session, the perceivedbenets of their participation, and suggestions for improvements. Examples of questions on thePhone Feedback Survey include: (a) How much is the family plan developed through the FGDMmeeting(s) being followed?; (b) How have things changed for the family since the FGDM meetings?;and (c) What are your suggestions for how to improve FGDM meetings? In addition, management


4/20


4

information system data on child and youth outcomes will be collected as well as demographicinformation on parents and youth who consent to participate.

Timeline

FGDM meetings began in June 2010. A report summarizing preliminary ndings will be completed inDecember 2012.

Implications

The evaluation of this program will provide useful data on the programs effectiveness andrecommendations for program improvement with the ultimate goal of program sustainability andreplication in other tribal communities in order to serve more at-risk youth and families.


5/20

able of ContentsData Collection Flowchart .............................................................. 6

Evaluation Procedures ...................................................................7

Adult Consent Form .................................................................... 10

Youth Consent Form .................................................................... 12

Participant Satisfaction Survey ..................................................... 13

Information Sheet ........................................................................ 16

Phone Follow-Up Survey at 6- and 12-months ............................ 18

casey family programs | LOWO | Sicangu


6/20


6

Data Collection Flowchart

Step 1: At the end of the FGDM meeting

Step 2

Step 3

Facilitator hands out:Consent Form for Adults, or

Youth Assent Form (for Ages 1217)

IF participantagrees to bein the study

Facilitatorcollects allforms andplaces them in1 envelope

For a TOTALof 3 formsfor eachparticipant

Facilitator hands out:

Information Sheet

And

Participant Satisfaction Survey

Returns them to program coordinator or evaluators. Forms include:

Consent for Adults Youth Assent (Ages 1217)

Information Sheet Participant Satisfaction Survey

Participants keep a copy of either the consent or the assent formdepending on their age so they know who to contact if they haveconcerns or no longer want to participate in the study.

Conrm one of the two boxes is checked:

o I agree to participate in this study.

o I do NOT agree to participate in this study.

And

printed name, signature, and date:

Printed name

Signature Date


7/20


8/20


8

Methodology

Method of data collection. A consumer satisfaction survey was used to collect information fromyouth and family members participating in the FGDM conference.

Survey. Items for the Participant Satisfaction Survey were culled from a variety of sources includingsample surveys from the American Humane Association. Many items were reworded to better tthe FGDM model used in Pine Ridge and Rosebud. All team members had input into writing and re-writing items. The current survey contains 27 items, with four values shown on the page: Belonging,Generosity, Mastery, and Interdependence.

Current Survey Work

The evaluation team plans to pool the participant satisfaction survey ndings across multiple sitesand thereby increase sample size. We hope to examine correlations between potential factors inparticipant satisfaction survey and these follow-up outcomes: FGDM plan compliance, serviceneeds, and youth residential placement status (e.g., in foster care, in family home) for many tribalnations. We are excited about these projects because they are focused on reducing the number ofchildren in foster care and this population is disproportionally represented in child welfare. For tribesin South Dakota, disproportionality ranges between 60% and 63%.

Commonly Asked Questions on the Information Sheet

Form: Information Sheet

Item: Suggested Response:

2. What is your Enrolled orPrincipal Tribe?

If participants, arent enrolled in their tribe they could list theirheritage tribe here.

6. FOR CAREGIVERS ONLY

What is your currentpartner status?

Some research indicates that child outcomes differ based on

who lives in the family home especially parents partners. Wewould like to understand who is living in the home where thechildren reside. This question is only for primary caregivers.For example, an aunt or grandmother who is not the primarycaregiver should skip this question.

The Collaboration

The evaluation tools and measures in this toolkit were developed collaboratively with Pete SmallBear, Carol Iron Rope-Herrera, Russ Conti, Erin Geary, Peter Pecora, and Lyscha Marcynyszyn inpartnership with Lakota Oyate Wakanyeja Owicakiyapi and Sicangu Child and Family Services.


9/20


9

For More Information

For additional information or questions about the FGDM evaluation, please contact LyschaMarcynyszyn, [email protected], 206.378.4665, or Peter Pecora, [email protected], atCasey Family Programs.

Tis is a draft. Te program and evaluation team welcome any changesor additions you may have.Tank you!


10/20


10

S a m p l e

Family Group Decision Making Consent Form for AdultsParents, Caregivers, Kin, or Young Adults Age 18 or Older

Study Description

Purpose and BenetesLOWO, SCFS, and Casey Family Programs would like to learn more about Family Group DecisionMaking meetings as a way to bring family preservation to native families. To do this, we areevaluating these meetings and would like to invite you to take part in this study. Your opinions willmake a major difference in improving services for other families in the future. Whether you decideto take part in the evaluation will not affect your relationship with the Tribal Program or theDepartment of Social Services. You will receive any follow-up services whether or not you participatein the evaluation.

ProceduresIf you decide to participate, you will complete two short surveys at the end of the meeting, whichwill take about 10 minutes to complete. The rst survey includes basic questions about you andyour family. For example, questions about your ethnicity, gender, and cultural identity. The secondsurvey includes questions about your experiences before and during the meeting. You and your childare free to skip any question you do not wish to answer. When the surveys are completed, pleaseput them into the envelope provided by the group leader (facilitator) who will seal the envelope. Thegroup leader will not see your answers.

If you take part in the evaluation, we will collect some information from the agency which referredyou for services. The information will help us determine whether Family Group Decision Makinghelped you and your family. Also a member of the study team may contact you by phone in afew months with a few other questions. Participation in this follow-up phone survey is completelyvoluntary. You and your child can decide not to take part at any time.

All the information from the surveys will be stored in locked le cabinets and on protectedcomputers. Information will be summarized by the evaluators and will be available only ingrouped form (averages) so your identity will be protected. All information will be destroyed withinseven years.

Risks, Stress, or DiscomfortWe do not know of any risk or discomfort from participation in the evaluation. Most people nd thatcompleting the survey is interesting. If you become upset while completing the survey, you can talkto the group leader. Some of the questions may be difcult to answer. You can refuse to answer anyquestion, for any reason. You can also stop participating in the study at any time.

We hope you will allow your child or youth to participate in our evaluation. In doing so, you will helpus understand how to better serve families and children.


11/20


11

S a m p l e

What if you have questions?

You can ask ____________________________ [Group Leader/ FGDM Facilitator] or contact the StudyEvaluators, Lyscha Marcynyszyn or Peter Pecora, at Casey Family Programs, 206.378-4665.

If you have more questions about your rights, you can also contact Adam Darnell, Co-Chair of the CaseyHuman Subjects Review Committee, 206.352.4200, or at [email protected].

You will receive a copy of this form.

Family Group Decision Making Consent Form for Adults:Parents, Caregivers, or Young Adults Over Age 18

Please sign this form and return it to the facilitator (group leader). Thanks!

Evaluation Team:Lyscha Marcynyszyn, Research Analyst | Casey Family Programs, 206.378.4665Peter Pecora, Managing Director of Research Services | Casey Family Programs, 206.270.4936

The evaluation study described above has been explained to me. I understand this process. Any questions I have about the evaluation will be answered by a member of the evaluation team listed above. As a token of our appreciation for your time, we will be providing you with a $10 gift card to Walmart.

For parents, guardians, or other legal representatives of participating Youth. Please Check One:

o ________________________________________has my permission to participate in this study.(youths name printed)

o _________________________________ does NOT have my permission to participate in this study.(youths name printed)

Printed name of parent, guardian, or other legal representative

Signature of parent, guardian, or other legal representative Date

For All AdultsPlease Check One: o I agree to participate in this study. o I do NOT agree to participate in this study.

Print name

Signature Date


12/20


12

S a m p l e

Family Group Decision Making: Youth Assent Form(Ages 12-17)

Description of this Evaluation Study

Casey Family Programs would like to learn more about Family Group Decision Making meetings byunderstanding how you felt about the meeting you attended today.

On two forms, there are some questions about you and your experience at the meeting. Thesesurveys give you the chance to let us know what went well and what could be done better. The twoforms will take less than 10 minutes to complete.

Your parent has given permission for you to complete the survey. The survey is private. NO ONEexcept the evaluators will be able to see the survey you complete. Your parents will not be able toread your answers. You can choose to ll out the survey or not. Nothing will happen to you if youdecide not to do it. You can skip any questions you want to skip. All information will be stored inlocked le cabinets and on protected computers.

If you become upset while answering the questions, you can talk to the person leading the group.

After you ll out the survey, please give it back to the Facilitator (the person leading the group). Also,a member of the study team may contact you by phone in a few months with a few other questions.

What if you have questions?

You can ask ____________________________ [Facilitator (Group Leader)] or contact the StudyLeaders, Lyscha Marcynyszyn and Peter Pecora at Casey Family Programs, 206.378-4665.

If you have more questions about your rights, you can also contact Adam Darnell, Co-Chair of the

Casey Human Subjects Review Committee, 206.352.4200, or at [email protected]. You will receive a copy of this form.

The evaluation has been explained to me. I understand this process. Any questions I have about theevaluation will be answered by the Study Leaders listed above. As a token of our appreciation foryour time, we will be providing you with a $10 gift card to Walmart.

Please Check One: o I agree to participate in this study. o I do NOT agree to participate in this study.

Print name

Signature Date


13/20


13

Youth Name _______________________ Relationship to Youth _________________ Date __________

Participant Satisfaction Survey Thank you for taking the time to complete this short survey. Your responses will make a majordifference in improving services for other families in the future. Please respond to ALL of thestatements on the front and back of this page.

What was your role in the meeting? o Youth o Parent o Family Member: __________________o Friend o Service Provider o Support Person o Other: ________________________________

Next to each statement below, please circle the number that reects your level of agreementwith the statement.

# Statements StronglyDisagree DisagreeSlightlyDisagree Neutral

Slightly Agree Agree

Strongly Agree

1 My family helped choose who attended the meeting. 1 2 3 4 5 6 7

2 My family was involved in deciding when and whereto hold the meeting. 1 2 3 4 5 6 7

3 The meeting place felt adequate and welcoming. 1 2 3 4 5 6 7

4 In case we needed language assistance, it wasavailable. 1 2 3 4 5 6 7

5 The purpose of the meeting was clear to me. 1 2 3 4 5 6 7

6 I felt prepared for the Family meeting. 1 2 3 4 5 6 7

7 My role in the meeting was clear to me. 1 2 3 4 5 6 7

8 There were more family members than serviceproviders invited to the meeting. 1 2 3 4 5 6 7

9 The role of the facilitator was discussed with theparticipants and was clear to me. 1 2 3 4 5 6 7

10 The facilitator remained neutral and impartial duringthe meeting. 1 2 3 4 5 6 7

11 Child and family needs were clearly identiedthrough this process. 1 2 3 4 5 6 7

12 I was actively involved in the process during themeeting. 1 2 3 4 5 6 7

13 Our family had private family time. 1 2 3 4 5 6 7

14 My family identied cultural needs during themeeting. 1 2 3 4 5 6 7


14/20


14

# Statements StronglyDisagree DisagreeSlightlyDisagree Neutral

Slightly Agree Agree

Strongly Agree

15Family traditions were respected in the family plan,which is consistent with my cultural beliefs andvalues.

1 2 3 4 5 6 7

16 I felt safe during the family meeting. 1 2 3 4 5 6 7

17 I said what I wanted to say during the meeting. 1 2 3 4 5 6 7

18 I thought others valued what I had to say. 1 2 3 4 5 6 7

19 The right people were at the meeting. 1 2 3 4 5 6 7

20 We had enough time for the meeting. 1 2 3 4 5 6 7

21 I had enough information to help make a good plan. 1 2 3 4 5 6 7

22Our family developed a plan that is realistic andaddresses the well-being, permanency, and safetyneeds of our child(ren).

1 2 3 4 5 6 7

23 My family understands the key elements of safety tobe included in the plan. 1 2 3 4 5 6 7

24 I expect my familys connections to the communityto become stronger as a result of this meeting. 1 2 3 4 5 6 7

25 I am satised with the plan for our child(ren). 1 2 3 4 5 6 7

26 I am satised with the service and results of themeeting. 1 2 3 4 5 6 7

27 I would recommend the Family meeting process toothers. 1 2 3 4 5 6 7

Any additional comments or suggestions would be appreciated. Tank you!

Revised July 15, 2010. Prepared by Casey Family Programs Research Services, Lakota Oyate Wakanyeja Owicakiyapi, and Sicangu Child and Family Services with appreciation tothe American Humane Association. For further information please contact Dr. Lyscha Marcynyszyn at [email protected].


15/20


15

Information SheetFirst Name Last Name

Address

City State ZipHome Phone ( ) Work Phone ( )

Relationship to Youth E-mail

1. What is your race or ethnicity? Check all that apply.o Native American or American Indian

o Alaskan Native

o Whiteo Hawaiian or Pacic Islander

o African American or Blacko Hispanic or Latino

o Asian

o Other (specify) _________________

2. What is your Enrolled/Principal Tribe? ________________________

3. What is your date of birth? _______________ MM / DD / YYYY

4. What gender are you?

o Male o Female

For Youth Only 5. What grade are you currently in? _______

For Caregivers Only 6. What is your current partner status?

o Married

o Living together in a marriage-like relationshipo Divorced

o Separated

o Single

o Other (specify) __________________


16/20


16

7. How do you see yourself in terms of your American Indian culture? Circle one number.

1 2 3 4 5

Low Identity High Identity

Low Identity : Currently, I have little connection with my tribal community, traditions, or ceremonies.

High Identity: Know your tribal language and practice life ways of the people (participate intraditional ceremonies or practices or tribal community events).

8. What is your level of Lakota language competency? Circle one number.

1 2 3 4 5

Dontspeak or nounderstanding

at all

Understand butcant speak Fluent


17/20

A n E v a l u a t i o n o f

F a m

i l y G r o u p

D e c

i s i o n M a k

i n g w i t h N a t i v e A m e r i c a n F a m i l i e s

c a s e y f a m

i l y p r o g r a m s

| L O W O | S i c a n g u

F a m

i l y N a m e

_______________________________

R e l a

t i o n s

h i p

t o Y o u t

h__________________

D a t e

_____________

P h o n e

F o l l o w - U p

S u r v e y a t

6 - a n

d 1 2 - m o n

t h s

T h a n

k y o u

f o r t a k

i n g

t h e

t i m e

t o c o m p l e t e

t h i s s u r v e y . Y

o u r r e s p o n s e s w

i l l m a k e a m a j o r

d i f f e r e n c e

i n i m p r o v i n g s e r v

i c e s

f o r o

t h e r

f a m

i l i e s i n

t h e

f u t u r e .

#

Q u e s t

i o n

N o

t a

t a

l l

0

S o m e w

h a

t

3

G r e a

t l y

6

1

H o w m u c

h i s t h e

f a m

i l y p l a n

d e v e

l o p e

d t h r o u g

h t h e

F G D M m e e

t i n g ( s )

b e i n g

f o l l o w e d

?

0

1

2

3

4

5

6

2

W h y d o y o u

f e e l

i t i s o r

i s n t

b e i n g

f o l l o w e d

?

3

H o w m u c

h o f a n

i m p a c t

d i d t h e

F G D M m e e

t i n g ( s )

h a v e o n y o u r

f a m

i l y ?

0

1

2

3

4

5

6

4

I n w

h a t w a y s

d i d i t h e l p m y f a m

i l y ?

H o w w a s

i t n o

t h e l p f u l

?

5

H o w m u c

h w a s

F G D M m e e t

i n g ( s ) r e s p o n s i

b l e

f o r

h e l p i n g y o u o b

t a i n a p o s i

t i v e

l i v i n g

s i t u a t

i o n

f o r y o u r c

h i l d ?

0

1

2

3

4

5

6

6

O v e r a

l l , h o w m u c

h i s y o u r

f a m

i l y d o i n g

b e t t e r n o w

t h a n

b e f o r e

t h e F

G D M

c o n f e r e n c e

( s ) ?

0

1

2

3

4

5

6

7

H o w

h a v e

t h i n g s c h a n g e

d f o r y o u r

f a m

i l y s i n c e

t h e

F G D M m e e

t i n g s ?

8

O v e r a

l l , t h e y o u t

h i s / a r e

d o i n g

b e t t e r n o w

t h a n

b e f o r e

t h e

F G D M m e e t

i n g ( s ) .

0

1

2

3

4

5

6

9

H o w

h a v e

t h i n g s c h a n g e

d f o r t

h e y o u t

h s i n c e

t h e

F G D M m e e

t i n g s

?

1 0

H o w m u c

h w o u

l d y o u r e c o m m e n

d F G D M t o o t

h e r

f a m

i l i e s ?

0

1

2

3

4

5

6

1 1

W h a t a r e y o u r s u g g e s

t i o n s

f o r h o w

t o i m p r o v e

F G D M m e e

t i n g s

?

1 2

W h a t k i n d o f s e r v

i c e s a n

d o t h e r s u p p o r t s

d o y o u n e e d n o w

b u t h a v e

n o t r e c e i v e

d ?

1 3

T i m e l

i n e o f

t h e y o u t

h s

l i v i n g s i

t u a t

i o n s i n c e

t h e m e e

t i n g .

H o w

h a s

i t c h a n g e

d ?


18/20


F a m

i l y G r o u p

D e c

i s i o n M a k


c a s e y f a m



F o r e a c

h m o n

t h , p

l a c e a n

X t h a t c o r r e s p o n d s

t o t h e

t y p e o f

l i v i n g s i t u a

t i o n

E x a m p

l e

R i g h t a f

t e r t

h e M e e

t i n g

N a m e o f

M o n

t h M a y

1 s t m o n

t h

2 n d m o n

t h

3 r d m o n

t h

4 t h m o n

t h

5 t h m o n

t h

T o d a y

( 6 t h m o n

t h )

__ P l a c e

d w

i t h R e l a t

i v e s o r

K i n

X

__ W i t h P a r e n

t s i n t h e i r H o m e

X

X

X

__ O u t o f

H o m e

C a r e

X

X

Y o u

t h 1 N a m e :_

_________________________________________

R i g h t a f

t e r t

h e M e e

t i n g

N a m e o f

M o n

t h_________________

1 s t m o n

t h

2 n d m o n

t h

3 r d m o n

t h

4 t h m o n

t h

5 t h m o n

t h

T o d a y

( 6 t h m o n

t h )

__ P l a c e

d w

i t h R e l a t

i v e s o r

K i n


t s i n t h e i r

H o m e

__ O u t o f

H o m e

C a r e

__ O t h e r

( N o t e

t y p e

i n e a c h c o

l u m n )

Y o u

t h 1 N a m e :_

_________________________________________

N a m e o f

M o n

t h_________________

( 6 t h m o n

t h )

7 t h m o n

t h

8 t h m o n t

h

9 t h m o n

t h

1 0 t h m o n

t h

1 1 t h m o n

t h

T o d a y

( 1 2 t h m o n

t h )

__ P l a c e

d w

i t h R e l a t

i v e s o r

K i n


t s i n t h e i r

H o m e

__ O u t o f

H o m e

C a r e

__ O t h e r

( N o t e

t y p e

i n e a c h c o

l u m n )


19/20


F a m

i l y G r o u p

D e c

i s i o n M a k


c a s e y f a m



Y o u

t h 2 N a m e :_

_________________________________________

R i g h t a f

t e r t

h e M e e

t i n g

N a m e o f

M o n

t h_________________

1 s t m o n

t h

2 n d m o n

t h

3 r d m o n

t h

4 t h m o n

t h

5 t h m o n

t h

T o d a y

( 6 t h m o n

t h )

__ P l a c e

d w

i t h R e l a t

i v e s o r

K i n


t s i n t h e i r

H o m e

__ O u t o f

H o m e

C a r e

__ O t h e r

( N o t e

t y p e

i n e a c h c o

l u m n )

Y o u

t h 2 N a m e :_

_________________________________________

N a m e o f

M o n

t h_________________

( 6 t h m o n

t h )

7 t h m o n

t h

8 t h m o n t

h

9 t h m o n

t h

1 0 t h m o n

t h

1 1 t h m o n

t h

T o d a y

( 1 2 t h m o n

t h )

__ P l a c e

d w

i t h R e l a t

i v e s o r

K i n


t s i n t h e i r

H o m e

__ O u t o f

H o m e

C a r e

__ O t h e r

( N o t e

t y p e

i n e a c h c o

l u m n )

R e v

i s e d

A p r

i l 4 , 2 0 1 1

. P r e p a r e

d b y C a s e y

F a m i l y P r o g r a m s

R e s e a r c

h S e r v i c e s ,

L a k o t a O y a

t e W a k a n y e j a

O w

i c a k

i y a p

i , S i c a n g u

C h i l d a n

d F a m

i l y S e r v i c e s , a n

d t h e

U n i v e r s

i t y o f

M i n n e s o

t a D u l u t

h C e n t e r f o r

R e g

i o n a

l a n d

T r i b a l

C h i l d W e l

f a r e

S t u d i e s , w

i t h a p p r e c

i a t i o n

t o t h e

A m e r

i c a n

H u m a n e

A s s o c

i a t i o n .

F o r f u r

t h e r

i n f o r m a t

i o n p l e a s e c o n t a c

t E r i n

G e a r y a t e g e a r y

@ d . u m n . e d u o r

D r .

L y s c h a

M a r c y n y s z y n a t

l m a r c y n y s z y n

@ c a s e y . o r g .


20/20

Casey Family Programs is the nations largest operating foundation focusedentirely on foster care and improving the child welfare system. Founded in 1966,we work to provide and improveand ultimately prevent the need forfoster

care in the United States.

Casey Family Programs

2001 Eighth Avenue, Suite 2700Seattle, WA 98121

P 800.228.3559

P 206.282.7300F 206.282.3555

[email protected]

evaluation fgdm native

Documents