a framework for evaluating community-based rehabilitation programmes in chinese communities

15
REHABILITATION IN PRACTICE A framework for evaluating community-based rehabilitation programmes in Chinese communities EVA YIN-HAN CHUNG 1,2,3 , TANYA L. PACKER 2,3,4 & MATTHEW YAU 5 1 Professional Development and Research Unit, SAHK, Hong Kong, 2 School of Occupational Therapy and Social Work, Centre for Research into Disability and Society, Curtin University of Technology, Australia, 3 Faculty of Health Sciences, Curtin Health Innovation Research Institute, Curtin University of Technology, Australia, 4 School of Occupational Therapy, Dalhousie University, Halifax, Canada, and 5 Discipline of Occupational Therapy, School of Public Health, Tropical Medicine and Rehabilitation Sciences, James Cook University, Townsville, Australia Accepted November 2010 Abstract Purpose. The primary aim of this study was to develop an evaluation framework that could effectively describe the quality of community-based rehabilitation (CBR) practice in Chinese communities. Method. This study adopted a case study approach to build and validate a CBR evaluation framework. Core elements of CBR programmes were defined from the literature to form an Initial Framework. Domains and elements of the Initial Framework were then verified with examples of CBR programmes cited in published articles. The revised framework was then further tested for relevance and appropriateness in the real life context through testing in five Chinese CBR programmes. Results. A final framework for evaluating CBR programmes was developed. It consists of 5 domains, 25 categorised core elements and 72 indicators. Conclusion. A comprehensive CBR evaluation framework was built and initially verified with domains, elements and indicators, and is ready for use in Chinese CBR settings. Keywords: Community-based rehabilitation, China, evaluation Introduction Community-based rehabilitation (CBR) is defined as ‘a strategy within general community development for rehabilitation, equalisation of opportunities and social inclusion of all children and adults with disabilities’ [1]. CBR is a common strategy employed in different countries to promote inclusion and participation of people with disabilities [2]. CBR programmes have been variously described as: 1. Having programmes, usually home-based, that focus on providing rehabilitation activities for people with disabilities [3,4]. 2. Working with communities to ensure that people with disabilities are included within the community [3,5]. 3. Addressing the problems of poverty of people with disabilities and their families, with income-generating activities or loan schemes of various types as the way to improve quality of life of people with disabilities [3,6]. 4. Working with the self-help and mutual help issues among people with disabilities or disabled peoples’ organisations [3,7]. 5. Concentrating upon the inequality of the position of people with disabilities within society and advocating for change to the societal and attitudinal barriers within society [3,8]. CBR has been evolving for nearly three decades and its practice varies by context and culture. In China, CBR programmes first emerged in the 1980s. Correspondence: Eva YH Chung, PhD, Professional Development and Research Unit, SAHK, 18/F., Pak Fuk Road, North Point, Hong Kong. Tel: þ852-3965-4024. Fax: þ852-2529-0536. E-mail: [email protected] Disability and Rehabilitation, 2011; 33(17–18): 1668–1682 ISSN 0963-8288 print/ISSN 1464-5165 online ª 2011 Informa UK, Ltd. DOI: 10.3109/09638288.2010.541545 Disabil Rehabil Downloaded from informahealthcare.com by National Silicosis Library on 11/03/14 For personal use only.

Upload: matthew

Post on 06-Mar-2017

212 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: A framework for evaluating community-based rehabilitation programmes in Chinese communities

REHABILITATION IN PRACTICE

A framework for evaluating community-based rehabilitationprogrammes in Chinese communities

EVA YIN-HAN CHUNG1,2,3, TANYA L. PACKER2,3,4 & MATTHEW YAU5

1Professional Development and Research Unit, SAHK, Hong Kong, 2School of Occupational Therapy and Social Work,

Centre for Research into Disability and Society, Curtin University of Technology, Australia, 3Faculty of Health Sciences, Curtin

Health Innovation Research Institute, Curtin University of Technology, Australia, 4School of Occupational Therapy, Dalhousie

University, Halifax, Canada, and 5Discipline of Occupational Therapy, School of Public Health, Tropical Medicine and

Rehabilitation Sciences, James Cook University, Townsville, Australia

Accepted November 2010

AbstractPurpose. The primary aim of this study was to develop an evaluation framework that could effectively describe the quality ofcommunity-based rehabilitation (CBR) practice in Chinese communities.Method. This study adopted a case study approach to build and validate a CBR evaluation framework. Core elements ofCBR programmes were defined from the literature to form an Initial Framework. Domains and elements of the InitialFramework were then verified with examples of CBR programmes cited in published articles. The revised framework wasthen further tested for relevance and appropriateness in the real life context through testing in five Chinese CBRprogrammes.Results. A final framework for evaluating CBR programmes was developed. It consists of 5 domains, 25 categorised coreelements and 72 indicators.Conclusion. A comprehensive CBR evaluation framework was built and initially verified with domains, elements andindicators, and is ready for use in Chinese CBR settings.

Keywords: Community-based rehabilitation, China, evaluation

Introduction

Community-based rehabilitation (CBR) is defined as

‘a strategy within general community development

for rehabilitation, equalisation of opportunities and

social inclusion of all children and adults with

disabilities’ [1]. CBR is a common strategy employed

in different countries to promote inclusion and

participation of people with disabilities [2]. CBR

programmes have been variously described as:

1. Having programmes, usually home-based,

that focus on providing rehabilitation activities

for people with disabilities [3,4].

2. Working with communities to ensure that

people with disabilities are included within the

community [3,5].

3. Addressing the problems of poverty of people

with disabilities and their families, with

income-generating activities or loan schemes

of various types as the way to improve quality

of life of people with disabilities [3,6].

4. Working with the self-help and mutual help

issues among people with disabilities or

disabled peoples’ organisations [3,7].

5. Concentrating upon the inequality of the

position of people with disabilities within

society and advocating for change to the

societal and attitudinal barriers within society

[3,8].

CBR has been evolving for nearly three decades

and its practice varies by context and culture. In

China, CBR programmes first emerged in the 1980s.

Correspondence: Eva YH Chung, PhD, Professional Development and Research Unit, SAHK, 18/F., Pak Fuk Road, North Point, Hong Kong.

Tel: þ852-3965-4024. Fax: þ852-2529-0536. E-mail: [email protected]

Disability and Rehabilitation, 2011; 33(17–18): 1668–1682

ISSN 0963-8288 print/ISSN 1464-5165 online ª 2011 Informa UK, Ltd.

DOI: 10.3109/09638288.2010.541545

Dis

abil

Reh

abil

Dow

nloa

ded

from

info

rmah

ealth

care

.com

by

Nat

iona

l Sili

cosi

s L

ibra

ry o

n 11

/03/

14Fo

r pe

rson

al u

se o

nly.

Page 2: A framework for evaluating community-based rehabilitation programmes in Chinese communities

According to official publications, the Chinese

government has put tremendous effort and resources

into the development of CBR in different parts of

China ever since that time. At the current time, CBR

is included as the Chinese government’s strategy to

promote ‘rehabilitation for all’ in their eleventh five-

year plan – their current five year plan. In 2009, the

Chinese budget for healthcare funding was increased

by 38% (118.1 billion yuan) compared to the budget

of 2008 [9]. Even in Hong Kong, which was a British

colony for 150 years and, since 1997, has been a

Special Administrative Region of China, the re-

sources being invested in CBR services continue to

increase [10]. Most programmes have adopted

Western CBR concepts; however, the uniqueness

of Chinese history and culture has made it difficult to

transfer these Western concepts and practices into

Chinese communities [11]. Hence, many CBR

programmes have had to find ways to succeed and

survive in local communities.

Cost-effectiveness of CBR programmes in China

and Hong Kong needs to be measured and under-

stood to ensure that these resources are justifiable

and wisely spent. It is essential to base cost-

effectiveness studies on quality programmes using

objective ways to measure programme outcomes.

According to Thomas and Thomas [12], however,

there has been little research on either outcomes or

the development of indicators with which to measure

quality or success in CBR. Robust indicators for

CBR have not been developed for either evaluation

or research purposes [5,13] in any culture or context.

Hence, the primary aim of this study was to develop

and validate an evaluation framework able to

examine and describe the quality of CBR practice

in Chinese communities. Such a framework should

permit characterisation and evaluation of each

programme according to its nature [14]. Core

elements of CBR programmes were first defined

from the literature and an Initial Framework drafted.

The framework was next verified using examples of

CBR programmes cited in the published literature.

This was followed by verification in the live context

using a case study approach with five existing CBR

programmes. All three phases are described in this

article. Prior to this, a review of existing literature is

presented.

Literature review

Recent work to delineate an evaluation model has

been carried out by some CBR researchers. Sharma

[15] reviewed 22 articles in order to analyse the

extent to which CBR programmes have been

evaluated over the past 30 years. This study revealed

that a variety of methods have been used in the

evaluation of CBR programmes in different commu-

nities including experimental designs, surveys and

qualitative methods. Qualitative and post-test de-

signs are the most common. The lack of consistency

in outcome measures and the lack of focus on

evaluation have been identified weaknesses in the

past evaluations of CBR programmes.

Cornielje et al. [16] were the first to introduce the

use of a classification model to evaluate CBR pro-

grammes. They presented an approach classifying

programmes according to four dimensions: ‘restora-

tion of quality of life’, ‘locus of power’, ‘commitment

to involve others’ and ‘types of response’. They used

these four dimensions to evaluate CBR programmes

using an agreed scoring system to categorise pro-

grammes. Their study provided a starting point for

evaluation of different CBR programmes highlight-

ing the importance of using a scoring system to aid

evaluation. However, more detailed work is needed

to define and describe the criteria used for classifying

programmes [15].

Wirz and Thomas [3] commented that ‘among

evaluations that have been undertaken, there has

been a tendency to describe practice rather than the

effectiveness of practice’ [3, p.163]. They empha-

sised the need for outcome indicators to measure the

effectiveness of CBR programmes. They examined

10 evaluation reports and classified the outcomes of

the programmes into three domains: (1) maximising

potential of people with disabilities, (2) service

delivery and (3) the environment where the person

with disability lives. They used a table format to

outline programme activities and outcomes. They

developed indicators to guide evaluation emphasis-

ing that indicators should be robust, easy to use and

related to the aims of the programmes. They also

recommended that these indicators should be tested

in the field in order to enhance CBR practice [3].

Wirz and Thomas provided good insight into the

development of a framework for programme evalua-

tion and outlined important considerations in the

delineation of an evaluation framework. However,

their postulations have not yet been fully elaborated,

operationalised or validated in practice. Among the

three domains mentioned, they only outlined the

activities, outcomes and indicators for the first

domain. They did not mention in their article how

each domain could be quantified and/or measured.

Kuipers and Quinn [17] adopted a cooperative

approach in a workshop to develop a framework to

guide the evaluation of CBR programmes. They

developed a template comprised of a number of

guiding questions within three domains (the people

domain, the programme domain and the perspective

domain). Velema and Cornielje [18] then developed

a list of evaluation questions and indicators for each

dimension. However, the work of Velema and

CBR framework 1669

Dis

abil

Reh

abil

Dow

nloa

ded

from

info

rmah

ealth

care

.com

by

Nat

iona

l Sili

cosi

s L

ibra

ry o

n 11

/03/

14Fo

r pe

rson

al u

se o

nly.

Page 3: A framework for evaluating community-based rehabilitation programmes in Chinese communities

Cornielje presented the same weakness as Wirz and

Thomas [3]; their framework and postulations were

not tested with CBR programmes to investigate

feasibility and applicability. Both Kuipers and Quinn

[17] and Velema and Cornielje [18] suggested the

use of evaluation questions to capture the necessary

information in an evaluation. However, the questions

suggested by both parties appeared to be mostly

broad and open ended questions that lacked quanti-

fication and measurements. Evaluation implies a

sense of comparison within/across programmes with-

in a time frame [18]; and, findings have to be

quantified to allow such comparison.

Following the work on the classification model by

Cornielje et al. [16] and Velema and Cornielje [18],

Finkenflugel et al. [14] reviewed the classification

model using 16 published articles describing rehabi-

litation programmes in the community. They con-

cluded that the classification model could be used to

structure the evaluation of and compare CBR

programmes of a diverse nature by using indicators

within a theoretical framework. Three types of

indicators are outlined in their articles; structure,

process and output indicators. Structure indicators

provide a description of the relevant aspects of the

project area, process indicators are used to describe

the process of a programme and outcome indicators

reflect the results of a programme [14].

Cornielje et al. [19] have continued the develop-

ment of their classification model and developed two

flowcharts that embed the evaluation questions

related to the programme environment and the

rehabilitation process. They introduced the use of

the management information system and emphasised

the role of such monitoring systems in evaluation.

They argued that any monitoring system should be

owned by the stakeholders within the system and

therefore the development of baseline data and

information systems should involve a participatory

process considering the political and cultural realities

of the context. They outlined the steps in the

building of a monitoring and evaluation system as

(1) develop objectives, (2) develop indicators, (3)

establish baseline data and (4) establish targets.

The World Health Organization has been devel-

oping a conceptual framework for CBR [20]. The

WHO recognised that there is no single model of

CBR appropriate for the whole world and they

proposed a ‘CBR Matrix’ or a common framework to

reflect a comprehensive multi-sectoral approach [2].

The CBR matrix consists of five components; health,

education, livelihood, empowerment and social

components. Each component is divided into five

elements and the elements are then sub-divided into

content headings [20]. The matrix suggests a pick

and mix option so that the practitioner can select the

most practical entry point or the next logical step

until a coherent programme of appropriate compo-

nents and elements is formed [20]. This matrix aims

at providing a framework for a coherent CBR

programme. Together with this matrix is the devel-

opment of the CBR guidelines in which a framework

for CBR is provided for making CBR a multi-

sectoral strategy and highlighting best practice in the

field [2]. The guidelines were expected to be

finalised and distributed in 2010 [21], but at this

time have not yet been released.

In summary, there appears to be consensus that a

framework or classification model would be useful to

highlight the unique dimensions of CBR programmes

and to guide programme evaluation. A matrix or

framework with a set of CBR objectives (or elements)

is advocated to enable evaluation of programmes with

a community focus but of a varied nature. Scholars

are recommending that outcomes of CBR pro-

grammes should be grouped into domains to facilitate

systematic collection and processing of data. They

further recommend that use of management strate-

gies, such as information management systems,

should facilitate the development of CBR programme

evaluation. Despite this consensus, proposed frame-

works have not yet been put into practice and they

lack experiential and empirical proof of their feasi-

bility, applicability and effectiveness in the field.

Formulation of an initial CBR framework based

on existing conceptual papers

Delineation of domains

As noted above, different scholars have delineated

broad domains of interest within CBR programmes;

some have also suggested detailed elements and/or

indicators. Formulation of the Initial Framework

first focused on finding consensus on the varying

views at the domain level.

Conceptual papers describing broad domains of

interest were purposefully selected from the literature

available as at March 2007 [22] and are listed in

Table I. Based on the literature, the Initial Frame-

work included four domains: (1) Outcomes of

Service Users, (2) Content and Mode of Service

Delivery, (3) Service Users in Context and (4)

Programme in Context.

Delineation of elements in each domain

Once the domains had been identified, conceptual

papers describing core elements of CBR were

purposefully selected so that elements could be

‘mapped’ against each domain. Key conceptual

papers were retrieved from journals as at March

1670 E. Y.-H. Chung et al.

Dis

abil

Reh

abil

Dow

nloa

ded

from

info

rmah

ealth

care

.com

by

Nat

iona

l Sili

cosi

s L

ibra

ry o

n 11

/03/

14Fo

r pe

rson

al u

se o

nly.

Page 4: A framework for evaluating community-based rehabilitation programmes in Chinese communities

2007. The core elements of CBR programmes

described in the selected papers were categorised

into the four domains. Descriptions of the elements

in the cited literature were extracted and further

translated into indicators for each element. Table II

diagrammatically presents a synthesis of the litera-

ture that reports or describes core elements of CBR

programmes. Results are briefly reviewed below.

Wirz and Thomas [3] examined the activities and

outcomes of 10 evaluation reports of CBR pro-

grammes and derived a set of activities and outcomes

of CBR programmes. The work of Velema et al. and

Velema and Cornielje [16,18] provided a framework

for evaluation by listing evaluation questions for

CBR projects. A Joint Position Paper of the Inter-

national Labour Office, UNESCO and World

Health Organization [1] outlined four essential

elements of CBR programmes that contribute to

sustainability. The WHO also outlined five compo-

nents in their CBR matrix: (1) health, (2) education,

(3) livelihood, (4) social and (5) empowerment

components. Kuipers and Quinn [17] outlined a

template for evaluating community rehabilitation

service. The template was derived at a workshop of

representatives from four specialist rehabilitation

services based in South-East Queensland, Australia.

Similar studies [23,24] describe core elements and

outcomes for CBR programmes. Elements described

by each are summarised in Table II.

Since the proposed framework was expected to be

used in the Chinese context, Chinese literature was

also searched, however, no Chinese frameworks were

found. In view of this, Chinese concepts of health

were reviewed and included. Hwu et al. [25]

provided the most valuable insight. They outlined

six dimensions/concepts of Chinese health (1)

independence; (2) physical functioning; (3) content-

ment in social interaction; (4) zest for life; (5)

serenity and (6) meaning.

Content validity – comparison to published

literature

Once constructed, the Initial Framework was next

tested for validity using examples of CBR pro-

grammes reported in the literature. Content validity

in this study was defined as the process of ensuring

that the framework contained all the elements that

comprehensively describe CBR practice. There are

no statistical indices that can assess content validity

and the determination of content validity is a rather

subjective process [26]. Examples of CBR pro-

grammes in published journals were therefore used

as a comparison against which to verify the compre-

hensiveness of the elements and domains, and thus

constitute a measure of content validity. It is

recognised that this retrospective analysis was limited

to the information reported. Had full details and

records of the programmes been available results

may have demonstrated inclusion of more elements

per programme. However, as the intent was to test

the utility of the framework, rather than the quality of

the programmes this approach was justified.

Method

The process of theory building using a case study

approach, as suggested by Eisenhardt [27], was used

to systematically examine validity of the Initial

Framework. The steps and their application in this

study are explained below.

Selecting cases. Existing descriptions of CBR pro-

grammes were used to verify the Initial Framework.

The inclusion of articles was based on the following

criteria:

1. formal publication in an academic journal;

2. programme described in the article was identi-

fied by the author as a CBR programme and

3. a clear description or evaluation of the pro-

gramme contents and practice.

Thirteen articles describing CBR programmes in

nine countries, published between 1988 and 2004

were found and included in this study [4, 28–39]. Of

these, three were in Chinese communities.

Crafting instruments. Each article was reviewed by

the investigator for (1) programme content,

Table I. The four domains of CBR.

Wirz and

Thomas

(2002)

Cornielje

et al.

(2000)

Velema and

Cornielje

(2003)

Hwu

et al.

(2002)

Kuipers and

Quinn

(2003)

ILO,

UNESCO,

WHO (2004)

WHO

(2004)

Domain One – Outcomes of Service User � � � � � � �Domain Two – Content and

Mode of Service Delivery

� � � � � �

Domain Three – Service Users in Context � � � �Domain Four – Programme in Context � � � �

CBR framework 1671

Dis

abil

Reh

abil

Dow

nloa

ded

from

info

rmah

ealth

care

.com

by

Nat

iona

l Sili

cosi

s L

ibra

ry o

n 11

/03/

14Fo

r pe

rson

al u

se o

nly.

Page 5: A framework for evaluating community-based rehabilitation programmes in Chinese communities

(2) outcome(s) and (3) distinctive features of the

programme. Excel spreadsheets were designed to

record findings.

Entering the field and analysing data. Articles were

read and reread; all descriptions of the programmes

were highlighted. Each highlighted description was

then examined and compared to the elements in the

Initial Framework. The indicators of the Initial

Framework were used to operationalise the elements.

The presence or absence of the elements reported in

each article was then tabulated.

Results

Consolidated findings from all 12 programmes are

shown in Table III which also illustrates the elements

present in each CBR programme reviewed. In

Domain One, authors tended to emphasise elements

related to physical and medical rehabilitation of

people with disabilities. The provision of home-

based and centre-based training for improvement of

physical function was common in the programme

descriptions. Another focus in this domain was

education. Most participants of the programmes

described were children with disabilities. Integration

of these children into mainstream or special schools

was frequently emphasised. The three Chinese CBR

programmes mentioned aspects related to the

elements of education, functional independence,

physical change, psychosocial change and participa-

tion in family and community life. However, the

element of economic independence was not de-

scribed in the Chinese programmes. Spiritual change

was not mentioned in any of the articles.

In Domain Two, most authors described efforts to

build networks within the community to facilitate

appropriate referral pathways. They also recognised

the importance of accessible channels to allow people

with disabilities to seek assistance and intervention.

Involvement of families in programmes was a

common characteristic with most articles emphasis-

ing the importance of identification, training and

support for the family trainers. Advocacy was

mentioned in a total of five articles but none of

these were within the Chinese programmes de-

scribed. The element of compliance to relevant

service standards was described in only one

programme.

Table II. Core elements of CBR as reviewed from literature.

Wirz and

Thomas

(2002)

Cornielje

et al.

(2000)

Velema and

Cornielje

(2003)

Hwu

et al.

(2002)

Kuipers and

Quinn

(2003)

ILO,

UNESCO,

WHO (2004)

WHO

(2004)

Domain One

Functional independence � � � � � �Education � � �Economic independence � � � �Participation in family & community life � � � � � �Physical status � � � �Psychosocial status � � � �Spiritual status �

Domain Two

Advocacy � � � � �Networking � � �Involvement of PWD’s family/relative � � � �Involvement of neighbours/community members � �CBR manager and programme management � � � �CBR workers � �Compliance to relevant service standards �Ethical practices �

Domain Three

Leadership role in the community � �Ownership of programme � �Locus of power � � �

Domain Four

Community support & recognition �Continuous growth & development �National/government level support � � �Multi-sectoral collaboration � � � �

�¼Presence of elements as reported by each author.

The review of literature used for development of the Initial Framework ended in March 2007.

1672 E. Y.-H. Chung et al.

Dis

abil

Reh

abil

Dow

nloa

ded

from

info

rmah

ealth

care

.com

by

Nat

iona

l Sili

cosi

s L

ibra

ry o

n 11

/03/

14Fo

r pe

rson

al u

se o

nly.

Page 6: A framework for evaluating community-based rehabilitation programmes in Chinese communities

Tab

le3

.E

lem

ents

iden

tifi

edin

pro

gra

ms

cite

din

lite

ratu

re.

Co

reel

emen

ts

Bo

yce

&

Pat

erso

n

20

02

/

Nep

al

No

rdh

olm

&

Lin

dq

uis

t,

19

99

/

Bo

tsw

ana

Val

dez

&

Mit

chel

l,1

99

9/

Neg

ros

Occ

iden

tal

Sh

arm

a&

Dee

pak

,

20

01

/No

rth

Cen

tral

Vie

tnam

Hai

&

Ch

uo

ng,

19

99

/

Vie

tnam

[4]/

So

uth

Ko

rea

Inth

irat

&

Th

on

glith

,

19

99

/Lao

Fin

nst

am

etal

.,

19

88

/

Pak

ista

n

Miles

,

19

98

/

Pak

ista

n

Ala

met

al.,

20

05

/

Ban

gle

des

h

Siu

&

Ch

ui,

20

04

/

Ho

ng

Ko

ng

Zh

uo

&N

an,

19

99

/

Ch

ina

[31

]/

Ch

ina

Do

ma

ino

ne

1.

Fu

nct

ion

alin

dep

end

ence

��

��

��

�2

.E

du

cati

on

��

��

��

��

3.

Eco

no

mic

ind

epen

den

ce�

��

��

�4

.P

arti

cip

atio

nin

fam

ily

and

com

mu

nit

y

life

��

��

��

5.

Ph

ysic

alst

atu

s�

��

��

��

��

6.

Psy

cho

soci

alst

atu

s�

��

��

7.

Sp

irit

ual

stat

us

Do

ma

intw

o

1.

Ad

voca

cy�

��

��

2.

Net

wo

rkin

g�

��

��

��

�3

.In

volv

emen

to

fre

lati

ves

and

fam

ilie

so

fp

eop

lew

ith

dis

abilit

ies

��

��

��

��

�4

.In

volv

emen

to

fn

eigh

bo

urs

/co

mm

un

ity

��

��

�5

.C

BR

man

ager

and

man

agem

ent

issu

e�

��

6.

CB

Rw

ork

ers

��

��

��

7.

Co

mp

lian

ceto

rele

van

tse

rvic

est

and

ard

s�

8.

Eth

ical

pra

ctic

es

Do

ma

inth

ree

1.

Lea

der

ship

role

inth

eco

mm

un

ity

�2

.O

wn

ersh

ipin

the

pro

gra

mm

e�

��

�3

.L

ocu

so

fp

ow

er�

Do

ma

info

ur

1.

Co

mm

un

ity

sup

po

rtan

dre

cogn

itio

n�

��

��

2.

Co

nti

nu

ou

sgro

wth

and

dev

elo

pm

ent

��

��

��

��

��

3.

Nat

ion

al/g

ove

rnm

ent

leve

lsu

pp

ort

��

�4

.C

ollab

ora

tio

nan

dsu

pp

ort

amo

ng

dif

fere

nt

sect

ors

��

��

��

CBR framework 1673

Dis

abil

Reh

abil

Dow

nloa

ded

from

info

rmah

ealth

care

.com

by

Nat

iona

l Sili

cosi

s L

ibra

ry o

n 11

/03/

14Fo

r pe

rson

al u

se o

nly.

Page 7: A framework for evaluating community-based rehabilitation programmes in Chinese communities

In Domain Three, most programmes described

the involvement of people with disabilities and their

relatives in self-help and mutual help activities.

Social gatherings and opportunities to share experi-

ences were frequently described. Taking a leadership

role in the community was mentioned by one Hong

Kong programme which had adopted the self-

management approach for the people with rheuma-

toid arthritis. Autonomy of service users in the

programme was mentioned in the article describing

the Vietnamese programme.

In Domain Four, training of local supervisors was

frequently described. In the initiation of pro-

grammes, it was regarded as important to provide

training prior to launching services. Many pro-

grammes translated the WHO manuals and used

them as a training guide for their workers. Besides

continuous growth and development, collaboration

and support among different sectors was commonly

described in programmes. Five articles mentioned

aspects that corresponded with the element of

community support and recognition and three

mentioned national/governmental level support.

In summary, the most commonly reported items

in the first domain were the elements related to the

‘physical dimension’, ‘education’ and ‘participation

in community life’. In Domain Two, the most

commonly reported elements were ‘networking’

and ‘involvement of relatives and families of people

with disabilities’. ‘Ownership in the programme’ was

reported most in Domain Three and ‘continuous

growth and development’ was the most common

element in Domain Four. Although, no articles

described activities corresponding to the spiritual

dimension or ethical practice elements, these ele-

ments were not removed from the framework as

these elements were considered essential in some of

the conceptual papers. Further verification of the

non-reported elements was delayed until the later

phase of this study. No descriptions resulted in the

need to add elements.

In conclusion, an Initial Framework with four

domains was built from the review of seven

conceptual papers. The framework was validated

through comparison to 13 CBR programme exam-

ples cited in literature setting the stage for the second

validity study undertaken in the real life context of

existing CBR programmes.

Content validity – comparison to existing

programmes in Chinese communities

This study also adopted the case study approach in

order to test the framework in real life settings. The

intent was to specifically test the framework within a

Chinese context. A multiple, embedded case study

design added reliability to findings and offered a

thorough understanding of cases in the study [40].

The embedded case study design allowed the

investigator to study the programmes through the

pre-selected categories of descriptions; the different

domains, elements and indicators in the frame-

work [41].

Methods

Selecting cases. Five CBR programmes in Hong

Kong or China were purposefully selected to inform

an understanding of the research problem and

central phenomenon in the study [42]. As stated in

the introductory part of this article, CBR pro-

grammes have been variously described as: (1)

having programmes, usually home-based, that focus

on providing rehabilitation activities for people with

disabilities [3,4]; (2) working with communities to

ensure that people with disabilities are included

within the community [3,5]; (3) addressing the

problems of poverty of people with disabilities and

their families, with income-generating activities or

loan schemes of various types as the way to improve

quality of life of people with disabilities [3,6]; (4)

working with the self-help and mutual help issues

among people with disabilities or disabled peoples’

organisations [3,7] and (5) concentrating upon the

inequality of the position of people with disabilities

within society and advocating for change to the

societal and attitudinal barriers within society [3,8].

Since the understanding of CBR varies and not all

programmes in practice have all of the above

characteristics, programmes that had at least three

of the above were eligible for inclusion in this study.

Five additional inclusion criteria were applied: (1)

CBR programmes carried out in Hong Kong or in

Mainland China; (2) target service users were

Chinese people with disabilities; (3) programmes

had been operating for 2 years or more; (4)

programmes were formally registered in the local

community and (5) programmes having autonomy in

their budget management, staff management and

administration.

Ethics approval was gained from Curtin University

Human Research Ethics Committee (Reference

Number HR 68/2007) [22]. Programmes were

recruited via networking by the investigator or

appropriate agencies. Letters of invitation, including

a description of the research process, were forwarded

to potential programmes. Upon consent, pro-

grammes were then contacted by the researcher.

Programme users and workers were identified by

programme managers. Voluntary, informed consent

was obtained from all participants prior to their

participation. Each participant received an informa-

1674 E. Y.-H. Chung et al.

Dis

abil

Reh

abil

Dow

nloa

ded

from

info

rmah

ealth

care

.com

by

Nat

iona

l Sili

cosi

s L

ibra

ry o

n 11

/03/

14Fo

r pe

rson

al u

se o

nly.

Page 8: A framework for evaluating community-based rehabilitation programmes in Chinese communities

tion sheet and provided written consent. Participants

were informed that they could withdraw their

participation without prejudice.

Crafting instrument and protocols. Multiple data

collection methods were used to collect data in the

selected programmes. Developed to ensure consis-

tency of data collection procedures across pro-

grammes, the Case Study Protocol included an

overview of the research project, field procedures,

case study questions and a guide for the case study

report. The use of the Protocol standardised the data

collection procedures and enhanced the validity and

reliability of the case study [40]. Data were collected

through interviews, observations, reading of pro-

gramme documentation, home visits and guided by a

‘Template for Data Collection’ based on the

domains, elements and indicators of the Initial

Framework. An ‘Indicator Summary Template’ was

also designed using Microsoft Access to tabulate the

huge volume of data recorded with respective to each

element and domain. The template provided a matrix

that combined data collected from different sources.

Entering the field. Detailed examination of each

programme was undertaken during a 4-day field

visit. The first author, who is fluent in English,

Mandarin and Cantonese, visited the selected

programmes and examined the objectives and

activities of each programme. She read publications,

service materials and any available programme

reports. Interviews with the programme manager,

CBR workers and service users (in the form of visits

to participant’s home or activity programmes) were

carried out in each programme using a semi-

structured interview. The following was noted in

the process: (1) the objectives of the programme; (2)

the description of activities carried out in the

programme; (3) any stated outcomes and indicators

to describe practice and (4) reasons for the objec-

tives, activities and outcomes for the programme.

Analysing data.

1. All interviews were transcribed. Observations

and findings from the document review were

recorded in the Template for Data Collection.

The analysis of all transcripts and documents

was done in the original language (i.e.,

Chinese) by the primary author with input

from the second author. The second author

provided methodological support and pro-

vided an international perspective where

needed. The third author provided a perspec-

tive from the Chinese side.

2. Two types of data analysis were carried out.

Within-case analysis – combining all sources

of data for each programme; across case

analysis – aggregating data from all pro-

grammes to determine the occurrence of

elements and domains across programmes;

Presence, absence and the most common CBR

elements in the four domains were identified and

tabulated. Data (for example programme objectives

and activities) reported by programmes that could

not be matched to indicators in the Initial Frame-

work were considered as potential new items for

addition to the Framework. To be considered as a

new item, it had to have appeared in any of the

programmes with a clear description of its process

and outcomes by the programme manager, workers

and/or users. As noted, analysis to this point was

conducted in the original language. Once presence

and/or absence of items were determined and a list of

potentially new items was completed, they were

translated to English. All potential items in the

Framework were then examined and edited by the

research team. During the editing process, all data

collected were thoroughly examined by the research

team with regard to organisation, grouping and

wording of domains, elements and indicators in the

Framework. The team reviewed all the items in the

Revised Framework to check whether the descrip-

tions were all clear and relevant. The rationale for

and the nature of change in the Initial Framework

were recorded in written format. Consensus was

reached regarding all modifications in the frame-

work.

Results

Nine programmes were approached with seven

programmes responding positively for this study.

Five programmes among the seven met the selection

criteria for inclusion. The profile of each programme

can be seen in the within-case analysis (see Table

IV). The across case analysis demonstrated that all

elements in the Initial Framework were present in at

least one of the five programmes (see Table IV). Two

items, not originally included in the Initial Frame-

work emerged from the analysis: (1) early interven-

tion and (2) programme sustainability. The

indicators for ‘early intervention’ found in the data

were (1) service user identified in early stage of

illness; and (2) service user received early interven-

tion or treatment. The indicators for ‘sustainability of

programme’ were (1) stable financial resources for

the continuing existence of the programme in the

community; (2) stable human resources for continu-

ing existence of programme in the community and

(3) continuous entry of new service users into the

programme. The frequency of data matching the

CBR framework 1675

Dis

abil

Reh

abil

Dow

nloa

ded

from

info

rmah

ealth

care

.com

by

Nat

iona

l Sili

cosi

s L

ibra

ry o

n 11

/03/

14Fo

r pe

rson

al u

se o

nly.

Page 9: A framework for evaluating community-based rehabilitation programmes in Chinese communities

indicators of these new elements (as shown in Table

V) demonstrated the prominence of these elements

in the studied CBR programmes.

The new items were placed into the framework

and all domains, elements and their respective

indicators were again reviewed by the research team.

Renaming of domains, changing of wording and

reorganisation of the elements in the framework was

undertaken. Consequently, five rather than four

domains emerged: (1) Participant Outcomes, (2)

CBR Programme Content, (3) Participant Govern-

ance/Empowerment, (4) Community Ownership

and (5) Programme Operation and Development.

Three original elements, ‘ethical practice’, ‘compli-

ance to relevant service standards’ and the ‘contin-

uous growth and development’, were moved to the

new, fifth Domain. This domain included all

elements related to programme operation, service

management, quality assurance, programme sustain-

ability and continuous development. This domain

was recognised as different from the other four

domains. Although universal to all rehabilitation

programmes regardless of their nature, it was

considered an essential domain in the framework.

Table IV. Programme summary table.

Framework elements

Programme

1 2 3 4 5

Domain One

1.1 Functional independence � � � �1.2 Education � � � �1.3 Economic independence � � � �1.4 Participation in family and community life � � � � �1.5 Physical dimension (Chinese sense) � � � � �1.6 Psychosocial dimension (Chinese sense) � � � � �1.7 Spiritual dimension (Chinese Sense) � � �

Domain Two

2.1 Advocacy � � � � �2.2 Networking � � � � �2.3 Involvement of relatives and families of PWD � � � � �2.4 Involvement of neighbours/community Members � � �2.5 CBR manager and management issue � � � � �2.6 CBR workers � � � �2.7 Compliance to relevant service standards � �2.8 Ethical practices �

Domain Three

3.1 Leadership role in the community � �3.2 Ownership in the programme � � �3.3 Locus of power � � �

Domain Four

4.1 Community support and recognition � � � � �4.2 Continuous growth and development � � �4.3 National/government level support � �4.4 Collaboration and support among different sectors � � � �

�¼Presence of element.

Table V. Programme summary table for the added items and their respective indicators.

Added Elements and Indicators

Programme

1 2 3 4 5

Early detection and intervention

User identified in early stage of illness � � � �User received early intervention for treatment � � � �

Sustainability of programme

With stable financial resource for the continuing existence of the programme in the community � � � � �With stable human resource for the continuing existence of the programme in the community � � �With continuous entry of new service users into the

Programme � � � �

�¼ Presence of elements.

1676 E. Y.-H. Chung et al.

Dis

abil

Reh

abil

Dow

nloa

ded

from

info

rmah

ealth

care

.com

by

Nat

iona

l Sili

cosi

s L

ibra

ry o

n 11

/03/

14Fo

r pe

rson

al u

se o

nly.

Page 10: A framework for evaluating community-based rehabilitation programmes in Chinese communities

The two newly added elements were added to the

framework. ‘Early detection and intervention’ was

put in Domain One and ‘Sustainability of pro-

gramme’ was in Domain Five. With the revised

domains, elements and indicators, the Revised

Framework was confirmed and is shown in Table VI.

The frequency of the occurrence of indicators in

the Revised Framework is presented in Table VII to

show the prevalence of items. All indicators were

found in the data of the five programmes. In Domain

One (Participant Outcomes), ‘changed in physical

functioning’ and ‘participant identified in early stages

of illness’ were found to be most common. In

Domain Two (CBR Programme Content), the most

commonly reported items were ‘enhanced family

members’ level of knowledge, coping skills and

techniques’ and ‘worked with community to raise

awareness about the need for and benefits of the

CBR programmes’. In Domain Three (Participant

Governance/Empowerment), ‘people with disabil-

ities (or their family members) participated in

planning, execution and monitoring of interventions

in the programme’ was reported most commonly.

For the Domains Four (Community Ownership) and

Five (Programme Operation and Development), the

most commonly reported items were ‘programme is

known by local community’ and ‘programme showed

a clear organizational framework’, respectively.

Discussion

The process of framework building

This research study is significant in the development

of CBR as it has developed and validated a frame-

work to examine, describe and compare different

Chinese CBR programmes. The framework informs

practitioners, researchers, policy makers and funding

bodies of the core components of CBR programmes

and provides multiple indicators that can be used for

programme evaluation. As suggested by the litera-

ture, there is no single set of indicators to monitor

and evaluate the outcomes of CBR practice due to its

complex nature, hence, a descriptive framework with

multiple indicators to guide evaluation is regarded by

researchers and programme providers as more

valuable than a rigid monitoring system [3,18]. With

the understanding of the essential components of

CBR programmes and the desired outcomes, this

practical evaluation model can be used by research-

ers, service provider and workers while still con-

sidering and respecting the unique context of

individual programmes.

The Initial Framework was built from a synthesis

of the seven conceptual papers regarding CBR

programme evaluation. The use of a taxonomy

embedding the various dimensions (or elements) of

CBR into composite domains enables a simple, but

comprehensive description of a CBR programme

proving useful insight for funders, managers and

workers. Unlike the CBR matrix developed by the

WHO, the framework designed here is not intended

for a quick ‘pick and mix’ according to the preference

of the users. Rather, it aims to identify the core

elements and domains to be included in a CBR

programme. A best practice programme should

demonstrate the presence of some elements in all

domains. The presence of more elements in a

programme indicates the likelihood of achievement

of more successful outcomes by a programme.

The Initial Framework, built on the thinking of

international and Chinese scholars was validated

using 13 international programmes cited in journal

articles. As shown from the tabulated findings, most

elements of the framework could be found in the

pool of selected programmes, warranting further

validation in the real life context of existing CBR

programmes in Chinese communities.

Findings in the final validation study mirrored that

of the first – most elements in the Initial Framework

were present in the five Chinese programmes.

However, two additional elements were identified

and added ensuring its completeness and relevance

in the Chinese context.

The added elements were ‘early detection and

intervention’ and ‘sustainability of the programme’.

Since CBR is usually incorporated into the primary

health care system in China [12], it is obvious that

CBR programmes have a definite role in the early

detection of and intervention for people with

disabilities. Most Chinese CBR programmes tended

to use a door-to-door survey as the initial step in

setting up of the programmes [39]. With a door-to-

door survey, the CBR programmes easily located

people with various kinds of illness and/or disabilities

isolated at home. Necessary interventions could then

be offered. One of the main target populations in the

five CBR programmes recruited in this study was

children with disabilities. Program staff actively

identified those children in the early stages of illness

(or disability) and offered immediate interventions.

The second added element related to the ‘sustain-

ability of the programme’. Some of the programmes

recruited in this phase were funded and organised by

foreign agencies. They employed expatriate staff to

set up programmes in the local community with the

hope that the programme would become sustainable

in the community. Once established, the expatriate

funder expected to invest resources to develop CBR

programmes in other regions. The pre-requisites for

sustainability were regarded as a well-established

system and adequate resources. However, similar to

some of the programmes cited in the CBR literature,

CBR framework 1677

Dis

abil

Reh

abil

Dow

nloa

ded

from

info

rmah

ealth

care

.com

by

Nat

iona

l Sili

cosi

s L

ibra

ry o

n 11

/03/

14Fo

r pe

rson

al u

se o

nly.

Page 11: A framework for evaluating community-based rehabilitation programmes in Chinese communities

Table VI. The revised framework.

Core elements Outcome indicator

Domain One – Focus on Participant Outcomes

1.1 Functional

independence

1.1.1 Changed in functional status

1.1.2 Changed in health status

1.2 Education 1.2.1 Changed in educational level

1.2.2 Acquired general/specific skills or knowledge

1.3 Economic

independence

1.3.1 Changed in participation in productive activities

1.3.2 Changed in economic status

1.4 Participation in

family and

community life

1.4.1 Changed in use of the community services and facilities

1.4.2 Changed in frequency and quality of engaging in meaningful activities in various systems

(such as marriage, friendship)

1.4.3 Changed in frequency of participating in cultural/religious activities

1.4.4 Changed in inclusion status

1.5 Physical change 1.5.1 Changed in physical functions

1.5.2 Changed in mobility

1.6 Psychosocial change 1.6.1 Changed in cognitive-behavioural functions

1.6.2 Changed in attitude and motivation

1.6.3 Changed in social skills

1.6.4 Changed in social relationships

1.7 Spiritual change 1.7.1 Changed in sense of serenity

1.7.2 Changed in sense of meaning

1.7.3 Changed in sense of zest for life

1.8 Early detection and

intervention

1.8.1 Participants identified in early stage of illness

1.8.2 Participants received early intervention for treatment

Domain Two – CBR Related Programme Content

2.1 Advocacy 2.1.1 Promoted change of people with disabilities in their participation in various systems

2.1.2 Reduced discriminatory barriers and practices

2.1.3 Changed the law and legislation regarding people with disabilities, policies and disability

2.1.4 Promoted a barrier-free environment for people with disabilities

2.2 2.2 Networking 2.2.1 Provided proper channels for people with disabilities

2.2.2 Carried out networking activities to make proper referrals or service matching

2.2.3 Established profile of networking

2.2.4 Linked with other services or programmes

2.3 Involvement of

relatives and

families of people

with disabilities

2.3.1 Involved families of people with disabilities in programme

2.3.2 Showed positive attitudes towards family members of people with disabilities

2.3.3 Enhanced family members’ level of knowledge, coping skills and techniques to help the

person with disabilities

2.3.4 Provided benefit to family members

2.3.5 Showed satisfaction with programme by family members of people with disabilities

2.4 Involvement of neighbours/community members

2.4.1 Involved community members (volunteers) in programme

2.5 CBR manager 2.5.1 Works with community to raise awareness about the need for and benefits of the CBR

programme

2.6 CBR workers 2.6.1 Liaise between the people with disabilities and services in the community

2.6.2 Worked as support person to advocate participation and inclusion

Domain Three – Participant Empowerment/Governance

3.1 Leadership role in

the community

3.1.1 People with disabilities(or their family members) participated in leadership training

activities

3.1.2 People with disabilities(or their family members) assumed leadership roles in the

community and in appropriate context

3.2 Self-help and mutual

help

3.2.1 People with disabilities(or their family members) participated in self-help activities/

networks

3.3 Autonomy in

Programme

3.3.1 People with disabilities(or their family members) had their voices heard by the programme

3.3.2 People with disabilities(or their family members) participated in planning, execution and

monitoring of interventions in programme

Domain Four – Community Ownership

4.1 Community support

and recognition

4.1.1 Programme is known by local community

4.1.2 Programme is satisfied by local community

4.1.3 Programme is granted political support in the local community

4.1.4 Programme is granted financial/material support in local community

4.1.5 Programme is owned by the local community

(continued)

1678 E. Y.-H. Chung et al.

Dis

abil

Reh

abil

Dow

nloa

ded

from

info

rmah

ealth

care

.com

by

Nat

iona

l Sili

cosi

s L

ibra

ry o

n 11

/03/

14Fo

r pe

rson

al u

se o

nly.

Page 12: A framework for evaluating community-based rehabilitation programmes in Chinese communities

Table VI. (Continued).

Core elements Outcome indicator

4.2 National/

Government level

support

4.2.1 Programme is linked to government services

4.2.2 Programme is coordinated by local/central government

4.2.3 Programme is allocated adequate resources from the government

4.3 Collaboration and

support among

different sectors

4.3.1 Programme is collaborated horizontally with related sectors

4.3.2 Programme is collaborated vertically between sectors of different levels (national level,

intermediate level, community level)

4.3.3 Programme is collaborated between various referral services

Domain Five – Programme Operation and Development

5.1 Compliance to

relevant service

standards

5.1.1 Programme identified relevant standards pertaining to service

5.1.2 Programme complied with relevant service standards

5.2 Ethical practices 5.2.1 Programme identified areas of ethical practice that were relevant to service

5.2.2 Programme promoted ethical practice

5.3 Management Issues 5.3.1 Programme showed a clear organisational framework

5.3.2 Programme showed a documented structure in management of human and financial

resources

5.4 Sustainability 5.4.1 With stable financial resource for the continuing existence of programme in the community

5.4.2 With stable human resource for the continuing existence of programme in the community

5.4.3 With continuous entry of new service users into the programme (to demonstrate a need for

such a programme to be sustained in the community).

5.5 5.5 Continuous

growth and

development

5.5.1 Provided staff training activities to promote continuous development

5.5.2 Carried out research activities for programme development

5.5.3 Provided training/materials/reference to staff and to community

5.5.4 Showed new ideas in programme development

Table VII. Checking relevance of indicators in the revised framework.

Indicators Total

1.1.1 Changed in functional status 4

1.1.2 Changed in health status 2

1.2.1 Changed in educational level 3

1.2.2 Acquired general/specific skills or knowledge 2

1.3.1 Changed in participation in productive activities 4

1.3.2 Changed in participation in economic status 3

1.4.1 Changed in use of the community services and facilities 2

1.4.2 Changed in frequency and quality of engaging in meaningful activities in various systems 4

1.4.3 Changed in frequency of participating in cultural/religious activities 3

1.4.4 Changed in inclusion status 1

1.5.1 Changed in physical functioning 5

1.5.2 Changed in mobility 3

1.5.3 Changed in general physique 1

1.6.1 Changed in cognitive-behavioural functions 2

1.6.2 Changed in attitude and motivation 4

1.6.3 Changed in social skills 2

1.6.4 Changed in social relationships 2

1.7.1 Changed in sense of serenity 2

1.7.2 Changed in sense of meaning 2

1.7.3 Changed in sense of zest for life 1

1.8.1 Participant identified in early stages of illness 5

1.8.2 Participant received early intervention for treatment 3

2.1.1 Promoted change for people with disabilities in their participation in various systems 4

2.1.2 Reduced discriminatory barriers and practices 4

2.1.3 Changed the law and legislation regarding people with disabilities, policies and disability 4

2.1.4 Promoted a barrier-free environment for people with disabilities 2

2.2.1 Provided proper channels for people with disabilities 4

2.2.2 Carried out networking activities to make proper referrals or service matching 3

2.2.3 Established profile of networking 1

2.2.4 Linked with other services or programmes 4

2.3.1 Involved families of people with disabilities in programme 5

(continued)

CBR framework 1679

Dis

abil

Reh

abil

Dow

nloa

ded

from

info

rmah

ealth

care

.com

by

Nat

iona

l Sili

cosi

s L

ibra

ry o

n 11

/03/

14Fo

r pe

rson

al u

se o

nly.

Page 13: A framework for evaluating community-based rehabilitation programmes in Chinese communities

even the programmes in which local staff had

gradually taken over the management role in the

programme tended to rely heavily on financial

resources from a foreign agency.

Interestingly, two elements included in the Initial

Framework (spiritual status and ethical practice)

based on the conceptual papers were not found in

any of the programmes reported in the literature.

These elements were, however, found in the pro-

grammes who participated in the second validation

study. Both represent somewhat elusive constructs

and authors reporting on programmes may have

lacked tangible ways to measure or report on these

elements. Their inclusion in the framework, together

with potential indicators, may provide a mechanism

for programmes to more easily evaluate and report

existence and/or absence of outcomes related to

these elements.

The final reorganisation of the framework resulted

in elements being assigned to five, rather than four

domains. It is believed that CBR programmes can be

described in a comprehensive way using these five

domains as they include the five principles of CBR as

stated by the WHO, namely, (1) inclusion, (2)

participation, (3) empowerment, (4) self-advocacy

and (5) sustainability [20]. Inclusion is reflected by

the element Advocacy of Domain Two, participation

can be reflected by elements Education, Economic

Independence, Participation in family and commu-

nity life and Leadership Role in the Community.

Elements of Domain Three reflect the principle of

empowerment and self-advocacy. Sustainability of

programmes can be found in Domain Five. This also

suggests that this framework is compatible with the

CBR concepts and WHO principles and CBR

matrix.

Table VII. (Continued).

Indicators Total

2.3.2 Showed positive attitudes towards family members of people with disabilities 4

2.3.3 Enhanced family members’ level of knowledge, coping skills and techniques to help the person with disabilities 5

2.3.4 Provided benefit to family members 2

2.3.5 Showed satisfaction with programme by family members of people with disabilities 2

2.4.1 Involved community members (volunteers) in programme 4

2.5.1 Worked with community to raise awareness about the need for and benefits of the CBR programme 5

2.6.1 Liaised between people with disabilities and services in the community 3

2.6.2 Worked as support person to advocate participation and inclusion 4

3.1.1 People with disabilities (or their family members) participated in leadership training activities 2

3.1.2 People with disabilities (or their family members) assumed leadership roles in community and in appropriate

context

2

3.2.1 People with disabilities(or their family members) participated in self-help activities/networks 3

3.3.1 People with disabilities(or their family members) had their voices heard by the programme 3

3.3.2 People with disabilities(or their family members) participated in planning, execution and monitoring of

interventions in the programme

4

4.1.1 Programme is known by local community 5

4.1.2 Programme is satisfied by local community 2

4.1.3 Programme is granted political support in the local community 1

4.1.4 Programme is granted financial/material support in local community 2

4.1.5 Programme is owned by the local community 1

4.2.1 Programme is linked to government services 2

4.2.2 Programme is coordinated by local/central government 1

4.2.3 Programme is allocated adequate resources from the government 1

4.3.1 Programme is collaborated horizontally with related sectors 3

4.3.2 Programme is collaborated vertically between sectors of different levels (national level, intermediate level,

community level)

2

4.3.3 Programme is collaborated between various referral services 2

5.1.1 Programme identified relevant standards pertaining to services 2

5.1.2 Programme complied with relevant service standards 2

5.2.1 Programme identified areas of ethical practice that were relevant to services 1

5.2.2 Programme promoted ethical practice 1

5.3.1 Programme showed a clear organisational framework 5

5.3.2 Programme showed a documented structure in management of human and financial resources 1

5.4.1 With stable financial resource for the continuing existence of the programme in community 2

5.4.2 With stable human resource for the continuing existence of the programme in community 2

5.4.3 With continuous entry of new service users into the programme. 4

5.5.1 Provided staff training activities to promote continuous development 3

5.5.2 Carried out research activities for programme development 1

5.5.3 Provided training/materials/reference to staff and to community 1

5.5.4 Showed new ideas in programme development 1

1680 E. Y.-H. Chung et al.

Dis

abil

Reh

abil

Dow

nloa

ded

from

info

rmah

ealth

care

.com

by

Nat

iona

l Sili

cosi

s L

ibra

ry o

n 11

/03/

14Fo

r pe

rson

al u

se o

nly.

Page 14: A framework for evaluating community-based rehabilitation programmes in Chinese communities

Strengths and weaknesses

One of the strengths of the framework is its strong

foundation built on evidence both from the academic

literature and existing practice. Use of case study

methodology enabled verification of the theoretical

framework with empirical evidence. Evidence shown

in the literature and in real life is regarded as

complementary and this enhanced the internal

validity of the framework. Traditional methods to

test the validity of this framework were not feasible as

no gold standard exists in the Chinese CBR field, in

fact in any branch of CBR. Neither was the

traditional use of an expert panel to check content

and face validity possible. No recognised scholars in

the field of CBR with specific expertise in Chinese

communities could be identified. It is therefore not

surprising that among the many published journal

articles, no single author has frequently and con-

sistently published work within Chinese CBR prac-

tice. However, through the case study method, the

accuracy and relevance of the elements and indica-

tors were checked against evidence collected in

existing CBR programmes.

All data collected during the field visits were coded

and analysed in Chinese as two of the research team

members were from Chinese background. The whole

team was familiar with both Chinese CBR practice

and the Chinese culture. This further enhanced the

validity of the framework as Chinese CBR practice

was viewed from a Chinese perspective that appre-

ciated the unique characteristics in Chinese commu-

nities. Use of the original language transcripts also

reduced translation error or bias.

There were some weaknesses identified in this

process. Since the five programmes were purpose-

fully sampled to explore Chinese CBR practice, it is

possible additional unidentified items may exist and

need to be added to the framework. The inclusion of

more Chinese CBR programmes of a diverse nature

may enhance the inclusiveness of the data.

Upon building of the framework, missing elements

in the framework were identified through verification

in real life settings and the domains, elements and

indicators in the framework were reviewed and

revised. The framework outlined the essential

elements of CBR programmes and these elements

can also be regarded as the elements of a best

practice programme. However, this framework is not

yet sufficient for programme evaluation. Elements of

the framework need to be quantifiable so that best

practice can be measured and documented. Pro-

gramme evaluation is a way of systematically gather-

ing information with the aim of comparing the

situation of a programme to an agreed standard, to

preset objectives, to the situation at an earlier period

or to the situation found in other programmes [17].

Programme evaluation is useful as it helps to

measure and promote quality of service provided.

Conclusion

In conclusion, an Initial Framework with four

domains was built from the review of seven

conceptual papers. The framework was verified with

the CBR programme examples cited in literature and

the content validity of the framework was prelimina-

rily confirmed. The framework was then verified

using a case study approach with five Chinese CBR

programmes. This led to the final framework with

five domains, 25 categorised core elements and 72

indicators. However, using this framework to mea-

sure and document the performance of individual

programmes requires further quantification and

elaboration of items. Measurement scales and

performance standards are required in order to

discriminate best practice. Nevertheless, the pro-

posed Chinese CBR framework does not only

provide a guide for CBR service development and

evaluation in Chinese contexts, but also a direction

for further research.

Declaration of interest: The authors report no

conflicts of interest. The authors alone are respon-

sible for the content and writing of the paper.

References

1. International Labour Office, UNESCO, World Health

Organization. A strategy for rehabilitation, equalization of

opportunities, poverty reduction and social inclusion of people

with disabilities. Switzerland: World Health Organization;

2004.

2. Khasnabis C, Motsch H. The participatory development of

international guidelines for CBR. Lepr Rev 2008;79:17–29.

3. Wirz S, Thomas M. Evaluation of community-based rehabi-

litation programmes: a search for appropriate indicators. Int J

Rehabil Res 2002;25:163–171.

4. Hai TT, Van Chuong T. Vietnam and activities of com-

munity-based rehabilitation. Disabil Rehabil 1999;21:

474–478.

5. Eide AH. Impact of community-based rehabilitation pro-

grammes: the case of Palestine. Scand J Disabil Res 2006;

8:199–210.

6. Shang Y. Policies and initiatives for poverty alleviation for

persons with disability in China. In: Workshop on Commu-

nity-Based Rehabilitation (CBR) and Poverty Alleviation of

Persons with Disabilities. Bangkok; 2005.

7. Thomas M, Thomas MJ. Self-help groups as a tool

for economic empowerment of persons with disability. In:

Workshop on Community-Based Rehabilitation (CBR) and

Poverty Alleviation of Persons with Disabilities. Bangkok;

2005.

8. San N. Community based work with people with disabilities in

Cambodia. In Workshop on Community-Based Rehabilita-

tion (CBR) and Poverty Alleviation of Persons with Dis-

abilities. Bangkok; 2005.

CBR framework 1681

Dis

abil

Reh

abil

Dow

nloa

ded

from

info

rmah

ealth

care

.com

by

Nat

iona

l Sili

cosi

s L

ibra

ry o

n 11

/03/

14Fo

r pe

rson

al u

se o

nly.

Page 15: A framework for evaluating community-based rehabilitation programmes in Chinese communities

9. Shik T, Yim J. Mainland China Budget for 2009. Economic

Focus 2009.

10. Hong Kong Government. The Budget 2009–2010. Internet.

2009. Electronic Citation. http://www.budget.gov.hk/2009/

eng/pdf/e2009budget.pdf. Last accessed 15 April 2009.

11. Chung EY-H, Packer T, Yau M. When East meets West:

community-based rehabilitation in Chinese communities.

Disabil Rehabil, in press.

12. Thomas M, Thomas MJ. A discussion on the shifts and

changes in community based rehabilitation in the last decade.

Neurorehabil Neural Repair 1999;13:185–189.

13. Thomas M, Thomas MJ. A discussion on some controversies

in community-based rehabilitation. Asia Pac Disabil Rehabil J

2002;13:1–6.

14. Finkenflugel H, Cornielje H, Velema J. The use of classifica-

tion models in the evaluation of CBR programmes. Disabil

Rehabil 2008;30:348–354.

15. Sharma M. Evaluation in community based rehabilitation

programmes: a strengths, weaknesses, opportunities and

threats analysis. Asia Pac Disabil Rehabil J 2007;18:46–62.

16. Cornielje H, Nicholls PG, Velema J. Making sense of

rehabilitation projects: classification by objectives. Lepr Rev

2000;71:472–485.

17. Kuipers P, Quinn R. The template: a cooperative approach to

evaluating community rehabilitation services. J Rehabil 2003;

69:4–14.

18. Velema J, Cornielje H. Reflect before you act: providing

structure to the evaluation of rehabilitation programmes.

Disabil Rehabil 2003;25:1252–1264.

19. Cornielje H, Velema JP, Finkenflugel H. Community based

rehabilitation programmes: monitoring and evaluation in

order to measure results. Lepr Rev 2008;79:36–49.

20. World Health Organization. 1st meeting report on the

development of guidelines for Community Based Rehabilita-

tion (CBR). Switzerland: WHO; 2004.

21. World Health Organization. Report of the 4th Meeting on

Development of CBR Guidelinees. Geneva, Switzerland:

WHO; 2006.

22. Chung EY-H. Development of a validated framework to

describe and evaluate community-based rehabilitation prac-

tice in chinese communities. In School of Occupational

Therapy and Social Work. Perth, Australia: Curtin University

of Technology; 2009. p 280.

23. Kuipers P, Kuipers K, Mongkolsrisawat S, Weawsorn B,

Marungsit S. Categorising CBR service delivery: the roi-et

classification. Asia Pac Disabil Rehabil J 2003;14:128–146.

24. Sharma M. Viable methods for evaluation of community-based

rehabilitation programmes. Disabil Rehabil 2004;26:326–334.

25. Hwu Y-J, Coates VE, Boore JRP, Bunting BP. The Concept of

Health Scale: developed for chinese people with chronic illness.

Nurs Res 2002;51:292–301.

26. Portney LG, Watkins MP. Foundations of clinical research.

3rd ed. New Jersey: Pearson Education, Inc.; 2009.

27. Eisenhardt KM. Building theories from case study research.

Acad Manage Rev 1989;14:532–550.

28. Boyce W, Paterson J. Community-based rehabilitation for

children in Nepal. 2002; Available from: http://www.aifo.it/

english/resources/online/apdrj/selread102/boyce.doc. Last ac-

cessed 17 December 2010.

29. Nordholm LA, Lundgren-Lindquist B. Community-based

rehabilitation in Moshupa village, Botswana. Disabil Rehabil

1999;21:515–521.

30. Valdez LS, Mitchell RA. Community-based rehabilitation: a

development programme in Negros Occidental. Disabil

Rehabil 1999;21:495–500.

31. Sharma M, Deepak S. A participatory evaluation of commu-

nity-based rehabilitation programme in North Central Viet-

nam. Disabil Rehabil 2001;23:352–358.

32. Kim YH, Jo NK. Community-based rehabilitation in South

Korea. Disabil Rehabil 1999;21:484–489.

33. Inthirat TRS, Thonglith S. Community-based rehabilitation

in the Lao People’s Democratic Republic. Disabil Rehabil

1999;21:469–473.

34. Finnstam J, Grimby G, Nelson G, Rashid S. Evaluation of

community-based rehabilitation in Punjab, Pakintan: I: use of

the WHO manual, ‘Training disabled people in the commu-

nity’. Disabil Rehabil 1988;10:54–58.

35. Miles M. Development of Community Based Rehabilitation

in Pakistan: bringing mental handicap into focus. Int J Disabil

1998;45:431–448.

36. Alam KJ, Bari N, Khan MA. Community based rehabilitation

practices and alleviation of poverty of people with disabilities in

Bangladesh. In: Workshop on Community-Based Rehabilita-

tion (CBR) and Poverty Alleviation of Persons with Disabilities.

Bangkok; 2005.

37. Siu AMH, Chui DYY. Evaluation of a community rehabilita-

tion service for people with rheumatoid arthritis. Patient

Education Counsel 2004;55:62–69.

38. Zhuo D, Kun ND. Community-based rehabilitation in the

People’s Republic of China. Disabil Rehabil 1999;21:490–

494.

39. Baolin C, Huang G. Primary health care and community-

based rehabilitation in the People’s Republic of China. Disabil

Rehabil 1999;21:479–483.

40. Yin RK. Case study research : design and methods. 3rd ed.

Thousand Oaks, Calif.: Sage Publications, 2003.

41. Salminen A, Toini H, Lautamo T. Conducting case study

research in occupational therapy. Aust Occup Ther J 2006;

53:3–8.

42. Creswell JW. Qualitative inquiry and research design: choosing

among five approaches. 2nd ed. USA: Sage Publications Ltd.;

2007.

1682 E. Y.-H. Chung et al.

Dis

abil

Reh

abil

Dow

nloa

ded

from

info

rmah

ealth

care

.com

by

Nat

iona

l Sili

cosi

s L

ibra

ry o

n 11

/03/

14Fo

r pe

rson

al u

se o

nly.