journal of social work
TRANSCRIPT
-
7/30/2019 Journal of Social Work
1/22
http://jsw.sagepub.com/Journal of Social Work
http://jsw.sagepub.com/content/12/4/364The online version of this article can be found at:
DOI: 10.1177/1468017310387463
2012 12: 364 originally published online 2 March 2011Journal of Social WorkLisa Wallander
survey approach in the study of professional judgementsMeasuring social workers' judgements: Why and how to use the factorial
Published by:
http://www.sagepublications.com
can be found at:Journal of Social WorkAdditional services and information for
http://jsw.sagepub.com/cgi/alertsEmail Alerts:
http://jsw.sagepub.com/subscriptionsSubscriptions:
http://www.sagepub.com/journalsReprints.navReprints:
http://www.sagepub.com/journalsPermissions.navPermissions:
http://jsw.sagepub.com/content/12/4/364.refs.htmlCitations:
What is This?
- Mar 2, 2011OnlineFirst Version of Record
- Jun 15, 2012Version of Record>>
at Qatar University on May 11, 2013jsw.sagepub.comDownloaded from
http://jsw.sagepub.com/http://jsw.sagepub.com/http://jsw.sagepub.com/http://jsw.sagepub.com/content/12/4/364http://jsw.sagepub.com/content/12/4/364http://www.sagepublications.com/http://jsw.sagepub.com/cgi/alertshttp://jsw.sagepub.com/cgi/alertshttp://jsw.sagepub.com/cgi/alertshttp://jsw.sagepub.com/subscriptionshttp://jsw.sagepub.com/subscriptionshttp://www.sagepub.com/journalsReprints.navhttp://www.sagepub.com/journalsReprints.navhttp://www.sagepub.com/journalsPermissions.navhttp://jsw.sagepub.com/content/12/4/364.refs.htmlhttp://jsw.sagepub.com/content/12/4/364.refs.htmlhttp://jsw.sagepub.com/content/12/4/364.refs.htmlhttp://online.sagepub.com/site/sphelp/vorhelp.xhtmlhttp://online.sagepub.com/site/sphelp/vorhelp.xhtmlhttp://online.sagepub.com/site/sphelp/vorhelp.xhtmlhttp://jsw.sagepub.com/content/early/2011/03/02/1468017310387463.full.pdfhttp://jsw.sagepub.com/content/early/2011/03/02/1468017310387463.full.pdfhttp://jsw.sagepub.com/content/12/4/364.full.pdfhttp://jsw.sagepub.com/http://jsw.sagepub.com/http://jsw.sagepub.com/http://online.sagepub.com/site/sphelp/vorhelp.xhtmlhttp://jsw.sagepub.com/content/early/2011/03/02/1468017310387463.full.pdfhttp://jsw.sagepub.com/content/12/4/364.full.pdfhttp://jsw.sagepub.com/content/12/4/364.refs.htmlhttp://www.sagepub.com/journalsPermissions.navhttp://www.sagepub.com/journalsReprints.navhttp://jsw.sagepub.com/subscriptionshttp://jsw.sagepub.com/cgi/alertshttp://www.sagepublications.com/http://jsw.sagepub.com/content/12/4/364http://jsw.sagepub.com/ -
7/30/2019 Journal of Social Work
2/22
Journal of Social Work
12(4) 364384
! The Author(s) 2011
Reprints and permissions:
sagepub.co.uk/journalsPermissions.navDOI: 10.1177/1468017310387463
jsw.sagepub.com
Article
Measuring social workers
judgements: Why andhow to use the factorialsurvey approach in thestudy of professional
judgements
Lisa WallanderMalmo University, Sweden
Abstract
Summary: The factorial survey approach, which was first introduced in the socialsciences around the beginning of the 1980s, constitutes an advanced method formeasuring human judgements of people or social situations. At the general level, thisquasi-experimental approach involves presenting respondents with vignettes (fictive
descriptions), in which selected characteristics describing the vignette person orsituation are simultaneously manipulated. The aim of this article is to present a con-ceptual and an analytical framework for factorial survey studies of professional judge-ments in social work. Findings: In the first part of the article, I develop and discuss the proposition that thisapproach may be used in order to study the contents of professional judgements aboutthe diagnosis and treatment of clients. The contents is discussed in terms of knowledgeassumptions that practitioners explicitly and tacitly use as a basis for their professional
judgements. Second, I outline a strategy for modelling social workers judgements.
This modelling strategy proceeds from the possibilities afforded by multilevel regressionanalysis. Applications: Findings from analyses of factorial survey data may reveal both profes-sional agreement and disagreement in practitioners judgements. While results thatreveal high levels of disagreement in judgements about what constitutes a particulardiagnosis or about which intervention is the most suitable for a particular client mayraise questions as regards the professionalism of practitioners judgements, results thatreveal professional agreement in diagnostic and treatment assumptions may be trans-formed into hypotheses that can be tested further in research.
Corresponding author:
Lisa Wallander, Senior Lecturer in Health and Society, Faculty of Health and Society, Malmo University, SE-205
06 Malmo, Sweden
Email: [email protected]
at Qatar University on May 11, 2013jsw.sagepub.comDownloaded from
http://jsw.sagepub.com/http://jsw.sagepub.com/http://jsw.sagepub.com/http://jsw.sagepub.com/ -
7/30/2019 Journal of Social Work
3/22
Keywords
factorial survey approach, knowledge use, multilevel analysis, professional judgements,vignette
As a consequence of the advancement of the evidence-based practice (EBP) move-
ment in social work (see Trinder, 2000), increasing note is currently being taken of
the subject of social workers judgements and decisions. At the most basic level,
evidence-based medicine (EBM), which may be regarded as the forerunner of EBP,
involves the conscientious, explicit, and judicious use of current best evidence in
making decisions about the care of individual [clients] (Sackett, Rosenberg, Gray,
Haynes, & Richardson, 1996, p. 71). It has also been described as a guide forthinking about how decisions should be made (Haynes, Devereaux, & Guyatt,
2002, p. 2) and as a decision-making process (Gambrill, 2006, p. 215).
Although the introduction of evidence-based decision-making in social work may
in some cases involve the substitution of a new mode of practice for an older one
(e.g. Gambrill, 1999), more often than not it will set out from, and gradually
reshape, already existing modes of decision-making. Accordingly, the successful
application of EBP to social work will require that we have some knowledge
about what is already out there. As expressed by Ashford and LeCroy (1991,
p. 309), before we can encourage [evidence-based] knowledge utilization insocial work, we must first understand how social workers use knowledge in their
interventions and in their decision-making processes. Although there are signs of
some current research activity in the field of professional judgements in social
work, particularly in the area of child protection (see e.g. Children and Youth
Services Review, 2005), social workers judgements and decisions have over the
years been largely neglected by researchers as a subject of interest (see Cuzzi,
Holden, Grob, & Bazer, 1993; OSullivan, 1999; Taylor, 2006).
In recent years, the authors of a number of articles, both in nursing (e.g. Lauder,
2002; Ludwick et al., 2004) and in social work (Taylor, 2006), have proposed thatresearchers interested in the empirical study of professional judgements could start
employing a method labelled the factorial survey approach (FSA). This approach,
which may be described as quasi-experimental, was introduced in the social sci-
ences around the beginning of the 1980s as a means of thoroughly studying human
judgements of people or social situations (Rossi & Nock, 1982). At the general
level, it involves presenting respondents with a number of vignettes (fictive descrip-
tions), in which selected characteristics describing the vignette person or situa-
tion are simultaneously manipulated. In sociology, the factorial survey approach
has been used in many fields of study, including crime and deviance (e.g. Miller,Rossi, & Simpson, 1991), social stratification (e.g. Will, 1993) and urban sociology
(e.g. Shlay, 1986). Further, an extensive review of the FSA studies published in
selected sociology journals (Wallander, 2009) shows that the method has also been
employed to study professional judgements, with a focus on the members of such
Wallander 365
at Qatar University on May 11, 2013jsw.sagepub.comDownloaded from
http://jsw.sagepub.com/http://jsw.sagepub.com/http://jsw.sagepub.com/http://jsw.sagepub.com/ -
7/30/2019 Journal of Social Work
4/22
occupational groups as nurses (e.g. OToole, OToole, Webster, & Lucal, 1993),
case managers (e.g. Corazzini-Gomez, 2002) and police officers (Son, Davis, &
Rome, 1998).
Even though the factorial survey approach has already been introduced to the
study of professional judgements in health care and social work, no attempt has
been made to identify at a more theoretical level which particular aspects of
professional judgements the approach can be employed to investigate. Nor has
there been any thorough exploration of the full potential of the factorial survey
approach as a tool for modelling professional judgements. Only a few authors
concerned with the investigation of professional judgements have chosen to com-
bine the factorial survey approach with multilevel analysis (e.g. Degenholtz, Kane,
Kane, & Finch, 1999; Wallander & Blomqvist, 2005, 2009), for example, even
though the questions commonly at issue in such studies may in effect be describedas true multilevel problems, in the sense that the determinants of the outcome may
be defined at a number of different levels in the analysis. To take one example,
studies of this kind often include questions about whether professional judgements
are influenced not only by considerations associated with the client, but also by
characteristics of the practitioners who make the judgements, as well as by con-
textual conditions, such as the practitioners workplaces. Accordingly, the aim of
this article is to explore the questions of why and how the factorial survey approach
might be used in the study of professional judgements in social work. Since other
authors have already described the general principles of the factorial surveyapproach and have incorporated extensive illustrations of how to plan and to
carry out studies based on this design in their articles (see e.g. Ludwick et al., 2004;
Taylor, 2006) the current article will content itself with only a brief description of
the method itself. The main focus will instead be directed at developing a number
of concepts that may capture the aspects of professional judgements that the design
has the potential to detect. In addition, I will present a strategy for modelling social
workers judgements a strategy which makes use of the possibilities afforded by
multilevel analysis. Although the occupation of interest in this article is social
work, the conceptual framework and modelling strategy proposed are naturallyapplicable to the study of professional judgements in any of the human service
professions.
An introduction to the factorial survey approach
The main components of factorial surveys are the vignettes that are judged by the
respondents. For respondents in an FSA study, vignettes constitute fictive descrip-
tions of people or social situations (see Alexander & Becker, 1978). In studies of
professional judgements in health care and social work, the vignettes as a ruleportray the characteristics and current situation of (potential) clients, such as chil-
dren, for example (e.g. OToole et al., 1993), elderly people (e.g. Degenholtz et al.,
1999) or substance users (e.g. Wallander & Blomqvist, 2005, 2009). An example is
presented below of a vignette from a study of social workers judgements of
366 Journal of Social Work 12(4)
at Qatar University on May 11, 2013jsw.sagepub.comDownloaded from
http://jsw.sagepub.com/http://jsw.sagepub.com/http://jsw.sagepub.com/http://jsw.sagepub.com/ -
7/30/2019 Journal of Social Work
5/22
problem substance users eligibility for compulsory care (Wallander & Blomqvist,
2005).1 In this study, each of 205 social workers, sampled from 18 municipalities in
Stockholm County (Sweden), judged the need for compulsory care among 15
fictive problem substance users. Each of the 3075 vignettes (205 15) that were
presented to the respondents was uniquely constructed by randomly selecting
a value, or level, in the form of a textual fragment, from a set of variables (dimen-
sions), and by combining these levels into unique scenarios. The vignette described
in Figure 1 comprises information about 11 different client variables or
dimensions, which were considered by the authors of the study to constitute poten-
tial determinants of social workers judgements of their clients need for compul-
sory care.
Apart from the dimensions linked to the criteria outlined in the Care of Abusers
(Special Provisions) Act (1988, 870), this vignette also describes the clients pri-mary drug, age and sex (for a description of the dimensions, levels and wordings
used in this design, see the Appendix). The practitioners judgements were mea-
sured by a rating task comprising two options: the respondents were asked to judge
whether or not they believed that the client described in the vignette was in need of
compulsory care. Because each of the approximately 3000 vignettes that were
judged by the respondents was constructed by the random selection of dimension
levels, the characteristics describing the problem substance users making up the
vignette sample were completely uncorrelated with one another. Accordingly, the
authors were able to disentangle the unique effects of variables that are normallyvery highly correlated. For example, it was possible to make a distinction between
the effect on social workers judgements of the clients primary drug and of vari-
ables describing the clients physical and mental health conditions respectively (for
further results, see Wallander & Blomqvist, 2005). This possibility of completely
separating the influences of the independent variables promotes high internal valid-
ity of results from studies using this design. In addition, the fact that the FSA
makes it possible to simultaneously study and control for a large number of
variables (in contrast to the more common factorial experiment), points to high
For each of the fictive clients presented in the following, we ask you to state whether or
not you judge him or her to be in need of compulsory care.
The client is a 25-year-old man who misuses heroin on a more-or-less daily basis. He does
not consider himself to be in need of any type of intervention from the social services and
he has failed to complete treatment on several occasions during the past year. He has an
unstable social situation and lives alone, without children. He has no inclination towards
violence. He seems to be in poor physical health but has no known mental health
problems.
In need of compulsory care
Not in need of compulsory care
Figure 1. An example of a vignette (Wallander & Blomqvist, 2005, p. 68).
Wallander 367
at Qatar University on May 11, 2013jsw.sagepub.comDownloaded from
http://jsw.sagepub.com/http://jsw.sagepub.com/http://jsw.sagepub.com/http://jsw.sagepub.com/ -
7/30/2019 Journal of Social Work
6/22
levels of external validity (see realism) of the study results (for further information
about the technical and analytical advantages of the factorial survey approach, see
e.g. Lauder, 2002; Rossi & Anderson, 1982; Taylor, 2006; Wallander, 2008).
Because the situations generated in accordance with the principles of the facto-
rial survey approach are hypothetical in character, this method is not suitable for
replicating the judgements and decisions made in the complex context of everyday
practice. However, it can be used for studying practitioners professional judge-
ments. The concept of professional judgement may be defined in various ways. To
take one example, in the above-mentioned studies of the judgements made by social
workers and their choices of interventions for problem substance users (Wallander
& Blomqvist, 2005, 2009), the professional judgement concept was used to denote
individual practitioners judgements about which interventions in their own opin-
ion serve best to promote the welfare and best interests of their clients.2 Thisreadiness on the part of the practitioners to act as the clients advocates and to try
their best to help the [clients] (Parsons, 1951, p. 464), is frequently referred to as
one of the essential characteristics of a professional. By making ideal judgements
rather than real-world judgements the object of study, the responses to the vign-
ettes will (at least in the eyes of the respondents themselves) be disengaged from
factors that are often considered in the context of real-world judgements and
decision-making, such as the financial situation at a given practitioners workplace,
for example, and the range of services available. These factors may instead be
examined as potential predictors of the practitioners professional judgements.3
Conceptual framework
Knowledge use in diagnosis and treatment
Inevitably, the professional practice of social workers is permeated by judgements
and decisions. However, not all of the judgements made by practitioners are
directly associated with actions central to the promotion of the welfare and best
interests of their clients. In order to identify some of the most central judgementsmade in professional practice, we will start out from one of the theoretical prop-
ositions put forward by Andrew Abbot (1988, 1995), that professional practice may
be viewed as being essentially composed of the intellectual tasks of diagnosis,
inference and treatment. Undoubtedly, judgements associated with the acts of
classifying problems (diagnosis) and taking action on them (treatment) consti-
tute key judgements to be made prior to the initiation of any form of intervention.4
As described by Abbott (1988, p. 41), diagnosis involves collecting information
about the client and forming a professional opinion about the current status of the
client based on a dictionary of professionally legitimate problems. Although theconcept of diagnosis has a long history in social work (see Richmond, 1917), over
the years it has acquired a rather negative status. According to Turner (2002), this
is because diagnosis has been associated with medicine and with certain theoretical
schools of social work, and because it has come to imply a search for pathology
368 Journal of Social Work 12(4)
at Qatar University on May 11, 2013jsw.sagepub.comDownloaded from
http://jsw.sagepub.com/http://jsw.sagepub.com/http://jsw.sagepub.com/http://jsw.sagepub.com/ -
7/30/2019 Journal of Social Work
7/22
and the assignment of single labels to clients. In this article, and in line with Abbott
(1988) and Turner (2002), the concept of diagnosis will be used as a metaphor as a
neutral descriptor of a particular element of professional practice in any given
occupation. Treatment, the last of the three tasks mentioned by Abbott (1988), is
equivalent to prescription, that is, to suggesting interventions or treatments that are
deemed, on the basis of a classification system, to be the most suitable for the
particular diagnosis found. Here, it should be emphasized that the concept of
treatment not only includes the prescription of those interventions that are cus-
tomarily regarded as treatment, but suggestions about any form of action that is
initiated with the aim of changing the clients circumstances for the better.
Examples of FSA studies that investigate professional judgements associated
with the acts of diagnosis and treatment include those by the OTooles and their
colleagues, which have focused on nurses (e.g. OToole et al., 1993) recognition(diagnosis) of potential child abuse and their estimated likelihood of reporting
(treatment) this potential abuse.
In theory, and as mentioned above, the tasks of diagnosis and treatment involve
the use of a system of professional knowledge that formalizes the skills of the
particular type of work at issue (Abbott, 1988, p. 52). Despite current efforts to
systematize the results from research on social work practice in the form of meta-
analyses and practice guidelines (e.g. The Campbell Collaboration, 2010; The
Cochrane Collaboration, 2010), there are as of today still no general and wide-
spread dictionaries that social work practitioners can directly consult when makingjudgements about the diagnosis and treatment of clients (such as those used by
medical practitioners, for example, the United States Pharmacopeia [USP] and the
electronic Medicines Compendium [eMC]). However, notwithstanding the fact that
the current body of knowledge on social work may be described as unstandardized
and eclectic (Tucker, 1996), practitioners performing the tasks of judging what is
wrong with the client, and what may be done in order to remedy the clients
problems, inevitably make use of knowledge of some kind (see Rosen, 1993). In
this context, knowledge is widely defined as those assumptions which contribute to
the professions understanding of its own practice (see Rosen, 1994).5
Thus, afruitful approach for researchers who are interested in studying professional judge-
ments is to focus on the knowledge used by practitioners when making judgements
in relation to the tasks of diagnosis and treatment. This article argues that the
factorial survey approach constitutes one of the most advanced instruments for
measuring the use of knowledge in professional judgements.
Naturally, this proposition gives rise to the question of what forms of knowl-
edge, the use of which can be detected using an FSA design. In the contemporary
social work literature, suggestions about the forms of knowledge that may best
inform practice tend to be inspired by one of two opposing viewpoints. On the onehand, there is a group of researchers, practitioners and politicians who argue that
the work performed by social workers ought to proceed from evidence-based
knowledge, produced to academic standards (see e.g. Gambrill, 1999; Gibbs &
Gambrill, 2002; National Board of Health and Welfare, 2003). On the other
Wallander 369
at Qatar University on May 11, 2013jsw.sagepub.comDownloaded from
http://jsw.sagepub.com/http://jsw.sagepub.com/http://jsw.sagepub.com/http://jsw.sagepub.com/ -
7/30/2019 Journal of Social Work
8/22
hand, many authors believe that social work practice is best guided by so-called
practice wisdom, stemming primarily from practice itself (e.g. Chu & Tsui, 2008).6
However attractive the concepts of evidence-based knowledge and practice wisdom
are, the multidimensional character of these concepts including as they do
assumptions not only about different qualities of the knowledge involved but
also about the its source makes them ill suited to the task of serving as a theo-
retical basis from which to study the knowledge actually used by social workers
when making judgements about the diagnosis and treatment of clients. For exam-
ple, identifying the source of knowledge (research or practice) used in the perfor-
mance of a particular task tells us nothing about the actual content of this
knowledge. In effect, the same substantive hypotheses that are derived from scien-
tific knowledge might also be derived on the basis of practical experience, provided
that the same regularities that form the basis of scientific results are also noticeablein real-world practice.7 Further, there is evidence from research that the process of
applying scientific knowledge in practice involves a transformative element,
whereby the knowledge so acquired is adapted to the conditions of a particular
situation (e.g. Daley, 2001). Thus when evidence-based knowledge is applied in
practice, it inevitably becomes intertwined with knowledge that originates in prac-
tice. In conclusion, the empirical study of knowledge use in professional judge-
ments requires concepts of knowledge that are unequivocal in their content, and
that are not dependent upon particular sources of origin (such as research or
practice). The following discussion will involve a number of concepts of knowledgethat are argued to capture the aspects of professional judgements that can poten-
tially be detected by a factorial survey design.
Empirically useful concepts of knowledge
For authors interested in studying professional judgements, a first distinction must
be made between the process of making a judgement, and the content of the
specific judgement made. In the rich literature on judgement and decision-making
within the field of psychology, this distinction is well-established, and researchershave tended to focus either on tracing the process of judgements and/or decisions,
or on establishing the relationships between the input of information to the deci-
sion-maker and the output (the judgement or decision actually made)
(Benbenishty, 1992; Payne, Bettman, & Luce, 1998). Thus, in line with the sugges-
tion above, the making of professional judgements may be viewed as involving the
use of knowledge both in relation to the process of the judgement task itself, and in
relation to the subject matter involved in a particular judgement. In the social work
literature, process knowledge has been defined as the methodology of practice
decision making, focusing on the processes by which judgements are made(Sheppard & Ryan, 2003, p. 157). Although the past few years have seen a growing
interest in the study of the cognitive processes inherent in social work judgements
and decision-making (e.g. Osmo & Rosen, 2002; Sheppard & Ryan, 2003;
Sheppard, Newstead, Di Caccavo, & Ryan, 2000, 2001), we do not as yet know
370 Journal of Social Work 12(4)
at Qatar University on May 11, 2013jsw.sagepub.comDownloaded from
http://jsw.sagepub.com/http://jsw.sagepub.com/http://jsw.sagepub.com/http://jsw.sagepub.com/ -
7/30/2019 Journal of Social Work
9/22
very much about social workers methodologies of practice decision-making.
Thus, this subject area is clearly one that would benefit from more research.
While the factorial survey approach cannot be used in order to study the process
knowledge that is used in practice, other methods may be employed for this pur-
pose, such as the think aloud protocol (e.g. Sheppard et al., 2000), for example.
The factorial survey approach is however most suitable for studying the way pro-
fessionals use knowledge relating to the subject matter of judgements, so-called
subject knowledge. In line with the psychological research referred to above, the
object of this research involves establishing relationships between the information
considered by a practitioner who is making a specific judgement (input) and the
judgement actually made (output). While process knowledge may be described as
generic the cognitive processes involved in social workers judgements and deci-
sions are not necessarily different from the cognitive processes characterizing pro-fessional judgements and decision-making in general subject knowledge is
ultimately domain-specific. Social work practitioners working with problem sub-
stance users, for example, need to have knowledge about the problems typically
faced by members of this client group, and about the different ways in which these
problems may best be responded to.
As has been argued by Rosen and his colleagues (Rosen, 1978; Rosen, Proctor,
Morrow-Howell, & Staudt, 1995; Rosen, Proctor, & Staudt, 1999), the literature
has overlooked the fact that the successful performance of the different functions of
professional practice including the tasks of classifying clients problems and ofsuggesting interventions with the capacity to change the natural or social circum-
stances of the clients for the better may require different forms of (subject)
knowledge. Thus, while the task of diagnosis is best guided by descriptions of
human behaviour, of so-called descriptive knowledge, the prescription of suitable
interventions must be based on so-called control knowledge, denoting knowledge
about the effects of particular interventions on groups of clients. In his early work,
Rosen (1978) criticized the social work research community for focusing too much
on the development of descriptive (and explanatory) knowledge, at the expense of
control knowledge. In the current debate about knowledge development in socialwork, however, more attention is being directed at the advancement of knowledge
about what works than at the equally important goal of improving the knowledge
that may guide practitioners attempts to make sense of all the information col-
lected about their clients, in part via different types of assessment instruments
(White & Stancombe, 2003). While these forms of knowledge are not interchange-
able with one another in social work practice,8 both descriptive and control knowl-
edge may be decomposed into a series of statements, or assumptions, that guide
practitioners work with their clients. Assumptions guiding the primary task of
diagnosis, that is, that of linking information about the clients to more abstractproblem profiles, may be viewed as specific instances of subject knowledge that is
focused on description. Similarly, the assumptions involved in treatment assump-
tions linking the problems identified (. . .) with the responses that those problems
require (Sheppard & Ryan, 2003, p. 165) may be treated as specific instances of
Wallander 371
at Qatar University on May 11, 2013jsw.sagepub.comDownloaded from
http://jsw.sagepub.com/http://jsw.sagepub.com/http://jsw.sagepub.com/http://jsw.sagepub.com/ -
7/30/2019 Journal of Social Work
10/22
subject knowledge that is focused on control. This article argues that the factorial
survey approach may be used in order to investigate the diagnostic and treatment
assumptions involved in practitioners professional judgements. In order to shed
light on this proposal, examples of interpretations of selected results from two FSA
studies of professional judgements will follow.
First, a study by OToole and her colleagues (1993) on nurses recognition and
reporting of child abuse made use of vignettes in which seven dimensions of a
family situation were varied. These dimensions included type of act (sexual, phys-
ical, emotional), for example, perpetrator status (father, mother, sibling) and
victim sex (girl, boy).9 The results showed that sexual acts were more likely to
be recognized as child abuse than were other physical or emotional acts. In addi-
tion, by comparison with vignettes in which the perpetrator was a sibling, those
involving the mother or father were more often rated as cases of child abuse. Thegender of the child involved was also an important predictor of nurses ratings of
child abuse, with girls on average more frequently being regarded as the victims of
child abuse than boys. In sum, each of these three variables influenced nurses
recognition, or diagnosis, of child abuse. The results may be interpreted as reflect-
ing the following assumptions about what constitutes child abuse (i.e. diagnostic
assumptions): a) by comparison with (other) physical or emotional abuse, sexual
abuse is more constitutive of child abuse; b) cases that involve mothers and fathers
are more typical of child abuse than those that involve siblings; c) child abuse is
more likely to be present when girls are involved than when boys are involved.Second, in the study by Wallander and Blomqvist (2005) about social workers
judgements of problem substance users eligibility for compulsory care (see above),
it was found that, by comparison with problem users of alcohol and amphetamines,
problems users of heroin were more likely to be judged as being in need of com-
pulsory care. In addition, the results showed that on average, compulsory care was
more often judged to be required when the substance users were young than when
they were middle-aged or old. These results reflect the following treatment assump-
tions: a) by comparison with problem users of alcohol and amphetamines, problem
users of heroin are more in need of compulsory care; b) young clients are more inneed of compulsory care than are middle-aged or older clients.
The results described above reveal the diagnostic and treatment assumptions
that guide the judgements of many, but most probably not all of the practitioners
taking part in the studies. As will be demonstrated further below, the strategy
proposed for modelling data from a factorial survey makes it possible to discern
the existence of collective, subgroup-specific and context-specific diagnostic and
treatment assumptions.
The detection of knowledge actually-in-useThe most common course of action taken by researchers who are interested in
studying the subject knowledge used by social workers in judgement and deci-
sion-making is that of asking the practitioners to state the rationales supporting
372 Journal of Social Work 12(4)
at Qatar University on May 11, 2013jsw.sagepub.comDownloaded from
http://jsw.sagepub.com/http://jsw.sagepub.com/http://jsw.sagepub.com/http://jsw.sagepub.com/ -
7/30/2019 Journal of Social Work
11/22
their judgements (e.g. Rosen, 1994; Rosen et al., 1995). However, as of today, most
researchers would agree that conclusions with regard to what knowledge is actually
used in action cannot be based merely on individuals own accounts. For example,
the rationales provided by any one practitioner will in all probability never amount
to anything more than a thin representation of the thick version which includes
all the motives behind the judgement that is made (Eraut, 2000, p. 134). Further, as
a rule, accounts are tidied up and subject to post-hoc rationalisation, so as to be
easily defendable if challenged (Eraut, 2000, p. 134). Since the respondents in an
FSA study are most probably not fully attentive to the experimental manipulation
(i.e. the controlled variation) of the dimensions included in the vignettes, this
approach may be used for the study of the diagnostic and treatment assumptions
that are truly used by practitioners as a basis for their professional judgements. In
other words, the employment of this approach makes it possible to detect theknowledge practitioners actually use, irrespective of whether this knowledge is expli-
cit or tacit (see Polanyi, 1966) to the practitioners themselves at the moment of
judgement. Another benefit of the design is that problems associated with social
desirability are limited (see Alexander & Becker, 1978). Since it is virtually impos-
sible to obtain a complete overview of the manipulations of the vignette dimensions
(at least when the time given for filling out the questionnaire is limited), the con-
scious weighting of dimensions in accordance with the supposed wishes of research-
ers or others constitutes an insurmountable task.
Modelling social workers professional judgements
According to the pioneers of the factorial survey approach (Rossi & Anderson,
1982, p. 10), the principal objective of the factorial survey design is to uncover the
shared and idiosyncratic principles of judgements. In studies of professional
judgements, the shared principles of judgements may be expressed in terms of
professional agreement in judgements, while the variation in judgements between
individual respondents and between groups of respondents (see idiosyncratic prin-
ciples) may be referred to as professional disagreement in judgements. As far asprofessional disagreement in judgements is concerned, several conditions of social
work practice facilitate or make room for the existence of such variation in judge-
ments. For example, most of the laws that regulate social work practice are not
specified in detail, but generally allow for the exercise of discretionary judgement
on the part of the practitioner. In addition, and as mentioned above, because there
is as of today no common body of knowledge for social workers to consult, social
workers assumedly make use of a variety of forms of knowledge, whose content
also varies, in their daily practice with clients. Finally, we may presume that the
practice of social workers who make judgements in relation to the diagnosis andtreatment of clients is to some degree formed by conditions related to their local
work environments, such as organizational guidelines, for example, and the aver-
age problems of the local clientele. Thus, the suggestion that the professional
judgements of social workers are formed not only by shared principles of
Wallander 373
at Qatar University on May 11, 2013jsw.sagepub.comDownloaded from
http://jsw.sagepub.com/http://jsw.sagepub.com/http://jsw.sagepub.com/http://jsw.sagepub.com/ -
7/30/2019 Journal of Social Work
12/22
judgements, but also by idiosyncratic principles of judgements is rather plausible,
and it may be put to test in studies based on an FSA design.
A modelling strategy based on multilevel regression analysis
Multiple regression analysis constitutes the analytical technique most preferred by
sociologists using the factorial survey approach (Taylor & Zeller, 2007; Wallander,
2009). Further, it has been pointed out that the multilevel extension of regression
analysis provides special opportunities for authors who want to model judgements
of people or social situations (Hox, Kreft, & Hermkens, 1991; Jasso, 2006;
Wallander, 2009). Thus, the modelling strategy described here will proceed from
the possibilities afforded by multilevel regression analysis (using e.g. the HLM
software, see Raudenbush, Bryk, Fai Cheong, & Congdon, 2000). Throughoutthis section, examples from two studies, in which the factorial survey was combined
with multilevel (logistic) regression analysis, will be used (Degenholtz et al., 1999;
Wallander & Blomqvist, 2005). While both these studies refer to judgements made
in relation to the treatment of clients, the modelling strategy outlined below is
naturally equally applicable to judgements related to client diagnoses.
This modelling strategy proceeds from an assumption that each of the practi-
tioners involved in the study judges a minimum number of 15 to 20 vignettes.
When multiple vignettes have been judged, the dataset to be analysed has a
hierarchical structure by design. This means that units in the dataset are clus-tered, or nested, within units at a higher level (Snijders, 2004). In addition, since
it is of interest to research on professional judgements to determine whether the
judgements made by practitioners are to some degree also influenced by contex-
tual characteristics (see above), the initial sampling frame may consist of the
practitioners workplaces rather than of the practitioners themselves. Actually,
the full use of the modelling strategy described below presupposes that the prac-
titioners taking part in the study are clustered within their workplaces (i.e. each
workplace must be represented by several individuals), in which case the dataset
also reflects a natural hierarchy. In the designs used in the studies taken asexamples (Degenholtz et al., 1999; Wallander & Blomqvist, 2005), the vignettes,
which constituted units at level one, were clustered within respondents (units at
level two), which were nested within their workplaces (units at level three).10
Multilevel regression analysis is an advanced technique employed to analyse
just such hierarchical data (Snijders, 2004). The output from multilevel regression
models is typically split into two parts: the fixed part, consisting of estimations of
regression coefficients, their standard errors, t-values and probability values, and
the random part, comprising the decomposition of the unexplained variance into
variance components for each level. In so-called random intercept models, avariance component measuring the unexplained variance in the intercept across
units is specified for each of the higher levels of the design. When so-called
random slope models are employed, it is also possible to specify variance com-
ponents for the regression slopes of predictors introduced at lower levels of the
374 Journal of Social Work 12(4)
at Qatar University on May 11, 2013jsw.sagepub.comDownloaded from
http://jsw.sagepub.com/http://jsw.sagepub.com/http://jsw.sagepub.com/http://jsw.sagepub.com/ -
7/30/2019 Journal of Social Work
13/22
model (Snijders, 2004). Comprehensive interpretations of variance components
will be provided in the examples that follow.
In general, authors of factorial surveys begin by modelling the social component
of judgements (i.e. agreement), after which they continue with the investigation of
potential variation (i.e. disagreement) between judgements (Wallander, 2009). The
estimation of professional agreement is straightforward, and it involves including
the vignette dimensions as predictors of the respondents pooled judgements. In the
study by Wallander and Blomqvist (2005), 10 of 11 dimensions describing the
fictive problem substance users proved to be significantly related to social workers
judgements about eligibility for compulsory care. As has already been noted, one of
the effects of the vignette dimension measuring the clients primary drug on the
respondents judgements could be interpreted as indicating the presence of a treat-
ment assumption stating that by comparison with problem users of alcohol andamphetamines, problem users of heroin are more in need of compulsory care.
Naturally, it is not only the main effects of vignette dimensions on judgements
that can be estimated, but also the effects of interactions between vignette dimen-
sions. For example, Wallander and Blomqvist (2005) showed that for clients con-
senting to enter voluntary treatment, the probability of being judged to be in need
of coercion substantially increased if the clients involved had a history of failed
treatments. As mentioned above, the results from these analyses reveal assumptions
that are shared by many, but most probably not by all of the practitioners taking
part in the study. In addition, any given practitioner whose practice is guided by aparticular assumption in a particular situation may disregard it in another situa-
tion, if it comes into conflict with one or more equally or more critical assump-
tions. However, although the professional agreement indicated by the results does
not equal professional unanimity, these assumptions may be termed collective
treatment assumptions.
The first step in modelling professional disagreement involves the inspection of
what are referred to as the variance components provided in the output. As has
already been noted, the variance components capture unexplained variance in the
intercept or in selected regression slopes across units at different levels of the model.In their study of case managers decisions as to whether or not to recommend an
out-of-home placement for elderly clients, Degenholtz and his colleagues (1999)
started by specifying a model with no predictors, but in which the intercept was
allowed to vary across case managers and across the agencies in which these case
managers were working. Due to the statistical significance of the variance compo-
nents at both levels, the authors were able to conclude that individual case man-
agers varied in their average levels of judgements (individual variation), and that
case managers practising in different agencies varied in their average levels of
judgements (contextual variation). This means that the general propensity to rec-ommend an out-of-home placement for the elderly clients presented in the vignettes
varied between individual practitioners and between practitioners working in dif-
ferent agencies. This result is of interest in itself. However, the next step in the
analysis involves attempting to explain this variation in judgements, by including
Wallander 375
at Qatar University on May 11, 2013jsw.sagepub.comDownloaded from
http://jsw.sagepub.com/http://jsw.sagepub.com/http://jsw.sagepub.com/http://jsw.sagepub.com/ -
7/30/2019 Journal of Social Work
14/22
variables relating to the case managers and to their agencies as predictors in the
analysis. Once they had done this, the authors (Degenholtz et al., 1999) were able
to conclude that some of the individual and contextual variation in case managers
general propensity to recommend an out-of-home placement could be explained by
reference to the task specialization of the case managers and to the supply of
services at the agencies.
Next comes the inspection of the variance components measuring (potentially)
unexplained variance in the regression slopes for selected vignette dimensions. To
take an example, Degenholtz and his colleagues (1999) specified a model in which
they allowed the slopes of the three dimensions representing various client prefer-
ences to vary randomly across Level-2 and Level-3 units. An inspection of the
Level-2 variance components for the slopes showed significant variance between
case managers in the attention paid to client preferences when deciding whether ornot to recommend an out-of-home placement. This means that the (treatment)
assumptions linking client preferences to interventions varied between individual
practitioners. A model which included variables describing the case managers as
determinants of the regression slopes for client preferences (see cross-level inter-
actions, Snijders, 2004), showed that a higher workload, for example, was associ-
ated with less weight being placed on the clients preferences regarding the use of
family care (as an alternative to an out-of-home treatment). Thus, by comparison
with social workers with a low workload, those with a higher workload less often
used the treatment assumption an in-home care plan is more suitable for clientswho are willing to have family help than for clients who are not willing to have
family help as a basis for judgements. This result shows that treatment assump-
tions may indeed be subgroup-specific. If a variable describing the practitioners
workplaces, or another contextual variable, had also affected the slope for client
preferences, we would have concluded that this treatment assumption had been
context-specific.
If the size and significance of the variance components decrease with the inclu-
sion of respondent or contextual variables, it may be concluded that the variables
added (if significant) account for some of the previously unexplained variance. As afinal step in this modelling strategy, it is useful to inspect what remains of the
variance components subsequent to the inclusion of potential predictors of judge-
ments. For example, due to the remaining significance of the variance components
in a random intercept model with three levels, Wallander and Blomqvist (2005)
were able to conclude that the respondent and contextual variables included as
predictors of compulsory care judgements could explain some, but far from all
between-respondent and between-context variation in the general propensity to
judge clients need for compulsory care. The authors noted that the unexplained
variance at the respondent level could either be systematic, due to respondentpredictors that were not included in the models, or random, and that the remaining
unexplained variance at the contextual level provided additional support for the
view that social workers are indeed socialized at their workplaces into different
ways of viewing clients needs.
376 Journal of Social Work 12(4)
at Qatar University on May 11, 2013jsw.sagepub.comDownloaded from
http://jsw.sagepub.com/http://jsw.sagepub.com/http://jsw.sagepub.com/http://jsw.sagepub.com/ -
7/30/2019 Journal of Social Work
15/22
Concluding remarks
Proceeding from the understanding that the factorial survey approach has already
been introduced to the study of professional judgements in health care and social
work at the general level, the articles primary objectives have been to provide a
conceptual framework for interpreting the results from studies based on this
design, and to present a modelling strategy for researchers who are interested in
investigating the professional judgements of social work practitioners. In the fol-
lowing, we will recap on some of the most central ideas presented in the article. As
far as the conceptual framework is concerned, this article proposed that the facto-
rial survey approach constitutes an advanced instrument for studying practitioners
use of knowledge in the context of professional judgements, and more specifically
for studying the assumptions they employ as a basis for judgements associated withthe dual tasks of diagnosis and treatment. In addition, it was maintained that this
approach provides opportunities for detecting diagnostic and treatment assump-
tions irrespective of whether they are used explicitly or tacitly in professional judge-
ments. Thus, by using this instrument, researchers may achieve an objective that
has been called for by a number of authors in the field of social work (e.g. Scott,
1990) and which has been succinctly described by Michaud (1998, p. 13) as that of
identifying the variables upon which the practitioner is focusing in (. . .) instances
of intuition. Although many researchers, and particularly those associated with the
EBP movement, question the influence of intuition (i.e. the antonym of analysis) inprofessional practice (e.g. Gambrill, 1999), there is reason to believe that certain
conditions of social work practice, such as the low degree of structure associated
with certain tasks for example, may encourage the use of intuition rather than
analysis (see Hammond, 1996). Moreover, as has been suggested by two frequently
cited brothers (Dreyfus & Dreyfus, 1986), practitioners regarded as experts in
their fields may be assumed to make intuitive judgements and decisions more
often than novices. While recognizing that the complete transparency of practice
will always remain an unattainable goal, the factorial survey approach may be used
in order to make explicit some of the tacit knowledge that is used in professionaljudgements. Naturally, even given this substantial methodological potential there is
still a need for social work practitioners to continue to develop their own profes-
sional abilities to make the rationales for their judgements and decisions accessible
for scrutiny and critique (see Gambrill, 2006; Rosen, 1993).
As is the case with all methods used in social science, there are a number of
limitations associated with the use of the factorial survey approach in the study of
professional judgements. First, the FSA design cannot be used in order to study the
whole chain of judgements and decisions in the context of a dynamic professional
environment. Rather, it allows you to study a number of frozen moments in thischain (see Wallander, 2008), since you both abstract the judgements from real-life
practice, and deconstruct their determinants into a number of variables. Thus,
results from an FSA study will never give the whole picture and should be
regarded as representations rather than replicas of professional judgements
Wallander 377
at Qatar University on May 11, 2013jsw.sagepub.comDownloaded from
http://jsw.sagepub.com/http://jsw.sagepub.com/http://jsw.sagepub.com/http://jsw.sagepub.com/ -
7/30/2019 Journal of Social Work
16/22
(see Benbenishty, 1992). Second, the FSA design only has the potential to detect
those diagnostic or treatment assumptions which relate to variables that have been
included as dimensions in the vignettes. The construction of a factorial survey
therefore requires extensive preparation on the part of the researchers involved
(for a detailed description, see Wallander, 2008). Notwithstanding careful prepa-
rations, studies using the factorial survey approach obviously fall short of explain-
ing how the dynamics of the particular situation in which a social worker and a
client are interacting, as well as their personal chemistry, may influence social
workers professional judgements. Third, the results of a factorial survey, which
may reveal the collective, subgroup-specific or context-specific use of diagnostic or
treatment assumptions as a basis for professional judgements, do not provide any
explanations for these assumptions. For example, even though we know that many
social work practitioners taking part in the study by Wallander and Blomqvist(2005) believe that problem users of heroin are more in need of compulsory care
than are problem users of alcohol or amphetamines, we do not knowwhy this is the
case. The clues suggested by the results, however, indicate that it cannot be because
heroin users have greater physical and mental health problems, for example, or
more problematic social situations, because these conditions (among others) were
controlled for in the design. One potential means of countering this limitation of
the approach would be to combine an FSA study with group interviews, in which
the practitioners discussed and justified the diagnostic and/or treatment assump-
tions revealed by the results.Notwithstanding these limitations, by employing a combination of the factorial
survey approach and multilevel modelling, it is possible to arrive at findings with
important implications for social work decision-making. While results that reveal
high levels of disagreement in practitioners judgements about what constitutes a
particular diagnosis or about which intervention is the most suitable for a partic-
ular client may raise questions as regards the professionalism of practitioners
judgements, other results may strengthen the sense of professionalism in judgement
and decision-making. This is due to the fact that the factorial survey approach
contrary to the traditional case vignette method has the potential to detectprofessional agreement, that is, knowledge assumptions that are shared by many
of the practitioners taking part in the study. Because these assumptions are most
probably not always based on scientific knowledge, but on knowledge that origi-
nates in social work practice or in personal experience from other domains of life
they cannot be directly transformed into formal advice about what should consti-
tute a particular diagnosis, or about which treatment is the most suitable for a
particular client group. However, they may serve as hypotheses that can be tested
further in research. For example, assumptions used collectively by practitioners as
a basis for their judgements regarding the suitability of different treatments fordifferent clients could be employed as a means of structuring evaluations in which
the benefits of these particular treatments for groups of clients were compared.
The results from such evaluations could subsequently be utilized by practi-
tioners for validating or modifying the assumptions detected in an FSA design.
378 Journal of Social Work 12(4)
at Qatar University on May 11, 2013jsw.sagepub.comDownloaded from
http://jsw.sagepub.com/http://jsw.sagepub.com/http://jsw.sagepub.com/http://jsw.sagepub.com/ -
7/30/2019 Journal of Social Work
17/22
This suggestion is in line with Payne (2001), who criticizes the concept of a pro-
fessional knowledge base for implying that knowledge is something static, when
the knowledge used in real-world professional practice must actually be continually
revised and reconstructed.
Appendix
Table A1. Description of vignette dimensions, levels and wordings (Wallander & Blomqvist,
2005)
Dimensions and levels Wordings
Misuse pattern
Regular A couple of times a week
Frequent More-or-less daily
Accelerating Daily and accelerating
Consent to treatment
Strong Wants help
Medium Recognizes that he/she has misused the drug to a high extentlately
Weak Does not consider himself/herself to be in need of any type ofintervention from the social services
Failed treatments
None No treatment during the last year
One Failed to complete treatment on one occasion during the pastyear
Several Failed to complete treatment on several occasions during the pastyear
Physical health
No problems No known physical health problems
Some problems Seems to be in poor physical healthAcute problems Recently treated for medical injuries caused by the drug misuse
Mental health
No problems No known mental health problems
Some problems Seems to be mentally unstable
Acute problems Recently hospitalized following a suicide attempt
Social situation
Stable Stable social situation
Unstable Unstable social situation
Acute Is on the road to social marginalizationViolent behaviour
None No inclination towards violence
Earlier signs Earlier violent acts under influence of drugs
Recent signs Recent violent acts under influence of drugs
Wallander 379
at Qatar University on May 11, 2013jsw.sagepub.comDownloaded from
http://jsw.sagepub.com/http://jsw.sagepub.com/http://jsw.sagepub.com/http://jsw.sagepub.com/ -
7/30/2019 Journal of Social Work
18/22
Notes
1. According to the current compulsory care legislation in Sweden (the Care of Abusers
(Special Provisions Act) [LVM], 1988: 870), problem substance users can, under certain
conditions, be forced into care for a period of up to six months.2. Another example of a professional judgement consists in practitioners judgements about
what constitutes a particular diagnosis (see below).
3. Real-world constraints, such as the range of services available, for example, may natu-
rally also be incorporated in the vignettes themselves.
4. In social work, the judgement as to what particular outcome is desirable for a client is not
given by the formulation of that particular clients problems. Therefore, the formulations
of ultimate and intermediate outcomes may be regarded as additional tasks with impor-
tant implications for the clients future welfare (see Rosen, 1993).
5. In this article, practitioners assumptions are recognized as knowledge, whether or not
they are true in the scientific sense of the term.6. Views regarding what is actually meant by practice wisdom are numerous (see e.g.
Dybicz, 2004; Klein & Bloom, 1995; OSullivan, 2005; Scott, 1990).
7. Naturally, the employment of scientific methods of investigation may lead to the discov-
ery of regularities that are difficult to trace in everyday practice. In addition, because
scientific methods have evolved to become humankinds most powerful form of enquiry
(Reid, 2001, p. 273), knowledge produced by research is inevitably more reliable and
more valid (however, not necessarily more useful) than knowledge gained in practice.
8. While the ability to describe a phenomenon does not necessarily imply that you are also
able to control it, you may also be able to control a phenomenon without being able to
fully describe it (see Rosen, 1978).9. The following is an example of a vignette made up of selected dimension levels from the
study: The mother struck the 11-year-old girl with a wooden stick. The mother said, I
became carried away in disciplining the child. The mother appears outgoing (OToole
et al., 1993, p. 349).
Primary drug
Alcohol Misuses alcohol
Amphetamines Misuses amphetamines
Heroin Misuses heroinSex
Male Man
Female Woman
Age
Young A 25-year-old
Middle aged A 39-year-old
Old A 56-year-old
Family status
No family Lives alone, without childrenFamily Lives with partner and children
380 Journal of Social Work 12(4)
at Qatar University on May 11, 2013jsw.sagepub.comDownloaded from
http://jsw.sagepub.com/http://jsw.sagepub.com/http://jsw.sagepub.com/http://jsw.sagepub.com/ -
7/30/2019 Journal of Social Work
19/22
10. As a rule of thumb, Snijders (2004) has suggested that the smallest acceptable sample
size at the highest level is 20 units.
References
Abbott, A. (1988). The system of professions: An essay on the division of expert labor.
Chicago, IL: The University of Chicago Press.
Abbott, A. (1995). Boundaries of social work or social work of boundaries? Social Service
Review, 69(4), 545562.
Alexander, C. S., & Becker, H. J. (1978). The use of vignettes in survey research. Public
Opinion Quarterly, 42(1), 93104.
Ashford, J. B., & LeCroy, C. W. (1991). Problem solving in social work practice:
Implications for knowledge utilization. Research on Social Work Practice, 1(3), 306318.
Benbenishty, R. (1992). An overview of methods to elicit and model expert clinical judgmentand decision making. Social Service Review, 66(4), 598616.
Campbell Collaboration. (2010). Retrieved 24 January 2010 from: http://
www.campbellcollaboration.org/
Children and Youth Services Review. (2005) 27(4), 347463.
Chu, W. C. K., & Tsui, M.-s. (2008). The nature of practice wisdom in social work revisited.
International Social Work, 51(1), 4754.
Cochrane Collaboration. (2010). Retrieved 24 January 2010 from: http://www.cochrane.org/
Corazzini-Gomez, K. (2002). The relative effects of home care client characteristics on the
resource allocation process: Do personality and demeanor matter? Gerontologist, 42(6),
740750.Cuzzi, L. F., Holden, G., Grob, G. G., & Bazer, C. (1993). Decision making in social work:
A review. Social Work in Health Care, 18(2), 122.
Daley, B. J. (2001). Learning and professional practice: A study of four professions. Adult
Education Quarterly, 52(1), 3954.
Degenholtz, H. B., Kane, R. A., Kane, R. L., & Finch, M. D. (1999). Long-term care case
managers out-of-home placement decisions: An application of hierarchical logistic
regression. Research on Aging, 21(2), 240274.
Dreyfus, H. L., & Dreyfus, S. E. (1986). Mind over machine: The power of human intuition
and expertise in the era of the computer. New York: The Free Press.
Dybicz, P. (2004). An inquiry into practice wisdom. Families in Society, 85(2), 197203.Eraut, M. (2000). Non-formal learning and tacit knowledge in professional work. British
Journal of Educational Psychology, 70(1), 113136.
Gambrill, E. (1999). Evidence-based practice: An alternative to authority-based practice.
Families in Society, 80(4), 341350.
Gambrill, E. (2006). Social work practice: A critical thinkers guide (2nd ed.). New York:
Oxford University Press.
Gibbs, L., & Gambrill, E. (2002). Evidence-based practice: Counterarguments to objections.
Research on Social Work Practice, 12(3), 452476.
Hammond, K. R. (1996). Human judgment and social policy: Irreducible uncertainty, inevi-
table error, unavoidable injustice. New York: Oxford University Press.Haynes, R. B., Devereaux, P. J., & Guyatt, G. H. (2002). Editorial. Clinical expertise
in the era of evidence-based medicine and patient choice. ACP Journal Club, 136(A11),
17.
Wallander 381
at Qatar University on May 11, 2013jsw.sagepub.comDownloaded from
http://jsw.sagepub.com/http://jsw.sagepub.com/http://jsw.sagepub.com/http://jsw.sagepub.com/ -
7/30/2019 Journal of Social Work
20/22
Hox, J. J., Kreft, I. G. G., & Hermkens, P. L. J. (1991). The analysis of factorial surveys.
Sociological Methods & Research, 19(4), 493510.
Jasso, G. (2006). Factorial survey methods for studying beliefs and judgments. Sociological
Methods & Research, 34(3), 334423.Klein, W. C., & Bloom, M. (1995). Practice wisdom. Social Work, 40(6), 799807.
Lauder, W. (2002). Factorial survey methods: A valuable but under-utilised research method
in nursing research? Nursing Times Research, 7(1), 3543.
Ludwick, R., Wright, M. E., Zeller, R. A., Dowding, D. W., Lauder, W., & Winchell, J.
(2004). An improved methodology for advancing nursing research: Factorial surveys.
Advances in Nursing Science, 27(3), 224238.
Michaud, S. M. (1998). The use of intuition among expert social work practitioners. PhD
dissertation, Case Western Reserve University, USA. ProQuest Digital Dissertations
database (Publication No. AAT 9818884).
Miller, J. L., Rossi, P. H., & Simpson, J. E. (1991). Felony punishments: A factorial surveyof perceived justice in criminal sentencing. The Journal of Criminal Law & Criminology,
82(2), 396422.
National Board of Health and Welfare. (2003). Knowledge development in social services: A
presentation of the project for national support. Stockholm: National Board of Health and
Welfare.
Osmo, R., & Rosen, A. (2002). Social workers strategies for treatment hypothesis testing.
Social Work Research, 26(1), 918.
OSullivan, T. (1999). Decision making in social work. Basingstoke: Palgrave Macmillan.
OSullivan, T. (2005). Some theoretical propositions on the nature of practice wisdom.
Journal of Social Work, 5(2), 221242.OToole, A. W., OToole, R., Webster, S., & Lucal, B. (1993). Nurses recognition and
reporting of child abuse: A factorial survey. Deviant Behavior, 14(4), 341363.
Parsons, T. (1951). The social system. London: Routledge.
Payne, J. W., Bettman, J. R., & Luce, M. F. (1998). Behavioral decision research: An
overview. In M. H. Birnbaum (Ed.), Measurement, judgement, and decision making
(pp. 303360). San Diego, CA: Academic Press.
Payne, M. (2001). Knowledge bases and knowledge biases in social work. Journal of Social
Work, 1(2), 133146.
Polanyi, M. (1966). The tacit dimension. New York: Doubleday & Company, Inc.
Raudenbush, S., Bryk, A., Fai Cheong, Y., & Congdon, R. (2000). HLM 5: Hierarchicallinear and nonlinear modeling. Lincolnwood, IL: Scientific Software International, Inc.
Reid, W. J. (2001). The role of science in social work: The perennial debate. Journal of Social
Work, 1(3), 273293.
Richmond, M. (1917). Social diagnosis. New York: Russel Sage Foundation.
Rosen, A. (1978). Issues in educating for the knowledge-building research doctorate. Social
Service Review, 52(3), 437448.
Rosen, A. (1993). Systematic planned practice. Social Service Review, 67(1), 84100.
Rosen, A. (1994). Knowledge use in direct practice. Social Service Review, 68(4), 561577.
Rosen, A., Proctor, E. K., & Staudt, M. M. (1999). Social work research and the quest for
effective practice. Social Work Research, 23(1), 414.Rosen, A., Proctor, E. E., Morrow-Howell, N., & Staudt, M. (1995). Rationales for practice
decisions: Variations in knowledge use by decision task and social work service. Research
on Social Work Practice, 5(4), 501523.
382 Journal of Social Work 12(4)
at Qatar University on May 11, 2013jsw.sagepub.comDownloaded from
http://jsw.sagepub.com/http://jsw.sagepub.com/http://jsw.sagepub.com/http://jsw.sagepub.com/ -
7/30/2019 Journal of Social Work
21/22
Rossi, P. H., & Anderson, A. B. (1982). An introduction. In P. H. Rossi & S. L. Nock (Eds.),
Measuring social judgments: The factorial survey approach (pp. 1568). Beverly Hills, CA:
SAGE.
Rossi, P. H. & Nock, S. L. (Eds.) (1982). Measuring social judgments: The factorial surveyapproach. Beverly Hills, CA: SAGE.
Sackett, D. L., Rosenberg, W. M. C., Gray, J. A. M., Haynes, R. B., & Richardson, W. S.
(1996). Evidence based medicine: What it is and what it isnt. BMJ (British Medical
Journal), 312(7023), 7172.
Scott, D. (1990). Practice wisdom: The neglected source of practice research. Social Work,
35(6), 564568.
Sheppard, M., & Ryan, K. (2003). Practitioners as rule using analysts: A further
development of process knowledge in social work. British Journal of Social Work,
33(2), 157176.
Sheppard, M., Newstead, S., Di Caccavo, A., & Ryan, K. (2000). Reflexivity and the devel-opment of process knowledge in social work: A classification and empirical study. British
Journal of Social Work, 30(4), 465488.
Sheppard, M., Newstead, S., Di Caccavo, A., & Ryan, K. (2001). Comparative hypothesis
assessment and quasi triangulation as process knowledge assessment strategies in social
work practice. British Journal of Social Work, 31(6), 863885.
Shlay, A. B. (1986). Taking apart the American Dream: The influence of income and family
composition on residential evaluations. Urban Studies, 23(4), 253270.
Snijders, T. A. B. (2004). Multilevel analysis. In M. S. Lewis-Beck, A. Bryman, & T. Futing
Liao (Eds.), The SAGE encyclopedia of social science research methods (pp. 673677).
Thousand Oaks, CA: SAGE.Son, I. S., Davis, M. S., & Rome, D. M. (1998). Race and its effect on police officers
perceptions of misconduct. Journal of Criminal Justice, 26(1), 2128.
Taylor, B. J. (2006). Factorial surveys: Using vignettes to study professional judgement.
British Journal of Social Work, 36(7), 11871207.
Taylor, B. J., & Zeller, R. A. (2007). Getting robust and valid data on decision policies. The
Irish Journal of Psychology, 28(12), 2741.
The Swedish Council on Technology Assessment in Health Care. (2001). Behandling av
alkohol- och narkotikaproblem: En evidensbaserad kunskapssammanstallning. [The treat-
ment of problems related to alcohol and narcotics: A review of evidence-based knowl-
edge]. Stockholm: The Swedish Council on Technology Assessment in Health Care.Trinder, L. (2000). Evidence-based practice in social work and probation. In L. Trinder &
S. Reynolds (Eds.), Evidence-based practice: A critical appraisal (pp. 138162). Oxford:
Blackwell Science Ltd.
Tucker, D. J. (1996). Eclecticism is not a free good: Barriers to knowledge development in
social work. Social Service Review, 70(3), 400434.
Turner, F. J. (2002). Diagnosis in social work: New imperatives. Binghamton, NY: The
Haworth Social Work Practice Press.
Wallander, L. (2008). Modelling professional judgements: An application of the factorial
survey to the field of social work. Doctoral dissertation, Department of Sociology,
Stockholm University.Wallander, L. (2009). 25 years of factorial surveys in sociology: A review. Social Science
Research, 38(3), 505520.
Wallander 383
at Qatar University on May 11, 2013jsw.sagepub.comDownloaded from
http://jsw.sagepub.com/http://jsw.sagepub.com/http://jsw.sagepub.com/http://jsw.sagepub.com/ -
7/30/2019 Journal of Social Work
22/22
Wallander, L., & Blomqvist, J. (2005). Who needs compulsory care? A factorial survey of
Swedish social workers assessments of clients in relation to the Care of Abusers (Special
Provisions) Act. Nordic Studies on Alcohol and Drugs, 22(English supplement), 6385.
Wallander, L., & Blomqvist, J. (2009). Modeling ideal treatment recommendations: A fac-torial survey of Swedish social workers ideal recommendations of inpatient or outpatient
treatment for problem substance users. Journal of Social Service Research, 35(1), 4764.
White, S., & Stancombe, J. (2003). Clinical judgement in the health and welfare professions:
Extending the evidence base. Maidenhead: Open University Press.
Will, J. A. (1993). The dimensions of poverty: Public perceptions of the deserving poor.
Social Science Research, 22(3), 312332.
384 Journal of Social Work 12(4)