beneath the surface iom

Upload: vin-coscolluela

Post on 07-Apr-2018

217 views

Category:

Documents


0 download

TRANSCRIPT

  • 8/6/2019 Beneath the Surface IOM

    1/96

    1

    Beneaththesurface.Methodologic

    alissuesinresearchanddata

    colleconwithassistedtrac

    kingvicms

  • 8/6/2019 Beneath the Surface IOM

    2/96

    This is the rst paper in the IOM and NEXUS Instute Human Tracking Research Series.

    This publicaon was made possible through support provided by the United States

    Department of State, under the terms of Grant No. S-SGTIP-09-CR-0070. The opinions

    expressed herein are those of the authors and do not necessarily reect the views of the

    United States Department of State.

    _______________

    IOM is commied to the principle that humane and orderly migraon benets migrants

    and society. As an intergovernmental organizaon, IOM acts with its partners in the

    internaonal community to: assist in meeng the operaonal challenges of migraon;

    advance understanding of migraon issues; encourage social and economic development

    through migraon; and uphold the human dignity and well-being of migrants.

    _______________

    Publishers: Internaonal Organizaon for Migraon

    17 route des Morillons

    1211 Geneva 19

    Switzerland

    Tel: +41.22.717 91 11

    Fax: +41.22.798 61 50

    E-mail: [email protected]

    Internet: hp://www.iom.int

    NEXUS Instute

    1701 Pennsylvania Avenue N.W. Suite 300

    Washington, D.C. 20006

    United States of America

    Email: [email protected]

    Internet: www.NEXUSInstute.net

    _______________

    2010 Internaonal Organizaon for Migraon (IOM)_______________

    All rights reserved. No part of this publicaon may be reproduced, stored in a retrieval

    system, or transmied in any form or by any means, electronic, mechanical, photocopying,

    recording, or otherwise without the prior wrien permission of the publisher.

    04_11

  • 8/6/2019 Beneath the Surface IOM

    3/96

    Beneath the surface.

    2010

    Methodological issues

    in research and

    data collection

    with assistedtrafficking victims

    Rebecca Surtees and Sarah Craggs

    A research cooperaon between

    IOM and NEXUS Instute

  • 8/6/2019 Beneath the Surface IOM

    4/96

  • 8/6/2019 Beneath the Surface IOM

    5/96

    3

    Beneaththesurface.Methodologic

    alissuesinresearchanddata

    colleconwithassistedtrac

    kingvicms

    Foreword by NEXUS Institute

    In the late 1990s and early 2000s, during deliberaons of the seminal United

    Naons An-Tracking Protocol and the early draing of naonal laws that

    followed, only a handful of reports addressing contemporary forms of slavery

    had been wrien. This has changed. Today hundreds of studies on human

    tracking are available with more published each month.

    The expansive growth in the body of literature on this subject within this relavely

    short meframe is a posive development and is welcomed by all who have

    dedicated themselves to ending modern slavery. Government leaders, donors,

    service providers and other professionals, faced with the myriad of complexies

    and variaons of human tracking, connue to stress the importance of

    research to their work and their desire for more data collecon and research.

    However, even though policymakers and praconers want and need research

    they can use, many conclude, with some dismay, that only a small percentage

    of the numerous reports available provide sucient empirical rigour and qualityof analycal insights needed to help guide more informed decisions capable

    of producing more eecve an-tracking results. It is clear that despite a

    substanal investment of me and resources to produce more and more studies

    around the world, few end up being useful to government ocials and an-

    tracking professionals in their work.

    Implementaon of more eecve pracces to end modern slavery will require

    beer underlying research, analysis and evaluaon. Achieving this, however,

    will not be possible in the absence of a foundaon of sound data systemacallycollected to serve specic pracce-based research objecves.

    This report focuses on approaches to collecng data about human tracking

    that underlie a large segment of research produced since the UN Protocol

    and, in doing so, reveals some of the key reasons that research generally has

    not provided a clearer path to more eecve acon for policymakers and

    praconers. It examines how current approaches to the collecon and use

    of data about human tracking, while helpful for certain purposes, fall short

    of what will be needed to achieve a new generaon of higher quality research

    and analysis capable of helping to produce transformave results in addressing

    human tracking.

  • 8/6/2019 Beneath the Surface IOM

    6/96

    4

    Beneathth

    esurface.Methodologicalissuesinresearchanddatacolleconwithassistedtrackingvicms

    The NEXUS Instute is a policy and research centre dedicated to helping an-

    tracking leaders develop and implement best pracces to improve our collecve

    ability to prevent human tracking, assist and protect vicms of tracking as

    well as end the impunity of the trackers. The issues spotlighted in this report

    by the authors, Rebecca Surtees and Sarah Craggs, serves as a valuable starng

    point for a wider discussion among governments, donors, academic instuons

    and others who support, conduct or use research concerning human tracking.We encourage governments and others to consider in greater depth how best

    to operaonalise the important ndings of this report. Implemenng new

    methods to systemacally acquire data that can reveal a fuller picture of human

    tracking and enable pracce-based research will provide a rmer foundaon

    of understanding to act upon to achieve an end to slavery in our me.

    The NEXUS Instute appreciates our valued collaboraon with our partner IOM

    on this project. NEXUS is especially grateful to the U.S. Department of States

    Oce to Monitor and Combat Tracking in Persons for supporng and makingthis project possible.

    Stephen Warnath

    Founder and Chairman

    NEXUS Instute

  • 8/6/2019 Beneath the Surface IOM

    7/96

    5

    Beneaththesurface.Methodologic

    alissuesinresearchanddata

    colleconwithassistedtrac

    kingvicms

    Foreword by IOM

    In 2000, as countries met to inaugurate the United Naons An-Tracking

    Protocol, the IOM oce in Prisna took the important iniave to launch an

    internal human tracking case management tool. Its aim was to manage the

    assistance provided to tracking vicms as well as to improve the knowledge

    base through the collecon of informaon about tracked persons and

    the tracking process. The tool, today known as the IOM Human TrackingDatabase, was soon adopted within the South-Eastern Europe region and during

    the years that followed, was rolled-out globally within IOM and to our naonal

    counterparts.

    At the same me, there was an increased interest in the research potenal of

    the IOM database, given the detailed and unique degree of primary data being

    collected. This move towards assessing the research potenal of the database

    and the associated data set on assisted vicms allowed for new partnerships to

    be formed, including the partnership with NEXUS Instute.

    As the an-tracking community reects upon the ten years that have passed

    since the signing of the of the United Naons An-Tracking (Palermo) Protocol,

    there is a need to assess the impact of our research and data collecon eorts.

    While progress has been made, there remains a real need to further advance our

    understanding of human tracking and thus our associated research and data

    collecon eorts, by ensuring that a more precise and encompassing picture of

    tracking is presented. This requires us to not only reect upon the cases that

    have been assisted by IOM but to equally learn from those who have eitherdeclined IOMs assistance or failed to be idened. This further requires eorts

    to be undertaken in all corners of the world to ensure that all tracked persons

    regardless of sex, age or type of exploitaon are granted the protecon they

    need.

    This paper notes that there is a fundamental need for more accurate, quality,

    and in-depth data, informaon and research on all aspects of the tracking

    phenomenon if we are to successfully and eecvely combat human tracking

    and end the exploitaon of migrants. On this note, we encourage governments,

    policymakers, researchers, internaonal organisaons, and other actors to take

    note of the pernent and mely ndings herewith presented in this report; and

  • 8/6/2019 Beneath the Surface IOM

    8/96

    6

    Beneathth

    esurface.Methodologicalissuesinresearchanddatacolleconwithassistedtrackingvicms

    to bolster their eorts to support the producon of improved research and data

    in order to beer understand and combat human tracking.

    IOM has been working to end the exploitaon of migrants and to combat human

    tracking since 1994. During this me, the organizaon has assisted tens of

    thousands of tracked persons around the world. We hope that by sharing our

    experiences and lessons learned we will collecvely be able to protect moremigrants in vulnerable situaons, and to end their exploitaon.

    IOM equally appreciates our valued collaboraon with our partner NEXUS on this

    project. IOM would further like to extend our connued appreciaon and thanks

    to the U.S. Department of States Oce to Monitor and Combat Tracking in

    Persons for their generous support to the database over the years and to this

    project in parcular.

    Irena Vojackova-Sollorano

    Director

    Department of Migraon Management

    IOM Headquarters

  • 8/6/2019 Beneath the Surface IOM

    9/96

    7

    Beneaththesurface.Methodologic

    alissuesinresearchanddata

    colleconwithassistedtrac

    kingvicms

    Acknowledgements

    This research paper is the rst in a joint IOM/NEXUS research series which will

    seek to augment and enhance the current knowledge base on human tracking

    by conducng targeted research as well as to consider and test methods and

    approaches to tracking research in dierent sengs and in response to

    dierent situaons. The paper (and the project more generally) are generously

    funded by the US Department of State Oce to Monitor and Combat Tracking(G/TIP). The idea for the joint project was conceived over a number of years

    of discussion and cooperaon between the authors as well as IOM and NEXUS

    Instute and, as such, it is important to acknowledge the role of Richard

    Danziger, then Head of IOMs Counter Tracking Division in Geneva (now Chief

    of Mission in Sri Lanka) and Stephen Warnath, Chairmen and founder of NEXUS

    Instute in Washington. G/TIP has also been very supporve of this research

    cooperaon and partnership between IOM and NEXUS; their support must also

    be acknowledged here.

    This paper benets from the experse of a wide range of respondents from the

    elds of research as well as service provision. Our sincere thanks to all those

    who parcipated in this research study. We would also like to sincerely thank

    the tracked men and women who shared their experiences of being involved

    in research with us. Their ideas and suggesons are an important part of this

    paper and provide important insight into the issue from the vicm perspecve

    including what might be done dierently (and beer) in future.

    The inputs and suggesons of our seven peer reviewers has enhanced andstrengthened the paper. Our thanks to Anee Brunovskis (Senior researcher,

    Fafo in Norway), Elzbieta Gozdziak (Research Director, Instute for the Study

    of Internaonal Migraon, Georgetown University), Frank Laczko (Head of IOM

    Research in Geneva), Anh Nguyen (Deputy Chief of Mission/Senior operaons

    coordinator, IOM Kyiv), Ana Eva Radice (Head of unit, IOM Brussels, former

    Chief of Mission, IOM Skopje), Tal Raviv (Regional Project Development Ocer,

    IOM Nairobi) and Lisa Rende-Taylor (Chief Technical Advisor, United Naons

    Interagency Project in Bangkok).

  • 8/6/2019 Beneath the Surface IOM

    10/96

    8

    Beneathth

    esurface.Methodologicalissuesinresearchanddatacolleconwithassistedtrackingvicms

    In addion, within IOM and NEXUS here are a number of people without whom

    this study would not have been possible. Our thanks to Anvar Serojitdinov,

    Project Ocer (Migrant Assistance Division, IOM Geneva), who has been an

    important member of the project team and undertaken a wide range of roles and

    acvies. Thanks also to former IOM interns, Elizabeth Murphy and Sharmaake

    Sabrie. Finally parcular thanks to Richard Danziger and Stephen Warnath for

    their expert guidance and support as well as their inputs and direcon in thedevelopment of this paper.

    Rebecca Surtees Sarah Craggs

    Senior Researcher Researcher and Programme Coordinator

    NEXUS Instute IOM Geneva

    December 2010 December 2010

  • 8/6/2019 Beneath the Surface IOM

    11/96

    9

    Beneaththesurface.Methodologic

    alissuesinresearchanddata

    colleconwithassistedtrac

    kingvicms

    Table of contents

    Foreword by NEXUS Instute ............................................................................. 3

    Foreword by IOM ............................................................................................... 5

    Acknowledgements ............................................................................................ 7

    Table of contents ................................................................................................ 9

    Acronyms and abbreviaons ............................................................................ 11

    Execuve summary .......................................................................................... 131. Introducon ................................................................................................ 15

    2. Methodology and data collecon ............................................................... 19

    Interviews with key informants ................................................................... 19

    Survey of IOM missions ............................................................................... 20

    Analysis and review of the IOM tracking database .................................. 20

    Literature review ......................................................................................... 21

    Peer review process .................................................................................... 21

    Research limitaons .................................................................................... 21

    3. Considering the IOM approach ................................................................... 23Data from assisted vicms methodological strengths and limitaons ..... 27

    4. A global approach? Data quality and comparability across dierent

    terrains ........................................................................................................ 29

    The tools used ............................................................................................. 30

    The quesons asked, the variables used ..................................................... 32

    The language used ...................................................................................... 35

    The professionals involved .......................................................................... 38

    How data is managed .................................................................................. 40

    Missing data, missed meaning? .................................................................. 41Comparability across contexts..................................................................... 42

    Standardised but not comparable? ............................................................. 44

    5. Who is collecng data? The role of researchers and service providers ...... 45

    Blurred roles, blurred boundaries? ............................................................. 47

    Rigour, objecvity and independence ......................................................... 50

    Resources and me ..................................................................................... 51

    Dierent role, dierent goals? .................................................................... 52

    Mixed roles? ................................................................................................ 54

  • 8/6/2019 Beneath the Surface IOM

    12/96

    10

    Beneathth

    esurface.Methodologicalissuesinresearchanddatacolleconwithassistedtrackingvicms

    6. Being representave? Challenges in obtaining representave samples

    of tracking vicms .................................................................................... 57

    Are assisted tracking vicms representave? .......................................... 57

    Is an organisaons caseload representave? ............................................. 61

    Representavity in tracking research and data collecon ....................... 64

    7. What quesons are asked and why? Assumpons, biases and agendas

    in tracking research and data collecon .................................................. 67What assumpons? What biases? .............................................................. 67

    Agenda and ideology ................................................................................... 70

    The implicaons? ........................................................................................ 71

    Vicms perspecve .................................................................................... 73

    8. Where do we go from here? Some thoughts, some recommendaons ..... 77

    Data quality and comparability ................................................................... 78

    Relaonships and boundaries between service provision and research..... 78

    Representavity in tracking research and data collecon ....................... 79

    Assumpons, biases and agendas in research quesons ............................ 80Going forward? ............................................................................................ 80

    9. Bibliography ................................................................................................ 83

  • 8/6/2019 Beneath the Surface IOM

    13/96

    11

    Beneaththesurface.Methodologic

    alissuesinresearchanddata

    colleconwithassistedtrac

    kingvicms

    Acronyms and abbreviations

    AT An-tracking

    BiH Bosnia and Herzegovina

    BNRM Bureau of the Dutch Rapporteur on Tracking in Human Beings

    CT Counter-tracking

    CTM Counter-Tracking Module

    EC European CommissionECPAT Global network of organisaons and individuals working

    together to eliminate child prostuon, child pornography and

    the tracking of child for sexual purposes.

    EU European Union

    FSU Former Soviet Union

    GAO United States Government Accountability Oce

    GO Governmental Organisaon

    G/TIP U.S. Department of States Oce to Monitor and Combat

    Tracking in PersonsHQ Headquarters

    ILO Internaonal Labour Organizaon

    IO Internaonal Organisaon

    IOM Internaonal Organizaon for Migraon

    MoI Ministry of Interior

    NGO Non-governmental organisaon

    OSCE Organisaon for Security and Co-operaon in Europe

    SEA South-East Asia

    SEE South-Eastern EuropeSW Support workers

    THB Tracking in human beings

    TIP Tracking in persons

    UN United Naons

    UNAIDS United Naons Programme on HIV/AIDS

    UNDP United Naons Development Programme

    UNHCR United Naons High Commission for Refugees

    UN.GIFT United Naons Global Iniave to Fight Human Tracking

    UNIAP United Naons Inter-Agency Project on Human TrackingUNICEF United Naons Childrens Fund

  • 8/6/2019 Beneath the Surface IOM

    14/96

    12

    Beneathth

    esurface.Methodologicalissuesinresearchanddatacolleconwithassistedtrackingvicms

    UNODC United Naons Oce on Drugs and Crime

    UNOHCHR United Naons Oce of the High Commission of Human Rights

    US United States

    USAID United States Agency for Internaonal Development

    VoT Vicm of tracking

    WHO World Health Organizaon

  • 8/6/2019 Beneath the Surface IOM

    15/96

    13

    Beneaththesurface.Methodologic

    alissuesinresearchanddata

    colleconwithassistedtrac

    kingvicms

    Executive summary

    Recent years have seen increased aenon to research and data collecon on the

    issue of human tracking. Many early tracking studies sought to understand

    the nature and scope of human tracking. More recently, tracking studies

    have considered a wide range of topics including methodological and ethical

    issues when conducng research and data collecon. There has also been a

    spate of data collecon iniaves as a means of tracking and, by implicaon,beer understanding tracking in persons. Nevertheless, there is some debate

    about the current quality and integrity of research and data collecon in the

    tracking eld.

    This paper draws upon one parcular research and data collecon approach

    the IOM human tracking database as a means by which to discuss current

    data collecon and research eorts and, equally, as a lens to draw some lessons

    and suggesons for future research and data collecon iniaves.

    As the paper discusses, much of the current knowledge base on tracking

    is drawn from assisted tracking vicms (that is, vicms who have been or

    are currently being assisted). And research and data collecon with assisted

    tracking vicms, like that undertaken by IOM and other service providers,

    has many strengths. It can shed light on a range of issues including risk and

    vulnerability factors, the needs of dierent groups of tracking vicms (e.g.

    men, women, children, vicms of labour tracking and sex tracking); the

    gender dimensions of tracking; details of the tracking process and, albeit it

    to a lesser extent, the perpetrators involved, their modus operandi, the routesused and so on. This approach also allows counter-tracking professionals to

    idenfy emerging trends and paerns in real me, which, on the one hand,

    means the data is current and, on the other hand, allows the data to inform

    policy and programmac response.

    Nonetheless, as with all research methods, the approach suers from some

    challenges which must be understood for the research ndings to be used

    eecvely and appropriately. This paper outlines some of these issues, centring

    around the following four themes:

    A global approach? Data quality and comparability across dierent terrains

    Who is collecng data? The role of researchers and service providers

  • 8/6/2019 Beneath the Surface IOM

    16/96

    14

    Beneathth

    esurface.Methodologicalissuesinresearchanddatacolleconwithassistedtrackingvicms

    Being representave? Challenges in obtaining representave samples of

    tracking vicms

    What quesons are asked and why? Assumpons, biases and agendas in

    tracking research and data collecon

    In exploring these topics, we outline some of the methodological issues which

    arise when collecng data about assisted tracking vicms (and their trackingexperiences) through service providers and in the context of an-tracking

    assistance programmes. While it is not the aim of this paper to present an

    analysis of actual data contained within the IOM database, key examples from

    the database are used to illustrate these themes and issues.

    This paper equally seeks to draw some lessons for future research and data

    collecon iniaves. In sum, while IOM and other actors have made important

    steps in drawing upon assisted vicm data for research purposes including for

    trend analysis and to idenfy emerging issues there are opportunies to furtheradvance the analysis by ensuring that a more rounded picture of tracking is

    presented. This means being mindful of key issues like, issues of data quality and

    comparability, the context of data collecon, the representave nature of the

    data and biases and assumpons in the research process. This equally involves

    moving beyond an analysis of data collected from only one source and one group

    of vicms to include other data sources, employing mulple methodologies.

    It is crical that service providers and researchers increasingly explore and

    present both the strengths and limitaons of data and research in order thatpolicymakers and praconers can make informed decisions about which data

    they use and how in the design, implementaon, monitoring and evaluaon of

    their an-tracking responses. It is hoped that by making explicit some of the

    limitaons of data collecons with assisted vicms, and more specically what

    can be learned from the example of the IOM database, that research drawn

    from these data can be read and understood in context, including what this

    informaon does (and does not) tell us about tracking.

    This paper is the rst in a series of research papers being prepared jointly byIOM and the NEXUS Instute and funded by U.S. Department of States Oce to

    Monitor and Combat Tracking in Persons (G/TIP). The overall objecve of the

    themac research series is not only to seek to augment and enhance the current

    knowledge base on human tracking but also to consider and test methods

    and approaches to tracking research in dierent sengs and in response to

    dierent situaons.

    Key words

    An-tracking data collecon; assisted tracking vicms; bias; casemanagement; comparability; data quality; ethics; IOM human tracking

    database; methods; representavity; service providers; tracking research.

  • 8/6/2019 Beneath the Surface IOM

    17/96

    15

    Beneaththesurface.Methodologic

    alissuesinresearchanddata

    colleconwithassistedtrac

    kingvicms

    1. Introduction

    Recent years have seen increased aenon to research and data collecon

    on the issue of human tracking. Many early tracking studies sought to

    understand the nature and scope of human tracking. More recently, tracking

    studies have considered a wide range of topics including methodological and

    ethical issues when conducng research and data collecon. In addion, there

    has been a spate of data collecon iniaves, albeit dierent in scope, nature,and locaon, as a means of tracking and, by implicaon, beer understanding

    tracking in persons. These eorts are also intended, in many cases, to help

    account for focus and expenditures on an-tracking eorts.

    Nevertheless, there is some debate about the current quality and integrity of

    research and data collecon in the tracking eld. Within research and policy

    circles, there have been a number of recent iniaves and publicaons which

    have sought to assess the current state of tracking research, including the use of

    dierent methodologies and approaches.1

    Moreover, many instuons, agenciesand universies have been engaged in discussions of and projects on research

    and data collecon, including the establishment of naonal rapporteurs on

    tracking or equivalent mechanisms.2 And so, a decade since the signing of the

    Palermo Protocol,3 researchers, praconers and policy makers are increasingly

    taking stock of what is known about human tracking and what sll needs to be

    known to more eecvely undertake tracking research and, by implicaon, to

    design and implement more eecve an-tracking programmes and policies.

    This necessarily involves a consideraon of research methodology and pracce

    as a means by which this greater understanding can be realised.

    1 See, for example, Aghazarm, et al 2008; Andreas & Greenhill 2010; Andrees & van der Linden 2005; Brennan

    2005; Brunovkis & Surtees 2010; Clawson et al. 2006; Cwikel & Hoban 2005; David 2007; De Cock 2007;

    GAO 2006; Goodey 2008; Gozdziak & Bump 2008; Gozdziak & Collet 2005; Gragmena & Laczko 2003; IOM

    et al. 2009; Kelly 2005 & 2002; Laczko 2005; Laczko & Gozdziak 2005; Rogers et al 2010; Savona & Stefanizzi

    2007; Steinfa 2003, Steinfa et al. 2002; Surtees 2007c; Tyldum 2010 & 2009; Tyldum & Brunovskis 2005;

    Tyldum, Tveit & Brunovskis 2005; UNIAP 2008; Young 2009. In addion, there have been numerous naonal,

    regional and internaonal seminars, conferences and meengs to discuss research methodology and data

    collecon eorts.2 As a non-exhausve list, this includes: David 2007; Doridge 2010; Folden et al. 2007; ILO 2009; IOM et al.

    2009; Machado et al. 2007; OSCE 2009; Surtees 2009, 2007a, 2005; UNODC 2009; Vermeulen & Paterson

    2010; Vermeulen at al. 2006; Weiner & Hala 2008. Many naonal enes, such as naonal rapporteurs orequivalent mechanisms, also produce annual reports on the state of tracking in the respecve country

    (e.g. BNRM 2010).3 Ocially the United Naons Protocol to Prevent, Suppress and Punish Tracking in Persons, especially

    Women and Children, signed in 2000.

  • 8/6/2019 Beneath the Surface IOM

    18/96

    16

    Beneathth

    esurface.Methodologicalissuesinresearchanddatacolleconwithassistedtrackingvicms

    To this end, this paper aims to discuss some of what we have learned from our

    involvement in dierent an-tracking research and data collecon iniaves,

    with a view to moving forward. In parcular, we use our joint experience with

    one parcular research and data collecon approach IOMs Counter-Tracking

    Module (CTM)4 as the starng point for a discussion of current tracking

    research and, equally, as a lens to draw some lessons and suggesons for futureresearch and data collecon iniaves. The CTM is IOMs global database

    on vicms of human tracking. It collects data about individual tracking

    vicms assisted by IOM and/or its partner organisaons, including informaon

    on tracked persons background, recruitment, transportaon, tracking

    exploitaon and assistance.5

    The paper will consider how, to date, the IOM database has (and has not) been

    eecve in terms of tracking research and data collecon and, equally, what

    methodological, praccal and ethical issues arise from this parcular approach.While it is not the aim of this paper to present an analysis of data contained

    within the IOM database, examples from the IOM data sets will, where relevant,

    be included. We will also consider what might be done to improve tracking

    research and data collecon, suggesons which are specic to the IOM database

    and also have broader relevance. It should be noted that many organisaons

    employ approaches similar in scope and purpose to the IOM approach. It is,

    therefore, hoped that this paper with its discussion of our experience of and,

    at mes, our frustraon with the IOM database and other related data collecon

    iniaves can contribute to the dialogue on an-tracking research and datacollecon. It is also intended that by making explicit the strengths and limitaons

    of the IOM approach (and by implicaon, those of many other organisaons

    and instuons), research drawn from it can be read and understood in the

    appropriate light.

    Certainly research and data collecon is vital in terms of beer understanding

    human tracking and, equally, in designing and implemenng an-tracking

    responses. The authors, and the instuons we represent, have been involved

    in various studies, projects and iniaves with precisely these objecves.

    6

    At the

    4 The database is referred to as the CTM within IOM. In the context of this paper we refer to the IOM traf-

    cking database.5 The database is installed in 72 IOM missions globally. As of the end of December 2010, the system contained

    data on nearly 16,000 registered IOM beneciaries in more than 85 source and more than 100 desnaon

    countries. See also secon three for addional discussion of the IOM tracking database.6 We have each worked with the IOM tracking database at various stages of its development and in dier-

    ent roles and capacies. The rst author has approached the database from a largely outside perspecve,

    conducng independent research using dierent IOM data sets at dierent stages and in dierent ways. In

    some cases, the data sets were exclusively IOM; in other cases, IOM data was part of a larger body of prima-

    ry data. She has also conducted extensive eld research with tracked persons in Asia, Europe, the FSU and

    Africa. The second author has worked with the IOM database from the inside cleaning and validangthe data, providing training and guidance to eld missions, data analysis for country and themac reports

    and contribung to various arcles and documents based on IOMs approach to data collecon. She has

    also conducted eld research in Europe, the FSU and North America. In addion, both authors have been

    involved in various research discussions, meengs and seminars and have parcipated in dierent (naonal

    and regional) data collecon iniaves, including those which have drawn on, learned from and also built

    upon the IOM tracking database model.

  • 8/6/2019 Beneath the Surface IOM

    19/96

    17

    Beneaththesurface.Methodologic

    alissuesinresearchanddata

    colleconwithassistedtrac

    kingvicms

    same me, research and data collecon must be undertaken with cauon, care

    and adequate aenon to aendant methodological and ethical issues. And,

    as a number of researchers and studies have observed, there are substanal

    problems with much research on human tracking and data collecon iniaves

    which have, in many cases, been ill conceived and/or poorly implemented.

    Nevertheless, there is much that can be learned from these past eorts and

    iniaves. Equally, there is a need to move beyond simply taking stock of andcriquing exisng research and data collecon and oer some suggesons and

    entry points in terms of how to go forward with this work.

    This paper is not intended as a denive exploraon of methods in research and

    data collecon with tracking vicms. Rather, it is a starng point for discussion,

    illustrated largely through the discussion of IOMs very specic methodology and

    approach to research with assisted tracking vicms, including the aendant

    strengths and weaknesses. In doing so, it is also intended to encourage other

    organisaons, instuons and individual researchers to openly discuss andexplore some of the issues and constraints they face in their research and data

    collecon eorts as a mean of advancing both the methodological approach in

    this eld and to enhance the rigour of tracking research and analysis. Finally,

    the paper is intended to provide some guidance to policymakers and praconers

    in terms of the strengths and limitaons of the current body of knowledge on

    tracking, not least in terms of how it can and should be read, understood and

    used in the design and implementaon of policies and programmes.

    This paper is the rst in a series of research papers being prepared jointly byIOM and the NEXUS Instute and funded by U.S. Department of States Oce to

    Monitor and Combat Tracking in Persons (G/TIP). The overall objecve of the

    themac research series is not only to seek to augment and enhance the current

    knowledge base on human tracking but also to draw upon IOM database and

    data sets to consider and test methods and approaches to tracking research in

    dierent sengs and in response to dierent situaons. Each paper in the series

    will be a stand-alone study of a specic aspect of tracking and/or tracking

    research. Preliminary analysis of data contained within the IOM database has

    led to the selecon of research topics which will include, but are not limitedto, an analysis of research on trackers and tracking operaons, research

    on tracking into the construcon industry, tracking and exploitaon of

    shermen and seafarers and tracking for forced marriage. At the same me,

    taken together, the studies will provide a strong foundaon for considering

    not only the potenal of the IOM database toward providing fresh insights on

    human tracking but, equally, what is (and is not) working in the eld of an-

    tracking data collecon and research, including ideas and recommendaons

    for ways forward, both in terms of what is known, what research is needed and

    how to go about undertaking such studies.

  • 8/6/2019 Beneath the Surface IOM

    20/96

  • 8/6/2019 Beneath the Surface IOM

    21/96

  • 8/6/2019 Beneath the Surface IOM

    22/96

    20

    Beneathth

    esurface.Methodologicalissuesinresearchanddatacolleconwithassistedtrackingvicms

    Interviews were also conducted with 18 service providers from IOM and NGOs

    who, in addion to their assistance and case management work, also collect

    data about the tracking vicms they assist. This included 12 IOM sta from

    seven countries in Europe, Asia, the FSU, Africa and Lan America who work or

    have previously worked on tracking data collecon and research. In addion,

    six NGO sta was interviewed from three countries in Europe, the FSU and Asia.

    Service provider interviews focused on their experiences of conducng researchand data collecon with their programme beneciaries some with the IOM

    forms, others according to their own tools and methods.

    We also interviewed 21 tracked persons who were currently being or had

    previously been assisted within an an-tracking assistance programme and, in

    that context, had been involved in data collecon process as respondents. Five

    tracked persons from Albania and one from Ukraine were interviewed in 2009;

    15 tracked persons from Ukraine were interviewed in 2010. This included

    both men and women and vicms of both tracking for labour and sexualexploitaon. The intenon was to learn from tracked persons how they had

    understood and experienced the research and data collecon process, including

    how they felt about this type of data collecon, how they felt about the tools

    used and quesons asked, any concerns they had about the data collecon and

    what could be done dierently (and beer) in future.

    Survey of IOM missions

    IOM counter-tracking focal points currently working with the IOM trackingdatabase and/or the accompanying screening and assistance interview forms

    were globally surveyed according to a standard research quesonnaire. The

    quesonnaire focused on current data collecon processes and protocols within

    the mission and, where relevant, the nature and extent of any variaon on or

    deviaon from the standard approach outlined in IOMs tracking database

    protocols. Responses were received from 23 missions in Europe, North America,

    Asia, the FSU, the Middle East, Africa and Lan America. This accounted for

    about a third of the 72 missions which currently use or have used the CTM; there

    are approximately 250 IOM missions worldwide.

    7

    We also drew on informaonand feedback shared previously by IOM missions in the context of an internal

    evaluaon of the IOM database undertaken in 2006-2007 (Sgter 2006) as well

    as in past and ongoing discussions with IOM eld missions.

    Analysis and review of the IOM tracking database

    This included a review of the database, checking for full data and high levels

    of non-response, coding errors, outliers, inconsistencies, logic checks and an

    7 Not all of these missions implement or are currently implemenng - an-tracking acvies. Further-

    more, while IOM is present in 460 eld locaons, this does not necessarily refer to an oce as a physical

    premise but to the presence of IOM sta.

  • 8/6/2019 Beneath the Surface IOM

    23/96

    21

    Beneaththesurface.Methodologic

    alissuesinresearchanddata

    colleconwithassistedtrac

    kingvicms

    assessment of the open elds and narrave informaon. While some of this was

    done in the context of this paper, this exercise is also done regularly within IOM

    (at the global and local level) as part of data maintenance and quality assurance.

    In addion, queries were made in the database to answer specic quesons in

    relaon to non-response, local adaptaons and changing paerns.

    Literature review

    A broad review was undertaken of tracking research methodology as well as

    research methods and approaches which potenally overlap with the tracking

    eld for example, methods used in studying migraon, prostuon, hidden

    and elusive populaons and sgmased/marginalised populaons. This included

    reviewing journal arcles, books, organisaonal reports and presentaons.

    Peer review process

    The paper was reviewed by seven peer reviewers, with extensive knowledge and

    experience in tracking research including, in some cases, detailed knowledge of

    the IOM database and methodology. This included four internal peer reviewers

    (personnel who had previously or currently work for IOM) and three external

    reviewers from research instutes, research projects and universies.

    In addion, the paper was reviewed internally within IOM and NEXUS Instute

    project teams by Richard Danziger, then Head of the IOM Migrant Assistance

    Division and Stephen Warnath, Chair and founder of NEXUS Instute.

    Research limitaons

    This paper draws on a wide range of experiences and experse in considering,

    the current state of tracking research and data collecon, through the lens

    of the IOM approach. This includes not only a review of current research and

    exisng IOM data sets but also interviewing a range of researchers and service

    providers working on the issue as well talking with tracking vicms themselves.

    Nevertheless, there are some limitaons in terms of the data collected, whichare discussed briey below.

    Geography. There was a geographical bias in that more respondents were from

    Europe, North America, the FSU and Asia than from Africa, Lan America and

    the Middle East. To some extent this is a consequence of our own working

    environments and contacts. However, it is also, at least partly, because a large

    amount of tracking research is focused on or conducted by researchers in or

    from Europe, Asia and North America (Aghazarm et al. 2008; Laczko 2005). One

    survey of IOM tracking publicaons found that, between 2000 and 2004, 44per cent originated from within Europe and 35 per cent from within Asia-Pacic

    (Laczko & Gozdziak 2005).

  • 8/6/2019 Beneath the Surface IOM

    24/96

    22

    Beneathth

    esurface.Methodologicalissuesinresearchanddatacolleconwithassistedtrackingvicms

    Moreover, IOM missions in SEE and FSU have the longest experience with the

    IOM database and, as a result, the largest data sets. While there are pockets of

    experience in other regions, it is by no means comparable. As a consequence,

    the ndings and issues idened may be more reecve of these sengs than

    less represented regions. Future papers in the series will seek to pay aenon to

    this geographical bias by considering less studied countries and regions, to the

    extent that this is possible.

    Representavity amongst respondents. The intenon was to use the IOM

    database as a lens to discuss methodological issues faced by those undertaking

    research and data collecon with assisted tracking vicms. There are

    consequently a limited number of interviews with organisaons which work

    directly on data collecon in dierent sengs and do not partner with IOM.

    While it was possible to conduct brief eldwork in Ukraine and Albania, this was

    an add on to other eldwork projects, which means that there is insucient

    aenon to (dierent and diering) eld perspecves and organisaons not

    associated with IOM and its partners. There is also a geographic bias in that the

    eldwork took place in one country in Europe (Albania) and one country in the

    FSU (Ukraine).

    Representavity amongst tracked persons. The paper includes the experiences

    and opinions of tracked persons, both men and women and vicms of both

    labour and sex tracking. However, because eldwork took place only in two

    countries in the Europe and FSU region, this informs the extent to which vicmsexperiences are representave and/or globally relevant.

    Language barriers. Telephone interviews were primarily conducted in English,

    although Russian language interviews were possible due to language skills of

    the project research assistant. Interpretaon was available in the context of

    eldwork. Nevertheless, there is a bias toward researchers and service providers

    who are procient in the English language. The literature review also reects this

    bias toward English language sources which means that some valuable research

    has been missed. Lack of funds for translang research prevented the inclusionof these foreign language studies.

  • 8/6/2019 Beneath the Surface IOM

    25/96

    23

    Beneaththesurface.Methodologic

    alissuesinresearchanddata

    colleconwithassistedtrac

    kingvicms

    3. Considering the IOM approach

    IOMs tracking database collects single case data about assisted vicms as a

    means of facilitang case management in the shorter term and facilitang data

    analysis for research purposes in the longer term.Data is collected with two

    disnct tools a screening interview form and an assistance interview form.8

    Screening interviews, undertaken upon rst contact with the tracked person,

    assess whether an individual was tracked according to the denion providedin the Palermo Protocol9 and also their immediate protecon needs. Assistance

    interviews, undertaken once the individual has accepted IOM assistance,

    document the vicms background, recruitment and transportaon, tracking

    experience and their assistance and/or re/integraon needs, including what

    service are (and are not) provided. The IOM database encodes data about

    individual tracking vicms according to these standardised interview forms.

    This standardised data is further supplemented by qualitave data from

    interviews with tracking vicms, which allows for the documentaon of details

    that fall outside of the standardised elds and adds depth to the informaoncollected. Interviews are undertaken by service providers, either an IOM sta or

    an NGO or GO partner with whom IOM works in providing direct assistance.10

    The IOM tracking database aims to consolidate into one database tracking

    cases assisted by IOM missions and their partners globally. By mobilising the

    links between eld missions (in origin, transit and desnaon countries), the

    database aims to establish a standardised model for data collecon and data

    sharing (allowing for local and cultural adaptaon through the inclusion of

    open elds) while reducing the risk of double counng cases. The database alsofacilitates the cross-border transfer of data in a secure manner (Sgter 2006: 9).

    IOMs rst counter-tracking data collecon system was started in 2000 in

    Kosovo, UNSC resoluon 1244-administered Kosovo11 by IOM counter-tracking

    sta who required a system to collect informaon about tracking vicms they

    were assisng as well as returning and referring for assistance in countries of

    8 Please refer to the IOM Direct Assistance Handbook for a copy of the screening form and a detailed descrip-

    on of IOMs approach to screening and assistance. See IOM 2007.9 See Chapter Two of the IOM Direct Assistance Handbook for more informaon on how IOM determines

    tracking status. See IOM 2007.10 The interview process and nature of data collecon will be discussed in more detail in subsequent secons.11 Hereinaer referred to as Kosovo/UNSC 1244.

  • 8/6/2019 Beneath the Surface IOM

    26/96

  • 8/6/2019 Beneath the Surface IOM

    27/96

    25

    Beneaththesurface.Methodologic

    alissuesinresearchanddata

    colleconwithassistedtrac

    kingvicms

    while others required amendments in the system.15 In 2004, revisions were made

    to the database and the old data set, which has been collected since 2000 (with

    a very small number of cases having been idened in 1999), was transferred

    and integrated into the new IOM tracking data management system.

    In January 2006, the then IOM Counter Tracking Division16 hosted a meeng

    on how to improve data collecon and how to make the database a more usefulresearch tool. The meeng was aended by relevant HQ and eld sta and

    representaves from external instuons like NEXUS Instute and ILO. This was

    in response to ongoing inputs, and oen frustraons, from eld missions about

    the ease of the tools use and/or its suitability for their purposes. While some

    issues were technical17 or linked to resources, others were linked to the approach

    itself and included issues such as quesons which were deemed inappropriate

    in some sengs, unsuitability for all forms of tracking and all types of vicms,

    the large number of quesons and inconsistent or incomplete data. This meeng

    was followed by an internal evaluaon of the database, nalised in October2006, to idenfy reasons for none or paral usage of the database (including

    challenges in dierent operaonal environments) and to consider the research

    potenal of IOM tracking data (Sgter, 2006). Another meeng, aended by

    sta from IOM (HQ and eld missions) and external experts (NEXUS Instute and

    ILO) was held in Geneva in January 2007 to discuss the ndings and to explore

    ways forward.18

    Both the evaluaon and subsequent meengs idened the need for further

    change within the IOM tracking database, to make the tool more global,adaptable and user-friendly. This included resolving current technical constraints;

    ensuring sustainability of the tool within IOM; and accommodang regional

    and cultural specicies in data sets. As a result, the screening and assistance

    interview forms were revised, with aenon to removing biases. For example,

    an earlier version of the database assumed - based on the situaon in SEE at

    the me - that all vicms were essenally deceived or coerced into tracking.

    Yet this was out of synch with the situaon in other regions where many

    tracking vicms were (and sll are) willing labour migrants (oen accessing

    formal migraon channels) but ending up tracked. Quesons were also addedto address gaps and somemes a lack of precision in the exisng data sets

    for example, about vicms place/family of origin; educaon; past employment

    experience; tracker/recruiter proles and dierent types of exploitaon.19

    15 Please see secon four for a more detailed discussion of the contextual challenges to global data collecon.16 Now the Migrant Assistance Division.17 While some frustraons and problems connue to be of a technical nature and lessons can be learned from

    a discussion of the technical implementaon of the data collecon system, this papers focuses on more

    substanve themac and methodological consideraons.18 In late November/ early December 2010, IOM convened an addional meeng with counter-tracking and

    assisted voluntary return and reintegraon subject maer experts. The aim of the meeng was to begindiscussing the feasibility of moving IOMs operaonal databases, including the IOM tracking database,

    to the internet. Sta also began discussing ways in which to further improve the tool. The process will be

    further expanded during 2011/ 2012.19 See secon four for a more detailed discussion of cultural and contextual challenges to global research and

    data collecon approaches.

  • 8/6/2019 Beneath the Surface IOM

    28/96

    26

    Beneathth

    esurface.Methodologicalissuesinresearchanddatacolleconwithassistedtrackingvicms

    The revised forms were piloted at IOM Headquarters in Geneva, using a number

    of cross-cultural tracking scenarios to test for global applicability and regional

    and cultural specicies. They were then translated into French, Spanish, Arabic,

    Chinese, Kurdish, Japanese, Portuguese and Russian. At the same me, changes

    were reected in the technical system, which was piloted at IOM Headquarters

    and two eld missions. This resulted in some minor changes and bug xes and

    the revised database was then launched globally.

    The database is today installed in 72 IOM missions globally, albeit with diering

    levels of data collected from mission to mission. As of the end of December 2010,

    the system contained data on approximately 16,000 registered IOM assisted

    vicms in more than 85 source and more than 100 desnaon countries.20

    While the IOM tracking database represents in some ways a unique tool (both

    methodologically and technically), IOM is by no means the only organisaon

    which uses this approach. Indeed it is similar in many ways to the approach ofmany NGO and GO assistance organisaons around the world which collect data

    about the tracked persons whom they idenfy and assist. In some cases, data

    collecon mechanisms have been based on the IOM model, drawing on IOMs

    past successes and challenges in this eld (IOM et al. 2009; Surtees 2009 & 2007;

    Weiner & Hala 2008).21 Most service providers, whether from NGOs, IOs or GOs,

    maintain comprehensive case informaon about the tracked persons they

    assist both about their tracking exploitaon and their assistance needs. Many

    also use this informaon for research as well as case management. There may

    be a wide variaon between service providers in terms of what data is collectedand how. Yet this methodological approach that is, accessing vicm-centred

    data from service providers as a means of understanding tracking is common

    in most countries and constutes the primary source of data about tracking in

    the current knowledge base. Moreover, a large number of tracking research

    projects are based on vicm-centred data, oen accessing respondents through

    assistance programmes and, thus, overlapping in terms of informants with the

    informaon collected by assistance programmes (Brunovskis & Surtees 2010).

    20 A number of missions also collect standardised data sets based upon the global data collecon approach but

    outside of the database. This is due to technical reasons (where the mission is unable to connect to the host-

    ing server); or the existence of a previously developed data collecon tool (prior to the roll-out of the global

    database). This situaon is currently being resolved and, in 2011-2012, all relevant IOM assistance data will

    be captured within the one database. In the interim, IOM requests that all missions operang outside of

    the database share a minimum core data set with Headquarters bi-annually. This data is then validated and

    compiled.21 IOM has also partnered with various governments globally to support their data collecon mechanisms,

    sharing IOMs method and approach and providing technical assistance. For example, this has included

    cooperaon and/or technical assistance and training on data collecon in Bahrain, Belgium, Canada, Chad,

    Cote DIvoire, Costa Rica, Ecuador, Egypt, Greece, Kosovo/ UNSC 1244, Nepal, Portugal, Romania, SierraLeone, Somalia, Sri Lanka, Syria, Turkey, United Kingdom, United States of America, and Zambia. IOM has

    further provided technical assistance at the regional level to the European Union (IOM et al. 2009). Local

    iniaves are similarly oen in place at the IOM mission level.

  • 8/6/2019 Beneath the Surface IOM

    29/96

    27

    Beneaththesurface.Methodologic

    alissuesinresearchanddata

    colleconwithassistedtrac

    kingvicms

    Data from assisted vicms methodological strengths and limitaons

    Data collected directly from tracked persons is an important source of

    informaon and has proven central in eorts to understand and combat human

    tracking. As one CT professional remarked, there is a need to bridge the gap

    between research and data collecon and operaonal work:

    Research and data are paramount for our work and I really do not

    understand why people and managers that are out in the country and in

    the eld do not understand this because it is really mandatory. Without

    data especially on counter tracking () theres nothing you can do.22

    Research and data collecon conducted within the assistance framework, such

    as the IOM approach, can shed light on a range of issues including risks and

    vulnerability factors, the needs of dierent groups of tracking vicms (e.g. men,

    women, children, vicm of labour and sex tracking); the gender dimensions oftracking; details of the tracking process and, albeit it to a lesser extent, the

    perpetrators involved, their modus operandi, the routes used and so on.23

    Moreover, as will be discussed in more detail in secon 5 (Who is collecng

    data? The role of researchers and service providers), this approach (which

    involves data collecon by service providers) potenally migates some of the

    ethical concerns associated with research with tracked persons, like extensive

    interviewing (and re-interviewing), insensivity in the interview process, the risk

    of oung respondents through research and so on. The relaonship betweenservice providers and respondents may also translate into more comprehensive,

    detailed informaon; data can also potenally be collected over me allowing

    for a fuller picture of the individuals experience and needs than a one o

    interview may allow.

    The sheer volume of data which can be collected in this way potenally allows

    for a broader picture of tracking than smaller studies may permit. Research

    and data collecon with assisted tracking vicms also allows counter-

    tracking professionals to idenfy emerging trends and paerns in real me like new forms of tracking, new routes, emerging means of control, dierent

    desnaons, new proles of vicms. This means that data is current and is able

    to inform policy and programmac response.

    However, as with all methods, research and data collecon with assisted vicms

    is not without its problems. And, in going forward, it is important to take into

    account and accommodate methodological issues, not least because these

    22 Interviews with respondents were recorded, with the consent of the respondent, and then transcribed. The

    quotes included in this paper are verbam and have not been edited.23 For a discussion of the methodological limitaons of collecng data about perpetrators from assisted vic-

    ms, see for example, Antonopoulos & Winterdyk 2005; Cwikel & Hoban 2005; Goodey 2008; IOM et al.

    2009; Kelley 2002; Lazos 2007; Levenkron 2007; Surtees forthcoming 2011, 2009 & 2008b; Troshynski &

    Blank 2008.

  • 8/6/2019 Beneath the Surface IOM

    30/96

    28

    Beneathth

    esurface.Methodologicalissuesinresearchanddatacolleconwithassistedtrackingvicms

    impact an understanding of tracking and, by implicaon, the ability to prevent

    and combat it. This paper lays bare some of the strengths and also the constraints

    in working with this approach (both within the IOM tracking database and

    through other assistance frameworks). The discussion centres around four main

    themes including:

    A global approach? Data quality and comparability across dierent terrains Who is collecng data? The role of researchers and service providers

    Being representave? Challenges in obtaining representave samples of

    tracking vicms

    What quesons are asked and why? Assumpons, biases and agendas in

    tracking research and data collecon

    While the focus of this paper is explicitly about the IOM tracking database, it

    is of relevance and importance for all service providers who undertake research

    and data collecon in a similar way. In addion, many of the methodologicaland ethical issues raised will resonate with researchers more broadly who, while

    perhaps not using this specic approach, may also access tracked persons

    within the assistance framework, and, regardless, must consider and address

    issues such as data quality and comparability, boundaries between service

    provision and research, representavity and assumpons, biases and agendas in

    research quesons. Finally, and as importantly, the issues raised and discussed

    here are crical for those who rely on data and research to support programme

    and policy decisions to combang human tracking. Providing guidance about

    what tracking data does (and does not) reveal can go a long way toward abeer understanding of the issue and the policies and programmes which can

    serve to prevent and address it. It is these issues that are discussed in the next

    secons.

  • 8/6/2019 Beneath the Surface IOM

    31/96

  • 8/6/2019 Beneath the Surface IOM

    32/96

  • 8/6/2019 Beneath the Surface IOM

    33/96

    31

    Beneaththesurface.Methodologic

    alissuesinresearchanddata

    colleconwithassistedtrac

    kingvicms

    has been used over a predened, coded eld and, further, if this is an issue of

    training or local adaptaon that is, who is perceived to be an acquaintance in

    dierent sengs. Language may also be an issue with open elds, where terms

    are listed in the local language or loosely translated rather than according to set

    terminology. This is parcularly the case in mulnaonal or mullingual data

    collecon aempts, which are oen required in the case of human tracking

    due to the transnaonal nature of the phenomenon.25

    The above strengths notwithstanding, there are issues with the feasibility (and

    desirability) of a standardised approach. Some issues relate to the data collecon

    process, while others are a funcon of the rigidity of the model.

    While the IOM approach collects standardised data, the data collecon process

    is not done in an enrely standardised way. In pracce, many interviewers

    use an open ended, unstructured interview technique (oen done by service

    providers in the context of case management) and then ll in the interview formbased on memory or the notes they have taken (if the interviewee consented

    to note taking). Other interviewers use a more structured format, working

    directly with the IOM interview forms, asking each queson on the form in

    sequence, using the standardised terminology. Just as dierent methods may

    yield dierent response rates (Dillman et al. 2009; Reddy et al. 2006; Schwartz

    2000; Yu & Cooper 1983; Weiner & Hala 2008), dierences in implementaon of

    one method may yield dierent response rates.26

    Moreover, when data is collected by a partnering organisaon (whether NGO,GO agency or other), IOM has even less control over and informaon about

    the extent to which data collecon is standardised with data collected by IOM

    missions or, for that maer, from case to case within the partner organisaon.

    Given that in many countries IOM works with more than one partner organisaon

    (and with varying sta within these organisaons), it is reasonable to conclude

    that there are threats to standardisaon which result from data collected by

    dierent partners even in one seng. Such a consideraon will equally need

    to be taken into account by other actors aempng to collate, compare and

    analysis data collected from a variety of sources.

    25 The issue of language is discussed in more detail towards the end of this secon.26 Research on sensive issues has increasingly considered what methods are likely to yield the most reliable

    results. Some recent studies have found that data gathering procedures which avoid social contact (e.g. self

    administered quesonnaire, whether wrien or computer based) may be preferred by some respondents

    and result in greater disclosure (OLeary 2006; Reddy et al. 2006; Weiner & Hala 2008: 24). However, the

    nature of this type of data collecon linked as it is with case management does not necessarily lend itself

    to this approach. Rather, service providers work and talk on a day to day basis with beneciaries and, thus,

    the interview process is essenally part of this regular way of working and interacng. It is also how case

    relevant informaon is collected and counseling provided. Moreover, research has found that the interviewmethod may allow for greater comprehension of quesons and builds rapport between interviewer and

    respondent in ways that lead to greater disclosure (Schwartz 2000: 815; Weiner & Hala 2008: 24).

  • 8/6/2019 Beneath the Surface IOM

    34/96

    32

    Beneathth

    esurface.Methodologicalissuesinresearchanddatacolleconwithassistedtrackingvicms

    Equally relevant is that while standardisaon may be enhanced by the use

    of generic, standardised data entry templates, they oen lack exibility

    for instance, to accommodate new paerns and unancipated trends and

    behaviours. The oen nuanced and complex nature of tracking is dicult to

    capture through predened elds, which means that data collectors may nd

    themselves trying to choose the best (predened) answer from a menu of oen

    less than adequate responses, as dierent respondents both within and outsideof IOM observed:

    [Generic tools] may not be designed to capture the subtle nuances

    unique to the cases. Recordings of these nuances give us a more

    accurate picture of evolving and changing indicators and local trends.

    You cant take that kind of very complex set of circumstances [as seen

    in tracking] and convert it into a more specic and simpler set of

    quesons that you then ask and repeat and carefully make sure thatyoure asking in very much the same way of everybody, rather than a

    kind of opened ended conversaon.

    A lot of data comes from drop down boxes so the variables are

    predened and the predened variables dont always cover the actual

    scenario the predened naming is one of the problems. [in] a lot of

    [places] where the variables are dened, it might be beer just to leave

    [the eld] open because then you might get a beer picture in terms of

    research.

    Moreover, working with predened categories may sll leave room for dierent

    interpretaons where insucient direcon and training is provided to those

    working with the research tools (Sgter 2006). One simple example relates to the

    use of the answer opon partner when asked about the vicms relaonship to

    people in the recruitment process. There has been confusion as to whether the

    word partner denotes a purely professional relaonship (i.e. business partner)

    or a purely personal relaonship (i.e. inmate other). As this answer opon is

    used in relaon to quesons about dierent people involved in recruitment, itis important to have clear denions otherwise the validity of the coded answer

    response may be called into queson.

    The quesons asked, the variables used

    What quesons are asked and how are vital in terms of the validity and reliability

    of the responses received. Poorly designed quesons for example, those which

    are poorly worded or use jargon, have ambiguous meaning, are insensive or

    uncomfortable for respondents can lead to unreliable or invalid ndings in that

    respondents may misinterpret or misunderstand the quesons or be unwilling

    to answer in a truthful manner (Di Lillo et al 2006: 419-423; Hamby et al 2006:

    515-516; Mitchels 2004: 37-38; Golafshani 2003: 604). As one researcher

  • 8/6/2019 Beneath the Surface IOM

    35/96

    33

    Beneaththesurface.Methodologic

    alissuesinresearchanddata

    colleconwithassistedtrac

    kingvicms

    interviewed in the context of this paper stressed, there needs to be a process

    and criteria to ensure that the queson will be understood in all places where

    it is used, that people will have the same probability of answering truthfully to

    these quesons.

    One example is the use of the term tracking, a term which may be unfamiliar

    to respondents, understood dierently by dierent respondents or one whichtracked persons do not associate with their experience. The use of the

    tracking term, then, will (dierenally) impact how quesons are understood

    and answered. A respondent who answers no to a quesons about whether

    they have been tracked may sll have been tracked but may be unfamiliar or

    uncomfortable with the term, may see him or herself as failed a migrant rather

    than tracking vicms, etc. If the same respondent was instead asked a series

    of quesons relang to deceiul recruitment pracces and exploitaon, which

    cumulavely constute a tracking experience, the overall assessment may be

    yes. Clarity of meaning for all terms and concepts discussed with respondentsis, therefore, essenal.

    Moreover, it has been noted that labelling for example, using problemac

    or sensive labels such as rape or prostuon or tracking or illegal migraon

    may undermine disclosure of vicmisaon. Labelling may be parcularly an issue

    amongst some sub-populaons for example, certain culture groups, sexes, age

    groups, naonalies, ethnicies, etc. (Weiner & Hala 2008: 21). For instance,

    one of the authors has, in past research, explored how the term vicm and/or

    tracking vicm can be unpalatable to some vicms, leading some to declinebeing idened and assisted (Brunovskis & Surtees 2007; Surtees 2008a&b).

    This highlights the importance of how quesons are framed and issues queried

    and how even standard quesons may yield dierent response rates given the

    individual or social dynamics which inevitably come into play in such research. It

    also signals the need for reliance on behaviourally specic quesons to minimise

    labelling and capture issues of and associated with vicmisaon (Weiner & Hala

    2008: 21).

    Lack of consensus around key quesons and issues have the potenal to seriouslycompromise data standardisaon, thus negavely impacng comparability

    and validity. Even subtle or seemingly insignicant changes to wording and/

    or response categories can aect the level of self reporng and, thus, data

    quality. A 2006 internal evaluaon of the IOM tracking database found that

    data validity could be augmented by improving some of the quesons and by

    adding addional quesons to obtain a more comprehensive understanding of

    the tracking process (Sgter 2006: 13, 25).

    Consider again quesons about the roles of persons involved in tracking.

    Earlier versions of the database were based on the assumpon that the tracker

    was synonymous with the recruiter. When the vicm relayed informaon in

    relaon to the tracker, it was encoded into the system as being related to the

  • 8/6/2019 Beneath the Surface IOM

    36/96

    34

    Beneathth

    esurface.Methodologicalissuesinresearchanddatacolleconwithassistedtrackingvicms

    recruiter only. This led to informaon on transporters, harbourers, exploiters

    and other actors being collapsed into one category that of recruiter. This

    potenally caused an informaon gap about these specic categories and, at the

    same me, distorted an understanding of who are (and are not) trackers and,

    equally, how they do (and do not) operate. Later versions of the database have

    included addional quesons which dierenate between the oen diering

    roles played by dierent actors throughout the tracking process. Wherethere is relevant data, this allows for cross-variable analysis such as the cross-

    tabulang the gender of the vicm against the gender of the actor involved and

    the associated role (s/he, they) played.

    Certainly some informaon is more easily understood in a range of dierent

    sengs for example, more objecve categories like age and marital status.

    However, even what might appear to be quite universal and objecve categories

    like educaon levels require careful consideraon and denion when

    working with vicms, interviewers or case managers who originate fromdierent countries (and thus dierent educaon systems) and who may have

    a dierent understanding of what constutes primary, secondary and terary

    educaon. As one researcher observed, many seemingly direct categories are,

    in fact, quite complicated and diverse when considering all of the various global

    constellaons and opons which might arise and, thus, need to be captured in

    a global database:

    Things like the structure of the family, you need to allow for some quite

    strange structures if you are dealing with cultures all over the world.

    Similarly, somemes responses will mean dierent things for dierent people

    and in dierent contexts. For example, one queson in the database asks how

    vicms were referred for assistance, one response for which is self-referred.

    In some situaons, this self-referral was quite straighorward i.e. the vicm

    escaped tracking and sought the assistance of IOM. However, for others,

    self referral is a more complex chain of events, somemes involving a range of

    triggers like seeing an adversement, being told about it by a friend, seeking out

    assistance only following ones return home, self-referring only in a situaon ofcrisis, etc. For example, amongst Ukrainian men tracked for labour we found

    a specic paern of self-referral, whereby they mainly self-referred aer

    receiving a recommendaon from a friend who trusted the NGO or IOM and

    had visited and received assistance. And usually this self-referral took place only

    aer some me, when they had exhausted all other opons for support.

    Other data are even more problemac in terms of ensuring standardisaon.

    Oen mes an assessment of the vicms economic situaon is based on their

    individual assessment (e.g. very poor, poor, average and well o) rather than

    an objecve measurement (for example, actual income, income relave to

    minimum wage, etc.). This is equally the case with issues such as past experience

    of abuse and violence. Percepons of violence and abuse are very individual

  • 8/6/2019 Beneath the Surface IOM

    37/96

  • 8/6/2019 Beneath the Surface IOM

    38/96

    36

    Beneathth

    esurface.Methodologicalissuesinresearchanddatacolleconwithassistedtrackingvicms

    In this vein, IOM has recently worked with eld missions to standardise interview

    forms across language. The latest versions were launched in 2008 and have since

    been professionally translated from English into French and Spanish. A number

    of IOM eld missions have similarly translated and adapted the forms into a

    variety of other languages (such as Arabic, Japanese, Kurdish, Portuguese and

    Russian) and also dialects to meet their local and cultural needs; while other IOM

    missions work mainly with the English versions of the forms, hiring interpretersfor the interview process, when necessary.

    However, having forms in a local language only partly addresses language barriers.

    Because of the transnaonal nature of both tracking and an-tracking eorts,

    data collecon is oen done through translaon or interpretaon at least once

    and perhaps at mulple stages (e.g. at origin, transit or desnaon) or in

    dierent ways (e.g. a translator is involved in the interview process, translaon of

    the interview informaon for entry into the database). A typical scenario might

    be a situaon in which a Russian language speaker from the former Soviet Union(FSU) is tracked into prostuon in South-East Asia (SEA). At idencaon

    the interview will be conducted by a local NGO or IOM mission sta, which

    most oen means interviewing in the local language of the desnaon country

    through interpretaon. Data will inially be recorded in the case le in the

    local language but then translated into English when the informaon is entered

    into the database, which is an English language tool.27 Should the vicm then

    be returned home, later informaon gathering will be conducted in their own

    language but then translated back into English for the purpose of data entry.

    The English language skills of the data entry sta at origin and desnaon may vary quite considerably. The data will then be processed and analysed

    by someone who, at minimum, can work with English language data sets but

    for whom it may not be a rst language and who may not have knowledge of

    the language (or culture) of the respondents. Beyond navigang the dierent

    languages is that sta is likely to have diering levels of uency and literacy in

    the various languages (as well as in English, their common language), which can

    impact the quality of the informaon collected.

    Not only is the process of working through many languages cumbersome butthere is further the queson of what gets lost in translaon. One researcher

    stressed how generaons of translaon compromise data sets, drawing on her

    own recent experience with a mullingual process:

    The interviews were conducted in the language of the individual. It was

    something that I really did insist on. But, of course, then it was translated

    into [the naonal language]. I dont speak [the naonal language].... The

    27 The ocial languages of IOM are English, French, and Spanish. Up unl 2008, the database was available inall three of these languages. As the tool was updated, funding constraints only allowed for re-development

    of the English version of the tool. While the accompanying screening and assistance interview forms are sll

    available in French and Spanish (along with other language), the actual database interface is in English only.

    IOM intends to address this issue in 2011-2012.

  • 8/6/2019 Beneath the Surface IOM

    39/96

  • 8/6/2019 Beneath the Surface IOM

    40/96

  • 8/6/2019 Beneath the Surface IOM

    41/96

    39

    Beneaththesurface.Methodologic

    alissuesinresearchanddata

    colleconwithassistedtrac

    kingvicms

    However, a major limitaon remains the fact that such training materials and

    guidance notes are only available in English as are many training events and

    the technical support system. Further, not all missions have had equal access to

    these training opportunies nor are they systemacally implemented. Thus, it is

    likely that some IOM oces in certain regions may be less informed and skilled

    when using the research tools and entering data into the database itself. Thelack of training opportunies also reduces the number of occasions to receive

    interacve and detailed user feedback and, thus, to enhance and improve the

    research tools and database itself. Also important is that these improvements

    are not able to address issues in the data sets which preceded greater aenon

    to training, which is something to be acknowledged in data analysis.

    Other factors beyond an interviewers skills and experience can play a role in the

    research dynamic. Characteriscs including, but not limited to gender, age, class,

    social status, economic background, educaon and ethnicity may play a role inthe interview process including what quesons are answered and consequently

    how data is collected. Sex, for example, may aect disclosure of vicmisaon

    (Schwartz 2000: 825-26), oen making women prefer female interviewers

    parcularly when they have been vicmised by men (WHO 2003: 14). It may also

    be a funcon of cultural and social mores. This was illustrated in the responses

    of two former tracking vicms (women in their 20s from Albania) when asked

    whether they would feel comfortable in being interviewed by a male researcher

    or by a researcher with a male translator. Both were vicms of sex tracking and

    stated a clear preference for women to be involved:

    If there is a female, I would speak really freely because I would think I

    am speaking to my mom or my sister. But if there was a man I wouldnt

    have come at all.

    Its a bit uncomfortable if there is a man, because if there is a woman I

    feel more free.

    By contrast, tracked men interviewed in Ukraine were also asked if they hadany concerns about the sex of the interviewer and more specically about being

    interviewed by women. Their responses were more ambivalent, as the quotes

    from two tracked men below illustrate:

    Q. Would it have been dierent with males, having a male or female

    interpreter?

    A. [.] really doesnt maer speaking with men or women it doesnt

    maer much.

    It doesnt maer much to me but, of course, it is more pleasant to

    speak with women. A male translator is probably beer because he

    understands men [.] a man can understand what I mean for certain

    things.

  • 8/6/2019 Beneath the Surface IOM

    42/96

  • 8/6/2019 Beneath the Surface IOM

    43/96

  • 8/6/2019 Beneath the Surface IOM

    44/96

    42

    Beneathth

    esurface.Methodologicalissuesinresearchanddatacolleconwithassistedtrackingvicms

    Some missing data may be more a funcon of instuonal arrangements.

    There may be reluctance - or an inability from partnering organisaons

    to share certain types of informaon for example, because of concerns with

    condenality, legal issues associated with data protecon, lack of safe data

    sharing channels, issues of ownership of the data or because of a more

    limited role played by IOM in providing assistance. In many sengs, IOM no

    longer directly implements assistance programmes and, thus, much current datacollecon relies on agreements and cooperaon between partner organisaons

    and IOM.

    In some instances, it may be me and resource constraints which limit the

    amount of data collected. Service providers oen dont have me to collect

    and/or enter a lot of detail about each beneciary. Where data collecon is too

    ambious (e.g. too many data elds or quesons), there is likely to be a high

    degree of missing data, as one NGO worker noted of the IOM interview forms:

    The whole process of collecng this level of detail has problems. It takes

    a long me to ask the quesons and then ll in the informaon. And it

    is stressful in many cases to be asked such specic quesons, especially

    about the tracking experience.

    Missing data might also be a consequence of the methodological approach taken.

    Consider, for example, interviews conducted with males in the FSU. A desk-top

    analysis of relevant (and de-personalized) IOM database data in advance of in-

    country eldwork revealed that many males were noted as having self-referredto IOM or partnering NGOs. However, aer employing a mixed method approach

    which involved interviewing males, we leant that many men had in fact only

    self-referred aer receiving a recommendaon from a friend or colleague who

    trusted the NGO or IOM. In this example, the data received in a eld research

    seng added to and enhanced the ndings from the IOM database.32

    Thus, while there is a need to ensure suciently complete data for standardisaon

    and comparability, data collecon iniaves also need to balance what needs

    to be known against the degree of informaon that can be realiscally (andethically) collected.

    Comparability across contexts

    An addional queson is to what extent tracking data is comparable across

    dierent naonal and cultural boundaries. Quesons and concepts (and, by

    implicaon, interview responses) may not be understood in the same way

    between countries, cultures, dierent sta, interviewers and interpreters and/

    or at dierent points in me (e.g. Van Liempt & Bilger 2009:3; Surtees 2007c;

    Bre-Davies 2007: 82; Mitchels 2004:37-38).

    32 The ability to draw upon the IOM assistance data in advance of the eldwork did however help to provide a

    stronger baseline understanding and entry point for analysis, helping to rene the research focus.

  • 8/6/2019 Beneath the Surface IOM

    45/96

  • 8/6/2019 Beneath the Surface IOM

    46/96

  • 8/6/2019 Beneath the Surface IOM

    47/96

  • 8/6/2019 Beneath the Surface IOM

    48/96

    46

    Beneathth

    esurface.Methodologicalissuesinresearchanddatacolleconwithassistedtrackingvicms

    other seng because these are not the experiences that are useful to

    statutory services in terms of prosecuon; because of shame/sgma

    around sexual violence; and because for women who have been tricked,

    deceived and abused, it is oen dicult to trust anyone. We believe that

    the women we support tell their support workers of these experiences

    precisely because they are in a place of safety where they are believed

    (POPPY Project 2004: 1).

    There is also an element of protecon and condenality when data is collected

    within the assistance framework because some forms of respondent recruitment

    for example, community sampling may serve to idenfy tracked persons

    to their families and communies. While oung tracking vicms to the

    community may dier in signicance and fallout for example, relave to

    the form of tracking or cultural context in many cases, it has a very real

    and serious implicaons, including social ostracism, rejecon by ones family,

    discriminaon, reduced economic opons, limited access to social services,threats and retribuon from tracking and even physical and sexual violence by

    family or community (Brunovskis & Surtees 2010). This approach also potenally

    provides a layer of protecon in that, should any assistance needs surface during

    or following the interview, service providers are aware of and able to respond

    accordingly (Brunovskis & Surtees 2010, 2007; Surtees 2007b).

    Data collected by service providers is also praccal in that it potenally provides

    a great deal of informaon about a large number of tracking cases in an

    economical fashion, tapping into an organisaons exisng data colleconprocess. And it is dynamic. When vicms are assisted over a period of me,

    data can be updated, expanded and even corrected as a fuller picture of the

    individuals experience and needs emerge, as is oen the case with IOM data.

    When contact with vicms is ongoing, even beyond the formal assistance and

    reintegraon process, this may provide access also to longitudinal data, rather

    than a snap shot approach (for example, single interviews or surveys at a set

    point in me), which is common in tracking research.34 And because vicm

    assistance organisaons are on the frontline of the issue, this can mean being

    able to idenfy trends in real me like new forms of tracking, new ro