integrating across data sets at the point of analysis jo moran-ellis, victoria d. alexander, ann...

Integrating across data sets Integrating across data sets at the point of analysisat the point of analysis

Jo Moran-Ellis, Victoria D. Alexander, Ann Cronin, Jane Jo Moran-Ellis, Victoria D. Alexander, Ann Cronin, Jane Fielding (University of Surrey) and Hilary Thomas Fielding (University of Surrey) and Hilary Thomas (University of Hertfordshire)(University of Hertfordshire)

Paper presented to Paper presented to Combining Social Research Methods, Data and Analysis Combining Social Research Methods, Data and Analysis

Qualiti Workshop (Cardiff University) Qualiti Workshop (Cardiff University) at the University of Surreyat the University of Surrey

2222ndnd February 2006 February 2006

©J. Moran-Ellis; V.D. Alexander; A. Cronin; J. Fielding; H. Tho©J. Moran-Ellis; V.D. Alexander; A. Cronin; J. Fielding; H. Thomas. Feb. 2006mas. Feb. 2006

22

OverviewOverview

Thinking Thinking about integrationabout integration points of integration points of integration analytic integration analytic integration

example: following the threadexample: following the thread implicationsimplications


33

Thinking about integration Thinking about integration

Separating out…Separating out… Combination Combination

IntegrationIntegration

TriangulationTriangulation


44

Combining Combining Integrating Integrating

Combine methods (a continuum…)Combine methods (a continuum…)one subsumed to the other concerning the one subsumed to the other concerning the substantive questionsubstantive question‘‘flesh on the bones’ flesh on the bones’ (eg Green 2003)(eg Green 2003)

informing design informing design (Gobo 2001)(Gobo 2001)

IntegrateIntegrate

IntegrationIntegrationContribution of equal value to the Contribution of equal value to the substantive question substantive question (Moran-Ellis et al 2006)(Moran-Ellis et al 2006)

Not necessarily triangulationNot necessarily triangulation

?


55

Triangulation: Triangulation: An An epistemologicalepistemological claim claim about what one knows as the outcome of using mixed about what one knows as the outcome of using mixed

methodsmethods Accurate measurementAccurate measurement ComplementarityComplementarity Complexity/Knowing moreComplexity/Knowing more

Integration without triangulationIntegration without triangulation

Triangulation without integration?Triangulation without integration? Translation?Translation? (eg (eg Gray & Densten 1998)Gray & Densten 1998)


66

Integration:Integration:aa process process

which brings different methods, data (sets), which brings different methods, data (sets), analyses, or interpretations into a relationship analyses, or interpretations into a relationship with each other where… with each other where…

they are combined in such a way that they they are combined in such a way that they form a whole form a whole

and and they are interdependent but retain their they are interdependent but retain their paradigmatic nature (ie they are not translated paradigmatic nature (ie they are not translated one into the other) one into the other)

andand they make a contribution of equal value they make a contribution of equal value


77

Integration as processIntegration as process

As a process integration then requiresAs a process integration then requires

a means, i.e. a set of decisions & actions, a means, i.e. a set of decisions & actions,

by which a tangible relationship can be created by which a tangible relationship can be created between methods, data between methods, data

and/or perspectivesand/or perspectives


88

integrationintegration

MetaphorMetaphor integrated transport system in Amsterdamintegrated transport system in Amsterdam


99

Potential integration point(s) in the Potential integration point(s) in the

research process?research process?

from the start from the start (eg Coxon 2005)(eg Coxon 2005)

data generation/fieldwork data generation/fieldwork (eg Deren et al 2003)(eg Deren et al 2003)

data analysisdata analysis

interpretationinterpretation

presentation presentation (eg Moran & Butler 2001)(eg Moran & Butler 2001)


1010

In terms of integration also In terms of integration also think about think about

Opportunities offered for integration by the Opportunities offered for integration by the research design research design

Design of multiple methods research Design of multiple methods research requires consideration of many requires consideration of many elements… elements…

(see also Greene, Caracelli & Graham, 1989).(see also Greene, Caracelli & Graham, 1989).


1111

Phen

omen

a

Methods

Status

Inter-dependence

Seq

uenc

ing

Paradigms

Different

Unequal

Diff

eren

t

Different

Seq

uent

ial

Independent

Same

Similar Same

Interactive Sim

ulta

neou

sE

qual


1212

Potential integration point(s) in the Potential integration point(s) in the

research process?research process?

from the startfrom the start

data generation/fieldworkdata generation/fieldwork

data analysisdata analysis

interpretationinterpretation

presentationpresentation


1313

integration deferred until analysis:integration deferred until analysis:

data generated in two waves (parallel or data generated in two waves (parallel or sequential) for whatever reason sequential) for whatever reason (eg draws on two data sources; methodological reasons)(eg draws on two data sources; methodological reasons)

specification (and timing of specification) of specification (and timing of specification) of research question ‘differs’ at the level of the research question ‘differs’ at the level of the different methods different methods

data generated differ in ‘type’ data generated differ in ‘type’ eg text and visualeg text and visual

research instruments differ in contentresearch instruments differ in content

multiple sub-sets of data where (possibly) multiple sub-sets of data where (possibly) different strong findings (might) emergedifferent strong findings (might) emerge


1414

After generating separate After generating separate data - integrated data - integrated analyses 1analyses 1

Kelle (2001)Kelle (2001)

Two separate sets of data: quantitative and qualitativeTwo separate sets of data: quantitative and qualitative Divergences and tensions in findings from each Divergences and tensions in findings from each Uses these analytically to develop richer explanatory Uses these analytically to develop richer explanatory

accountsaccounts Theoretical warrant: macro, micro and meso Theoretical warrant: macro, micro and meso

dimensions to the phenomenondimensions to the phenomenon


1515

Bringing together separate data Bringing together separate data sets - integrated sets - integrated analyses 2analyses 2

Following a thread – Following a thread –

A potential framework to guide analytic A potential framework to guide analytic integration alongside the research questionintegration alongside the research question


1616

PPIMs - following a thread…PPIMs - following a thread…

Pick up on an emergent finding in one Pick up on an emergent finding in one data set which has resonances in others data set which has resonances in others

Explore that Explore that thematic threadthematic thread in the other in the other data sets.data sets.

Creates Creates a data repertoirea data repertoire which can then which can then be analysed further to generate an be analysed further to generate an integrated account concerning that theme.integrated account concerning that theme.

Link back to the wider research question Link back to the wider research question


1717

the PPIMs studythe PPIMs study

Research question: how is vulnerability experienced and Research question: how is vulnerability experienced and managed in everyday life?managed in everyday life?

Qualitative interview data setsQualitative interview data sets Homeless participantsHomeless participants People living on their ownPeople living on their own Children & householdsChildren & households

Qualitative visual data – Qualitative visual data –

Photographs and interviews; video journeysPhotographs and interviews; video journeys

Quantitative data – secondary sourcesQuantitative data – secondary sources


1818

Initially each data set is analysed in its own terms Initially each data set is analysed in its own terms to give due to what it contributes epistemologically to give due to what it contributes epistemologically to understanding the phenomenon of everyday to understanding the phenomenon of everyday vulnerabilities and how they are strategically vulnerabilities and how they are strategically managedmanaged

Where a promising ‘thread’ is seen this is ‘picked Where a promising ‘thread’ is seen this is ‘picked up’ and followed through into the other data sets up’ and followed through into the other data sets via positioning the emergent thread as an analytic via positioning the emergent thread as an analytic enquiry – is this in the other data sets, if it is what enquiry – is this in the other data sets, if it is what does it look like? does it look like?

What is ‘promising’ ?What is ‘promising’ ?


1919

gather the threads together – juxtapose relevant gather the threads together – juxtapose relevant data, codings and categorisations with each data, codings and categorisations with each other other

Creates a data repertoireCreates a data repertoire A collection of emergent findings concerning a A collection of emergent findings concerning a

particular theme from each of the different particular theme from each of the different methods/methodologies usedmethods/methodologies used


2020

Analysing the repertoireAnalysing the repertoire

Synthesise the emergent findings to build Synthesise the emergent findings to build up a ‘bigger’ pictureup a ‘bigger’ picture Could be multi-faceted, complex, or singularCould be multi-faceted, complex, or singular


2121

Example: Picking up a thread…Example: Picking up a thread…homes and houseshomes and houses

analytically became interested in articulations of analytically became interested in articulations of vulnerability, homes, and houses in the interview vulnerability, homes, and houses in the interview data generated with homeless participants…data generated with homeless participants…


2222

““I left home when I was 15 and a half and I just couldn’t I left home when I was 15 and a half and I just couldn’t take the abuse there no more … I left there and other take the abuse there no more … I left there and other friends were like, ‘can [Jane] stay over tonight?’ and made friends were like, ‘can [Jane] stay over tonight?’ and made out that it was just staying over for a night as kids do…”out that it was just staying over for a night as kids do…”

““Curfew time [in the hostel] is like 11 o'clock but if we’re Curfew time [in the hostel] is like 11 o'clock but if we’re living here and it’s like home we should be allowed to come living here and it’s like home we should be allowed to come in like whenever we want really.”in like whenever we want really.”

““Just a little home and a bit of help and support so that I Just a little home and a bit of help and support so that I can get used to being on my own and coping without the can get used to being on my own and coping without the drink and drugs. Somewhere to live and somewhere drink and drugs. Somewhere to live and somewhere secure… somewhere that is not a high-risk area where secure… somewhere that is not a high-risk area where there are lots of users and […]. That is all really, just a little there are lots of users and […]. That is all really, just a little place on my own eventually that I can call home.” place on my own eventually that I can call home.”


2323

Key emergent findingsKey emergent findings

Articulations of ‘homes and houses’ with: Articulations of ‘homes and houses’ with: Lived experiences of vulnerabilityLived experiences of vulnerability

abuse; drink/drugs; conflict; violence; locationabuse; drink/drugs; conflict; violence; location

Personal strategies of managementPersonal strategies of managementmoving out; staying putmoving out; staying put

Symbolism of home/housesSymbolism of home/houses Safe; place of your own; place where your stuff is Safe; place of your own; place where your stuff is


2424

Homes and houses in the Homes and houses in the other interview dataother interview data

NeighboursNeighbours

Financial vulnerabilityFinancial vulnerability

A base related to A base related to dependence dependence and and independenceindependence

Charting the lifecourse; history and Charting the lifecourse; history and biographybiography

Community and connection Community and connection


2525

Picking up the thread in Picking up the thread in the visual datathe visual data

How were ‘homes and houses’ presented How were ‘homes and houses’ presented visually and positioned verbally?visually and positioned verbally?

To what extent was this theme of To what extent was this theme of home/house and vulnerability a feature of home/house and vulnerability a feature of the visual data?the visual data?


2626

Resonance in the visual data: aestheticsResonance in the visual data: aestheticsResonance in the visual data: aestheticsResonance in the visual data: aesthetics


2727

Resonance in the visual data: Resonance in the visual data: affectaffect


2828

Analytic integration…Analytic integration…

Producing a synthesised accountProducing a synthesised account


2929

CONCEPTUAL ADVANTAGESCONCEPTUAL ADVANTAGES

Preserves epistemological insightsPreserves epistemological insights

Allows exploration of how concept Allows exploration of how concept ‘changes’ ‘changes’

Explore degrees of Explore degrees of homogeneity/heterogeneityhomogeneity/heterogeneity


3030

PRAGMATIC ADVANTAGESPRAGMATIC ADVANTAGES

Data managementData management

Refocus of research question(s)Refocus of research question(s)


3131

Some points to consider…Some points to consider…

Decision to use multiple methods and to integrate them Decision to use multiple methods and to integrate them should be theory driven should be theory driven

Integration can take place at a number of points in the Integration can take place at a number of points in the research processresearch process

Integration may not always be possible (or desirable)Integration may not always be possible (or desirable)

Paradigm issues may emerge around certain Paradigm issues may emerge around certain combinations of methods combinations of methods

Tensions need to be identified and resolved for Tensions need to be identified and resolved for integration to be achievedintegration to be achieved

Integration does not intrinsically imply what sort of claims Integration does not intrinsically imply what sort of claims can be made for the findingscan be made for the findings

EndEnd


3232

“ “we have got quite a lot of friends there, and actually they come we have got quite a lot of friends there, and actually they come every day but they don’t live there that is their granddad and every day but they don’t live there that is their granddad and grandmother’s house and they quite a lot of the times visit there and grandmother’s house and they quite a lot of the times visit there and we have got a broken fence so we go around each other’s gardens we have got a broken fence so we go around each other’s gardens and play ”and play ”

Sometimes I cycle to the park that is just at the back of our house. Sometimes I cycle to the park that is just at the back of our house. Sometimes I just go in the front garden and ride my bike but not Sometimes I just go in the front garden and ride my bike but not very often. I do it in the garden too. very often. I do it in the garden too.

““as soon as I wake up I … go round [girlfriend’s] house. Stay round as soon as I wake up I … go round [girlfriend’s] house. Stay round her house for a bit, chill out with her. Then, if she’s got work I take her house for a bit, chill out with her. Then, if she’s got work I take her to work and then from then I drop her off and then depending on her to work and then from then I drop her off and then depending on what time it is if it’s early in the morning I come back home or if it’s what time it is if it’s early in the morning I come back home or if it’s late like about three or four o’clock and like my friends have finished late like about three or four o’clock and like my friends have finished college or whatever I just meet up with a couple of friends and go college or whatever I just meet up with a couple of friends and go and sit around a mate’s house…. ”and sit around a mate’s house…. ”

returnreturn


3333

“…“…elsewhere it was all housing planning but here you’ve got a mix of a elsewhere it was all housing planning but here you’ve got a mix of a number if different types of people largely people with problems number if different types of people largely people with problems such as alcoholism or drug addiction…you almost have to learn to such as alcoholism or drug addiction…you almost have to learn to form your own support group around your own friends, there’s form your own support group around your own friends, there’s almost an element of propping each other up, because there’s so almost an element of propping each other up, because there’s so many different people with different problems if you mix at all here many different people with different problems if you mix at all here then most people you mix with are going to have some sort of then most people you mix with are going to have some sort of problem and, for instance the guy next door is and alcoholic and has problem and, for instance the guy next door is and alcoholic and has mental health problems in some shape or form, he did recently try to mental health problems in some shape or form, he did recently try to detox and we, my partner and I tried to help him through that… my detox and we, my partner and I tried to help him through that… my husband left me last year and I was really very depressed and down husband left me last year and I was really very depressed and down and [John] the guy I told you about with the alcohol problem, he and [John] the guy I told you about with the alcohol problem, he would come in, he was like a total ‘priest’, I don’t know you wouldn’t would come in, he was like a total ‘priest’, I don’t know you wouldn’t see him he'd dash down the shops and dash back again, head see him he'd dash down the shops and dash back again, head down but he’d make a point of coming in and checking on me and if down but he’d make a point of coming in and checking on me and if he couldn’t cope with the situation he’d ring someone up and say he couldn’t cope with the situation he’d ring someone up and say ‘come and help her’, equally we’ve tried to help him.”‘come and help her’, equally we’ve tried to help him.” returnreturn


3434

““I’ve lived here since I came back from the army, from I’ve lived here since I came back from the army, from India, after the war, my parents lived on [road in Hillside] India, after the war, my parents lived on [road in Hillside] and I lived with them until I decided to take the reckless and I lived with them until I decided to take the reckless step, or good step of getting married and they gave me step, or good step of getting married and they gave me the cottage and stable in [road in Hillside] in fact and we the cottage and stable in [road in Hillside] in fact and we converted that to a house. The first year the baby converted that to a house. The first year the baby arrived and we had to add a bedroom to that, then the arrived and we had to add a bedroom to that, then the second one arrived and we added another bedroom until second one arrived and we added another bedroom until the situation became ridiculous and we couldn’t add any the situation became ridiculous and we couldn’t add any more and so my parents were getting more incapable of more and so my parents were getting more incapable of managing and it was a very large house, they had two managing and it was a very large house, they had two live-in girls but they were both Italian, they were nice live-in girls but they were both Italian, they were nice girls but all they wanted was to marry me off but at that girls but all they wanted was to marry me off but at that stage I was married when they were here. Anyway stage I was married when they were here. Anyway that’s really by the by but I’ve lived here since 1945.”that’s really by the by but I’ve lived here since 1945.”

returnreturn


3535

““Well, sometimes you just need home [Greece] you Well, sometimes you just need home [Greece] you know…. ..I’ve been living in this country for 19 years know…. ..I’ve been living in this country for 19 years and…two years ago I came by chance to visit a friend of and…two years ago I came by chance to visit a friend of mine and then I applied to live here because there is a mine and then I applied to live here because there is a Greek community so lots of Greek people.”Greek community so lots of Greek people.”

““It’s good to come into our own community, it gives you a It’s good to come into our own community, it gives you a sense of belonging, you can relate better, the Mosque is sense of belonging, you can relate better, the Mosque is closer, it is time for the children’s religious bringing up as closer, it is time for the children’s religious bringing up as well….so there are lots of benefits.”well….so there are lots of benefits.”

returnreturn

integrating across data sets at the point of analysis jo moran-ellis, victoria d. alexander, ann...

Documents

triangulation integration

process integration

terms of integration

data sets

different methods data

potential integration

moran butler

separate sets of data