promap: developing a research tool for protest mapping · promap: developing a research tool for...

PROMAP: developing a research tool for protest mapping

TheoniStathopoulouResearchDirector

EKKE-Na7onalCentreforSocialResearch

CLARIN-PLUSworkshop,Leuven19-21Sep.2016

The Na<onal Centre for Social Research -EKKE in Clarin:el

• Prospec7vemember• Memorandumofcollabora7onbetweenEKKEandRCAthenaalreadysigned•  Sometechnicalissuess7llneedtobesolved(EKKEIdP)•  EKKEisplannedtojointheGreeknetworkduringthenextphase(Opera7onalPhase,2017-2019)


Use of Clarin:el services

1.PROMAP:ausecase2.Radicalism:verbalaggressivenessintwiWerdata• DuringthePROMAPprojectILSPserviceswerenotyetintegratedintheinfrastructure• Goal:toreplacethemanualworkflowusedun7lthenwithautomatedservices,regarding:•  Collec7onofnewspapermaterialtobeusedascorpus•  Processingoftextualmaterialtoiden7fyusefulexcerpts•  Analysisofexcerptstofeedthecodebookframes•  Sta7s7calprocessingofcodifiedmaterial•  Visualiza7onofresults


Radicalism

RadicalizedOrthodoxy?

Civicdiscontentandreligiousiden7fica7onin7mesofcrisis

TheoniStathopoulou(EKKE)&HarisPapageorgiou(AthenaRC)RC33Conference,Leicester11-16Sep.2016

• Muslims• Pakistani

VerbalAggressiveness

(TwiWer)

• Muslims• Pakistani

PhysicalAWacks

(NewsData)

RESEARCH QUESTIONS

• Whatarethecorrela7ons?

•  DoesVerbalAggressiveness

leadtoPhysicalViolence?

•  Arecallsforac7onturned

intoeventsofviolence?

PALOMARARCHITECTURE

Ra<onale of PROMAP

•  Eurozoneandglobaleconomiccrisis• Newwavesofmobiliza7onandprotest,newformsofcollec7veac7on• Newparadigms,repertoiresandactors•  Emerging“new”formsofprotestandgrassrootsmobiliza7ononeconomichardshiphaveincorporatedaWributesof“older”formsofprotest(mid1990s)

Aim and Key objec<ves

Recordandmap•  varyingformsofconten7onandmobiliza7oninpost-authoritarianGreece(1996-2014)•  protestevents/actors-par7cipants/repertoires/agendas•  theevolu7onandtransforma7onofconten7ousclaimsover7meDocument•  protestcyclesinGreece•  “thedynamicsofconten7on”(Kriesiet.al.1995;Grande&Kriesi2013)inGreece

RESEARCH FRAMEWORK

• Collec7veac7on•  Theroleofsocialmovementsforsocialtransforma7on• Researchagendaaeer2000:• migra7onandci7zenship(Koopmansetal.2005);•  theemergenceofaEuropeanpublicsphere(KoopmansandStatham2010;DellaPortaandCaiani2009);•  thepoli7csofunemployment(Giugni2009);•  thespreadofnewformsofpar7cipatorypoli7csanddemocracy(DellaPorta2007;2009);•  thepolicingofprotest(DellaPorta,Peterson,andReiter2006).

RESEARCH FRAMEWORK

•  Protesteventanalysis(Diani&Kousis2014)•  Claimsanalysis: Poli7calDiscourseApproaches inordertoextendthecontextof poli7cal claims making, and become more sensi7ve to discursive messages(Koopmans& Statham 1999) (Koopmans; Statham; Giugni; Passy 2005) (deWilde;Koopmans;Zürn2014)•  Researchagendasetbylargecompara7veEuropeanprojects

• Relevantresearchprojects

Title ResearchCentre

Timereference Topic Method Resources SamplingMethod

PRODAT WZB:BerlinSocialScienceCenter(Rucht)

46years(1950-1996)

Protesteventanalysisforthewhole7mespan

eventdataanalysis PRODAT1:Newspapers(1)PRODAT2:Newspapers(2)andPoliceRecords

MondayNewspaperEdi7on&alledi7onsofthe4thWeekperMonth

Europub WZB:BerlinSocialScienceCenter(Koopmans)

8years(1980,1985,1990,1995,1999-2002)

DegreeofEuropeanIntegra7onof7Countries(3)In6Ins7tu7onalSectors

poli7calclaimanalysis/Semi–structuredInterviews

NewspaperArchive,Internet

MERCI WZB:BerlinSocialScienceCenter(Koopmans)

7years(1992-1998)

Immigra7onAndethnicrela7onsin5EuropeanCi7es

poli7calclaimanalysis

1NewspaperperCountry(4)

EveryMonday,WednesdayandFriday



Responsivegov UniversityofLeicester(Morales)

30years(1980-2010)

18Governments’(1)responsivenesstodifferentformsofpublicopinionexpression.

Contentanalysis&protesteventanalysis/opinionpolls

Newspapers&newsagenciesarchive,exis7ngdatabasesofprotestevents(2)

GGCRISI FreieUniversitätBerlin&UniversityofCrete(Roose&Kousis)

4years(2009-2013)[researchinprogress]

AssigningresponsibilityforEurozoneCrisis,accordingtotherelatedpublicdebateinGreece&Germany

Poli7calClaimAnalysis,ProtestEvent&Interpreta7veFramingAnalysis(Conversa7onAnalysisofaccountability)(3)

5NewspapersperCountry&Reuters,Internet(Par7esandCivilSocietyPosi7ons)

1Dayperweek(rota7on)

POLPART S7ch7ngVu-Vumc(Klandermans)

5years(2014-2018)[researchinprogress]

DifferenttypesofPoli7calPar7cipa7on(na7onal&interna7onallevel)(4)

Movements&Par7esPublica7onsMeta-analysis,Interna7onalResearchArchivescomparison,focusgroup&Ques7onnaires(1000respondents)



LOCALMULTIDEM

UniversidaddeMurcia(Morales)

1year(2006) DegreeofIntegra7onofImmigrantsin6European

Ci7es

Poli7calClaimAnalysis

1NewspaperperCity(1)

EveryMonday,Wednesdayand

Friday

ESSi

TheNetherlandsIns7tuteforSocialResearch&City

UniversityLondon

1Month(Novemberof2010)

Feasibilitystudy(UseofMediaClaimsasa

ResearchtoolsupplementarytotheESS/

for8Countries)(2)

Mediaclaimsanalysis

2NewspapersperCountry/Greece:‘TaNea’&‘Kathimerini’

EverydayEdi7ons

exceptforWeekends

LIVEWHAT

UniversityofGeneva(Giugni)

3years(2013-2016)[ResearchinProgress]

Alterna7veCrisisAdaptabilityformsofEuropeanCi7zens,

individually,collec7velyandins7tu7onally(20countries)

Poli7calClaimAnalysis

andAc7onCaseAnalysis

5Na7onwideNewspapersper

Country&internet

(facebookpages,blogs,etc)

Representa7veSampleof1000

publicinterven7onsandalterna7ve

adaptabilityforms

ESSi: Developing event repor<ng

•  EventData/EventmonitoringinEuropeanSocialSurvey•  SupplementarytooltoESSq/naire• Measuringcontextincross-na7onalsurvey• Mediaclaims


SoDaMapSocialDataMappingΕΚΚΕ

PanoramaPartner:Hellenic

Sta7s7calAuthority

SocioscopePartner:

AthenaResearchCentre

ILSP-IMIS

IMISIns7tutefortheManagementof

Informa7onSystems

ILSPIns7tuteforLanguageand

SpeechProcessing

PROMAP:acollabora7veresearchproject

The need for automated content analysis with NLP tools

•  1.SocialMediaasasupplementaryresource•  2.“Big”Data•  3.Iden7fytrendsoverlarger7mespans•  UniversityofZurich-Wuestet.al2013(Τhepoli7ciza7onofEurope-Acompara7vestudyofsixEuropeancountries1970-2010)

PROMAP Methodology I

•  PCA(Poli7calclaimsanalysis)Κοοpmans&Statham(1999);Koopmans(2002);deWilde,Koopmans&Zürn(2014)•  Unitofanalysis:claim•  Elabora7onofnewcodingscheme•  Refinementofcodebook(14ver.)•  Samplingstrategy

•  Selec7onofdailynewspapers:Kathimerini(righ7st-centerrigh7st),Avgi(leeist)•  Sample:2daysperweekfortheen7reperiod(WednesdayandFriday)

•  PilotCoding

PROMAP Methodology II Applica7onofacomputa7onalmethoddevelopedbyILSP(suitev.0.4)Itera7ons(Machinelearning)incollabora7onwithILSPteam.Geospa7almappinganddevelopmentofcubecollec7on(RDF)byIMIS(socioscope)

•  Constraints•  Availabilityofselectednewspapers(Eleeherotypia)•  Availabilityofnewspaperdatainhtmlorxmlformat•  Copyrightedmaterial•  Selec7onBias-Mediacontent•  Restric7onsofautomatedNLPtools

Defini<on of a claim in PROMAP

RephrasingKoopman’s(2002)andStatham’s(2005)definiTons:

•  “AclaimisdefinedasapurposiveunitofstrategicorcommunicaTveacToninthepublicsphereaimingatacollecTvestakeandhavingtheformofphysicalorverbalacTon”.

•  Avalidclaimisnotexplicitlypoli7cal-anonpoli7calclaimmayhavepoli7calimplica7ons.

The structure of a claim (variables)

1.  Loca7onoftheclaimin7meandspace(WHENandWHEREistheclaimmade?)

2.  Claimant:theactormakingtheclaim(WHOmakestheclaim?)3.  Formoftheclaim(HOWistheclaiminsertedinthepublicsphere?)4.  Theaddresseeoftheclaim(ATWHOMistheclaimdirected?)5.  Thesubstan7veissueoftheclaim(WHATistheclaimabout?)6.  Objectactor:whowouldbeaffectedbytheclaimifitisrealized(FOR/

AGAINSTWHOM?)7.  Thejus7fica7onfortheclaim(WHYshouldthisac7onbeundertaken?)

•  Source:RuudKoopmans,2002,CodebookfortheanalysisofpoliTcalmobilisaTonandcommunicaToninEuropeanpublicspheres,DeliverableD2.1oftheproject"TheTransforma7onofPoli7calMobilisa7onandCommunica7oninEuropeanPublicSpheres”

Examples of claims

WHO(SUBJECTACTOR)

HOW(FORM) ATWHOM(ADDRESSEE)

WHAT(ISSUE) FOR/AGAINSTWHOM(OBJECT

ACTOR)

WHY(FRAME)

TheemployeesoftheGreekPublicPowerCorpora7on

wentonastrike sta7ngthatthegovernment

shouldnotfurtherpriva7zethePowerCorpora7onbecause

theGreekpeople benefitfromthepublicownershipoftheCorpora7on

Thepolicemenandthefire-fighters

launchedawork-to-ruleac7on

askingtheDeputyMinisterofFinance

tosa7sfytheirins7tu7onalandsalaryrelateddemands

forthemselves(policemenandfire-fighters)

Themunicipalauthori7esandci7zensofMelissia

organizedarally inordertosavethesurroundingforest

becausethenaturalcharacteroftheforestshouldbemaintained

Applica<on of computa<onal method (Computa<onal Social Sciences suite v0.4)

Analysis:RequirementsSpecifica7ondocumentbasedontheCodebook

Data:Collec7on,Preprocessing,Filtering

Design:DomainModelling,Systemarchitecture

Implementa7on&Tes7ng:toolsandresources,sophis7catedlinguis7crules,machinelearning,Basis:ILSP-NLPsuite

IntegraKon[CSSsuitev0.4]:ClaimextracKon,Actor/Addressee&IssuedetecKon,Time/LocaKonRecogniKon

Maintenance

Natural Language Processing pipeline

FormActor/

AddresseeIssue Time/Loca7on

NamedEn7tyRecogni7on

PhraseExtrac7on

DependencyParsing

Co-referenceResolu7on Aggrega7on

ClaimsDetecKon

EKKEILSP-NLP

Summarize

Preprocessing procedure

OriginaldatafromNewspapers

• TransformXMLfilestoTXTfiles

• N1=330.000arKcles

Applyabasicfilter(Lexicon)

• Lemmas(nouns):strike,protest,demonstra7onetc.

• Locatear7clesthatcontainthesewords

Output:new

collec7onofar7cles

• N2>50.000ar7clesthatcontainthenounsiden7fiedinthepreviousstep.• Crea7onofnewspaperarchive

•  Input:collec7onofar7clesfromnewspapersfrom1996to2014inXMLformat•  Eachfileinthedatasetisauniquear7cle.•  Output:acollecKonoftextfiles(TXT)

Searchforterms

Filterbyyearorbysec7on

Savesthequeryandthecollec7onofar7cles

Steps

συνολικά(Τετάρτη&Παρασκευή)

Καθημερινή 314527

Αυγή 226462

Σύνολο 540989

μετάτηναφαίρεσηκατηγοριών


Αυγή 191268

Σύνολο 362884

επεξεργασμέναάρθρα


Αυγή 14849

Σύνολο 25051

MANUALCODINGΗ Αυγή, 11 Σεπτεµβρίου 2013

Μαχητική συγκέντρωση και πορεία διαµαρτυρίας στη Θεσσαλονίκη

Θεσσαλονίκη: Την ώρα που οι εκπαιδευτικοί διαδήλωναν µαζικά στο Σύνταγµα, στη Θεσσαλονίκη εκατοντάδες καθηγητές της δευτεροβάθµιας εκπαίδευσης συγκεντρώθηκαν στην πλατεία Αγίας Σοφίας και στη συνέχεια πραγµατοποίησαν πορεία διαµαρτυρίας σε κεντρικούς δρόµους της πόλης, φωνάζοντας συνθήµατα κατά της κινητικότητας, αλλά και ενάντια στο ταξικό «Νέο Λύκειο» του Κ. Αρβανιτόπουλου.

...

PROMAPCODING

ΠΟΤΕ (time)

ΠΟΥ (location)

ΠΟΙΟΣ (actor)

ΠΩΣ (form)

ΣΕ ΠΟΙΟΝ (addressee)

ΤΙ (issue)

For/Against whom(object

actor)

10-9-2013 CDAY=10 CMONTH=9 CYEAR=13

Θεσσαλονίκη CITY=1120701

Καθηγητές ACT1S=412 ACTTYP1=1 ACTPAR1=0

Συγκέντρωση/ Πορεία FORMS=7 FORM=72

Υπ. Παιδείας Κ. Αρβανιτόπουλος ACT1S=102 ACTCOUN1=11 ACTPAR1=1

Κινητικότητα, ταξικό «Νέο Λύκειο» ISFIELD1=90

Καθηγητές OBJ1S=412 OBJCOUN1=11 OBJPAR1=0

10-9-2013 CDAY=10 CMONTH=9 CYEAR=13

Πλατεία Συντάγµατος CITY=3514501

Εκπαιδευ-τικοί ACT1S=412 ACTTYP1=1 ACTPAR1=0

Διαδήλωση FORMS=7 FORM=72

Υπ. Παιδείας Κ. Αρβανιτόπουλος ACT1S=102 ACTCOUN1=11 ACTPAR1=1

Κινητικότητα, ταξικό «Νέο Λύκειο» ISFIELD1=90

Εκπαιδευτικοί OBJ1S=412 OBJCOUN1=11 OBJPAR1=0

Findings: Selected forms of ac<on

FormNumberof

claimsidenKfied(1996-2013)

PercentageoftotalclaimsidenKfied

Strike 2100 70.7%

Publicassembly1 718 24.2%

Occupa7on/Sit-in 97 3.3%

Symbolicviolence2 55 1.9%

Total 2970 100%

TotalNo.ofar7cles=1997(1.48/claimsperar7cle)

1Publicassembliesreferonlytopeacefulrallies(demonstra7onsonthemoveandviolentdemonstra7ons/assembliesareconsideredasdifferentformsofac7on).2.Symbolicviolenceincludestheburningofflags,eggthrowing,jeering,etc.

Figure 1: Claims per year

Figure 2: Claims per month

Main findings •  Predominantclaimsareoverlabour,employmentandeduca7onalissues•  Strikesshowthemostsignificantvaria7onover7me(escala7ngduringthefirstyearsofEconomiccrisis)•  Strikesarelargelylabour-relatedand7me-dependent•  TradeUnionsaretheprominentactorsofstrikes,butshortlyaeertheOlympicGames,andbeforeMemorandum,itseemsthattheyloosetheirabilitytoformandsynthesizeclaims•  SymbolicviolenceoccursmainlyintheCapital(Athens)andshowsastableevolu7onover7me•  TheexpectaTonofagovernmentchange,hasanega7veeffectonprotest

ASocialDataAnalyTcspla[orm

www.socioscope.gr


Socioscope Highlights

o SocialDataAnaly7cso DataExplora7ono VisualAnaly7csonsocialandpoli7caldata

o SocialDataVisualiza7ono DynamicVisualiza7onso Combina7onofdatafromDifferentThema7careas

o LinkedOpenDataavailabilityo Reuseofcodebooko APIendpointforonlineanalysis


RDBMs

DatasourcesCLARIN-PLUSworkshop,Leuven19-21Sep.2016

Dashboards Dataoverview

HighlightedDiagrams


Varioustypesofdiagrams(bar,line,area,pie)


ChoroplethMaps


HierarchicalExplora7on(roll-up,drill-down)CLARIN-PLUSworkshop,Leuven19-21Sep.2016

FacetsBrowsingforfiltering

FullTextSearch


MobileSupport


References

•  StathopoulouT.,(ed.)(2016)TransformaTonsofProtestinGreece.PapazisisPublishers&EKKE,Athens[inEnglish],inpress.•  Papanikolaou,K,Papageorgiou,PapasarantopoulosN,Stathopoulou,T,Papastefanatos,G(2016)“JustthefactswithPALOMAR”DetecTngprotesteventsinmediaoutletsandTwifer.Paperpresentat:SocialMediaintheNewsroom.InternaTonalConferenceonWebandSocialMedia(ICWSM2016),Cologne,Germany.•  StathopoulouT.,StasinopoulosN.,DiakoumakosG,2015(August25-28)Mapping“old”and“new”formsofprotestinGreece.EuropeanSociologicalAssociaTonConference.Prague,CzechRepublic.

ThankyouforyouraWen7on

[email protected]

promap: developing a research tool for protest mapping · promap: developing a research tool for...

Documents