provide input and learn more about the study at ...

37
Provide input and learn more about the study at www.nas.edu/EnvisioningDS

Upload: others

Post on 24-Sep-2019

2 views

Category:

Documents


0 download

TRANSCRIPT

Provideinputandlearnmoreaboutthestudyatwww.nas.edu/EnvisioningDS

Provideinputandlearnmoreaboutthestudyatwww.nas.edu/EnvisioningDS

9/12/17–BuildingDataAcumen9/19/17–Incorpora4ngReal-WorldApplica4ons

9/26/17–FacultyTrainingandCurriculumDevelopment

10/3/17–Communica4onSkillsandTeamwork

10/10/17–Inter-DepartmentalCollabora4onandIns4tu4onalOrganiza4on

10/17/17–Ethics10/24/17–AssessmentandEvalua4onforDataSciencePrograms

11/7/17–Diversity,Inclusion,andIncreasingPar4cipa4on

11/14/17–Two-YearCollegesandIns4tu4onalPartnerships

(recordingposted)

(recordingposted)

(recordingposted)

Provideinput,downloadtheinterimreport,andlearnmoreaboutthe

studyatwww.nas.edu/EnvisioningDS

(recordingposted)

(recordingposted)

Provideinputandlearnmoreaboutthestudyatwww.nas.edu/EnvisioningDSProvideinputandlearnmoreaboutthestudyatwww.nas.edu/EnvisioningDS

Ethics

SorinAdamMatei,PurdueUniversityProfessorandDirectorofPurdueData

StorytellingNetwork

BriHanyFiore-Gartland,UniversityofWashington

DirectorofDataScienceEthnographyeScienceInsBtute

3

Provideinputandlearnmoreaboutthestudyatwww.nas.edu/EnvisioningDSProvideinputandlearnmoreaboutthestudyatwww.nas.edu/EnvisioningDS

Ethics

SorinAdamMatei,PurdueUniversityProfessorandDirectorofPurdueData

StorytellingNetworkandKredible.netProject

4

Anethicalreasoning

frameworkfordatascienceeduca4on

Provideinputandlearnmoreaboutthestudyatwww.nas.edu/EnvisioningDS

Goalsofpresenta4on

•  Defineethicsandbigdata(therealmofdatascience)

•  Defineprinciplesforethicalreasoning•  Discusstheprinciplesinadatasciencecontext•  Presenttheethicalreasoningprocessincontext,usinganexample

•  Discusstheimplica4ons/answerques4ons

5

Provideinputandlearnmoreaboutthestudyatwww.nas.edu/EnvisioningDS

Aprincipledapproachtoethics

•  Ethicsisamethodology.Dependsonmorality,whichisrootedinhumanvalues.– Dealswith“rightconduct.”

•  Necessitatesvalues:Whatvaluesshoulddirectethicalconduct?

•  Usedincontext:Whattypesoftrade-offsarepossibleandwhen?

6

Provideinputandlearnmoreaboutthestudyatwww.nas.edu/EnvisioningDS

Ethicalconductinthecontextofdatascience

•  Whatarethemainethicalchallengesinvolvedindatascience?

•  Whatmoralprinciplesareaffectedbythesechallenges?

•  Howdocontextsofdatascienceuseorpoten4alabuseaggravateormi4gatetheurgencyofethicaldecisionmaking?

7

Provideinputandlearnmoreaboutthestudyatwww.nas.edu/EnvisioningDS

DataScienceanditschallenges

•  Challengesderivedfromtheautoma4ccollec4onofbigdata–  Reuse

•  Genomicdatacollectedforonepurpose(diseasepreven4on)usedfordrugdiscovery

–  Recombina4on•  Joiningmul4pledatasetstoobtainfullerprofilesofusers(Google,Facebook)

–  Repurposing•  Datacollectedforbillingpurposesisusedforan4-terrorismsurveillance(theNSAmeta-datascandal)

–  Reanalysis•  Rawdatacanbeanonymous,analyzeddatacanbecomepersonallyiden4fiable(behaviorforensics:loginpa`erns,Wikipediaedi4ngpa`erns,etc.)

8

Provideinputandlearnmoreaboutthestudyatwww.nas.edu/EnvisioningDS

Challenge1:Privacy

•  The4Rs(recombining,repurposing,reuse,reanalysis)implicitindatasciencemayaffectindividuallyprofoundlyanddirectly

•  Iden4ty,anonymitymaybecompromised->Privacymainconcern

•  Butisthisall?

9

Provideinputandlearnmoreaboutthestudyatwww.nas.edu/EnvisioningDS

Privacyisnotsufficient

Concernforprivacyisaseriousissuebutdoesnotsuggestapathtoac4onStrategicques4on:whatdoeslossofprivacydotous?

10

Provideinputandlearnmoreaboutthestudyatwww.nas.edu/EnvisioningDS

Lossofprivacyandcorehumanvalues

•  Privacylossisinfactpartofafamilyofmuchgeneralconcerns.– Limitsordenieshumanautonomy– Mayleadtotrea4ngpeopleunfairly– Breaksthebondsoftrustinsociety– Makessomepeopleworseofforexposesthemtorisk

11

Provideinputandlearnmoreaboutthestudyatwww.nas.edu/EnvisioningDS

Corevaluesindatascienceethicalreasoning

•  Autonomy•  Jus4ce•  Trust•  Non-maleficence/beneficence

•  Howdowemakeprac4caluseofthem?

12

Provideinputandlearnmoreaboutthestudyatwww.nas.edu/EnvisioningDS

Ethicalreasoningprocess

Doesthisprocedure,beitofanyform(collec4on,analysis,repurposing,recombina4on,etc.)leadto:•  Lossofautonomy?•  Lossoftrustbetweenindividualsorbetweenindividualsandtheresearcher?

•  Createunjustalloca4onofrewards(recogni4on,accesstoresources,socialadvancement)ordeleteriouseffects(s4gma,lossofface,materialloss,etc)?

•  Harmand/createsanetbenefitfortheusers?

13

Provideinputandlearnmoreaboutthestudyatwww.nas.edu/EnvisioningDS

Sowhat?

•  Askingques4onsiseasy….

•  Answeringthemishard.

•  Howdowegoaboutansweringthem?

•  Inacontextualmanner….

14

Provideinputandlearnmoreaboutthestudyatwww.nas.edu/EnvisioningDS

Contextualuseofvalues

•  Humanvaluesare(shouldbe)absolutes•  Valuejudgementsinthemselvesarenon-nego4able(jus4ce,trust,non-maleficencearepreferableunderallcircumstances.)

•  Whenconsideringtheeffectofvaluesonourac4onsweshouldestablishaminimumthresholdunderwhichweshouldandwecannotgo

•  Yet,forcertainsitua4onsandaboveacertainlevelofmoralcertainty,ethicalac4onsshouldbepragma4callydirectedbytrade-offanalysis

15

Provideinputandlearnmoreaboutthestudyatwww.nas.edu/EnvisioningDS

Projectexample

•  Largescaleharves4ngofvideo-streamsfrompublicallyavailableweb-camsinna4onalparksbynon-governmentalactors(universityresearchers)

•  Declaredgoals:–  Reduc4onofhuman-wildlifeinterac4on–lesshumanandanimallimbandlifelossincidents

– Openupthedatatotheresearchcommunitytopredictincidentsandtargetpoten4alvic4msviasocialmediatoreducehuman-animalencounters

– Datacontainstensofthousandsofhoursoffootage,includingfaces,acts,andpersonallyiden4fiableinforma4onaboutparkvisitors

16

Provideinputandlearnmoreaboutthestudyatwww.nas.edu/EnvisioningDS

Projectoutcomes

•  Findings– Reanalysis–revealswhoismorelikelytointeractwithanimals(gender,race,age)

– Recombiningwithsocialmediadata–iden4fiesrecentvisitorsataloca4onofgivengender,race,orage

– Repurposing–iden4fiedvisitorsaretargetedwithcustomizedmessagesviaTwi`ertoavoidfutureencounters

17

Provideinputandlearnmoreaboutthestudyatwww.nas.edu/EnvisioningDS

Ethicalreasoningprocess

•  Yes,if:–  Thegoalisnon-maleficentorevenbeneficent

•  Inthiscasetolimitlossofhumanandanimallifeorlimb–  Autonomyisnotlimited

•  Inthiscase,individualsarenotdeniedaccesstothepark,theyaresimplyinformed–  Jus4ce

•  Acasecanbemadethatsomeindividualsmaybetargetedbyrace,gender,ageaffilia4onregardlessiftheydidnotinteractwithanimalsinanunsafeway

–  Trade-offanalysis–isthesocietalbenefitgreaterthanthemildannoyanceoftheindividualsofreceivinginforma4vetweets?weresomefundamentalrightsdeniedtotheseindividualsorsomeprivilegesbestowedtosomeandnottothem?

–  Trust•  Doesthiscampaigninspireorerodetrust?

–  Tradeoffanalysis–whilesomemightfindthecampaignintrusive,ifrightlypreparedbypos4ngnotesnexttocamerasthatinformabouttheiruse,itmayleadtoanincreaseoftrustinthosethataretryingtolimithumanoranimallifeandlimbloss

18

Provideinputandlearnmoreaboutthestudyatwww.nas.edu/EnvisioningDS

Whatdidwejustdo?

•  Weengagedinethicalreasoning•  Valuebased,withaminimumthresholdofvalueconcernandcontext-basedtrade-offanalysis

•  TheprocessisdescribedinEthicalReasoninginBigData,co-editedwithJeffCollmann

•  TheethicalprocessdescribedwasshapedinamajorwaybyMichaelSteinmannfromStevensIns4tuteofTechnology

19

h`p://amzn.to/2kOwTDz

Provideinputandlearnmoreaboutthestudyatwww.nas.edu/EnvisioningDS

Ques4ons?

•  Moreinforma4on– h`p://kredible.net– h`p://matei.org/ithink

20

Provideinputandlearnmoreaboutthestudyatwww.nas.edu/EnvisioningDSProvideinputandlearnmoreaboutthestudyatwww.nas.edu/EnvisioningDS

Ethics

BriHanyFiore-Gartland,UniversityofWashington

DirectorofDataScienceEthnographyeScienceInsBtute

21

EthicalThinkingforDataScience

Educa4on

Provideinputandlearnmoreaboutthestudyatwww.nas.edu/EnvisioningDS

Datajus4ceandresponsibility

22

•  Democra4za4onofdatasciencetoolsandtechniques

•  Computa4onalresearchers

workinginunfamiliarfieldsorcontexts

•  Secondaryusesofdata;Datacollectedforonepurposeandusedforanother

•  Shincultureofethicalcompliancetocultureofethicalthinking

Provideinputandlearnmoreaboutthestudyatwww.nas.edu/EnvisioningDS 23

Course developed by Jevin West and Carl Bergstrom, University of Washington

Provideinputandlearnmoreaboutthestudyatwww.nas.edu/EnvisioningDS

DataPipeline

24

Provideinputandlearnmoreaboutthestudyatwww.nas.edu/EnvisioningDS

Human-DataPipeline

25

Inspired by Dr. Seuss

Provideinputandlearnmoreaboutthestudyatwww.nas.edu/EnvisioningDS 26

Spurious correla-ons (Tyler Vigen)

Provideinputandlearnmoreaboutthestudyatwww.nas.edu/EnvisioningDS 27

BigDataTruthiness Implicit assumption and expectation that big

data has the quality of seeming or being felt to be true, even if not necessarily true.

(Adapted from Stephen Colbert’s “Truthiness”)

Provideinputandlearnmoreaboutthestudyatwww.nas.edu/EnvisioningDS

DataSciencechallenges

currentethicalframeworks

Theperils!

CaseStudy:Uber“RidesofGlory”

analysis

Provideinputandlearnmoreaboutthestudyatwww.nas.edu/EnvisioningDS

Uber’s“RidesofGlory”Analysis

•  Ridesfrom10pm-4amonFri/Sat,followedbyridefromsameloca4on4-6hrslater

•  Impliespeople“foundlovethatyoumightimmediatelyregretuponwakingupthemorninganer”

•  Callsthese“RidesofGlory”

Provideinputandlearnmoreaboutthestudyatwww.nas.edu/EnvisioningDS

Uber’s“RidesofGlory”Analysis

• Consent• Privacy• Interpreta4on

Provideinputandlearnmoreaboutthestudyatwww.nas.edu/EnvisioningDS

DataScienceasEthical

Interven4onThepromise!

CaseStudy:Amazonsame-daydeliveryservice:Canalgorithmsberacist?

Provideinputandlearnmoreaboutthestudyatwww.nas.edu/EnvisioningDS 32

Provideinputandlearnmoreaboutthestudyatwww.nas.edu/EnvisioningDS 33

Provideinputandlearnmoreaboutthestudyatwww.nas.edu/EnvisioningDS 34

Provideinputandlearnmoreaboutthestudyatwww.nas.edu/EnvisioningDS

Thankyou!

35

Contact:[email protected]

Resources:

•  CallingBullshitsyllabusandreadings,tools,editedvideosoflecturesandcasestudiesareallavailableatwww.callingbullshit.org

•  [email protected]•  Linktodatascienceethicscasestudiesandfurtherreading,

h`ps://4nyurl.com/y9meel3s

Provideinputandlearnmoreaboutthestudyatwww.nas.edu/EnvisioningDSProvideinputandlearnmoreaboutthestudyatwww.nas.edu/EnvisioningDS

Ethics–Q&A

SorinAdamMatei,PurdueUniversityProfessorandDirectorofPurdueData

StorytellingNetwork

BriHanyFiore-Gartland,UniversityofWashington

DirectorofDataScienceEthnographyeScienceInsBtute

36

9/12/17–BuildingDataAcumen9/19/17–Incorpora4ngReal-WorldApplica4ons

9/26/17–FacultyTrainingandCurriculumDevelopment

10/3/17–Communica4onSkillsandTeamwork

10/10/17–Inter-DepartmentalCollabora4onandIns4tu4onalOrganiza4on

10/17/17–Ethics10/24/17–AssessmentandEvalua4onforDataSciencePrograms

11/7/17–Diversity,Inclusion,andIncreasingPar4cipa4on

11/14/17–Two-YearCollegesandIns4tu4onalPartnerships

(recordingposted)

(recordingposted)

(recordingposted)

Provideinput,downloadtheinterimreport,andlearnmoreaboutthe

studyatwww.nas.edu/EnvisioningDS

(recordingposted)

(recordingposted)