personal born-digital in what environments do we...

17
8/24/19 1 The Challenges of Archiving Personal, Community, & Event-based Born-Digital material Howard Besser Moving Image Archiving & PreservaIon New York University hNp://besser.tsoa.nyu.edu/howard/Talks/ hNp://www.nyu.edu/Isch/preservaIon/ Besser-Indiana 8/30/2019 1 The Challenges of Archiving Personal, Community, & Event-based Born-Digital material Background & The Problem of Personal, Community, & Event-based Digital Archiving (for both text and image) The PDA Conferences My Projects that provided key concepts & Challenges InterPARES Preserving Digital Public Television AcIvist Archivists & the Occupy Movement Important Lessons & Approaches Learned (From AcIvist Archivists & Other projects) Other projects to Monitor Further Applied Research needed Besser-Indiana 8/30/2019 2 Personal born-digital (from PDA Conferences) Correspondence/email Personal photos/movies and group collecIons Manuscript dra]s, camera original footage, rough cuts Personal documents Diaries Home movies And has been extended to encompass: Family history Community/Ethnic history & Movements Genealogy Digital humaniIes Besser-Indiana 8/30/2019 3 In what environments do we find this type of material? Archives and Library Special CollecIons CollecIons documenIng a community CollecIons documenIng an ethnic group CollecIons documenIng a social movement CollecIons documenIng the work of any other type of group (a group of Architects, a set of law-makers, etc.) CollecIons documenIng an event- Besser-Indiana 8/30/2019 4 DocumenIng an Event Besser-Indiana 8/30/2019 5 DocumenIng an Event Besser-Indiana 8/30/2019 6

Upload: others

Post on 12-Oct-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Personal born-digital In what environments do we findbesser.tsoa.nyu.edu/howard/Talks/19indiana-pda.pdf · – Cloud storage for documents (google docs) – Social network services

8/24/19

1

TheChallengesofArchivingPersonal,Community,&Event-basedBorn-Digital

material

HowardBesserMovingImageArchiving&PreservaIon

NewYorkUniversityhNp://besser.tsoa.nyu.edu/howard/Talks/hNp://www.nyu.edu/Isch/preservaIon/

Besser-Indiana8/30/2019 1

TheChallengesofArchivingPersonal,Community,&Event-basedBorn-Digital

material•  Background&TheProblemofPersonal,Community,&

Event-basedDigitalArchiving(forbothtextandimage)•  ThePDAConferences•  MyProjectsthatprovidedkeyconcepts&Challenges

–  InterPARES–  PreservingDigitalPublicTelevision–  AcIvistArchivists&theOccupyMovement

•  ImportantLessons&ApproachesLearned(FromAcIvistArchivists&Otherprojects)

•  OtherprojectstoMonitor•  FurtherAppliedResearchneeded

Besser-Indiana8/30/2019 2

Personalborn-digital(fromPDAConferences)

•  Correspondence/email•  Personalphotos/moviesandgroupcollecIons•  Manuscriptdra]s,cameraoriginalfootage,roughcuts•  Personaldocuments•  Diaries•  HomemoviesAndhasbeenextendedtoencompass:•  Familyhistory•  Community/Ethnichistory&Movements•  Genealogy•  DigitalhumaniIes

Besser-Indiana8/30/2019 3

Inwhatenvironmentsdowefindthistypeofmaterial?

•  ArchivesandLibrarySpecialCollecIons•  CollecIonsdocumenIngacommunity•  CollecIonsdocumenInganethnicgroup•  CollecIonsdocumenIngasocialmovement•  CollecIonsdocumenIngtheworkofanyothertypeofgroup(agroupofArchitects,asetoflaw-makers,etc.)

•  CollecIonsdocumenInganevent-

Besser-Indiana8/30/2019 4

DocumenInganEvent

Besser-Indiana8/30/2019 5

DocumenInganEvent

Besser-Indiana8/30/2019 6

Page 2: Personal born-digital In what environments do we findbesser.tsoa.nyu.edu/howard/Talks/19indiana-pda.pdf · – Cloud storage for documents (google docs) – Social network services

8/24/19

2

DocumenInganEvent

Besser-Indiana8/30/2019 7

Well-funded“anI-racist”acIvists,withbackingfrombillionaireJewsandgovernmentinsItuIons,preventracially-awareWhitepeoplefromengaginginonlinecommerce.TheNaIonalAllianceandCosmotheistChurch,forexample,havebeeneffecIvelybannedfromonlinecommercefornearlytwoyears.NowtheJewsandtheirpawnsaretryingtoextendthiscensorshiptototallynon-poliIcalvenueslikethisBloomington,Indianafarmers’market.

https://nationalvanguard.org/2019/06/indiana-pro-white-farmers-threatened-persecuted-by-jewish-funded-leftists/

DocumenIngaCommunityGroup

Besser-Indiana8/30/2019 8

DocumenIngaSocialMovement

Besser-Indiana8/30/2019 9

GENERALPROBLEMSOFTHISTYPEOFBORN-DIGITALCONTENT

Besser-Indiana8/30/2019 10

Intheanalogworld

•  TradiIonally,wehavecometounderstandtheworkofwriters,scienIsts,filmmakersbyscholarsstudyingtheirpapersandrough-cutsinSpecialCollecIonsandArchives

•  Theircorrespondenceandprogressivelydifferentdra]sofpapersandrough-cutsrevealtheirchangingthoughtsandcra]

•  ButhowdowegathertheseintheDigitalAge?

Besser-Indiana8/30/2019 11

AlasdairGray'sLanark(GlasgowULibrary)

Besser-Indiana8/30/2019 12

Page 3: Personal born-digital In what environments do we findbesser.tsoa.nyu.edu/howard/Talks/19indiana-pda.pdf · – Cloud storage for documents (google docs) – Social network services

8/24/19

3

Correspondence

Besser-Indiana8/30/2019 13

Wherecanwefindthesetoday?

•  DopeoplewriteleNersonpaper?CanweseetheiteraIonsofchangesonmanuscripts?DopeoplesavetheirEDLs?

•  Wherecanwefindtoday’sequivalentofthese?

Besser-Indiana8/30/2019 14

Stagesoftheproblem

•  Stage#1:Peoplerecordondigitalmediainsteadofanalog

•  Stage#2:Peoplenolongerstoretheirdigitalworksinplacesoverwhichtheyhaveabsolutecontrol– Emailservices(gmail,yahoo)– Cloudstoragefordocuments(googledocs)– Socialnetworkservices(Vimeo,YouTube,Instagram)

Besser-Indiana8/30/2019 15

Stage#1Issues-digitalreplacesanalog

Besser-Indiana8/30/2019 16

Stage#1Issues-digitalreplacesanalog

•  Thiswillrequire– newintervenIons(likechangingcreators’workflow,savingEDLs,orinterveninginemailhandlingso]ware)

– Newtools(likeforanalyzingemail)– newapproacheslikedigitalarcheology,forensics

Besser-Indiana8/30/2019 17

Stage#2Issues-contentnolongeronharddisk

•  RiseofOnlineServicesandSocialMediaischangingwherethiscontentresides(andisimposingTOSrestricIonsthatgobeyondtherightsholder)

Besser-Indiana8/30/2019 18

Page 4: Personal born-digital In what environments do we findbesser.tsoa.nyu.edu/howard/Talks/19indiana-pda.pdf · – Cloud storage for documents (google docs) – Social network services

8/24/19

4

MuchContentisonFacebook

Besser-Indiana8/30/2019 19

IdenItarianPlapormonlyonWeb

Besser-Indiana8/30/2019 20

CoreMulI-locaIonProblems

•  It’sdifficultenoughwhensomeone’sphotosormoviesarespreadthroughouttheirharddisk.Buttodaysomeimagesthere,butothersontheirphone(s),YouTube,Vimeo,Instagram,Flickr,Facebook,inTweets,etc.

•  Similarproblemsplagueemail•  MostSocialNetworkTOSpoliciesprohibittheownerfromgivingtheirpasswordtoanyoneelse(evenLibrary)

Besser-Indiana8/30/2019 21

AndhowdowehandledonaIonsa]eranimportantpersondies?

Besser-Indiana8/30/2019 22

AndtheseissuesarealsotrueforCommunityGrps&Assns

•  w/SocialMedia,groupacIvityismoreimportantthanever

•  Buteachpersoninthegroupisanindividualcollector.AndfrequentlyasetofindividualcollecIonsformsthegroupcollecIon.

Besser-Indiana8/30/2019 23

DocumenIngProtests

Besser-Indiana8/30/2019

-photo from Activists Guide to Archiving Video

24

Page 5: Personal born-digital In what environments do we findbesser.tsoa.nyu.edu/howard/Talks/19indiana-pda.pdf · – Cloud storage for documents (google docs) – Social network services

8/24/19

5

Whenaggregated,manydifferentpersonalcollecIonsformanimportant

pictureof:•  Anevent•  Anethnicgroup•  Acommunity•  Asocialmovement•  Asetofarchitects•  Asetoflaw-makers

•  Whatisimportanttothem,howtheygoabouttheirbusiness,…

Besser-Indiana8/30/2019 25

AndweknowfrompastworksthataggregaIonscreatenewmeanings

•  AggregaIngallthephotosandhomemoviesoftheDigitalDiasporaishugelymoremeaningfulthanasinglephoto-

•  OnetweetsaysveryliNle,butthousandsoftweetscanshowtrendsordepictaparIculareventorday

Besser-Indiana8/30/2019 26

DigitalDiasporaFamilyReunion

Besser-Indiana8/30/2019 27

DigitalDiasporaFamilyReunion

Besser-Indiana8/30/2019 28

AndweknowfrompastworksthataggregaIonscreatenewmeanings

•  AggregaIngallthephotosandhomemoviesoftheDigitalDiasporaishugelymoremeaningfulthanasinglephoto

•  OnetweetsaysveryliNle,butthousandsoftweetscanshowtrendsordepictaparIculareventorday

Besser-Indiana8/30/2019 29

ButaggregaIngitemsfromdisparatesourcescausessignificantproblems

•  VastquanItyofuser-contributedmaterial•  RightsIssues•  Noeasywaytocontrolforquality,fileformat,metadata(notevenanyconsistencyforanyofthese)-

Besser-Indiana8/30/2019 30

Page 6: Personal born-digital In what environments do we findbesser.tsoa.nyu.edu/howard/Talks/19indiana-pda.pdf · – Cloud storage for documents (google docs) – Social network services

8/24/19

6

EveryImageCollectorhasaDifferentApproach

•  Differentfile-namingconvenIons•  Differentfileformats•  Differentcompressionschemes•  Differentmetadata•  Storedindifferentarrangements/hierarchies•  Storedindifferentplaces(cellphone,personalharddisk,YouTube,Vimeo,Facebook,…)

Besser-Indiana8/30/2019 31

THEPDACONFERENCES

Besser-Indiana8/30/2019 32

PersonalDigitalArchiving2015hNp://personaldigitalarchiving.com/

Besser-Indiana8/30/2019 33

PDA:WhoANends&Presents

•  CiIzenArchivists–  Peoplewhowanttostepinandrescuecontentinperil–  Peoplewholiketocreateso]ware/Apps/Guidelinestohelpothersfacingsimilarproblems

•  CommunityorEthnicgroupsandacIvistswanIngtosaveporIonsoftheirheritage

•  Professionallibrarians&archivists(andtheirprogrammingsupportstaff)

•  Regularso]waredevelopers•  Researchers(bothacademicandcomputerindustry)

Besser-Indiana8/30/2019 34

PDAGoals—Sharingknowledge

•  Whatworkedandwhatdidn’t;whatpartsturnedouttobemoredifficultthananIcipated

•  Newanddifferenttypesofcontenttocollect•  Guidelines,procedures,workflows,methodologies

•  So]ware

Besser-Indiana8/30/2019 35

PDAHistoryIniIallystartedbyInternetArchivewithco-sponsorshipfromNetherlandsSound&Vision,LC/NDIIPPandCNI•  2010InternetArchive•  2011InternetArchive•  2012InternetArchive•  2013UnivofMaryland•  2014IndianaStateLibrary&ISU•  2015NewYorkUniversity•  2016UniversityofMichigan•  2017StanfordUniversity•  2018UniversityofHouston•  2019UniversityofPiNsburgh

Besser-Indiana8/30/2019 36

Page 7: Personal born-digital In what environments do we findbesser.tsoa.nyu.edu/howard/Talks/19indiana-pda.pdf · – Cloud storage for documents (google docs) – Social network services

8/24/19

7

SamplePDATalks-Indianapolis2014hNp://visions.indstate.edu/pda2014/conference-program.html

•  TheSocialLifeofPersonalInformaIon,•  DefiningthePersonalinDigitalArchivingandCommuniIes•  PersonalArchivingasaGatewaytoDataLiteracy•  FindingRoots,Gems,andInspiraIon:UnderstandingtheUlImateUsesofDigital

Materials•  OpportuniIesandChallengesinAccessioningPersonalDigitalArchives•  PublicLibrariesandPersonalDigitalArchiving:OutreachLessonsLearned•  ClearasGlass:ControllingtheDataGeneratedbyWearableTechnology•  PersonalArchivingWithintheScholarlyWorkflow:ZoteroasConnectorfor

CollecIngFacultyWork•  PreservingYourDigitalPhotosUsingFreeorLow-CostSo]ware•  CollaboraIveDataManagementandProvenanceasCorePillarsofPersonalDigital

CuraIon•  FamilyArchiveasaNarraIveOrganizaIon•  DesigningaPersonal&FamilyArchiveforthe21stCentury

Besser-Indiana8/30/2019 37

PDA2015hNp://blogs.loc.gov/digitalpreservaIon/2015/08/report-on-the-personal-digital-

archiving-2015-conference/

Besser-Indiana8/30/2019 38

PDA2015

Besser-Indiana8/30/2019 39

PDA2015Topics

•  PreservingDigitalPhotos•  DigitalPreservaIonofArt•  CreaIveuseofOpenSourcetools-•  CollegeLibrarysponsoredPersonalDigitalArchivingDays

•  CommunityEngagement•  VideoPreservaIon•  DigitalHumaniIes&SocialScience•  Workshops-

Besser-Indiana8/30/2019 40

CreaIveuseofOpenSourcetools•  JasonScoN,“WhentheEmulatorsBrokeFree.”ScoN’sbasicmessagewasthattheInternetArchive

hasmadesignificantadvanceswithemulaIonofoldgamesonline.•  JusInMckinney,MarkSimonHaydnandAshleyBlewer,“

DoesBitTorrent+PrivateTrackers=TheNewFilmArchive?”(PDF).MckinneysaidBitTorrentisnotinherentlyevil,it’sjustatool,andpeople—especiallyprofessionalarchivistsandlibrarians—shouldbemoreopenmindedaboutusingBitTorrentasatested,effecIvetooltotransferlarge(legal)filesquicklyonline.

•  CalLeeandKamWoods,“BitstreamConfidenIal:ConsideraIonsandApproachestoCuraIngPotenIallySensiIvePersonalDatainCollecIons”(PDF)

•  WendyHagenmaier,“PDAasanOpportunityforCollaboraIveAdvocacyandMurderMysteryIntrigue”(PDF)and“AnExploraIonofthePotenIalImpactofWearableCompuIngTechnologiesonDigitalArchivingandPreservaIon”(PDF)

•  CheyenneJansdaNer,“BuildingDigitalCollecIonsInOmekaForTheLayperson”•  AshleyBlewer,“Don’tknowaboutyou,butI’mfeelinglikeSHA-2!”•  PeterChan,“5.25inchfloppydisks”(PDF).

Besser-Indiana8/30/2019 41

WorkshoponDo-It-YourselfPersonalDigitalArchiving

Besser-Indiana8/30/2019 42

Page 8: Personal born-digital In what environments do we findbesser.tsoa.nyu.edu/howard/Talks/19indiana-pda.pdf · – Cloud storage for documents (google docs) – Social network services

8/24/19

8

WorkshoponArchiveMaIca

Besser-Indiana8/30/2019 43

WorkshoponEmailArchiving

Besser-Indiana8/30/2019 44

SOMEKEYCONCEPTSFROMINTERPARES,PDPTV,ACTIVISTARCHIVISTS Besser-Indiana8/30/2019 45

KeyConcepts&ChallengesfrommypriorworkwithothertypesofDigitalContent

•  InterPARES—Ifwehopetopreserveelectronicrecords,archivistsneedtobeinvolvedearlyinthelife-cycleofthatrecord,longbeforetherecordentersthearchive

•  PreservingDigitalPublicTelevision—PushingmetadatagatheringupstreamintotheproducIoncycle-

Besser-Indiana8/30/2019 46

Preserving Digital Public Television Workflow in Production Process-

•  Site Visits to productions •  Interview Production staff •  Diagrams of Workflow-

Besser-Indiana 8/30/2019

Pushing Metadata Gathering Upstream: The Problem

TRADITIONALLY… •  Very little metadata required for

preservation accompanies an object to a repository.

•  Archives, libraries and other repositories must create (or re-create) most of the necessary metadata.

•  This requires many manual hours, and significant resources - both time and money.

IN THE DIGITAL WORLD… •  This doesn’t scale up. Repositories

will be unable to continue in this manner, as more metadata than ever is required.

Besser-Indiana 8/30/2019

Page 9: Personal born-digital In what environments do we findbesser.tsoa.nyu.edu/howard/Talks/19indiana-pda.pdf · – Cloud storage for documents (google docs) – Social network services

8/24/19

9

But much of the necessary metadata has already been gathered during production

•  For each element/clip, production team usually notes source, date, place, people, and other descriptive info

•  But this is treated as internal information, and often various parts of the info are distributed among the personal notebooks of different production assistants

•  There is seldom a central location for this info, and the info is seldom turned over to the archive (which later tries to recreate much of it)

Besser-Indiana 8/30/2019

When the Archive tries to re-create this info, it is seldom successful

Producers know much more about the content of their productions than the archivists do. Archivists wanting accurate info must go back to the production staff (often years later) to start brainstoriming over the info

“Once the (television) program is finished, it is passed on to the archive or library for safe keeping. Librarians will catalog and classify the content, possibly using a proxy copy, and enter the resulting informative metadata in their database so they can retrieve it in the future. However, rarely if ever is the metadata from the rest of the process passed onto them, except, perhaps, for the title, tape number, and basic technical information about recording formats. It has to be re-created, with all the associated risk of errors and lack of accuracy--not to mention the work and time involved.” - Cox, Tadic, and Mulder, Descriptive Metadata for Television (2006)

Besser-Indiana 8/30/2019

We need to find ways to push metadata access upstream

•  Digital requires even more metadata than Analog –  As the workflow becomes file-based, the need for robust and accurate

metadata will become critical. File relationships, video codecs, bit rates, and rights information must be explicit, accurate, and immediately accessible. This will require a much deeper level of metadata than is currently captured in tape-based archives.

–  We can’t continue to supply this metadata at ingest; that won’t scale •  Obtaining the necessary metadata at the end of production and

broadcast life cycle is not feasible. Metadata will need to be systematically gathered during the production lifecycle and submitted with the programs to the preservation repository.

Besser-Indiana 8/30/2019 Besser-Indiana 8/30/2019

Examined Potential Points of Metadata Capture

Besser-Indiana 8/30/2019

Examined Potential Points for Metadata Capture •  Much of the necessary metadata for preservation is already

generated by the production unit, but discarded after their internal use. This needs to be captured throughout the workflow.

•  “Those in the production unit are the creators and have first

hand knowledge of who, what, where, when, and why the content was created.” -- Mary Ide and Leah Weisse, WGBH Archivists.

Proposed Solutions…?

•  Preservation becoming a shared responsibility between content

creators, distributors, curators, and preservationists.

•  Partnerships are needed to come to unified solutions.

•  Preservationists seek reliable metadata back upstream in the production workflow...

Besser-Indiana 8/30/2019

Page 10: Personal born-digital In what environments do we findbesser.tsoa.nyu.edu/howard/Talks/19indiana-pda.pdf · – Cloud storage for documents (google docs) – Social network services

8/24/19

10

WorldFocus •  Nightly news program begun Oct 2008 •  We began working with Workflows six months before program

began •  Had ability to engineer metadata gathering into the creation/

production process

Besser-Indiana 8/30/2019

AcIvistArchivistshNp://acIvist-archivists.org/(useWaybackMachine)

hNps://www.facebook.com/AcIvistArchivists/

•  NYUMIAPstudentsandgradsoriginallyworkingonarchivingmediafromtheOccupymovement

•  GuidelinesbothacIvistcreatorsandarchives•  Developednewerlow-impactmethods

Besser-Indiana8/30/2019 56

HowOccupymaterialresembleswhatwe’llbefacinginthefuture

•  VastquanItyofuser-contributedmaterial•  Noeasywaytocontrolforquality,fileformat,metadata–  noenforcingguidelinesaswithorganizaIonalrecords–  nosemi-consistencyasinasingleindividual’spersonalrecords

•  MuchofthematerialcanmosteasilybefoundonSocialNetworks

•  …weneedtofindsmartwaystoharvestmetadataandanalyzefiles,aswellastoinfluencebehaviorofpotenIalcontributors

Besser-Indiana8/30/2019 57

AcIvistArchivistWebsite

Besser-Indiana8/30/2019 58

AcIvistArchivistsProjects-

•  “WhyArchive”postcard&video•  7TipstoEnsureYourVideoIsUsableintheLongTerm

•  Studyofmetadatalossthroughuploadingtoservices•  BestPracIcesforCreators/Collectors•  “Toolkit”forOccupyarchiving•  CoordinaIngdiscussionsamongvariousgroupsarchivingdifferentpartsofOccupy

•  ExploringmethodsforobscuringidenIIes

Besser-Indiana8/30/2019 59

IMPORTANTLESSONSFROMACTIVISTARCHIVISTS(&OTHERS)

Besser-Indiana8/30/2019 60

Page 11: Personal born-digital In what environments do we findbesser.tsoa.nyu.edu/howard/Talks/19indiana-pda.pdf · – Cloud storage for documents (google docs) – Social network services

8/24/19

11

LessonsLearnedforArchivists-

•  CommunicatewellwithyourfutureContributors•  DevelopCooperaIveRelaIonships•  Makeiteasyforfuturecontributorstocreate“archival-friendly”works

•  ForCooperaIveProjects,allowforinstrucIonsnotbeingfollowed

•  FindsmartwaystodealwithScale•  HandlePrivacy&Securityresponsibly

Besser-Indiana8/30/2019 61

CommunicatewellwithyourfutureContributors-

•  Learntospeaktheirlanguage•  Helpthemtorealizetheimportanceofarchiving

Besser-Indiana8/30/2019 62

“WhyArchive”video

Besser-Indiana8/30/2019 63

“WhyArchive”postcard•  ACCOUNTABILITY.Archivescollectevidencethatcanholdthoseinpower

accountable.•  SELF-DETERMINATION.Wedefineourownmovement.Weneedto

createandmaintainourownhistoricalrecord.•  SHARE.Archivesareapointofentrytoourmovement’srichrecord.We

canusethemtoensuretransparency,generatediscussion,andenabledirectacIon.

•  EDUCATE.Today’svideos,flyers,web-pages,andsignsarematerialfortomorrow’sskill-shares,classes,andmobilizaIons.

•  CONTINUITY.Justaspastmovementsinspireus,newacIvistswilllearnfromtheexperienceswedocument.

•  RECORD&COLLECTwhat’shappeningaroundyou.•  PRESERVEtherecord.

Besser-Indiana8/30/2019 64

DevelopCooperaWveRelaWonships-

•  TrytobeNerunderstandwhattheiraimsare;getinvolvedintheiracIviIes

•  DeveloppartneringrelaIonships

Besser-Indiana8/30/2019 65

parIcipatedinSelf-helpacIviIes:Skill-sharesforOccupiers

Besser-Indiana8/30/2019 66

Page 12: Personal born-digital In what environments do we findbesser.tsoa.nyu.edu/howard/Talks/19indiana-pda.pdf · – Cloud storage for documents (google docs) – Social network services

8/24/19

12

Self-helpacIviIes:

OtherArchiveShare-DayandHackathonacIviIes

•  BatchdownloadfromFLICKRwithselectedaNributes(#OWS,CreaIveCommons,EXIFmetadata,tagged-textmetadata)

•  Re-mixingofolderfootage•  CreaIngavisualImeline•  Miningmaterialfordata(eg.numberofco-locaIonsofanofficer’snamewith“pepperspray”)

Besser-Indiana8/30/2019 67

Makeiteasyforfuturecontributorstocreate“archival-friendly”works-

•  Low-hangingfruit•  EasyinstrucIonalmaterialthatappealstowhattheythinkisimportant

•  InstrucIonsforredundantmetadatacollecIon(tomakesurethatitiscaptured)

Besser-Indiana8/30/2019 68

Low-Hangingfruit

•  TurnGPSon•  DevelopstrategiesforautomaIngaprofileanduploads(ouridealApp)

Besser-Indiana8/30/2019 69

7TipstoEnsureYourVideoIsUsableintheLongTerm

•  Collectdetailswhilefilming•  Keepyouroriginalrawfootage,unaltered•  Makeyourvideodiscoverable•  Contextualizeit•  Makeitverifiable•  Allowotherstocollectandarchive•  Orarchiveityourself

Besser-Indiana8/30/2019 70

BestPracIcesforContentCreators

•  Security–  Hiddencameralaws,parIes’consentlaws

•  CapturingContent–  Highestquality,setdateandIme-stamps,notelocaIon

•  OffloadingContent–  Rawfilesdirectlyontocomputer,keepmaterialorganized

•  UploadingContent–  Importanceoftagging,reviewofdiffservices

•  DeposiIngwithanArchive•  Copyright

Besser-Indiana8/30/2019 71

OccupyArchivingKit•  WhyArchive?•  Whatisan“archive”?HowdoIcreateanarchive?•  CreaIngarchiving-friendlycontent•  HowcanIcollectmaterialsforthearchive?•  WhatshouldIsave?•  HowshouldIorganizemymaterials?HowdoIgetitintothearchive?•  DescripIon/Metadata•  MediaManagement•  Storage&PreservaIon•  Access•  ExhibiIonandPresentaIon/Outreach•  RightsandRe-Use

Besser-Indiana8/30/2019 72

Page 13: Personal born-digital In what environments do we findbesser.tsoa.nyu.edu/howard/Talks/19indiana-pda.pdf · – Cloud storage for documents (google docs) – Social network services

8/24/19

13

WITNESS:AcIvists’GuidetoArchivingVideo,YvonneNg

hNp://archiveguide.witness.org/

Besser-Indiana8/30/2019 73

CollecIng–ThinkTank

Besser-Indiana8/30/2019 74

ThinkTankmetadataredundancies•  GuidelinessIpulatethatpersonholdingrecordingdevicewillchecktoseethatImeanddatestamparecorrectbeforebeginningrecording(mostlydidn’thappen)

•  GuidelinessIpulatethatascriptbereadverbaImatthebeginningoftherecording,withdate,Ime,proposedsubject,etc.(andwouldeventuallyallowvoice-recogniIonso]waretocreateappropriatemetadata).ScriptalsostatedthatallparIcipantsagreedtoCreaIveCommonslicensingoftherecording

•  Guidelinesrequestedthatdate/Imebeembeddedintheappliedfile-name

Besser-Indiana8/30/2019 75

FindsmartwaystodealwithScale-

Besser-Indiana8/30/2019 76

CollecIngStreamingMediaTheNYUMellonComposersProject

•  TradiIonalWebCrawlers(Heritrix) follow links and capture most web content. But they are less successful with streaming video and dynamic content executed in the browser (like JavaScript).

•  NYU collaborated with IA to create a combined crawler and browser-

Besser-Indiana8/30/2019 77

BROZZLER!

“browser” | “crawler” = BROZZLER

Logo: Noah Levitt 78Complex Works-Dig Preserv, Feb 2019

Page 14: Personal born-digital In what environments do we findbesser.tsoa.nyu.edu/howard/Talks/19indiana-pda.pdf · – Cloud storage for documents (google docs) – Social network services

8/24/19

14

79Complex Works-Dig Preserv, Feb 2019

StreamcapturereliesonYoutube-dlhNps://rg3.github.io/youtube-dl/supportedsites.html

80Complex Works-Dig Preserv, Feb 2019

TamimentYouTubecollecIng

•  TamimentArchivewasselecIvelybrowsingthroughYouTubeOccupyvideos,tryingtochoosewhichonestokeep,thencatalogingthemwith–  Title,Creator,CreaIonDate,UploadDate,DescripIon,URL,YoutubeUsername,License,Format,Codec,SourceMedia,OnInternetArchive,CCLicensetype

•  Buttheydidn’trealizethatthiswouldn’tscale!

Besser-Indiana8/30/2019 81

March24,2012YouTubestats(just6monthsa]erstartofmovement)

•  “#Occupy”169,000•  “OccupyWallStreet”98,400•  “OccupyProtest”70,500•  “OccupyMovement”54,800•  “#OWS”50,300•  “OccupyOakland”13,400•  “Zuco}Park”6,690

Besser-Indiana8/30/2019 82

AlternaIveapproachtoYouTubeSelecIonprocess

•  DevelopcategoriesofimportantYouTubevideos– Celebrityvisits,Internalworkings(library,kitchen,media),ConfrontaIonswithpolice,Labor,Housing,etc.

•  HaveOccupiersfillinanonlineformlisIngthe5mostimportantvideosineachcategory

Besser-Indiana8/30/2019 83

AdvantagesofYouTubeCollaboraIveFilteringSelecIonProcess

•  Scalableandmanageable•  ConsistentwithOccupyideasofinclusivenessandofmanagingownstory

•  TamimentcansIllchoosetobeselecIveincollecIngonlyaporIonofwhatisvotedin,butthetotalsetforreviewisamanageablescale

Besser-Indiana8/30/2019 84

Page 15: Personal born-digital In what environments do we findbesser.tsoa.nyu.edu/howard/Talks/19indiana-pda.pdf · – Cloud storage for documents (google docs) – Social network services

8/24/19

15

HandlePrivacy&Securityresponsibly-

Besser-Indiana8/30/2019 85

“Inaneffortto

todevelopmethodologyandanapproachandwillredacttheemailaddressesorotherpersonallyidenIfiableinformaIonfrombroadpublicpresentaIon.”Formoreseelibrary.ucla.edu/service/scl/rights-toolkit

UCLA Deed of Gift template

Besser-Indiana8/30/2019 86

PromoIngPrivacyProtecIonExamplefromWITNESS

•  “ObscuraCamisavisualprivacyappforphotoandvideo,thatgivesyouthepowertobeNerprotecttheidenItyofthosecapturesinyourphotos,beforeyoupostthemonline”

•  DevelopedbyGuardianProjectinconjuncIonw/HumanRightsgroupWITNESS-

Besser-Indiana8/30/2019 87

ObscuraCam

Besser-Indiana8/30/2019 88

DiscussissuesaroundcommercialserviceswithCreators/Recorders-

•  DisappearanceofembeddedmetadatafromYouTube&Vimeo

•  MoregeneralRightsissues•  GivearchivestheIPrighttodownload

Besser-Indiana8/30/2019 89

Studyofmetadatalossthroughuploadingtoservices

Besser-Indiana8/30/2019 90

Page 16: Personal born-digital In what environments do we findbesser.tsoa.nyu.edu/howard/Talks/19indiana-pda.pdf · – Cloud storage for documents (google docs) – Social network services

8/24/19

16

Evenwithgoodrecords,RightsIssuesremain1999WTOSeaNleProtest20thanniversaryVideoPreservaIon

Besser-Indiana8/30/2019 91

Evenwithgoodrecords,RightsIssuesremain1999WTOSeaNleProtest20thanniversaryVideoPreservaIon

Besser-Indiana8/30/2019 92

Evenwithgoodrecords,RightsIssuesremain1999WTOSeaNleProtest20thanniversaryVideoPreservaIon

Besser-Indiana8/30/2019 93

YouTubeUserAgreement

•  5B“YoushallnotdownloadanyContentunlessyouseea‘download’orsimilarlinkdisplayedbyYouTubeontheServiceforthatContent.”

Besser-Indiana8/30/2019 94

CreaIveCommonsGuidance•  CreaIveCommonsletsyoumix-and-matchfourdifferent

condiIons:–  ANribuIon:Youletotherscopy,re-useanddistributeyourvideo,butthey

mustcredityou.–  Share-Alike:Youletotherscopy,re-useanddistributeyourvideo,onlyifthey

dothesamewiththeworktheycreate.–  Non-Commercial:Youletotherscopy,re-useanddistributeyourvideofor

non-commercialpurposesonly.–  NoDerivaIveWorks:Youletotherscopyanddistributeyourvideo,butnotto

createnewworksusingit.•  YoucanusethesecondiIonsindifferentcombinaIonstoshareyourwork

inacontrolledway.CreaIveCommonslicensesarelegaltoolsthatdependonpre-exisIngcopyrightlaws.HavingaCreaIveCommonslicenseonyourworkmaygiveyoulegalrecourse,butitmaynotactuallypreventpeoplefromdownloadingandre-usingyourvideoillegally.

Besser-Indiana8/30/2019 95

MarkingCreaIveCommonslicenses•  ThereareafewwaystomarkyourvideowithaCreaIveCommons

license.OnewayistoincludeaCreaIveCommons“bumper”ortextcardinyourvideo.CreaIveCommonshascreatedsomewithgraphicsthatyoucandownloadfromtheirwebsite.Thismethodisusefulifyourvideoisgoingtobesharedoffline(e.g.onDVD,livescreenings),asthelicenseinformaIonisaNachedtothevideoitself.

•  AnotherwaytomarkyourvideowithaCreaIveCommonslicenseistopublishyourvideoonplapormsthatareCreaIveCommons-enabled,suchasYouTube,Vimeo,orInternetArchive.Theseplapormsallowyoutoeasilyselectalicenseduringtheuploadprocess.Thismethodisusefulbecausethelicenseismachine-readable.Asearchengine,forexample,candetectthelicense.

Besser-Indiana8/30/2019 96

Page 17: Personal born-digital In what environments do we findbesser.tsoa.nyu.edu/howard/Talks/19indiana-pda.pdf · – Cloud storage for documents (google docs) – Social network services

8/24/19

17

TipsforArchivistsonOutreachtoCommuniIes

•  Buildtrust•  Speakintheirlanguage(notarchive-speak)•  IdenIfywaysyoucanmeetneedstheyalreadyperceive

•  ApproachprojectsascollaboraIonwheneverpossible

•  Don’tonlyfocusoncontentandmetadata,butalsorightsthatcanbeanimpedimenttopreservaIon

Besser-Indiana8/30/2019 97

OtherProjectstomonitor

•  DocumenIngtheNowhNps://www.docnow.io/

•  InternaIonalDigitalEphemeraProjecthNp://idep.library.ucla.edu/

Besser-Indiana8/30/2019 98

RemainingAppliedResearchQuesIons

•  HowdodealwithScalewiththetsunamiofborn-digitalcontent(appraisal,descripIon,discovery,workflow,…)

•  HowtoavoidourcollecIonsconInuingtoreflecttheworldoftherich,well-known,andpowerful

•  BeNermethodsforcollecIngsocialmedia•  TensionbtwnpreservaIon&privacy(&handlingmassiveamountsofredacIon)

•  ImprovingpublicpolicyandTOSinareaslikeIP,privacy,andwhathappensupondeath

Besser-Indiana8/30/2019 99 Besser-Indiana8/30/2019

•  hNp://besser.tsoa.nyu.edu/howard/Talks•  hNp://idep.library.ucla.edu/•  hNp://acIvist-archivists.org/(useWayback)•  hNps://www.facebook.com/AcIvistArchivists/•  hNps://archive.org/details/personaldigitalarchiving•  hNp://www.docnow.io/•  hNp://blogs.loc.gov/digitalpreservaIon/2015/08/report-on-the-personal-digital-

archiving-2015-conference/

TheChallengesofArchivingPersonal,Community,&Event-basedBorn-Digital

material

100

TheChallengesofArchivingPersonal,Community,&Event-basedBorn-Digitalmaterial

Besser-Indiana8/30/2019 101