active digital preservation and data/metadata migration
TRANSCRIPT
![Page 1: Active Digital Preservation and Data/Metadata Migration](https://reader034.vdocuments.net/reader034/viewer/2022042707/58ec89781a28abeb058b4621/html5/thumbnails/1.jpg)
Active Digital Preservation
and Data/Metadata
Migration
Nick Ruest, York University Karen Estlund, Penn State University
![Page 2: Active Digital Preservation and Data/Metadata Migration](https://reader034.vdocuments.net/reader034/viewer/2022042707/58ec89781a28abeb058b4621/html5/thumbnails/2.jpg)
Focusing on Movement
![Page 3: Active Digital Preservation and Data/Metadata Migration](https://reader034.vdocuments.net/reader034/viewer/2022042707/58ec89781a28abeb058b4621/html5/thumbnails/3.jpg)
NDSA Preservation Activities
- Check fixity of all content in
response to specific events
or activities
- Ability to replace / repair
computed data
- Ensure no one person...
Store standard
preservation metadata
![Page 4: Active Digital Preservation and Data/Metadata Migration](https://reader034.vdocuments.net/reader034/viewer/2022042707/58ec89781a28abeb058b4621/html5/thumbnails/4.jpg)
Lund, Ken. (2012). Timpanogos Cave National Monument.
https://www.flickr.com/photos/kenlund/7187382348/ CC-BY 2.0
MoabAdventurer. (2010). Cataract Canyon.
https://www.flickr.com/photos/tag-a-long/4818668522/ CC-BY 2.0
Digital Preservation Storage
![Page 5: Active Digital Preservation and Data/Metadata Migration](https://reader034.vdocuments.net/reader034/viewer/2022042707/58ec89781a28abeb058b4621/html5/thumbnails/5.jpg)
PROBLEM STATEMENT
![Page 6: Active Digital Preservation and Data/Metadata Migration](https://reader034.vdocuments.net/reader034/viewer/2022042707/58ec89781a28abeb058b4621/html5/thumbnails/6.jpg)
Repository Migrations
![Page 7: Active Digital Preservation and Data/Metadata Migration](https://reader034.vdocuments.net/reader034/viewer/2022042707/58ec89781a28abeb058b4621/html5/thumbnails/7.jpg)
Connecting Access & Preservation Copies
<institutal_id.item_uid[.b###.of###]>/
| bagit.txt
| manifest-md5.txt
| bag-info.txt
| aptrust-info.txt
\----data/
| [payload files]
![Page 8: Active Digital Preservation and Data/Metadata Migration](https://reader034.vdocuments.net/reader034/viewer/2022042707/58ec89781a28abeb058b4621/html5/thumbnails/8.jpg)
Big Data - Lack of Movement
Federal Communications Center. (2010). Data Center.
https://www.flickr.com/photos/fccdotgov/albums/72157624535788708
![Page 9: Active Digital Preservation and Data/Metadata Migration](https://reader034.vdocuments.net/reader034/viewer/2022042707/58ec89781a28abeb058b4621/html5/thumbnails/9.jpg)
ADDRESSING THE PROBLEMS
![Page 10: Active Digital Preservation and Data/Metadata Migration](https://reader034.vdocuments.net/reader034/viewer/2022042707/58ec89781a28abeb058b4621/html5/thumbnails/10.jpg)
Staffing and Skills Required
● Understanding of issues related to both
digitized and born-digital formats, media,
and migration is required
● METS & PREMIS (metadata standards)
● Fedora, Hydra, Islandora….
● Familiarity with national and international
collaborative digital preservation efforts
● Digital preservation tools such as
BitCurator, Archivematica, Preservica,
BagIT and
● Application of Linked Data URIs in
metadata records
● + all sorts of good standard language
Missing Abilities:
• Ability to communicate and understand networking and data center environments
• Ability to identify metadata necessary to preserve and track data in changing technical environments
• Ability to identify and manage copyright-related concerns for data preservation and metadata management
• Ability to forecast access needs and identify content preservation standards
Current Ads
![Page 11: Active Digital Preservation and Data/Metadata Migration](https://reader034.vdocuments.net/reader034/viewer/2022042707/58ec89781a28abeb058b4621/html5/thumbnails/11.jpg)
Export & Import
![Page 12: Active Digital Preservation and Data/Metadata Migration](https://reader034.vdocuments.net/reader034/viewer/2022042707/58ec89781a28abeb058b4621/html5/thumbnails/12.jpg)
Infrastructure & Local Collaborations Required
Federal Communications Center. (2010). Data Center.
https://www.flickr.com/photos/fccdotgov/albums/72157624535788708
![Page 13: Active Digital Preservation and Data/Metadata Migration](https://reader034.vdocuments.net/reader034/viewer/2022042707/58ec89781a28abeb058b4621/html5/thumbnails/13.jpg)
Open Source Commitment
NASA. A Precocious Black Hole. (2015). https://www.nasa.gov/image-feature/a-precocious-
black-hole
![Page 14: Active Digital Preservation and Data/Metadata Migration](https://reader034.vdocuments.net/reader034/viewer/2022042707/58ec89781a28abeb058b4621/html5/thumbnails/14.jpg)
Decision Trees – Where to Preserve & How to Access*
Preservation Strategy Back-up Local
Preservation
Strategies**
MetaArchive APTrust Digital
Preservation
Network
Research Data X X
ETDs X X
PA unique CHO materials X X X
Purchased content X
High value, at risk unique
materials
X X X
* Draft decision tree
** May include off-site storage
![Page 15: Active Digital Preservation and Data/Metadata Migration](https://reader034.vdocuments.net/reader034/viewer/2022042707/58ec89781a28abeb058b4621/html5/thumbnails/15.jpg)
NEXT STEPS
![Page 16: Active Digital Preservation and Data/Metadata Migration](https://reader034.vdocuments.net/reader034/viewer/2022042707/58ec89781a28abeb058b4621/html5/thumbnails/16.jpg)
What Does Digital Preservation Look Like Now
Federal Communications Commission. (2010). Data Center
https://www.flickr.com/photos/fccdotgov/4808782554/
![Page 17: Active Digital Preservation and Data/Metadata Migration](https://reader034.vdocuments.net/reader034/viewer/2022042707/58ec89781a28abeb058b4621/html5/thumbnails/17.jpg)
Fedora Import/Export
![Page 18: Active Digital Preservation and Data/Metadata Migration](https://reader034.vdocuments.net/reader034/viewer/2022042707/58ec89781a28abeb058b4621/html5/thumbnails/18.jpg)
Background
![Page 19: Active Digital Preservation and Data/Metadata Migration](https://reader034.vdocuments.net/reader034/viewer/2022042707/58ec89781a28abeb058b4621/html5/thumbnails/19.jpg)
Stakeholders
Esmé Cowles, Princeton University
Ben Armintor, Columbia University
Mike Durbin, University of Virginia
Josh Westgard, University of Maryland
Youn Noh, Yale University
Mike Giarlo, Stanford University
Jon Stroop, Princeton University
Karen Estlund, Penn State University
Jim Tuttle, Duke University
![Page 20: Active Digital Preservation and Data/Metadata Migration](https://reader034.vdocuments.net/reader034/viewer/2022042707/58ec89781a28abeb058b4621/html5/thumbnails/20.jpg)
Planning
![Page 21: Active Digital Preservation and Data/Metadata Migration](https://reader034.vdocuments.net/reader034/viewer/2022042707/58ec89781a28abeb058b4621/html5/thumbnails/21.jpg)
Use Cases
![Page 22: Active Digital Preservation and Data/Metadata Migration](https://reader034.vdocuments.net/reader034/viewer/2022042707/58ec89781a28abeb058b4621/html5/thumbnails/22.jpg)
Design
![Page 23: Active Digital Preservation and Data/Metadata Migration](https://reader034.vdocuments.net/reader034/viewer/2022042707/58ec89781a28abeb058b4621/html5/thumbnails/23.jpg)
Requirements
![Page 24: Active Digital Preservation and Data/Metadata Migration](https://reader034.vdocuments.net/reader034/viewer/2022042707/58ec89781a28abeb058b4621/html5/thumbnails/24.jpg)
Requirements
![Page 25: Active Digital Preservation and Data/Metadata Migration](https://reader034.vdocuments.net/reader034/viewer/2022042707/58ec89781a28abeb058b4621/html5/thumbnails/25.jpg)
Requirements
![Page 26: Active Digital Preservation and Data/Metadata Migration](https://reader034.vdocuments.net/reader034/viewer/2022042707/58ec89781a28abeb058b4621/html5/thumbnails/26.jpg)
Sprints
![Page 27: Active Digital Preservation and Data/Metadata Migration](https://reader034.vdocuments.net/reader034/viewer/2022042707/58ec89781a28abeb058b4621/html5/thumbnails/27.jpg)
August, 2016Devs
Esmé Cowles
Ben Arminator
Nick Ruest
Mike Durbin
Testing & ValidationMike Durbin
Josh Westgard
Justin Simpson
Youn Noh
Yinlin Chen
Bethany Seegar
DocumentationYoun Noh
Josh Westgard
![Page 28: Active Digital Preservation and Data/Metadata Migration](https://reader034.vdocuments.net/reader034/viewer/2022042707/58ec89781a28abeb058b4621/html5/thumbnails/28.jpg)
September, 2016
(Penn State)Devs
Esmé Cowles
Nick Ruest
Andrew Woods
Testing & ValidationAdam Wead
Nick Ruest
Andrew Woods
Karen Estlund
DocumentationAdam Wead
Nick Ruest
![Page 29: Active Digital Preservation and Data/Metadata Migration](https://reader034.vdocuments.net/reader034/viewer/2022042707/58ec89781a28abeb058b4621/html5/thumbnails/29.jpg)
December, 2016Devs
Esmé Cowles
Nick Ruest
Jared Whiklo
Danny Bernstein
Testing & ValidationJosh Westgard
Nick Ruest
Kieran Etienne
Adam Wead
Justin Simpson
DocumentationJosh Westgard
Nick Ruest
![Page 30: Active Digital Preservation and Data/Metadata Migration](https://reader034.vdocuments.net/reader034/viewer/2022042707/58ec89781a28abeb058b4621/html5/thumbnails/30.jpg)
Stakeholder evaluation
![Page 31: Active Digital Preservation and Data/Metadata Migration](https://reader034.vdocuments.net/reader034/viewer/2022042707/58ec89781a28abeb058b4621/html5/thumbnails/31.jpg)
Where we’re at now
![Page 32: Active Digital Preservation and Data/Metadata Migration](https://reader034.vdocuments.net/reader034/viewer/2022042707/58ec89781a28abeb058b4621/html5/thumbnails/32.jpg)
Next steps