PowerPoint Presentation
01100100 01101001 01100111 01101001 01110100 01100001 01101100 00100000 01110000 01110010 01100101 01110011 01100101 01110010 01110110 01100001 01110100 01101111 01101110
THE LEVELS OF DIGITAL PRESERVATIONA NATIONAL DIGITAL STEWARDSHIP ALLIANCE PROJECTJEFFERSON BAILEY, @jefferson_bailNDSA INNOVATION WORKING GROUP CO-CHAIRALA Digital Preservation Interest Group, 2013-06-30Upstairs, by Jo Szczepanska, from The Noun Project01100100 01101001 01100111 01101001 01110100 01100001 01101100 00100000 01110000 01110010 01100101 01110011 01100101 01110010 01110110 01100001 01110100 01101111 0110111001100100 01101001 01100111 01101001 01110100 01100001 01101100 00100000 01110000 01110010 01100101 01110011 01100101 01110010 01110110 01100001 01110100 01101111 01101110About the NDSAThe Levels: Goals & IntentThe Levels: In briefThe Levels: In detailEarly feedbackYour feedback!THE LEVELS: THIS PRESENTATION
Upstairs, by Jo Szczepanska, from The Noun Project01100100 01101001 01100111 01101001 01110100 01100001 01101100 00100000 01110000 01110010 01100101 01110011 01100101 01110010 01110110 01100001 01110100 01101111 0110111001100100 01101001 01100111 01101001 01110100 01100001 01101100 00100000 01110000 01110010 01100101 01110011 01100101 01110010 01110110 01100001 01110100 01101111 01101110The mission of the National Digital Stewardship Alliance is to establish, maintain, and advance the capacity to preserve our nations digital resources for the benefit of present and future generations.
Started in July 2010 by Library of Congress, NDIIPP
Has 160+ members; free to join & all-volunteer
Features a diverse range of institutions and sizes
Organized in 5 Working Groups: Innovation, Infrastructure, Content, Standards, Outreach
http://www.digitalpreservation.gov/ndsa/THE NDSA: ABOUT01100100 01101001 01100111 01101001 01110100 01100001 01101100 00100000 01110000 01110010 01100101 01110011 01100101 01110010 01110110 01100001 01110100 01101111 0110111001100100 01101001 01100111 01101001 01110100 01100001 01101100 00100000 01110000 01110010 01100101 01110011 01100101 01110010 01110110 01100001 01110100 01101111 01101110THE NDSA: ACTIVITIESStorage Survey & Staffing SurveyWeb Archiving reportAnnual Innovation AwardsContent Case Studies (geospatial, citizen journalism, etc)WikiProjectKickstarter featured projectsWebinars on OSSInnovation Interview SeriesThese Levels!http://www.digitalpreservation.gov/ndsa/activities01100100 01101001 01100111 01101001 01110100 01100001 01101100 00100000 01110000 01110010 01100101 01110011 01100101 01110010 01110110 01100001 01110100 01101111 0110111001100100 01101001 01100111 01101001 01110100 01100001 01101100 00100000 01110000 01110010 01100101 01110011 01100101 01110010 01110110 01100001 01110100 01101111 01101110Simple guidance to help institutions of any type and size mitigate the risks to digital content
Basic assistance for planning and undertaking digital preservation activities
Content and resource agnostic
Evolving document of community-accepted minimums for digital stewardship
To be usedTHE LEVELS: GOALS01100100 01101001 01100111 01101001 01110100 01100001 01101100 00100000 01110000 01110010 01100101 01110011 01100101 01110010 01110110 01100001 01110100 01101111 0110111001100100 01101001 01100111 01101001 01110100 01100001 01101100 00100000 01110000 01110010 01100101 01110011 01100101 01110010 01110110 01100001 01110100 01101111 01101110NDSA Supergroup: Abbie Grotke (Library of Congress), Amy Kirchhoff (ITHAKA), Kris Klein (California State Library), Jane Mandelbaum (Library of Congress), Shawn Rounds (Minnesota Historical Society), Robin Ruggaber (University of Virginia) and Linda Tadic (Audiovisual Archive Network), Trevor Owens (Library of Congress), Andrea Goethels (Harvard University), Meg Phillips (NARA), me
Community-development
Blog posts on NDIIPP blog, The SignalTHE LEVELS: ORIGINS01100100 01101001 01100111 01101001 01110100 01100001 01101100 00100000 01110000 01110010 01100101 01110011 01100101 01110010 01110110 01100001 01110100 01101111 0110111001100100 01101001 01100111 01101001 01110100 01100001 01101100 00100000 01110000 01110010 01100101 01110011 01100101 01110010 01110110 01100001 01110100 01101111 01101110Concepts & process areas
Accepted best practices & validation
Baseline considerations, boxes off the floor
Progressive, accessible scalability
Functional independenceTHE LEVELS: WHAT THEY COVER01100100 01101001 01100111 01101001 01110100 01100001 01101100 00100000 01110000 01110010 01100101 01110011 01100101 01110010 01110110 01100001 01110100 01101111 0110111001100100 01101001 01100111 01101001 01110100 01100001 01101100 00100000 01110000 01110010 01100101 01110011 01100101 01110010 01110110 01100001 01110100 01101111 01101110THE LEVELS: WHAT THEY DONT COVERTechnology:
InfrastructureHardware, softwareTech ownership
Activity:
BudgetingProject Management
Policy:
Scope of CollectingStandards & WorkflowsStaffing
Elasticity:
Vendor lock, systems, OSSData I/OInstitutional change/knowledge
01100100 01101001 01100111 01101001 01110100 01100001 01101100 00100000 01110000 01110010 01100101 01110011 01100101 01110010 01110110 01100001 01110100 01101111 0110111001100100 01101001 01100111 01101001 01110100 01100001 01101100 00100000 01110000 01110010 01100101 01110011 01100101 01110010 01110110 01100001 01110100 01101111 01101110Identify consensus of best practices
Bootstrapping
Self Assessment
Strategic Planning
Institutional advocacy
A roadmap & a starting point
THE LEVELS: USES01100100 01101001 01100111 01101001 01110100 01100001 01101100 00100000 01110000 01110010 01100101 01110011 01100101 01110010 01110110 01100001 01110100 01101111 0110111001100100 01101001 01100111 01101001 01110100 01100001 01101100 00100000 01110000 01110010 01100101 01110011 01100101 01110010 01110110 01100001 01110100 01101111 01101110FOUR LEVELSLevel 1 Protect your dataLevel 2 Know your dataLevel 3 Monitor your dataLevel 4 Repair your data
FIVE ACTIVITY AREASStorage & Geographic LocationFile Fixity & Data IntegrityInformation SecurityMetadataFile Formats
From Bit-level Preservation to Long-term StewardshipTHE LEVELS: STRUCTURE01100100 01101001 01100111 01101001 01110100 01100001 01101100 00100000 01110000 01110010 01100101 01110011 01100101 01110010 01110110 01100001 01110100 01101111 01101110THE LEVELS: THE LEVELSLevel 1 (Protect your data)Level 2 (Know your data)Level 3 (Monitor your data)Level 4 (Repair your data)Storage and
Geographic
Location- Two complete copies that are not collocated- For data on heterogeneous media (optical discs, hard drives, etc.) get the content off the medium and into your storage system- At least three complete copies- At least one copy in a different geographic location- Document your storage system(s) and storage media and what you need to use them- At least one copy in a geographic location with a different disaster threat- Obsolescence monitoring process for your storage system(s) and media- At least three copies in geographic locations with different disaster threats- Have a comprehensive plan in place that will keep files and metadata on currently accessible media or systemsFile Fixity
and Data
Integrity- Check file fixity on ingest if it has been provided with the content- Create fixity info if it wasnt provided with the content- Check fixity on all ingests- Use write-blockers when working with original media- Virus-check high risk content- Check fixity of content at fixed intervals- Maintain logs of fixity info; supply audit on demand- Ability to detect corrupt data- Virus-check all content- Check fixity of all content in response to specific events or activities- Ability to replace/repair corrupted data- Ensure no one person has write access to all copiesInformation
Security- Identify who has read, write, move and delete authorization to individual files- Restrict who has those authorizations to individual files- Document access restrictions for content- Maintain logs of who performed what actions on files, including deletions and preservation actions- Perform audit of logsMetadata- Inventory of content and its storage location- Ensure backup and non-collocation of inventory- Store administrative metadata- Store transformative metadata and log events- Store standard technical and descriptive metadata- Store standard preservation metadataFile Formats- When you can give input into the creation of digital files encourage use of a limited set of known open formats and codecs- Inventory of file formats in use- Monitor file format obsolescence issues- Perform format migrations, emulation and similar activities as neededStorage and Geographic LocationLevel 1Protect your dataLevel 2Know your dataLevel 3Monitor your dataLevel 4Repair your dataTwo complete copies that are not collocated
For data on heterogeneous media (optical discs, hard drives, etc.) get the content off the medium and into your storage systemAt least three complete copies
At least one copy in a different geographic location
Document your storage systems(s) and storage media and what you need to use themAt least one copy in a geographic location with a different disaster threat
Obsolescence monitoring for your storage system(s) and mediaAt least three copies in geographic locations with different disaster threats
Have a comprehensive plan in place that will keep files and metadata on currently accessible media or systemsTHE LEVELS: THE LEVELSStorage and Geographic Location01100100 01101001 01100111 01101001 01110100 01100001 01101100 00100000 01110000 01110010 01100101 01110011 01100101 01110010 01110110 01100001 01110100 01101111 0110111012Storage and Geographic LocationTHE LEVELS: THE LEVELSFile Fixity and Data IntegrityLevel 1Protect your dataLevel 2Know your dataLevel 3Monitor your dataLevel 4Repair your dataCheck file fixity on ingest if it has been provided with the content
Create fixity info if it wasnt provided with the contentCheck fixity on all ingests
Use write-blockers when working with original media
Virus-check high risk contentCheck fixity of content at fixed intervals
Maintain logs of fixity info; supply audit on demand
Ability to detect corrupt data
Virus-check all contentCheck fixity of all content in response to specific events or activities
Ability to replace/repair corrupted data
Ensure no one person has write access to all copies01100100 01101001 01100111 01101001 01110100 01100001 01101100 00100000 01110000 01110010 01100101 01110011 01100101 01110010 01110110 01100001 01110100 01101111 0110111013THE LEVELS: THE LEVELSInformation SecurityLevel 1Protect your dataLevel 2Know your dataLevel 3Monitor your dataLevel 4Repair your dataIdentify who has read, write, move and delete authorization to individual files
Restrict who has those authorizations to individual filesDocument access restrictions for contentMaintain logs of who performed what actions on files, including deletions and preservation actionsPerform audit of logs01100100 01101001 01100111 01101001 01110100 01100001 01101100 00100000 01110000 01110010 01100101 01110011 01100101 01110010 01110110 01100001 01110100 01101111 0110111014Storage and Geographic LocationTHE LEVELS: THE LEVELSMetadataLevel 1Protect your dataLevel 2Know your dataLevel 3Monitor your dataLevel 4Repair your dataInventory of content and its storage location
Ensure backup and non-collocation of inventoryStore administrative metadata
Store transformative metadata and log eventsStore standards technical and descriptive metadataStore standard preservation metadata01100100 01101001 01100111 01101001 01110100 01100001 01101100 00100000 01110000 01110010 01100101 01110011 01100101 01110010 01110110 01100001 01110100 01101111 0110111015Storage and Geographic LocationTHE LEVELS: THE LEVELSFile FormatsLevel 1Protect your dataLevel 2Know your dataLevel 3Monitor your dataLevel 4Repair your dataWhen you can give input into the creation of digital files, encourage use of a limited set of known open formats and codecsInventory of file formats in useMonitor file format obsolescence issuesPerform format migrations, emulation and similar activities as needed01100100 01101001 01100111 01101001 01110100 01100001 01101100 00100000 01110000 01110010 01100101 01110011 01100101 01110010 01110110 01100001 01110100 01101111 0110111016Storage and Geographic LocationTHE LEVELS: THE LEVELSLevel 1Storage & Geographic LocationFile Fixity & Data IntegrityInformation SecurityMetadataFile Formats- Two complete copies that are not collocated- For data on heterogeneous media (optical discs, hard drives, etc.) get the content off the medium and into your storage system - Check file fixity on ingest if it has been provided with the content- Create fixity info if it wasnt provided with the content- Identify who has read, write, move and delete authorization to individual files- Inventory of content and its storage location- When you can give input into the creation of digital files encourage use of a limited set of known open formats and codecs01100100 01101001 01100111 01101001 01110100 01100001 01101100 00100000 01110000 01110010 01100101 01110011 01100101 01110010 01110110 01100001 01110100 01101111 01101110
17Storage and Geographic LocationTHE LEVELS: THE LEVELSLevel 2Storage & Geographic LocationFile Fixity & Data IntegrityInformation SecurityMetadataFile Formats- At least three complete copies- At least one copy in a different geographic location- Document your storage system(s) and storage media and what you need to use them- Check fixity on all ingests- Use write-blockers when working with original media- Virus-check high risk content - Document access restrictions for content - Store administrative metadata- Store transformative metadata and log events - Inventory of file formats in use
01100100 01101001 01100111 01101001 01110100 01100001 01101100 00100000 01110000 01110010 01100101 01110011 01100101 01110010 01110110 01100001 01110100 01101111 0110111018Storage and Geographic LocationTHE LEVELS: THE LEVELSLevel 3Storage & Geographic LocationFile Fixity & Data IntegrityInformation SecurityMetadataFile Formats- At least one copy in a geographic location with a different disaster threat-Obsolescence monitoring process for your storage system(s) and media - Check fixity of content at fixed intervals- Maintain logs of fixity info; supply audit on demand- Ability to detect corrupt data- Virus-check all content - Maintain logs of who performed what actions on files, including deletions and preservation actions - Store standard technical and descriptive metadata- Monitor file format obsolescence issues 01100100 01101001 01100111 01101001 01110100 01100001 01101100 00100000 01110000 01110010 01100101 01110011 01100101 01110010 01110110 01100001 01110100 01101111 01101110
19Storage and Geographic LocationTHE LEVELS: THE LEVELSLevel 4Storage & Geographic LocationFile Fixity & Data IntegrityInformation SecurityMetadataFile Formats- At least three copies in geographic locations with different disaster threats- Have a comprehensive plan in place that will keep files and metadata on currently accessible media or systems - Check fixity of all content in response to specific events or activities- Ability to replace/repair corrupted data- Ensure no one person has write access to all copies - Perform audit of logs- Store standard preservation metadata - Perform format migrations, emulation and similar activities as needed 01100100 01101001 01100111 01101001 01110100 01100001 01101100 00100000 01110000 01110010 01100101 01110011 01100101 01110010 01110110 01100001 01110100 01101111 01101110
2001100100 01101001 01100111 01101001 01110100 01100001 01101100 00100000 01110000 01110010 01100101 01110011 01100101 01110010 01110110 01100001 01110100 01101111 0110111001100100 01101001 01100111 01101001 01110100 01100001 01101100 00100000 01110000 01110010 01100101 01110011 01100101 01110010 01110110 01100001 01110100 01101111 01101110THE LEVELS: EARLY FEEDBACK
Dramatic Chipmunk, via YouTube user cregets01100100 01101001 01100111 01101001 01110100 01100001 01101100 00100000 01110000 01110010 01100101 01110011 01100101 01110010 01110110 01100001 01110100 01101111 01101110THE LEVELS: PRIMARY FEEDBACK AREASLevel 1 (Protect your data)Level 2 (Know your data)Level 3 (Monitor your data)Level 4 (Repair your data)Storage and
Geographic
Location- Two complete copies that are not collocated- For data on heterogeneous media (optical discs, hard drives, etc.) get the content off the medium and into your storage system- At least three complete copies- At least one copy in a different geographic location- Document your storage system(s) and storage media and what you need to use them- At least one copy in a geographic location with a different disaster threat- Obsolescence monitoring process for your storage system(s) and media- At least three copies in geographic locations with different disaster threats- Have a comprehensive plan in place that will keep files and metadata on currently accessible media or systemsFile Fixity
and Data
Integrity- Check file fixity on ingest if it has been provided with the content- Create fixity info if it wasnt provided with the content- Check fixity on all ingests- Use write-blockers when working with original media- Virus-check high risk content- Check fixity of content at fixed intervals- Maintain logs of fixity info; supply audit on demand- Ability to detect corrupt data- Virus-check all content- Check fixity of all content in response to specific events or activities- Ability to replace/repair corrupted data- Ensure no one person has write access to all copiesInformation
Security- Identify who has read, write, move and delete authorization to individual files- Restrict who has those authorizations to individual files- Document access restrictions for content- Maintain logs of who performed what actions on files, including deletions and preservation actions- Perform audit of logsMetadata- Inventory of content and its storage location- Ensure backup and non-collocation of inventory- Store administrative metadata- Store transformative metadata and log events- Store standard technical and descriptive metadata- Store standard preservation metadataFile Formats- When you can give input into the creation of digital files encourage use of a limited set of known open formats and codecs- Inventory of file formats in use- Monitor file format obsolescence issues- Perform format migrations, emulation and similar activities as needed01100100 01101001 01100111 01101001 01110100 01100001 01101100 00100000 01110000 01110010 01100101 01110011 01100101 01110010 01110110 01100001 01110100 01101111 0110111001100100 01101001 01100111 01101001 01110100 01100001 01101100 00100000 01110000 01110010 01100101 01110011 01100101 01110010 01110110 01100001 01110100 01101111 01101110Next Steps:Community FeedbackRelease Candidate One is liveNext Iterations Late Summer
Your Feedback:Clarity?Usability?Levels and Activity Areas?Additions?THE LEVELS: NEXT STEPS & FEEDBACK01100100 01101001 01100111 01101001 01110100 01100001 01101100 00100000 01110000 01110010 01100101 01110011 01100101 01110010 01110110 01100001 01110100 01101111 01101110THE LEVELS OF DIGITAL PRESERVATIONA NATIONAL DIGITAL STEWARDSHIP ALLIANCE PROJECTLevels of Digital Preservation Resourceshttp://bit.ly/ndsa_levels
NDSA Homepagehttp://www.digitalpreservation.gov/ndsa
