institutional repositories 17-19 july 2007 digital curation creating, managing and preserving...

Institutional Repositories 17-19 July 2007

DIGITAL CURATION creating, managing and preserving digital objects

Dr D PetersDISA

Digital Innovation South Africa

Topics

What is digital curation?

Curating digital objects Digital repository functions Role of metadata in digital preservation

Information density vs. life expectancy

Paul Conway, School for Scanning, Chicago, 1999

Future scenario

Where will our descendents find today’s information - in 50 years time?

In what media will it be presented?

What must happen in the space/ time between creation and presentation?

Chain of preservation Authenticity

Committing to storage Maintaining in storage Retrieval Presentation

Transmission Over time and across

technologies Technological approaches Archival practice

What is digital curation?

Digital Curation: lifecycle

Paradigm shift

Preserve an electronic record?

Software translation Beyond safe storage Future representation of components

What is a Digital Information Object ?

METADATA

DATA

Representation Information

Strategies for digital preservation Research agenda

Archival systems Methods and tools Policy and legal framework

Education and training Advocacy workshops Develop suitable educational qualifications Operational training in digital curation

Centre of excellence Third party service provider: commercial / consortial Lead a shared community of practice Trusted digital repository

What is a digital repository?

Digital Repository

Business model for sustainability Agreements with participants Appropriate technological infrastructure Production-level archiving system Define trusted archiving service model

Attributes of a Trusted Digital Repository

“…an organisation that has responsibility for the long-term maintenance of digital resources, as well as making them available [through time and across changing technologies] to communities agreed on by the depositor and the repository.”

Research Libraries Group

http://www.rlg.org/longterm/attributes01.pdf

Trusted Digital Repository

Administrative responsibility Organisational viability Financial sustainability Technological suitability System security Procedural accountability

OAIS Information Model

SIP = Submission Information PackageAIP = Archive In formation PackageDIP = Dissemination Information Package

Functions of Ingest

Level Metadata Authors Names

Projects Theses Publications Datasets

L0

L1

L2

L3

L4

UStellenbosch Access Model

No Access

Access

To be confirmed

View by owner

The role of metadata in digital preservation?

Metadata and Digital Preservation

Metadata is the glue of any digital preservation strategy:

Within a digital repository, “metadata accompanies and makes reference to each digital object and provides associated descriptive, structural, administrative, rights management, and other kinds of information.”

Clifford Lynch (D-Lib Magazine, 1999)

Preservation Metadata

Viability bit stream is intact and readable from digital storage media

Renderability translation of the bit stream into a form that can be viewed by

humans, or processed by computers Understandability

providing enough information that the rendered content can be interpreted and understood by users

PREMIS Metadata Framework to support the preservation of digital objects

http://www.oclc.org/research/projects/pmwg/pm_framework.pdf

Creating the Wrapper Metadata Encoding & Transmission Standard (METS)

Digital Library Federation-sponsored initiative XML document format for encoding metadata necessary for

management of digital library objects within a repository exchange of such objects between repositories (or between

repositories and their users).

METS & Digital Preservation

As a vehicle to express/contain various types of metadata Descriptive, administrative, structural, rights, technical

As a vehicle/wrapper for information and digital repository management OAIS (SIP, AIP, DIP)

Like Nesting Dolls

General FrameworksCedarsOCLC/RLG

DescriptiveMARC Dublin CoreOpenURLOAIONIX

Archive PackagingMETSAIP

StructuralDataDataDataRepresentationInfo

AdministrativeRightsTechnical (NISO, ViDE, etc.)

Content Management Systems General Requirements

Handle repository functions Representation Structural organisation Aggregation Networked distribution

Preservation Requirements Defined preservation strategy Metadata support Integrity checks

D-Space

MySQL

Fedora

Review

What is digital curation?

Preserving digital objects Digital repository functions Role of metadata in digital preservation Legal rights management

Sneak Preview…

Normalising to open formats - open standards. XML schema for preservation - metadata and where to put

it. Identifying data format types programmatically. Normaliser and file namer plugin architecture…well, maybe. Integration with 3rd party software applications (e.g.

DSpace, Fedora, Eprints)

More information…

PADI Preservation Metadata Bibliography:http://www.nla.gov.au/padi/topics/32.html

PREMIS: http://www.oclc.org/research/projects/pmwg/ JHOVE: http://hul.harvard.edu/jhove/jhove.html PRONOM: http://www.nationalarchives.gov.uk/pronom/ OAIS: http://ssdoo.gsfc.nasa.gov/nost/wwwclassic/documents/

pdf/CCSDS-650.0-B-1.pdf METS: http://www.loc.gov/standards/mets/

petersd@ukzn.ac.za

DISA: Digital Imaging South Africa

http://disa.nu.ac.za

                                           Attribution-NonCommercial-ShareAlike 2.0 South AfricaYou are free:•to copy, distribute, display, and perform the work •to make derivative works Under the following conditions:

Attribution. You must attribute the work in the manner specified by the author or licensor.

                 Noncommercial. You may not use this work for commercial purposes.

Share Alike. If you alter, transform, or build upon this work, you may distribute the resulting work only under a license identical to this one.

•For any reuse or distribution, you must make clear to others the license terms of this work. •Any of these conditions can be waived if you get permission from the copyright holder.

Your fair use and other rights are in no way affected by the above.