hub and spoke tool suite premis implementation fair – 7 october 2009 bill ingram visiting research...

HUB AND SPOKE TOOL SUITE

PREMIS Implementation Fair – 7 October 2009

Bill IngramVisiting Research ProgrammerUniversity of Illinois at Urbana-Champaign

Background on Hub & Spoke NDIIPP funded Began as repository evaluation – DSpace,

Fedora, EPrints, and Greenstone – against an OAIS-based checklist.

The need arose to build a software test bed to evaluate multiple repository systems with common test data.

Hub & Spoke tool suite was a natural outcome of the work that went into developing the test bed for repository evaluation.

2

Digital Repository Interoperability

3

METS-based profile, non-prescriptive with regard to file format or structure, but with special attention given to preservation and technical metadata.

Hub & Spoke METS Profile4

METS Profile – Focus on Preservation

dmdSec

dmdSec

amdSec

amdSec

techMD

techMD

digiprovMD

digiprovMD

rightsMD

rightsMD

primary

primaryalternate

alternate

METS MOD

S

DC, etc

PREMIS

Object

MIX, AudioMD

, VideoMD

PREMIS

Rights

PREMIS

AgentPREM

IS Even

t

5

Functional Overview / Workflow

Validation

Bitstream Verification

Profile Validation

Repository B

Technical Metadata

Augmentation

XSLT

TechMDAugmenter

JHOVE

LRCRUD

Web Service Client

Web Service

Repository A

To Hub Packag

erH&S METS

Construction

DescriptiveMetadataMigration

From Hub

PackagerRepository

PackageConstruction

DescriptiveMetadataMigration

LRCRUD

Web Service Client

Web Service

REST

REST

6

LRCRUD Client & Service

RESTful Web service API for repositories Client integrated into Hub and Spoke tools Support for DSpace, EPrints, and Fedora Specification and API for extending the

tools for other repositories

Lightweight Repository Create/Retrieve/Update/Delete

LRCRUD

Client

LRCRUD

Client

LRCRUD

Service

LRCRUD

Service

RepositoryRepository-

specific calls

REST Calls Create/Retrieve/Update/Del

ete

SIP Hub & Spoke Tools

7

To Hub Packager

Creates Hub and Spoke object from repository DIPs or from scratch, given content files and metadata

Support for DSpace, EPrints, and Fedora Extendable plug-in architecture for creating

new packagers

To Hub Packag

er

To Hub Packag

er

Hub PackageRepository DIP

8

Descriptive Metadata

MARCXML

MARCXML MODSMODS DCDCT T

PREMIS Event: 'METADATA_TRANSFORMATION'

Descriptive metadata is part of the representation, not just about the representation

Format conversions expressed as PREMIS Events MODS (required) as primary dmdSec All others as alternate dmdSec – including

intermediate formats

9

Technical Metadata

METS

METS JHOVEJHOVE

XSLT

XSLT

Format-Specific TechMD

Format-Specific TechMD

Custom

Code

Custom

Code

PREMISObjectPREMISObject

PREMIS Event: 'METADATA_CREATION'

10

From Hub Packager

Creates repository SIPs from a Hub Package Support for DSpace, EPrints, and Fedora Additional packagers for Bagit and SWORD Extendable plug-in architecture for creating

new packagers

From Hub

Packager

From Hub

Packager

Hub Package Repository SIP

11

Technical Architecture (Java)

DSpaceDSpace FedoraFedora Repo XRepo X

LRCRUD ServiceLRCRUD ServiceDSpace LRCRUDDSpace LRCRUD

Fedora LRCRUDFedora

LRCRUDRepo X LRCRUDRepo X LRCRUD

LRCRUD ClientLRCRUD Client

JHOVEJHOVEH&S TechMD AugmenterH&S TechMD Augmenter

DSpace PackagerDSpace

PackagerFedora

PackagerFedora

PackagerRepo X

PackagerRepo X

PackagerPackagers

Apache XML BeansApache XML BeansHub & Spoke METS APIHub & Spoke METS API

12

Links

Project Home Pagehttp://dli.grainger.uiuc.edu/echodep/hands/

Hub and Spoke METS Profilehttp://www.loc.gov/standards/mets/profiles/00000015.html

DLF Aquifer MODS Profilehttps://wiki.dlib.indiana.edu/confluence/download/attachments/24288/DLFMODS_ImplementationGuidelines.pdf

13

Thanks!

Bill Ingram Grainger Engineering Library Information

Center University of Illinois at Urbana Champaign wingram2@illinois.edu http://dli.grainger.uiuc.edu/echodep/hands/

14