nu primo – what’s next “what to do with digital objects in primo” igelu 2014 michael north -...

NU Primo – What’s Next“What to do with Digital Objects in

Primo”

IGeLU 2014

Michael North - Sr. Systems Analyst / Programmer Lead, Systems Team

AGENDA

.1. Digital Objects and Digital Collections : What is our Plan ? Why Use Primo ?

.2. Fedora and Primo workflow / Integrated with Blackboard

.3. Fun Item : Dublin Core : Youtube Videos and Blackboard Canvas ???

.4. MODS protocol extract and Ingestion (Winterton Collection)

.5. EAD to Primo (Finding Aids)

.6. METS schema : African Maps Collection

.7. MODS schema : African Posters

.8. LibGuides into Primo

What is our Plan? … ya gotta have a plan !

Heaviest Traffic Blackboard

2nd Heaviest Traffic Library

Fastest Growing Traffic Repositories

= The “sweet spot”Develop integrated solution

ISSUES:Metadata choice ?Repository solution ?Primo Configuration ?

Working with DC Silo’s

Working with Primo

Moving to …… Fedora and Primo

First Hurdle

* All different inside* Consistent Delivery

Why use Primo for Digital Collections Viewing ?

Built-in facet search capability.Boolean search capability

Value of cross collection searching.Facets work (select 2+)Advanced searchingIntegration into other applications (such as Blackboard CMS)

#1 reason: Access points increased (more than one way to find). Entry point for patron into a collection/website they never knew about.

NOTE: Use Primo instead of hiring a team of developers to build a repository website capable of

cross-collection searching ! ! !

Digital Collections Searching And

Cross Collection Searching

NEW : Repository Cross Searching VIEW

Cross Collection Searching

More Options : to facilitate Xsearching

Advanced Search Select specific Digital Collection

Repository Metadata Workflow into Primo So-Far !

EAD/MODS to PNX/Primo (Winterton / Africana Posters)

METS/MODS to PNX/Primo (Africana Maps)

EAD to PNX/Primo (Archon - Finding Aids)

XML to PNX/Primo (LibGuides)

Dublin Core to PNX/Primo (YouTube Videos)

Fedora to Primo Overview

Metadata Schema EAD, MODS, METS, DC, etc.

MODSDatafile

(xml)

PNXDatafile

PNXDB

FEDORA PRIMO

Fedora Objects

Schema Conversions: Convert non-

MODS metadata to MODS xml

files.

Ruby/Rails script with

XSLT

Primo Harvest:XML File Splitter & Harvest

MODS to PNX :

Convert MODS xml files into

single PNX file.


XSLT

Primo BackOffice using basic XML pipe

ITQL or SPARQL query

PIDs file

Fedora Exported

File

Extract Fedora

Metadata: Extract Fedora

Objects Metadata

Schema to xml files.

(mets, dc, ead, etc)

MODS metadata export

Non-MODS metadata export

1

2

2

3

4

5

OR

2 3 5Extract PIDs File:

Use ITQL to create file with

PIDs.

1

4

Add Collection Updates:

Use above procedure – only use the

add_content.rb script.

6

Ruby/Rails script

* 4 Ruby Scripts (export, convert, mods_2_pnx, add_content.rb)* Fedora = modular repository system for management and dissemination of digital content.

* Why do we run 3 scripts ? It will be one script eventually ! ! !

Something Special for our Teaching Faculty

With Primo and Blackboard interoperability

=================

Dublin CoreUse DC to manually add

YouTube Videos for Faculty Classroom use with

Blackboard CMS.

Example: DC record from Faculty Form

PULL E-Shelf folders into Blackboard

Primo E-Shelf Folders built by Faculty Member

PULL feature

E-Shelf Folders in Blackboard Course Documents PageWith additional instructions

* Dynamically linked ! ! !

DYNAMICLinks ! ! !

YouTube VideosHistory

The professor was thrilled.

PUSH feature of Primo/Blackboard interoperability

Side note :We added Primo Searching (and Library Resources) into Blackboard

How the Primo/Bb Project Comes Around "FULL CIRCLE" with our

repository development

• Teachers provide digital objects or request one (NU scanning project). These objects are made available through Primo via "harvesting."

• Teachers pull or push this material into their Blackboard Course Materials pages.

• Students use the material in a classroom environment.

Primo/Blackboard Video’s

YouTube : Northwestern Primo/Blackboard PULL Integration Demo http://youtu.be/dq_C4AAWF2U

YouTube : Northwestern Primo/Blackboard PUSH Integration Demo http://youtu.be/B6rSV4hgy5g

PLEASE USE BOTH LINKS (there are older vids on this site)

http://youtu.be/dq_C4AAWF2U

http://youtu.be/B6rSV4hgy5g

CANVAS ????

Northwestern is moving to Canvas this fall and will no longer be using Blackboard so we are now looking at replicating these features in Canvas, and possible using LTI.

Our next major undertaking ! ! ! !

Blackboard

MODSHarvesting

MODs Primo

(Winterton Collection)

The Winterton Collection (using MODS)

We chose MODS because it lets us document “hierarchical” metadata.

Provenance ! ! !

Important to Special Collections and Archives.

Winteron Case.

Why MODS ?

MODSDatafile

(xml)

PNXDatafile

PNXDB

FEDORA PRIMO

Fedora Objects


XSLT


MODS to PNX :


single PNX file.

Primo BackOffice using file

splitter and basic XML

pipeITQL or SPARQL query

PIDs file

Extract Fedora Metadata:

Extract Fedora Objects

Metadata Schema to xml

files.


1

2

4

5

2 5Extract PIDs File: Use ITQL to create file with PIDs.

1

4XSLTEAD

MODS

EAD/MODS to PNX/PrimoWinterton Collection

Ruby/Rails script

Winterton Process

The Winterton records in Fedora are stored, along with corresponding images, as Fedora Objects. These objects include multiple files including descriptive metadata. The Fedora object (theoretically) might have a tiff file, a jpeg file, a pdf.

First, we created an XSLT script which created the MODS portion of the Fedora objects and these are the record form one sees on the Digital Collections site.

Then we created a Ruby on Rails script that exports the MODS files out of Fedora.

Then we created a Ruby/Rails script that uses an XSLT script that transforms the MODS records into PNX records.

Finally, we ingest the PNX record into using the default XML file splitter and pipe.

Primo Record Discovery – Details Tab

Parent of image

Actual image (item record)

Primo Record Discovery – Online Resource Tab

Actual Photo displayClick on “thumbnail” or image displayed in Online Resource or Details tabs.

Image on parent page

Parent of actual image record (hierarchy provided)Click on the “Link to source in Winterton Collection of East African Photographs” link in the “Online Resource” or “Details” tabs. This will display the parent page of the individual record (shows where the image came from).

Clicking on Component Page provides Picture detail…. Plus metadata for the picture.

So, Why Is This So GREAT ! ! !

This harvesting method incorporates hierarchical metadata into Primo for our collections, and provides another access point for patrons who never knew about the Winterton Collection. So now, patrons can look at the digital object directly in a webpage, or they can go to the Winterton Repository website via Primo and be placed right into the collection website so they can look at other related objects.

EAD Finding Aids (Archon)

into Primo

Metadata Schema: EAD

MODSDatafile

(xml)

PNXDatafile

PNXDB

FEDORA PRIMO

Fedora Objects

Schema Conversions:

Convert non-MODS metadata

to MODS xml files.


XSLT


MODS to PNX :


single PNX file.


XSLT



PIDs file

Fedora Export

File

Extract Fedora


Objects Metadata



1

2

3

4

5



PIDs.

1

4

EAD to PNX/PrimoArchon – Finding Aids

Ruby/Rails script

ARCHON (Finding Aids - publishes archival descriptive information ) EAD

EAD Metadata for the Finding Aids (inventories, indexes or guides)

Archival and Manuscript Collection Portal : Over 400 collections are accessible using EAD Finding Aids

Just listings – indexes – guides - inventories

Getting from here….

To here….

Ingested into Fedora

Archon EAD record

Extract PIDS file from FEDORA using ITQL query

Ruby on Rails script Uses PIDs file to extract the entire EAD record from FEDORA

EAD record extracted from FEDORA

MODS records created from descriptive section of EAD

XSLT script

XSLT script transforms records into PNX data file

Set up pipe and simple normalization rules that copy the PNX data file into Primo

Finding aids in Primo Another ACCESS POINT ! ! !

Metadata Schema: EAD

MODSDatafile

(xml)

PNXDatafile

PNXDB

FEDORA PRIMO

Fedora Objects

Schema Conversions:

Convert non-MODS metadata

to MODS xml files.


XSLT


MODS to PNX :


single PNX file.


XSLT



PIDs file

Fedora Export

File

Extract Fedora


Objects Metadata



1

2

3

4

5



PIDs.

1

4

EAD to PNX/PrimoArchon – Finding Aids

Ruby/Rails script

REVIEW SLIDE ARCHON (Finding Aids)EAD

METS Metadata Schema into

Primo (African Maps)

MODSDatafile

(xml)

PNXDatafile

PNXDB

FEDORA PRIMO


XSLT


MODS to PNX :


single PNX file.




PIDs file

Extract Fedora


Objects Metadata



1

2

4

5


1

4

METS/MODS to PNX/PrimoAfricana Maps Collection

Ruby/Rails script

MODSDC

Africana MapsFedora Objects

METS

Africana Maps Process

In our Fedora Africana Maps Collection, the Fedora Objects contain METS files that function as a wrapper around MODS and Dublin Core metadata. The METS file contains a Description Section that contain MODS metadata and Dublin Core metadata. The MODS and DC metadata was created by using the VB script behind Gary Strawn’s Catalogers Toolkit Program (not the actual program menu itself). .1. In short, MODS and DC metadata is contained within the METS metadata schema. .2. Then, a Ruby/Rails script accesses the MODS metadata (within METS) and creates a MODS XML file.

.3. Then, a Ruby/Rails script is run with an XSLT file, that converts the MODS XML to a PNX file. .4. Using the Primo XML File Splitter, the Africana Maps PNX file is harvested by Primo.

AFRI-MAPS : METS Wrapper with MODS

Primo Record for African Map Collection

View and Zoom in Primo VIEW ONLINE tab

MODS: African

Posters into Primo

MODSDatafile

(xml)

PNXDatafile

PNXDB

FEDORA PRIMO

Fedora Objects

Ruby/Rails script

with XSLT


MODS to PNX :


single PNX file.




PIDs file

Extract Fedora


Objects Metadata



1

2

4

5


1

4XSLTEAD

MODS

EAD/MODS to PNX/PrimoAfrican Posters Collection

Ruby/Rails script

Image appears in the Primo Online Resource tab

Linking takes the user to the image inside the Collection website (new “access”)

LibGuides into

Primo

LibGuides into Primo

LibGuides records Send link

that will generate an XML

file

Springshare

XML Datafile

XSLT script Excel

table

(links guide ID number with guide

creator name)

PRIMO

libguideaccounts

Mapping table

Primo BackOffice using file splitter and basic XML pipe PNX

DB

LibGuides into Primo – why good!

• Use XSLT script to create mapping table that will link LibGuide creator to guide


XSLT script

Accounts, Categories, Guides

LibGuides into Primo• Upload mapping table in Primo Back Office

LibGuides into Primo• Configure file splitter

• Create normalization rules

• Configure data source


• Define pipe


Records appear in Primo:

LibGuides into PrimoRecords appear in Primo “VIEW ONLINE” tab

DID I SAY YET. . . . . . . . . . . .What I have shown you today provides additional ACCESS POINTS to your digital collections such that users can find your digital collection, LibGuides, AND Finding Aids, without ever knowing where they are ! ! ! ! And once Primo links take them to the collection website (that they did not know existed), they will discover MORE ! ! !

Session Review

.1. Digital Objects and Digital Collections : What is our Plan ? Why Use Primo ?

.2. Fedora and Primo workflow / Integrated with Blackboard

.3. Fun Item : Dublin Core : Youtube Videos and Blackboard Canvas ???

.4. MODS protocol extract and Ingestion (Winterton Collection)

.5. EAD to Primo (Finding Aids)

.6. METS to Primo : African Maps Collection

.7. MODS to Primo : African Posters

.8. LibGuides XML into Primo

What’s Next

.1. Deep Search setup with News Archives from Vanderbilt University.

.2. More Digital Collections at Northwestern.

.3. Looking at ingesting external collections of interest (Africana). Example : DPLA collections harvest ??? Smithsonian ???

Thank You

Michael North [email protected]

mailto:[email protected]