open source glam tools for building sustainable cultural heritage and digital humanities...

Open source GLAM tools for building sustainable DCH & DH infrastructures

Roxanne Wyns

Roxanne.Wyns@kuleuven.be

Short intro

GLAM tools for sustainable CH & DH infrastructures

On the agenda

• From Collection Management to Online Access

• Digital infrastructures and projects

• Best practices

Source: dilbert.com

From Collection Management to Online Access

Digital project workflow

Dr. Lynda Sayce prepares a manuscript in the Alamire Digital Lab in Vatican City. © Veerle Francke - Alamire

GLAM infrastructure overview

Coll.MS CMS

DAM/LTP

Collection management system- Metadata creation and management

(master files)- Closed system (access rights)- Metadata is pushed to public portal

DAM / LTP- Ingest of files + metadata- PID- Visualisation view

AdminUI

Admin UI

Front - end

Admin UI

Front- end

Public Access portal / CMSAdditional content such as news, story's, …

Metadatafor publication

Descriptive & administrative metadata

Physical & Digital born items

Creation of metadata

Collection management system

Coll.MS CMS

DAM/LTP view

AdminUI

Admin UI

Front - end

Admin UI

Front- end

Metadata at libraries, archives and museums

• Domain specific description and export standards

• Often with (small) adaptations to fit specific needs

• Exports in different formats

Metadata in the Arts, Social Sciences and Humanities

• No tradition of using descriptive standards

• Data models according to researchers needs

• Can be based on common principles within the research domain

• Increase of data sharing thanks to VRIs

Collection management system

A Collections Management System is software used to organize, control, and manage collections of objects by describing all information related to and about those objects.

• Commercial systems

• Open Source systems

• Client installations

• Cloud-based systems

LIBIS Collection management layer

• Alma for libraries• MARC standard

• CollectiveAccess• Flexible data model

• Standard of choice

• Scope for archives• Archival standards such as

ISAD(G), ISAAR, EAD …

• …

Long-term preservation and accessLot’s of data is unique and can only be captured once

Long-term preservation and access

Source: Libray of Congress

Digital Asset Management & Preservation

Coll.MS CMS

DAM/LTP view

AdminUI

Admin UI

Front - end

Admin UI

Front- end

Preservation at libraries, archives and museums

• Have preservation as one of their core functions

• But are still focused on traditional materials

• This also relates to the allocation of resources

• Storage and long term preservation concepts are still often mixed

Source: pinterest.comSource: bucklinbuildings.com

Preservation of research data in the Arts, Social Sciences & Humanities

• Most Humanities researchers do not think in terms of data

• Limited data sharing and reuse

• Problem of ownership

An engraving of the human heart by Lambert Blendeff, from the elaborately illustrated lecture notes ‘Physica’ (1686-1687) by Balthasar Cox.© KU Leuven - Dieter Daemen and Bruno Vandermeulen

Storage vs. Long-term preservation

• Digital Asset Management (DAM)• Store, organize, find, retrieve and share digital files

• Long-term preservation (LTP) of digital files according to ISO OAIS reference model

• Authenticity, unicity and integrity of files

• Ingest, Storage, Data management, Administration, Preservation planning, Persistent access

LIBIS preservation & access layer

LIAS ingester

Lias Uploader

Masters and derivativesRosetta Long-term preservation software

Persistent accessLIBIS resolver service

Viewer applicationsResolvable URL http://resolver.libis.be/IE3562253/representation

Data discovery and digital access

Coll.MS CMS

DAM/LTP view

AdminUI

Admin UI

Front - end

Admin UI

Front- end

Webpublising & data sharing at GLAM institutes

General types of access• Data discovery • Distributed access• Storytelling and virtual exhibits• User engagement

Tools• Often from same software provider as their Coll.MS• (Limited) movement towards Open Source (Drupal, Omeka)• Growing popularity of Google Cultural Institute

tellyourphtostory.be - Europeana Space Photography Pilot

Webpublising & data sharing in the Arts, Social Sciences and Humanities

General types of access

• Limited to specific individuals/groups

• Through a public web interface

• Download in a machine readable format

• Collaborative environments (VRIs)

• Lot’s of custom development

LIBIS access layer

LIAS ingester

Lias Uploader

Digital infrastructures and projects

Centre for Agrarian HistoryCAG

CAG – Tools & infrastructure

LIAS ingester

Lias Uploader

CollectiveAccess (Providence)

• Web cataloguing application

• Flexible data modeling according to standards

• Extensive management options via UI

• Suitable for collaboration

• Open source (https://github.com/collectiveaccess)

• Open system (MySQL database, XML, API, OAI-PMH)

• SQL & Elasticsearch

http://www.collectiveaccess.org/

CollectiveAccess Het Virtuele Land

CollectiveAccess demo (test system)

• Flexible web publishing platform for GLAM, scholarly collections and virtual exhibitions

• User friendly back-end

• Lot’s of plug-ins

• Open system (MySQL database, XML, API, OAI-PMH)

• SQL & Solr facet browsing

• Open source (https://github.com/omeka/Omeka), strong (developer) community

http://omeka.org/

Omeka website Het Virtuele Landhetvirtueleland.be

Het Virtuele Land – Image databasehetvirtueleland.be

Het Virtuele Land - Storieshetvirtueleland.be

Preservation and access Het Virtuele Land

http://www.hetvirtueleland.beWenskaart met bakkersmeisje, 1880 - 1914 © Bakkerijmuseum

Preservation and access Het Virtuele Land

http://www.hetvirtueleland.beWenskaart met bakkersmeisje, 1880 - 1914 © Bakkerijmuseum

Europeana Food & Drink exhibitions

Cake? Cake!

Europeana Giphy

Gify Cake? Cake!

Integrated Database for Early MusicIDEM project

Integrated Database for Early Music project

Alamire Foundation

• International Centre for the Study of Music in the Low Countries

• Research on medieval music manuscripts

Hercules call 2013

• Flemish investment fund for research infrastructures

• Proposal accepted, budget heavily reduced

IDEM project

Manuscript illumination. Probably created by the workshop of Petrus Alamire for the

Illustrious Brotherhood of Our Lady in 's-Hertogenbosch (around 1530’s).

Source: idemdatabase.org

IDEM – Project budget

• Main budget preserved for storage & long term preservation

• Limited resources for database, website, and viewer

• No budget for post-project maintenance and support

Budget cut on post-project maintenance influenced the selection of tools

IDEM - Selection of tools

Reuse a combination of existing tools in a flexible way

Use open source where possible to limit the license costs

Share the development costs with projects with similar interests

LIBIS services and tools

Clear communication on pros & cons of offered tools and total cost of ownership

IDEM - Tools & infrastructure

LIAS ingester

Lias Uploader

IDEM – Data details

• Alamire had 15 TB “ready” for ingest in 2014

• But, clean up actions required

• Master: RAW (EIP), TIFF

• Derivative: JPEG 2000

• Data growth: + 15 TB each year

Source: B-Br-ms-228 (view on idemdatabase.org)

IDEM – Viewer requirements

• Quick, without loss of quality

• Easy navigation within manuscript

• Full screen, tool bars should take up limited space

• Extensive zooming options in a single and fluid movement, focused on selected area

• Easily compare folio’s from different manuscripts in a single view

• ...

NL-SH-ms-72A D-Mbs-ms-Mus.ms.-F

IDEM – Selection of IIIF Mirador viewer

GLAM tools for sustainable CH & DH infrastructuresSources: iiif.io, projectmirador.org, idemdatabase.org, Mirador demo

Lectio - Magister Dixit project

Magister Dixit - Tools & infrastructure

LIAS ingester

Library Network

Magister Dixit project

• Leuven Centre for the Study of the Transmission of Texts and Ideas in Antiquity, the Middle Ages and the Renaissance

• Digitization and virtual reconstruction of Lecture notes from Leuven

• Online access to the collection for research purposes

LIBISnet Gebruikersdag 2016

Tractatus De Actibus Humanis (1733)© KU Leuven - Dieter Daemen and Bruno Vandermeulen

Magister Dixit projectPartners

Met de steun van

An engraving of the human hart from the lecture notes ‘Physica’ (1686-1687) by Balthasar Cox.© KU Leuven - Dieter Daemen and Bruno Vandermeulen

Magister Dixit projectMetadata in Alma

Data details

• 331 complex objects

• ca. 110.000 files

• 4,7 TB

• Master files:

• TIFF

• Derivative copies:

• JPEG

• JPEG2000

• PDF

Digital preservation with Teneo

Lectio & Magister DixitOld Lectio website

Lectio & Magister DixitNew organization & Project website with Omeka - lectio.ghum.kuleuven.be

Simple management of web pages

Access to the Magister Dixit collectionMetadata in Omeka

Access to the Magister Dixit collectionLink to Limo

Access to the Magister Dixit collectionMagister Dixit collection in Limo

Demo - Website - Mirador

NaBuCCoThe Neo-Babylonian Cuneiform Corpus

NaBuCCo – Tools & infrastructure

• Text oriented database and website of Babylonian sources

• Extensive relational metadata model focused on research of texts content

• Web access for researchers, also attractive for wider audiences

NaBuCCo – CollectiveAccess

GLAM tools for sustainable CH & DH infrastructuresDemo: Test database

NaBuCCo – Omeka websitehttp://nabucco.arts.kuleuven.be/

Chinese Christian Texts DatabaseCCT

CCT – Tools & infrastructure

• Chinese Christian Texts Database of the Sinology research unit

• Research on primary and secondary sources concerning the cultural contacts between China and Europe

• Chinese (+ pinyin), western languages

• Migration from MARC standard to relational data structure

Providence + Pawtucket

CCT - CollectiveAccess

GLAM tools for sustainable CH & DH infrastructuresDemo: Test database

DigitalHusserl

• Husserl archive - Centre for Phenomenology & Continental Philosophy

• Project funded by the Hercules foundation

• Collaborative research environment with tools to create virtual editions, collaboratively annotate and transcribe Husserl's work (stenographs)

• Extra attention for sustainability

DigitalHusserl - Tools & infrastructure

LIAS ingester

Lias Uploader

Annotations in Mirador

Aezel project

• Limburgs Genealogisch enGeschiedkundig Informatiecentrum

Aezel project project

• Goal: Bringing together the distributed heritage of the South of the Netherlands through digitization. Providing online access to all collected resources.

Aezel project

FASE I

• Set-up of infrastructure

• CollectiveAccess database accordingto new datamodel

• Omeka website

• OpenGeo suite & GeoExplorer

• One look & feel for all applications

• Data mapping and migration

• Filetransfer mechanism

Fase I

DigitalHusserl - Tools & infrastructure

Aezel projectCollectiveAccess

Aezel project GeoExplorer

Omeka-S

• Central management of multiple sites and users

• Extension of the metadata model

• Enrichment with vocabularies and authority files

• LOD publication

• Modular

• Responsive (mobile)

Fase II Omeka-S (http://omeka.org/s/)

Best practices for DCH & DH infrastructures

Infrastructure projects - Some basic principles

• Specify your requirements

• Foresee an appropriate IT budget

• Contact a technical partner

• Think in (iterative) phases

• Post-project sustainability

Infrastructure - Some basic principles

• Different systems should work independently from each other

• Different systems should be able to communicate with each other

• Use existing tools in a flexible way, but take into account it’s original purpose

• Document your data model, environment, …

Open Source - Some basic principles

• Many different license types

• Maturity and quality of the software

• Available documentation

• Activity of the community

• Contribute to the community

• Open source doesn’t mean free (total cost of ownership)

Source: Best practices for using open source software

Thank you! Questions?

From the lecture note ‘Physica’ (1686-1687) by Balthasar Cox

Roxanne Wyns - Roxanne.Wyns@kuleuven.be

open source glam tools for building sustainable cultural heritage and digital humanities...

Education

glam-wiki 2013 professional glam staffers on wikipedia

future glam

tessuti / fabrics / ткань · tessuti / fabrics /...

adequate business models for open access infrastructures in...

glam profile

folheto glam

principessa glam

glam media

glam diciembre

research infrastructures for the humanities

in the digital humanities - science connect ·...

grunge glam

glam bosses

from'digital humanities' to 'research infrastructures' ·...

glam summer2014

glam october

what are cyber infrastructures in the digital humanities

www.esf.org 1 strategic workshop on research communities and...

glam quartz

libraries, research infrastructures and the digital...