bhl europe atos origin wp3 insights v1.0

BHL-Europe

Biodiversity Heritage Library for Europe – ECP-2008-DILI-518001 – Kick-off meeting – Berlin – 10-15 May 2009 www.biodiversitylibrary.org

Lee NambaChief ArchitectPublic Sector – France

Museum für Naturkunde

Roger EssohHead of InnovationBiz Dev ManagerOpen Source ManagerPublic Sector - France

�Represent Atos Origin in BHL-Europe Consortium

� Acting as Open Source and Preservation and Archive System consultant

�Roger Essoh Deputy in BHL-Europe Consortium

� Acting as Preservation and Archive System consultant

Go for a PAS**Preservation & Archive System

BHL-Europe


We’ve a PAS* to build !

ACCESSACCESSINGESTINGEST STORAGESTORAGE

WP 2

WP 3* Preservation and Archive System

PROVIDERS

Europeana

CONSUMERS

ENGINE

Thank to CASPAR for the nice picture

Compliance with Europeana Meta-Data requirements

Meta-Data is a key success factor of the consumers satisfaction !(Taxonomic, Multilanguage's,…)

Europeanaconnect API

BHL-Europe


Our primary goalPrototype for German language

ACCESSACCESSINGESTINGEST STORAGESTORAGE

PROVIDERS

Europeana

CONSUMERS

ENGINE

German digital content

Now how to build a PAS ?

BHL-Europe


Building a PAS :Digital Preservation issues

1. How To guarantee a digital information may be accessed and accessed and understoodunderstood in the future

2. How To guarantee a proper information package managementinformation package managementwithin and OAIS Archive

3. How To guarantee longlong--time preservation maintenancetime preservation maintenance of any information package

4. How To guarantee retrievalretrieval of Archival Information5. How To guarantee intellegibilityintellegibility within heterogeneous Designated

Communities and their digital information6. How To guarantee preservation actors are informed about change informed about change

eventsevents7. How To guarantee an adequate security accesssecurity access with the proper

rightsrights to any resource and functionality within an OAIS Archive8. How To guarantee an adequate integrity and identityintegrity and identity for any

Archival Information

Source – Luigi Briguglio

BHL-Europe


Ideal approach ???

Standards

Work close

� Long-term

Open Source

Partnership

Integration

More risks

Maintenance

Community

Standards

Not relevant

� Short-term

Open Source

Not essential

Integration

Less possible

Maintenance

By my own

SUSTAINABLE ROAD

SUSTAINABLE ?

BHL-Europe


Long-term ?

Standards

Work close

� Long-term

Open Source

Partnership

Integration

More risks

Maintenance

Community

SUSTAINABLE ROAD

� Define what we mean by Standard regarding our requirements !

�Be sure we’re choosing the right standards !

� Build a B2B (win-win) partnership…No reinvent the wheel

�Focus on the BHL System maintenance and mutual interests during the deal

Reuse Europeanaassets (quick wins, best practices, standards,…)

� An Integration project

�Setup an Implementation methodology and industrialize the development platform

� Share our roadmap

�Setup a process review to ensure we stay aligned with the communities

BHL-Europe


Some integration challenges

BHL-Europe - Infrastructure

OAIS CORE

Ingest

BHL-Europe System

Preser-vation

Adminis-tration

Rights management

Data management

Storage

Access

Storage Abstraction Service (SAS)

Pre Ingest

OAI repository(descriptive metadata

catalog)

META DATA Policeman

Identity management

(rights metadata management)

RIGHT MEDIATOR

Users

Producer 1

Producer 2

Producer 3

Producer n

Easy, simple, understanding, Multilanguage'

s and homogeneous

access

THE SUCCESS FACTOR

Total Performance ExcellencePOWER &

ROBUSTNESS

Challenge

Challenge Challenge

Challenge

Challenge

Challenge

Challenge

OAIS compliance

The SYSTEM HEART

BHL-Europe


Integration success factors

BHL-EuropePreservation & Archive System

Development & Integration strategy & methodology

Use Agile approach to manage complexity and technical risks

Digital preservationexpertise

Design a Digital preservation leader

Stable specificationsASAP

Execute Iterative benchmarks to validate requirements

System integrationexpertise

Design a system integration leader

Industrialize your development platform

Use continuous Integration enginewith a strong issues tracker

Drivers Answers

BHL-Europe


Development strategy

SelfSelfSelfSelf----ContainedContainedContainedContained + + + +

Well DescribedWell DescribedWell DescribedWell Described + + + +

AdaptableAdaptableAdaptableAdaptable + + + +

Replaceable = Replaceable = Replaceable = Replaceable =

PreservablePreservablePreservablePreservable

Pure Service-oriented designguarantees that the component can provide functionality without requiring cooperation of other components

Component analysis, design and development process is strongly based on complete – shared – opendocumentation at any level

•• No DependenciesNo Dependencies•• Loosely coupledLoosely coupled•• DistributedDistributed

• Sharing knowSharing know--howhow•• Open SpecificationOpen Specification•• Open Source Open Source •• Open DocumentationOpen Documentation

Design choices and implementation allows to adapt and configure each component to provide always at least a minimal set of functionality independently from the deployment framework and condition

•• FlexibilityFlexibility•• ScalabilityScalability

Design choices and implementation allows to replace any component in the framework with compliant one.

•• InteroperabilityInteroperability•• MantainabilityMantainability

Source – Luigi Briguglio

BHL-Europe


Example of development steps


OAIS CORE

Ingest

BHL-Europe System

Preser-vation

Adminis-tration

Rights

management

Data management

Storage

Access


Pre Ingest Pre Ingest

• Activity 1

• Activity 2

• Activity n

Ingest

• Activity 1

• Activity 2

• Activity n

Infrastructure

• Activity 1

• Activity 2

• Activity n

Preservation

• Activity 1

• Activity 2

• Activity n

Data Mgt

• Activity 1

• Activity 2

• Activity n

Storage

• Activity 1

• Activity 2

• Activity n

Rights Mgt

• Activity 1

• Activity 2

• Activity n

SAS

• Activity 1

• Activity 2

• Activity n

Administration

• Activity 1

• Activity 2

• Activity n

Access

• Activity 1

• Activity 2

• Activity n

STEP 1

STEP 3STEP 2

STEP 4

• Work by module

• Driven by an Integration strategy

• Based on development by contract

BHL-Europe


An Agile approach

Ingest ModuleRelease 1

Sprint 1 Sprint 2 Sprint 3

4 weeks 4 weeks 3 weeks

Pre Ingest

• Activity 1

• Activity 2

• Activity n

Ingest

• Activity 1

• Activity 2

• Activity n

Infrastructure

• Activity 1

• Activity 2

• Activity n

Preservation

• Activity 1

• Activity 2

• Activity n

Data Mgt

• Activity 1

• Activity 2

• Activity n

Storage

• Activity 1

• Activity 2

• Activity n

Rights Mgt

• Activity 1

• Activity 2

• Activity n

SAS

• Activity 1

• Activity 2

• Activity n

Administration

• Activity 1

• Activity 2

• Activity n

Access

• Activity 1

• Activity 2

• Activity n

STEP 1

STEP 3STEP 2

STEP 4

Storage ModuleRelease 1

Sprint 1 Sprint 2 Sprint 3

4 weeks 4 weeks 3 weeks

Integration

• Respect implementation contract to ensure efficient integration

BHL-Europe


Continuous Integration Engine

Final versionRelease 1 Release 2 Release n

Eclipse / SCM / Hudson Architecture

Automate integration, Improve release quality, Identify regressions

BHL-Europe


Dev collaboration platform

Ideas for collaboration platform

Hudson platform(Continuous Integration)

Mercurial ?SVN ?

….

Technical Wiki

Jtrac(Issues tracker)

Mercurial/ JIT(tech)

CentralizeDevelopment ?

DistributedDevelopment ?

P

PP

P P

Synchronizedplatform

Timesheetsystem

BHL-Europe Wiki

Instant messaging ?Gtalk,…?

……

BHL-Europe



OAIS CORE

Ingest

BHL-Europe System

Preser-vation

Adminis-tration

Rights management

Data management

Storage

Access


Pre Ingest

bhl europe atos origin wp3 insights v1.0

Documents