c. aiftimiei- december 2003 alice dcdb @ nipne-hh cristina aiftimiei [email protected] national...

C. Aiftimiei- December 2003C. Aiftimiei- December 2003

ALICE DCDB @ NIPNE-HHCristina [email protected]

National Institute for Physics and Nuclear Engineering - Horia Hulubei

dracula.nipne.ro & TYPO3


Web site: dracula.nipne.roWeb site: dracula.nipne.ro


dracula.nipne.ro & TYPO3dracula.nipne.ro & TYPO3

What is TYPO3? TYPO3 is a Content Management System

What is a CMS? is a software, usually a database application, that will make it easy to create

and maintain websites and manage all publishing formats associated with the World Wide Web

Much for nothing

TYPO3 is licensed under GNU/GPL. Therefore, TYPO3 requires no license costs unlike its commercial competitors. Noone keeps the best ideas for themselves which insures that wheel is not invented twice.

Large developer community

TYPO3 has a large world wide community of developers with clients from all types of business branches securing its continual development of any additional

modern requirements of a CMS.


TYPO3 - www.typo3.orgTYPO3 - www.typo3.org

To cut a very long story short: TYPO3 is a web- application based on PHP and MySQL; it has everything you need for doing nearly everything you want to do on the web.


dracula.nipne.ro & TYPO3 - examples (1)dracula.nipne.ro & TYPO3 - examples (1)


dracula.nipne.ro & TYPO3 - examples (2)dracula.nipne.ro & TYPO3 - examples (2)


ALICE DCDB @ NIPNE-HH

• Thanks to Wiktor Peryt and Tomasz Traczyk, Warsaw University of Technology


ALICE DCDB - General InformationALICE DCDB - General Information

The DCDB project - conceived in the framework of the ALICE experiment. Goal: to produce a database system and application environment for use in the

initial construction of sub-detectors for ALICE and later to facilitate the operation of the completed ALICE detector.

Work on design of the general architecture of DCDB started at the beginning of 2001. Warsaw ALICE database group and the ALICE off-line project are in charge of the overall activities of the project.

The ALICE sub-detector construction is distributed among many European labs, also in USA and India. This is a specific task, related to tests of detector components, measurements of their properties and final assembly.

The movements of the sub-detector components between manufacturers and laboratories during various phases of the production; the physical location of the components with the proper ownership and related data - are data that have to be traced and stored in the database.

Component tests and measurements will produce large amounts of data - that need to be stored in the database for further analysis and use. The data comes directly from test benches with software based on the LabView suite. The most convenient and reliable solution should assure undisturbed, direct population of the database with these data, I.e without intermediate storage as disk files.


DCDB ArchitectureDCDB Architecture

Centraldatabase

Satellite databases

Central database:• Placed at CERN (temporarly placed at WUT).• Plays role of central repository• Contains:

- central inventory of components- copies of data from laboratories- metadata (e.g. dictionaries)

Satellite databases:• Placed in laboratories-participants• Contain:

- source data produced at laboratories delivered by manufacturers

- working copies of data from central repository- partial copies of metadata (read-only)

Communication:• Passing messages in XML• Mainly off-line (batch-processing)• No satellite-satellite communication!• Request-response model (like HTTP):

- only satellite database can initiate communication


Central database - satellite databasesCentral database - satellite databases

• Central database– Usage characteristics

• very large data volume• many concurrent users• twenty-four-hour utilisation• critical data (breakdown may be

very costly)

– Necessary features • transaction processing• 7 × 24 availability• high reliability• continuous administration

by professional DBA team• on-line backup• data partitioning

– Proper solution• high-end commercial DBMS

software is necessary

• Satellite databases– Usage characteristics

• average or small data volume• only few concurrent users• used only few hours per day• not critical data (can be restored from

backup or from central database)

– Necessary features• transaction processing• should not need complex

administration (no trained personnel at labs-participants)

• should be monitored remotely by developers

• off-line backup procedures are sufficient

• data may not need to be partitioned• should not be costly!

– Proper solution• open-source database can be used


Proposed technologyProposed technology

– Central database• Oracle RDBMS

• Advantages• very stable and reliable• built-in procedural language• support for complex data types

and BLOBs• support for VLDB (very large

databases), e.g. data partitioning• 7 × 24 availability (on-line backup,

etc.)

• Disadvantages• quite expensive• complex and difficult to administer

– Satellite databases• PostgreSQL

• Advantages• free of charge• quite easy to administer• stable enough• built-in procedural languages• support for complex data types

and BLOB objects

• Disadvantages• not very fast (but fast enough for this

particular application)• no support for distributed processing

(data replication, etc.)• no support for heterogeneous

systems• no support for VLDB• no 7 × 24 availability


Satellite Database – data structuresSatellite Database – data structures

DATA BASE# DATABASE CODE* NAME

COMPONENT TYPEDERIVATION* DERIVATION TYPEo DESCRIPTIONo QUANTITY

DETECTOR# DETECTOR CODE* NAMEo DESCRIPTION

ALLOWABLE VALUE# SEQUENTIAL NO* VALUEo HIGH VALUEo MEANINGo NUMERICAL VALUE

DATA TYPE# DATA TYPE CODE* NAME* ELEMENTARY TYPEo DESCRIPTION

BLOB TYPE# MIME TYPEo NAME

MANUFACTURER# MANUFACTURER CODE* NAME* IS LABo DESCRIPTION

PROCESS PARAMETERo VALUEo DESCRIPTION

BLOB# BLOB ID* BLOB VALUEo BLOB DATEo FILE NAMEo FILE PATHo FILE OWNERo DESCRIPTION

PROCESS# PROCESS DATEo DESCRIPTIONo X SIZEo Y SIZEo Z SIZEo VALUE TABLEo PROCESSED BY* IS SKELETON

PARAMETER# VALID FROMo VALID TOo VALUE

DEFINITION OF PROCESSPARAMETER# PARAMETER CODE* NAMEo SEQUENTIAL NOo UNITS OF MEASUREo DESCRIPTION* IS RESULT* IS ACTIVE

DEFINITION OF PROCESS# PROCESS CODE* NAME* TYPEo SEQUENTIAL NOo UNITS OF MEASUREo X LABELo Y LABELo Z LABELo DESCRIPTION* IS ACTIVE

DEFINITION OF PARAMETER# PARAMETER CODE* NAMEo SEQUENTIAL NOo UNITS OF MEASUREo DESCRIPTION* IS ACTIVE

COMPONENT STATE# VALID FROMo VALID TO* EXISTENCEo QUALITYo ACCEPTEDo IMPORT DATETIMEo EXPORT DATETIME

COMPONENT DERIVATION# VALID FROMo VALID TO* DERIVATION TYPEo LOCATIONo POSITION NOo DESCRIPTION

COMPONENT GROUP# GROUP CODE* NAMEo DESCRIPTION

COMPONENT TYPE# TYPE CODE* NAME* IS ACTIVEo DESCRIPTION

COMPONENT# COMPONENT IDo USER CODEo SERIAL NUMBERo DESCRIPTION* IS SKELETON* IS VIRTUAL* LAST MODIFIED

located in

site

coded by

creates code

of component

has

in group

group of

derivative

derivative

source of

source of

belongs to

includes

belongs to

consists of

of type

.of type

.

of type

.

belongs to

constrained by

of type

defines

belongs to

consists of

belongs to

consists of

delivered by

delivers

manufactured by

creates

of

described by

defined by

defines

of test

has

for

tested by

defined by

defines

of

described by

defined by

defines

.has parameters

of type

processed by

of type

described by

describes

in

source of

source of

derivative

derivative

in group

consists of

of type

includes

Dictionaries Maintained in central repository Supplied from central database to labs Read-only in satellite databases


Satellite Database – data structuresSatellite Database – data structures

DATA BASE# DATABASE CODE* NAME

COMPONENT TYPEDERIVATION* DERIVATION TYPEo DESCRIPTIONo QUANTITY

DETECTOR# DETECTOR CODE* NAMEo DESCRIPTION

ALLOWABLE VALUE# SEQUENTIAL NO* VALUEo HIGH VALUEo MEANINGo NUMERICAL VALUE

DATA TYPE# DATA TYPE CODE* NAME* ELEMENTARY TYPEo DESCRIPTION

BLOB TYPE# MIME TYPEo NAME

MANUFACTURER# MANUFACTURER CODE* NAME* IS LABo DESCRIPTION

PROCESS PARAMETERo VALUEo DESCRIPTION

BLOB# BLOB ID* BLOB VALUEo BLOB DATEo FILE NAMEo FILE PATHo FILE OWNERo DESCRIPTION

PROCESS# PROCESS DATEo DESCRIPTIONo X SIZEo Y SIZEo Z SIZEo VALUE TABLEo PROCESSED BY* IS SKELETON

PARAMETER# VALID FROMo VALID TOo VALUE

DEFINITION OF PROCESSPARAMETER# PARAMETER CODE* NAMEo SEQUENTIAL NOo UNITS OF MEASUREo DESCRIPTION* IS RESULT* IS ACTIVE

DEFINITION OF PROCESS# PROCESS CODE* NAME* TYPEo SEQUENTIAL NOo UNITS OF MEASUREo X LABELo Y LABELo Z LABELo DESCRIPTION* IS ACTIVE

DEFINITION OF PARAMETER# PARAMETER CODE* NAMEo SEQUENTIAL NOo UNITS OF MEASUREo DESCRIPTION* IS ACTIVE

COMPONENT STATE# VALID FROMo VALID TO* EXISTENCEo QUALITYo ACCEPTEDo IMPORT DATETIMEo EXPORT DATETIME

COMPONENT DERIVATION# VALID FROMo VALID TO* DERIVATION TYPEo LOCATIONo POSITION NOo DESCRIPTION

COMPONENT GROUP# GROUP CODE* NAMEo DESCRIPTION

COMPONENT TYPE# TYPE CODE* NAME* IS ACTIVEo DESCRIPTION

COMPONENT# COMPONENT IDo USER CODEo SERIAL NUMBERo DESCRIPTION* IS SKELETON* IS VIRTUAL* LAST MODIFIED

located in

site

coded by

creates code

of component

has

in group

group of

derivative

derivative

source of

source of

belongs to

includes

belongs to

consists of

of type

.of type

.

of type

.

belongs to

constrained by

of type

defines

belongs to

consists of

belongs to

consists of

delivered by

delivers

manufactured by

creates

of

described by

defined by

defines

of test

has

for

tested by

defined by

defines

of

described by

defined by

defines

.has parameters

of type

processed by

of type

described by

describes

in

source of

source of

derivative

derivative

in group

consists of

of type

includes

Components’ data Created and updated in satellite

databases at labs Copied to central repository


Satellite Database – examplesSatellite Database – examples

c. aiftimiei- december 2003 alice dcdb @ nipne-hh cristina aiftimiei [email protected] national...

Documents

typo3 slide

database application

typo3 examples

warsaw alice database

database system

alice experiment

completed alice detector

dcdb project