David Adams

ATLAS

AJDL job and dataset persistency

David AdamsBNL

April 21, 2004

GANGA workshop

AJDL persistency GANGA workshop April 20, 2004 2

David Adams

ATLAS

Contents

AJDL persistency

Job XML

Dataset XML

AJDL persistency GANGA workshop April 20, 2004 3

David Adams

ATLAS

AJDL persistencyAJDL objects are stored in repositories

• XML description indexed by ID

• Unique ID is 2 32-bit ints

May also have metadata in selection catalog• ID plus metadata values

High level service interface for all the above• Usual class (C++, python, …) interface

• May have other implementations– Files, MySQL table, …

Following slides show XML for job and dataset

AJDL persistency GANGA workshop April 20, 2004 4

David Adams

ATLAS

Job XML (existing)Job xml_version = 0.90 fulltype = XyzJob id = 123-456 status = INVALID | FAILED | INITIALIZING | RUNNING | DONE | KILLED create_time = 1000223455 start_time = 1000223456 update_time = 1000223457 stop_time = 1000223457 submit_host = subnode.org run_host = runnode.org job_directory = /home/junk/jobs/123-456 processed_event_count = 10000 processed_result_event_count = 10000 error = 0 Application … Task … XyzInDataset … XyzOutDataset … (optional)

AJDL persistency GANGA workshop April 20, 2004 5

David Adams

ATLAS

Dataset XML (proposed)EventDataset xml_version = 1.10 fulltype = XyzEventDataset id = 123-456 parent = 123-455 is_virtual = false event_count = 2049 EventIdList (optional) EventIdRange run = 123 first = 2401 last = 2468 EventId run = 123 event = 2470 ...

ContentIdList

label = ESD ContentId name = Myclass:mykey ... DatasetIdList (optional) DatasetId id = 123-456 ... LogicalFileList (optional) LogicalFile state = READONLY name = myfile.dat FileCatalog … FileId …