AJDL job and dataset persistency

1. AJDL job and dataset persistency GANGA workshop David Adams BNL April 21, 2004

2. AJDL persistency Job XML Dataset XML Contents AJDL persistency GANGA workshop

3. AJDL persistency • AJDL objects are stored in repositories • XML description indexed by ID • Unique ID is 2 32-bit ints • May also have metadata in selection catalog • ID plus metadata values • High level service interface for all the above • Usual class (C++, python, …) interface • May have other implementations • Files, MySQL table, … • Following slides show XML for job and dataset AJDL persistency GANGA workshop

4. Job XML (existing) • Job • xml_version = 0.90 • fulltype = XyzJob • id = 123-456 • status = INVALID | FAILED | INITIALIZING | RUNNING | DONE | KILLED • create_time = 1000223455 • start_time = 1000223456 • update_time = 1000223457 • stop_time = 1000223457 • submit_host = subnode.org • run_host = runnode.org • job_directory = /home/junk/jobs/123-456 • processed_event_count = 10000 • processed_result_event_count = 10000 • error = 0 • Application … • Task … • XyzInDataset … • XyzOutDataset … (optional) AJDL persistency GANGA workshop

5. Dataset XML (proposed) • EventDataset • xml_version = 1.10 • fulltype = XyzEventDataset • id = 123-456 • parent = 123-455 • is_virtual = false • event_count = 2049 • EventIdList (optional) • EventIdRange • run = 123 • first = 2401 • last = 2468 • EventId • run = 123 • event = 2470 • ... • ContentIdList • label = ESD • ContentId • name = Myclass:mykey • ... • DatasetIdList (optional) • DatasetId • id = 123-456 • ... • LogicalFileList (optional) • LogicalFile • state = READONLY • name = myfile.dat • FileCatalog … • FileId … AJDL persistency GANGA workshop