1 / 10

Status of Belle II Data Handling: AMGA Team Activities and Schedule Overview

This report provides an update on the activities of the Belle II Data Handling Group, focusing on the AMGA team's progress, schedule, and upcoming events. It covers the recent release of AMGA v2.1.2 with a Federation feature and the integration of AMGA into the Belle II computational system. The text discusses the challenges and advancements in data registration, metadata handling, and grid farm testing. Additionally, it highlights the implementation of a standalone dataset registration kit and the ongoing work on a new metadata system for Belle II. Collaboration opportunities for developing data handling tools and familiarity with gbasf2 are also mentioned.

jada
Télécharger la présentation

Status of Belle II Data Handling: AMGA Team Activities and Schedule Overview

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. April 19, 2011 Belle II ComputingMeeting, KEK, Japan Status of Belle II Data Handling Group Kihyeon Cho High Energy Physics Team KISTI (Korea Institute of Science and Technology Information)

  2. Contents • Schedule • Activities of AMGA team • Snap shot vs. Query • Standalone data registration

  3. Schedule • Korea Belle/Belle II Meeting • Date: 2011. 4. 30 (Saturday) • Place: Hanyang University, Seoul, Korea • Report on Belle II DH Group • Junghyun Kim and Kihyeon Cho • Belle II computing workshop (?)

  4. AMGA Team • Sunil Ahn, TaesangHuh, Soonwook Hwang • AGMA itself • AMGA v 2.1.2 released • Federation feature • GUI client toolkit • Included in the EMI-1 release • AMGA for Belle II • To plug AMGA system (KISTI) into Grid farm => done

  5. AMGA test at Grid Farm (since January) UI Grid Farm Belle VO Belle II VO @ AMGA Team @ HEP Team @ Melbourne AMGA Server • Sunil has written documentation of how to submit grid jobs. • We had tested AMGA Sever at HEP team(150.183.246.196). • AMGA Server at Melbourne is in Grid. • To test AMGA server at KEK => delayed

  6. Snap shot vs. Query Metadata A 1. Snap shot B Duplicated Metadata Duplicated Metadata C … 2. Query Metadata A Query Query • Query vs. Snap shot => Snap shot (1.5 TB/user) • Junghyun is making new idea since snap shot increases meta-data size due to duplication B C …

  7. 3. Snapshot-like Method => Working on Delete Delete OK? yes Metadata A No Keep metadata (Change Permission) Query Query B C … • Junghyun Kim, Sunil Ahnand Taesang Huh are working on it. • Snap-shot style => snap-shot like style for user created data • To store queries which are not duplicated • To keep the metadata for old data

  8. Martin’s mail (4/14) • Data Now that many Belle skim datasets have been created and distributed around the world, I think it is very important we implement a dataset registration tool for our distributed computing solution. This is defined in redmine feature 196: http://ekpbelle2.physik.uni-karlsruhe.de/redmine/issues/196The feature would place a dataset on a grid enabled storage element, register it with the LFC and place the appropriate metadata associated with the skim in the AMGA meta-database. With this tool we can begin to use our distributed data analysis system to analyse Belle data. This project is particularly vital given the situation with B-computer at KEK. We have access to large amounts of computing power on the grid but without this feature we can't really use it. I thought that you might be interested working together in developing this feature since it involves data handling, AMGA and the python interface to AMGA. It would also give you a chance to become familiar with gbasf2.

  9. #196 Standalone dataset registration tool kit • Junghyun and TaesangHuh • C++ modulefor Belle II 1st step. Gbasf2 @ KISTI • To check Logfile message and meta data 2nd step C++ Module • Open metadata system • New metadata system with registration • Close metadata system • A couple of month

  10. Thank you.

More Related