1 / 5

Multi-CE submission and Voview

The latest updates from the AliEn TF meeting on July 9, 2023, detail significant enhancements in the WMS submission module. The new version allows submissions to multiple local clusters from a single VOBOX, crucial for multi-cluster sites like CERN. Notable changes include the introduction of a new WMS.pm submission module, improved job querying using VOVIEW, and security checks to prevent submissions to CEs under maintenance. Additionally, obsolete configurations have been updated for better cluster management.

nitsa
Télécharger la présentation

Multi-CE submission and Voview

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. Multi-CEsubmission and Voview ALICE TF Meeting 23/07/09

  2. Multi-CEsubmission • The nextAliEn version has implementedsome changes in the WMS submission module • Whatis new? • The new module isnow able to submit to different local clusters from the same VOBOX • This is important for multi-cluster sites as CERN, or Lyon-T1 for example.

  3. Implementation • The submission to WMS isnowdonethrough a new module: WMS.pm • Voview information isused to query ALL CEs the number of running and waiting jobs • This wasalready in placedbefore • In addition the CEsdeclared by site are grouped in LDAP by clusters • For each cluster wetake the information of that CE publishing the max number of waiting jobs • Security check • Weredefine the default raking of the WMS includingourownranking • RANK=1 • All CEs have the sameweight • No changes to the level of jld file are needed • In addition we have added the condition: PRODUCTION to the level of WMS config file • This willavoidsubmissions to CEswhich are in maintenance

  4. Changes • Alice.confisobsolete • Local file in VOBOX is not longer used • Level of LDAP • Type = WMS (NEW) • Submitarg -> OBSOLETE • AliEN_WMS -> OBSOLETE • DEL_PROXY -> OBSOLETE • CE_RANKING=1 (NEW) • CE_LCGCE= (CE1,CE2,CE3),(CE1’,CE2’),(CE1’’,CE2’’)… • Groupednow by clusters

  5. Results • Installedat CERN during the last week for testingpurposes • Site with more large amount of CEsdistributed in 2 clusters: SLC4 and SLC5 • Afterseveralhours in production thisiswhatwesaw: • total number        : 1837 • Running             : 622 • Scheduled          : 1059 • Waiting            : 0 • Done (Failed)      : 0 • Done (Success)     : 66 • Cleared            : 0 • Aborted            : 90 • Ready              : 0 • Cancelled          : 0 • Jobs to : ce103.cern.ch        122 • Jobs to : ce104.cern.ch        105 • Jobs to : ce105.cern.ch        140 • Jobs to : ce106.cern.ch        100 • Jobs to : ce107.cern.ch        116 • Jobs to : ce108.cern.ch        101 • Jobs to : ce109.cern.ch        129 • Jobs to : ce111.cern.ch        120 • Jobs to : ce112.cern.ch        121 • Jobs to : ce114.cern.ch        109 • Jobs to : ce115.cern.ch        112 • Jobs to : ce124.cern.ch        111 • Jobs to : ce125.cern.ch        115 • Jobs to : ce126.cern.ch        103 • Jobs to : ce127.cern.ch        111 • Jobs to : ce128.cern.ch        66 • Jobs to : ce129.cern.ch        56 SLC4 cluster SLC5 cluster

More Related