1 / 16

Grid services Dusan Vudragovic dusan@phy.bg.ac.yu Scientific Computing Laboratory

Grid services Dusan Vudragovic dusan@phy.bg.ac.yu Scientific Computing Laboratory Institute of Physics Belgrade, Serbia. Set of basic Grid services. Job submission/management File transfer (individual, queued) Database access Data management (replication, metadata)

jonesfrank
Télécharger la présentation

Grid services Dusan Vudragovic dusan@phy.bg.ac.yu Scientific Computing Laboratory

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Grid services Dusan Vudragovic dusan@phy.bg.ac.yu Scientific Computing Laboratory Institute of Physics Belgrade, Serbia

  2. Set of basic Grid services • Job submission/management • File transfer (individual, queued) • Database access • Data management (replication, metadata) • Monitoring/Indexing system information

  3. VOMS (1/4) • Virtual Organization Membership Service • Problem description

  4. VOMS (2/4) • Grid Security Infrastructure (GSI) enables secure authentication and communication over an open network • Public key encryption • Digital X.509 certificate • Secure Sockets Layer (SSL) communication protocol • Certification Authority (CA) • grid-mapfile mechanism • LCAS/LCMAPS mechanism allow for a more detailed definition of user privilege • VOMS server example https://voms.phy.bg.ac.yu:8443/voms/aegis

  5. VOMS (3/4)

  6. VOMS (4/4) • Use delegation to establish dynamic distributed system ComputingCenter Service Rights VO ComputingCenter

  7. BDII (1/2) • Berkely Database Information Index • Information Service (IS) • Globus Monitoring and Discovery Service (MDS) • GLUE Schema • Lightweight Directory Access Protocol (LDAP) • Distinguished Name (DN) • Directory Information Tree (DIT) • Grid Resource Information Server (GRIS) • Relational Grid Monitoring Architecture

  8. BDII (2/2) • GStat http://goc.grid.sinica.edu.tw/gstat/ • GOC DB https://goc.gridops.org/

  9. RGMA • Relational Grid Monitoring Architecture • Global distributed relational database • Model is more powerful than the LDAP-based one • Advance query operations • Architecture consists of three major components • Producers - provide the information • Consumers - request the information • Registry - mediates the communication between the Producers and the Consumers • EGEE Accounting Portal http://www3.egee.cesga.es/gridsite/accounting/CESGA/egee_view.php

  10. WMS(1/2) • Run the Workload Management System • To accept job submissions • Dispatch jobs to appropriate Compute Element (CE) • Allow users • To get information about their status • To retrieve their output • A configuration file on each UI node determines which WMS node(s) will be used • When a user submits a job, JDL options are to: • Specify CE • Allow WMS to choose CE (using optional tags to define requirements) • Specify SE (then WMS finds “nearest” appropriate CE, after interrogating File catalogue service)

  11. WMS (2/2) • Workload Management System • WMS monitoring tool

  12. LB • Logging and Bookkeeping service • Who did what and when? • What’s happening to my job? • Usually runs on WMS node

  13. CE A CE is a grid batch queuewith a “grid gate” front-end: Information system Job request L&B Logging Loc. Info system Gatekeeper A&A Grid gate node Local resource management system:Condor / PBS / LSF master Homogeneous set of worker nodes

  14. SE A&A • Storage elements hold files: write once, read many • Replica files can be held on different SE: • “close” to CE; share load on SE • File Catalogue - what replicas exist for a file and where are they? File transfer Requests L&B GridFTP EventLogging Gatekeeper Info system Loc. InfoSystem Disk arrays or tapes

  15. Other Grid services • PX (MyProxy) • FTS (File Transfer Service) • LFC (Logical File Catalog) • AMGA (ARDA Metadata Grid Application)

  16. What really happens Job Query Publish Storage Element User interface File catalogue Input “sandbox” WMS DataSets info Information Service Output “sandbox” Job Submit Event SE & CE info Auth. &Auth. Input “sandbox” + Broker Info Job Status Output “sandbox” Job Status Computing Element Logging & Book-keeping

More Related