SlideServe
Télécharger Obtenir Pro
Menu
Accueil Pro
Préférences
ApparenceLight Aide et commentaires
© SlideServe · v2026

Resource Sharing and Problem Solving in Dynamic Virtual Organizations Through Grid Computing

shepry avatar
shepry
21 diapositives · 341 Views · Jul 31, 2014

This document outlines the principles and practices of grid computing as utilized at NIKHEF. It discusses the definition and concept of grid computing, emphasizing dependable, consistent, and pervasive access to resources across multiple institutions. Key technical challenges include uniform access methods and security through authentication, authorization, and accounting (AAA). The Globus Project and its role as a standard in grid middleware are highlighted, along with the importance of application toolkits and middleware in promoting resource sharing. The DutchGrid platform's integration, job submission frameworks, and optimization strategies are also discussed.

Resource Sharing and Problem Solving in Dynamic Virtual Organizations Through Grid Computing - slide 1
01 / 21Resource Sharing and Problem Solving in Dynamic Virtual Organizations Through Grid Computing
1 / 17

Télécharger la présentation

Resource Sharing and Problem Solving in Dynamic Virtual Organizations Through Grid Computing
Une image / un lien ci-dessous est fourni (tel quel) pour télécharger la présentation

Politique de téléchargement : le contenu du site vous est fourni TEL QUEL pour votre information et votre usage personnel ; il ne peut être vendu, concédé sous licence ni partagé sur d’autres sites sans l’accord de son auteur.Le contenu vous est fourni TEL QUEL, pour votre information et votre usage personnel uniquement. Téléchargez la présentation en cliquant sur ce lien. Lors du téléchargement, si vous ne parvenez pas à télécharger une présentation, l’éditeur a peut-être supprimé le fichier de son serveur.Pendant le téléchargement, si vous ne parvenez pas à obtenir une présentation, le fichier a peut-être été supprimé par l’éditeur.

F I N

Plus de contenu associé

Transcription de la présentation

  1. Using Grid Computingat NIKHEF David Groep, NIKHEF2001-10-01

  2. The One-Liner • Resource sharing and coordinated problem solving in dynamic multi-institutional virtual organisations

  3. What is Grid computing? • Dependable, consistent and pervasive access • Combining resources from various organizations • `Virtual Organizations’ – user-based view on Grid • Technical challenges: • transparent decisions for the user • uniformity in access methods • secure & crack resistant • authentication, authorization, accounting (AAA) &quota

  4. Grid Middleware • Globus Project started 1997 • de facto-standard • Reference implementation of Gridforum standards • Large community effort • Basis of several projects, including EU-DataGrid • Toolkit `bag-of-services' approach • Successful test beds, with single sign-on, etc…

  5. Applications Grid Architecture Make all resources talk standard protocols Promote interoperability of application toolkit, similar to interoperability of networks by Internet standards Application Toolkits Condor-G DUROC MPICH-G2 VLAM-G Grid Services MDS ReplicaSrv GridFTP GRAM Grid Security Infrastructure (GSI) Grid Fabric Condor MPI PBS SUN Internet Linux

  6. Looking for Resources • Per Virtual Organization (or test bed) • Directory of Resources and their Characteristics • Used to find `best resource out there’ DataGrid http://marianne.in2p3.fr/ DutchGrid ldap://giishost.nikhef.nl:30001/o=Grid

  7. Submitting a Job

  8. Sending your Data • Tape robots, disks, etc. share GridFTP interface • Optimize for high-speed >1Gbit/s networks • In the future: automatic optimizations, bandwidth reservations, directory-enabled networking, …

  9. DataGrid Test Bed 1 • DataGrid TB1: • 14 countries • 21 major sites • “Work Package 6” • Submitting Jobs: • Login only once,run everywhere • Cross administrativeboundaries in asecure and trusted way • Mutual authorization

  10. Amsterdam Leiden Enschede KNMI Utrecht Delft Nijmegen DutchGrid Platform • DutchGrid: • Test bed coordination • PKI security • Participation by • NIKHEF:FOM, VU, UvA, Utrecht, Nijmegen • KNMI, SARA • AMOLF • DAS-II (ASCI):TUDelft, Leiden, VU, UvA, Utrecht • Telematics Institute

  11. Systems around WCW

  12. Start using the grid • All the necessary “client tools” are on all Linux and Solaris systems • You just need: • Credentials/tokens for the Grid (see next slides) • Authorization to use resources(you get all NIKHEF resources by default) • Information on which resources to use effectively

  13. Your Grid Credentials • You will use resources across several domains • You may not care about security and authorization • But the remote site admin will ! • All communications are authenticated usingX.509 “Public Key” Certificates • The technology used to securecredit card transactions on the web (https://……) • Uniquely binds name/affiliation to a digital token

  14. Certification Authorities • CA’s act as trusted third parties • Remote sites trust the CA for a proper binding • They will not do authentication again, soonly authorization left. • CA’s are highly valuable: crack one to impersonate others on the Grid(and abuse resources) • Registration Authorities do in-person ID checks

  15. CA’s in DataGrid • 10 National CA’s (one per EU country) • Each one has a detailed policy and practice statement • NIKHEF operates the CA for DutchGridSee http://certificate.nikhef.nl/ • Get a “certificate” from the DutchGrid CAbefore you can start using the Grid • It’s valuable, protect it with a pass phrase • One cert valid for all DataGrid sites

  16. The Proxy • A `proxy certificate’ is a limited-lifetime delegationwithout a pass phrase to protect it • Implements the single sign-on for Grid • Valid for 12 hours (by default) • Use it to: • Run your jobs • Get access to your data • Get it, by running grid-proxy-init

  17. Now see for yourself

  18. Getting a Certificate • Initialize your environment for the Grid • Use the Globus local guide fromhttp://www.dutchgrid.nl/Org/Nikhef/ • Run grid-cert-request • Send the result to ca@nikhef.nlyou will be contacted by phone • Put the certificate (sent by mail) in your$HOME/.globus/usercert.pem • Or use the Web at http://certificate.nikhef.nl/cgi-bin/reqconf

  19. Using the Grid • Request authorization: gridadm@nikhef.nl • Look what is out there using grid-info-searchorhttp://marianne.in2p3.fr/datagrid/giis/giis-browse.html • Try some local hosts: • bilbo, kilogram, triangel kilogram:davidg:1009$ globus-job-run dommel.wins.uva.nl /usr/ucb/quota -v Disk quotas for random (uid 12xxx): Filesystem usage quota limit timeleft files quota limit timeleft /home/random 13067 1500000 2000000 0 0 0 kilogram:davidg:1010$ • Start running your analysis/MC/other jobs

  20. GridFTP • Universal high-performance file transfer • Extends the FTP protocol with: • Single sign-on (GSI, GSSAPI, RFC2228) • Parallel streams for speed-up • Striped access (ftp from multiple sites to be faster) • Clients: gsincftp, globus-url-copy.

  21. What’s Next? • Some of the nice user-features to come: • Finding data files by characteristics(give me all golden decay’s) • Moving your job to where the data is • Automatic partitioning of jobs • Support true-interactive work • Better network utilisation (faster access to data) • ……… • If you are in the DataGrid project, ask your WP leader for authorization in TB1