1 / 13

EGEE-0 / LCG-2 middleware Practical using GILDA testbed and GENIUS portal

EGEE-0 / LCG-2 middleware Practical using GILDA testbed and GENIUS portal. Mike Mineter mjm@nesc.ac.uk. Acknowledgements. Roberto Barbera and colleagues at Univ. of Catania Guy Warner of NeSC Colleagues in EGEE. Contents. LCG-2 (EGEE-0) middleware: higher services built on low-level tools

keahi
Télécharger la présentation

EGEE-0 / LCG-2 middleware Practical using GILDA testbed and GENIUS portal

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. EGEE-0 / LCG-2 middleware Practical using GILDA testbed and GENIUS portal Mike Minetermjm@nesc.ac.uk

  2. Acknowledgements • Roberto Barbera and colleagues at Univ. of Catania • Guy Warner of NeSC • Colleagues in EGEE

  3. Contents • LCG-2 (EGEE-0) middleware: higher services built on low-level tools • GILDA testbed • Portals: • Easy access from any browser • Enabled by MyProxy service – issues proxy certificates on user’s behalf • GENIUS, portal for GILDA • Practical

  4. Building a grid • GT2: a toolkit • not a turnkey solution • Current de-facto standard on which production grids are built • Need higher level tools • E.g. so submit a job to “a grid” not a CE in a grid • …including services for • Logging who’s done what, statistics about jobs,… • Monitoring whats happening on the grid • Illustrate this using LCG middleware (Large Hadron Collider Compute Grid)

  5. Application level services User interfaces Applications EU DataGrid “Collective” services App monitoring system Workload management Data management VDT (Condor, Globus, GLUE) “Basic” services User access Information system Information schema Data transfer Security PBS, Condor, LSF,… System software NFS, … RedHat Linux Operating system File system Local scheduler HPSS, CASTOR… Hardware Computing cluster Network resources Data storage Current production grid: LCG-2

  6. Replica Catalogue Input “sandbox” “User interface” DataSets info Information Service Output “sandbox” Resource Broker SE & CE info Job Submit Event Author. &Authen. Input “sandbox” + Broker Info Job Query Output “sandbox” Publish Job Status Storage Element Logging & Book-keeping Computing Element Job Status Current production m’ware: LCG-2

  7. Building on basic tools and Information Service Example JDL file Executable = “gridTest”; StdError = “stderr.log”; StdOutput = “stdout.log”; InputSandbox = {“/home/joda/test/gridTest”}; OutputSandbox = {“stderr.log”, “stdout.log”}; InputData = “lfn:testbed0-00019”; DataAccessProtocol = “gridftp”; Requirements = other.Architecture==“INTEL” && \ other.OpSys==“LINUX” && other.FreeCpus >=4; Rank = “other.GlueHostBenchmarkSF00”; • Submit job to “resource broker”, in LCG… • edg_job_submit my.jdl

  8. GILDAGrid INFN Laboratory for Dissemination Activities A virtual laboratory for demonstration, dissemination, and porting new applications Run by the EGEE team at INFN / University of Catania (Sicily) under Roberto Barbera GILDA incorporates: • The Gilda Testbed • GENIUS • A monitoring system using GridICE (not covered here) • Its own Virtual Organization and Certificate Authority (not covered here) • Runs current EGEE operational middleware

  9. GILDA Sites • 12 Sites • 5 Countries

  10. GENIUS Portal • Often want to access a grid from any machine – not just from a UI with your credentials uploaded • GENIUS: • Used to access GILDA testbed • Portal developed by University of Catania with NICE, developers of EngineFrame

  11. Replica Catalogue Input “sandbox” “User interface” DataSets info Information Service Output “sandbox” Resource Broker SE & CE info Job Submit Event Author. &Authen. Input “sandbox” + Broker Info Job Query Output “sandbox” Publish Job Status Storage Element Logging & Book-keeping Computing Element Job Status Using the Grid without a Portal edg-job-list-match HelloWorld.jdl edg-job-submit -o job.id HelloWorld.jdl edg-job-status -v 1 -i job.id edg-job-get-output -i job.id --dir . ???

  12. Web Server Browser Portal Development Kit 3-tier model Portal User interface Grid Services MyProxy service GENIUS: how it works

  13. PRACTICAL using GILDA and GENIUSOpen a browser window athttp://homepages.nesc.ac.uk/~gcw/GENIUS

More Related