1 / 11

WP1 Grid Workload Management

WP1 Grid Workload Management. Massimo Sgaravatto INFN Padova http://www.infn.it/workload-grid. Activities 2001. Driven by deliverables D1.1 Report on current technology Survey on existing Grid tools and frameworks

september-major
Télécharger la présentation

WP1 Grid Workload Management

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. WP1Grid Workload Management Massimo Sgaravatto INFN Padova http://www.infn.it/workload-grid

  2. Activities 2001 • Driven by deliverables • D1.1 Report on current technology • Survey on existing Grid tools and frameworks • C. Anglano (TO), T. Ferrari, F. Giacomini (CNAF), F. Prelz (MI), M. Sgaravatto (PD) • D1.2: Definition of architecture • Internal WP1 architecture document • F. Giacomini (CNAF) main author • Participation to ATF to define the global EDG architecture • D1.3: Initial Workload Management System (1st release) • Code released to EDG-Integration Team

  3. 1st Release (what and who) • UI (User Interface) - DATAMAT • Command line for job management operations • Job Description Language (JDL) to specify job characteristics and requirements • RB (Resource Broker) – Catania • Responsible to choose the “best” resources where to submit jobs based on the constraint specified in the JDL and characteristics and status of resources (published in the Grid Information Service and Replica Catalog)

  4. 1st Release (what and who) • JSS (Job Submission Service) – Padova • Responsible for job management operations • II (Information Index) – Milano • First filter to the Grid Information Service • LB (Logging & Bookkeeping) – CESNET • “State machine” view of each job • WP1 – WP2 interfaces - CNAF, PISA • Packaging - CNAF, PISA • Coordination (internal and with the other WP’s) - F. Prelz, M. Sgaravatto

  5. Other 2001 activities • Grid Accounting – Torino • Economy based model • Implementation of a first prototype on-going • Advance reservation and co-allocation - CNAF • Globus GARA evaluation

  6. Planning for 2002 • Bug fixes, improvement of functionalities • RB – Catania • JSS – Padova • II – Milano • Support for interactive jobs • RB – Catania • JSS - Padova • Grid accounting - Torino • Implementation of a prototype system and integration with the workload management system

  7. Planning for 2002 • Analysis of new and smarter scheduling strategies – Catania • Integration of network information in the matchmaking process within RB – CNAF, Catania, Torino • Advance reservation and co-allocation - CNAF • Triggering of data transfers – Catania, Torino • Add the ability to evaluate network throughput and decide on the convenience of transferring data to provide better scheduling options (this may involve some form of network bandwidth reservation)

  8. Planning for 2002 • Support for partitionable jobs • Padova • Job dependencies • CNAF • WP1 – WP2 interfaces • Pisa • Packaging of WP1 software, Participation to EDG-IT • CNAF, Pisa

  9. Resources for year 2002 • Travel • Travel in Italy: 104 K€ • 8 WP1 2-day meetings (Milano) • CT (2 people), CNAF (3 people), PD (4 people), PI (2 people), TO (4 people) • Integration activities (3 weeks) • CT (1 people), MI (1 people), CNAF (2 people), PD (1 people), PI (2 people), TO (2 people) • TB INFN-GRID and coordination activities (20 days) • MI (1 people), PD (1 people) • Conferences and workshops (5 days) • MI (1 people), PD (1 people), PI (1 people), TO (2 people)

  10. Resources for year 2002 • Travel abroad: 153 K€ • 3 EDG workshops (Paris, Edinburgh, ??) • CT (2 people), CNAF (3 people), MI (2 people), PD (4 people), PI (2 people), TO (4 people) • GGF4 - Toronto (4 days) • CT (1 people), CNAF (1 people), MI (1 people), PD (1 people), TO (1 people) • GGF6 - USA (4 days) • CT (1 people), CNAF (1 people), MI (1 people), PD (1 people), TO (1 people) • SC2002 – USA (1 week) • MI (1 people), PD (1 people) • 7 PTB – CERN • MI (1 people), PD (1 people) • Coordination – CERN • MI (1 people, 20 days), PD (1 people, 15 days) • Collaboration with Globus and GGF developers on Information Services • MI (1 people, 2 weeks) • Collaboration with Globus and GGF developers on Scheduling • CT (1 people, 2 weeks) • Collaboration with Condor developers • PD (1 people, 2 weeks), CNAF (1 people, 2 weeks) • Releases - CERN • CT (1 people, 5 weeks), PI (1 people, 5 weeks), CNAF (1 people, 7 weeks)

More Related