1 / 29

OGC-OGF Strategy Sessions

OGC-OGF Strategy Sessions. OGF-26, May 26, 2009. www.ogf.org. Agenda. First Session Introduction & Welcome Goals Overview of OGC and Strategic Activities G. Pervicall, et al. Overview of OGF and Strategic Activities C. Lee, I. Osborne, D. Wallom Second Session Open Floor Discussion

elkan
Télécharger la présentation

OGC-OGF Strategy Sessions

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. OGC-OGFStrategy Sessions OGF-26, May 26, 2009 www.ogf.org

  2. Agenda • First Session • Introduction & Welcome • Goals • Overview of OGC and Strategic Activities • G. Pervicall, et al. • Overview of OGF and Strategic Activities • C. Lee, I. Osborne, D. Wallom • Second Session • Open Floor Discussion • Draft plans to achieve technical and organizational goals 2

  3. Overall Goals of this Workshop • Identify joint OGC-OGF technical goals • Near-term -- OWS-7 • Longer term • Bidirectional community engagement • Distributed Computing  Geospatial • Promote individual and organizational memberships 3

  4. An Overview of theOpen Grid Forum OGF-26, May 26, 2009 www.ogf.org

  5. The OGF Mission Statement " OGF is an open community committed to driving the rapid evolution and adoption of applied distributed computing. Applied Distributed Computing is critical to developing new, innovative and scalable applications and infrastructures that are essential to productivity in the enterprise and within the science community." 5

  6. Organizational Structure 6

  7. OGF Leadership • Craig A. Lee, President • The Aerospace Corporation • Chris Smith, VP Standards • Platform Computing • Ian Osborne, VP Enterprise • Intellect UK • David Wallom, VP e-Research • Oxford e-Research Centre • Joel Replogle, Director • OGF 7

  8. OGF Board of Directors • Steven Newhouse, Chairman, Technical Director, EGEE • Charlie Catlett, Argonne National Lab • Wolfgang Gentzsch, DEISA • Andrew Grimshaw, University of Virginia • Neil Chue Hong, University of Southampton • Hiro Kishimoto, Fujitsu • Silvana Muscella, Trust-IT Services/OGF-Europe • Satoshi Sekiguchi, AIST • Walter Stewart, CANARIE • Paul Strong, eBay 8

  9. A Little History • June 1999 • First Grid Forum meeting • NASA Ames, Mountain View, California • March 2001 • First Global Grid Forum • NIKHEF/SARA, Amsterdam • June 2006 • Merged with the Enterprise Grid Alliance to become the Open Grid Forum 9

  10. Method of Operations • Working groups • Chartered to define a standard through one or more documents according to a schedule with milestones • Research groups • Chartered to investigate any interesting topic by running workshops and writing documents (except standards) • Community groups • Chartered to build community by identifying requirements, common practices, running workshops, and writing documents (except standards) • Three meetings a year • Plenaries • Workshops • Group sessions • Birds-of-a-Feather meetings (BoFs) • Co-location with other relevant organizations 10

  11. The OGF Document Series • OGF documents produced through an open process managed by the OGF Editor • Groups submit drafts through Area Director • Editor reviews for clarity and format • Manages public comment period • Assigns GFD number • Document types (number as of May 2009) • GFD-I -- Informational Document (73) • GFD-E -- Experimental Document (14) • GFD-C -- Community Practice (12) • GFD-R -- Recommendation (32) • http://www.ogf.org/ggf_docs_final.htm 11

  12. OGF Compute-Related Standards Architecture OGSA EMS Scenarios (GFD 106) Use Cases Grid Scheduling Use Cases (GFD 64) Education ISV Primer (GFD 141) Job Definition Agreement WS-Agreement (GFD 107) Programming Interface SAGA (GFD 90) Job Description JSDL (GFD 56/136) Uses Programming Interface DRMAA (GFD 22/133) Accounting Usage Record (GFD 98) Application Description HPC Application (GFD 111) Supports Produces Application Description SPMD Application (GFD 115) Extend Job Management OGSA-BES (GFD 108) Job Parameterization Parameter Sweep (Draft) Information GLUE Schema (Draft) Describes Profiles File Transfer HPC File Staging (GFD 135) HPC Domain Specific Profile HPC Basic Profile (GFD 114) 12

  13. OGF Data-Related Standards Data FormatDescription Language Storage Network Community Information Dissemination InfoD (GFD 110) Movement DMI (GFD 134) Naming RNS (GFD 101) Existing Possible Transport GridFTP (GFD 20) Access Byte-I/O (GFD 87/88) Storage Management SRM (GFD 129) Access & Management DAIS (GFD 74,75,76) Unstructured Data(Disk, Tape) Structured Data(Database) 13

  14. HPC Basic Profile HPC Specific Job Management HPC Basic Profile (GFD 114) Education ISV Primer (GFD 141) References Combines Job Definition Security WS-Security (OASIS) Security SSL/TLS (IETF) Job Management OGSA-BES (GFD 108) Job Description JSDL (GFD 56/136) Uses Provides Access To Extend Application Description HPC Application (GFD 111) File Transfer HPC File Staging (GFD 135) Compute Resources 14

  15. Running Applications Remotely • ISV Remote Computing Usage Primer, GFD-I.141 • How to use sets of OGF standards for different scenarios • www.ogf.org/RemoteExecution 15

  16. Strategic OGF Activities 2009 www.ogf.org

  17. A Current Operational Infrastructure 17

  18. Data Center Migration Vast Array of Application Scenarios Driving Evolution 18

  19. Strategic OGF Activities • Grids and Clouds • Green IT • Cyberinfrastructure Requirements • Production Grid Interoperability • Geospatial Application Domains 19

  20. How Do Grids and Clouds Relate? • Opinions vary … but … • Grids came out of “big science” and the desire to collaborate in a federated environment • Managed sharing of resources • Clouds came out of industry and the desire to dynamically provision resources in the cloud • Simple APIs for using abstracted or virtualized resources • Economies of scale in the data center • Aka, utility computing, internet computing, … • “Grids are an access model; Clouds are a business model” • Chris Smith, Platform Computing, OGF VP Standards • Distributed applications need and can use capabilities being developed under both rubrics of grid and cloud • There is no real grid vs. cloud dichotomy 20

  21. A Host of Cloud Issues • Data access and interoperability • Still has to be approached at the app domain level, with the domain users involved • What data do analysts really want and need, and where is it • Security • Machine-image clouds vs. application-hosting clouds • Private clouds vs. public clouds • How to express and enforce policy? • Reliability • Can cloud providers provide sufficient reliability for critical applications? • Can live migration, “NIC teaming” be made to work across sites? • Frameworks • How to manage sets of Virtual Machines (VMs) and Virtual Organizations (VOs)? • What services do non-specialist, end-user analysts really want and need? • Performance management • Clouds abstract away system info: e.g., compute-data locality, bandwidth, etc. • How to judiciously expose system information through cloud APIs? • How to characterize expected workload and manage behavior through SLAs? • Costing models • How to compare cloud infrastructure costs with traditional methods? • What are the cost/benefit trades? 21

  22. OGF Cloud Efforts • Open Cloud Computing Interface (OCCI) Working Group • Public cloud interface standards • Important group members, e.g., Reservoir, Eucalyptus and Nimbus, etc. • Coordination across industry and SDOs is critical • OGF, CSA, OCC, SNIA, OMG, CCIF, OASIS, NCOIC, DMTF, … • SATCCI Meeting, March 23, DC • federalcloudcomputing.wik.is/index.php?title=March_23%2C_2009 • SCRM telecons • IBM, Cisco, Sun, Fujitsu, OCC, NIST, OGF attended last call • Organizations to post summaries on SRCM wiki • Cloud Standards Summit, July 13, DC • federalcloudcomputing.wik.is/July_15%2c_2009 • Originally scheduled for July 15 but moved to accommodate the following • Cloud Computing Symposium, July 15, DC • Hosted by National Defense University, www.ndu.edu/irmc/ilss/ilss_events.html • Vivek Kundra (US Federal CIO) to keynote • Cloud Standards Summit trying to get an outbrief slot • CloudWorld • Co-located w/ NGDC and OpenSource World, August 12-13, San Francisco • OGF personnel on CloudWorld Program and Advisory Committees • Chris Smith (OGF VP Standards) to present on behalf of OGF Enterprise • OGF-27 Workshops: “Grid to Cloud” and “HPC in Cloud” • Identify more concrete coordination activities before July 13 meeting • OCCI/OVF profile, cloud workflows, virtual organizations, … 22

  23. Green IT/Grids/Clouds • Energy becoming defining issue for Data Centers • Beyond cost: location feasibility • Energy Management Architectures are Sensor & Control Systems • Environmental Monitoring • Decision Making • Enacting Responses • Control Mechanisms include: • Scheduling • Voltage-Frequency Scaling • Powering racks up-down • VM placement & migration • Clouds can be used to enforce energy policy • By abstracting the infrastructure, clouds can transparently manage workload on the back-end • Consolidate jobs on servers • Move work to where the green power is • Several projects underway • Reservoir (EU), OpenNebula (EU), GreenNet (INRIA), GreenLight (NSF), Low Carbon ICT (UK) More data centers are just not possible in NYC or London 23

  24. An Example of an Energy Management Architecture Anne-Cecile Orgerie, Laurent Lefèvre, and Jean-Patrick Gelas, Save Watts in your Grid: Green Strategies for Energy-Aware Framework in Large Scale Distributed Systems. 14th IEEE International Conference on Parallel and Distributed Systems, Melbourne, Australia, December 2008. 24

  25. A Notional Green IT Reference Model • CO2 Working Group Starting • Reporting interface between physical infrastructure management and workload management 25

  26. Cyberinfrastructure Requirements • What is Cyberinfrastructure (CI)? • Dynamic Data-Driven Application Systems (DDDAS) • Integrated Cyber-Physical Systems (CPS) • CI Requirements Gathering project initially discussed by E. Seidel (Director NSF/OCI) SC08 • eXtreme Digital (XD) is NSF's follow-on to TeraGrid • Postponement of XD proposals to June 2010 crystallized timeframe & process • Proposers to do a year of reqs. gathering, analysis & planning • OGF to be a neutral venue for all (both) teams • Requirements need to be collected/analyzed • Across all regions: EU, NA, AP 26

  27. CI Reqs. Gathering Plan • GOAL • Conduct a thorough survey of CI requirements, perform a solid analysis that identifies key CI capabilities, and make clear recommendations for investment, research, development, and adoption • APPROACH • Recruit Participants and Contributors • Review Documents from Previous Efforts • Engage all CI-relevant Projects & Workshops • Organize CI Workshops at OGF-27 and OGF-28 • Write & Publish Overview CI Requirements Doc • In coordination with OGF e-Research and all relevant stakeholders 27

  28. Production Grids • Production Grid Infrastructures WG formed to nail-down interoperability standards • Follow-on to Grid Interoperation Now (GIN) Community Group • Includes EGEE, OSG, NAREGI, NorduGrid, TeraGrid, NGS • Ambitious charter including (but not exhaustively): • Production Grid Infrastructure Roadmap Document (GFD-I) • Secure Job and Data Management Profile in Production Grids (GFD-R.P) • Secure Information Profile in Production Grids (GFD-R-P) • Secure Accounting Profile in Production Grids (GFD-R-P) • Secure Monitoring Profile in Production Grids (GFD-R-P) 28

  29. Possible Technical Areas • Data Access & Interoperability • Global File System • Workflow • Virtual Organizations • Programming Models/Frameworks • Campus Clouds, HPC/Science Clouds • Performance Management (in clouds) • Network and Communication Management • Accounting and Costing Models • Fault-tolerance and Reliability • Portability & Interoperability • Stakeholders need to be engaged • Which ones for which technical goals? • Which WG-level activities? 29

More Related