1 / 42

WP5 Dissemination, training, certification and web tools

WP5 Dissemination, training, certification and web tools. Marc-Elian Bégin (CERN) WP5 Leader ETICS Final Review CERN, Geneva - 15 February 2008. Contents. Goals Major Achievements Challenges Metrics and Statistics Conclusions. 2. Goals. Goals.

barbrak
Télécharger la présentation

WP5 Dissemination, training, certification and web tools

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. WP5Dissemination, training, certification and web tools Marc-Elian Bégin (CERN) WP5 Leader ETICS Final Review CERN, Geneva - 15 February 2008

  2. Contents • Goals • Major Achievements • Challenges • Metrics and Statistics • Conclusions ETICS Final Review - WP5 - CERN, 15 February 2008 2

  3. Goals ETICS Final Review - WP5 - CERN, 15 February 2008

  4. Goals ETICS Final Review - WP5 - CERN, 15 February 2008 Dissemination of ETICS results and best practices Training on the ETICS Service and Tools Certification study: ‘WP5 will conduct a feasibility study about the possibility of establishing a “Quality Certification” for software produced by research projects’ 4

  5. Goals • Web applications: one of the main user interface of ETICS • Central location to build the community, attract new users and used as first tool for distance training • Allow users to register their software, specify configuration information, compare the configuration with other registered software in order to identify interoperability issues • Register test suites • Launch build and test jobs • Collect results • Provide a generic reporting tool that projects can use to collect detailed information about their software, the test results, quality metrics, etc. ETICS Final Review - WP5 - CERN, 15 February 2008

  6. Major Achievements ETICS Final Review - WP5 - CERN, 15 February 2008

  7. Branding • Dissemination • Strong graphical identity ETICS Final Review - WP5 - CERN, 15 February 2008 7

  8. Branding ETICS is an international brand • Present in a number of European events, and mentioned as a companion service by our partners: EGEE and DILIGENT • Relationships with: • EuChinaGrid (IPv6 work) • Condor team • Globus • Standard bodies • ETSI • OGF • World-wide promotion: Asia (Japan, China), Americas (Canada, USA, Brazil) ETICS Final Review - WP5 - CERN, 15 February 2008

  9. Web site ETICS Final Review - WP5 - CERN, 15 February 2008

  10. Google.com ranks 1st when searching“grid quality process” in google.com ETICS Final Review - WP5 - CERN, 15 February 2008

  11. Yahoo ranks 1st when searching“grid quality process” in yahoo.com ETICS Final Review - WP5 - CERN, 15 February 2008

  12. ETICS in the News • Web Search • Google and Yahoo show ETICS portal first for • ‘ETICS’ • ‘Grid Quality Process’ • ETICS in the news • Feature in Science Grid This Week • (re-print in) Grid Today • Details in: http://etics.web.cern.ch/etics/dissemination/dissemination_articles.htm#Articles ETICS Final Review - WP5 - CERN, 15 February 2008

  13. Paper material produced ETICS Final Review - WP5 - CERN, 15 February 2008

  14. Standardisation • Co-chair of new Open Grid Forum (OGF) Build, Test and Certification Community Group, with Peter Couvares (WP2 Leader/UoW) • Grid-QCM • Prepared first version of the model • Plan to propose Grid-QCM for ISO standardisation during ETICS-2 • IPv6 • EuChinaGrid / EGEE/SA2 • Definition of testing framework for IPv6 compliance tests • IPv6 plugin for static source code analysis • IPv6 resources for dynamic tests • ETSI • Started to discuss with ETSI about standardisation work • Discussions took place during OGF20 and the 4th e-Infrastructure Concertation event ETICS Final Review - WP5 - CERN, 15 February 2008

  15. Community • We have grown the ETICS Users Community • Several types of users: • Using ETICS • Experimenting ETICS • Interested in ETICS evolution and services • Currently registered projects: 18 ‘production’ projects (+ a number of evaluation projects) • org.glite: gLite is the next generation middleware for grid computing developed by the EGEE project • org.glite.testsuites: This project contains testsuites for the gLite project • org.diligentproject: A DIgital Library Infrastructure on Grid ENabled Technology • org.etics: The ETICS System • etics-contrib: Tools and extensions to the ETICS system • externals: This project contains all externals components that are not part of any ETICS project, but are used somewhere as dependencies • quattor-compiler: java implementation of pan language compiler ETICS Final Review - WP5 - CERN, 15 February 2008

  16. Community (2) • Currently registered projects: 18 ‘production’ projects (cont.) • torquemaui: Maui scheduler and Torque resource manager • OMII-Europe: The Open Middleware Infrastructure Institute for Europe • gLite-ipv6: A Pilot project to test the IPv6 compliance of the gLite middleware • gridway: Metascheduling Technologies for the Grid • Grid-Ireland: Grid-Ireland • grid-testbed: Automatic tools for testing Grid software • Metronome: The NMI Build & Test software • mpi: components to support MPI use of the grid • psnc: Contains software developed, maintained or hosted in Poznan Supercomputing and Networking Center (GridSphere) ETICS Final Review - WP5 - CERN, 15 February 2008

  17. Community (3) • Evaluation projects: • CASTOR: The CERN Advanced Storage Manager system • Condor: Testing Condor • dicom: DICOM Servers and Clients • EGRID: Italian national Grid infrastructure for financial and economic research • glite-release: glite-release • gridice: Distributed Monitoring Tool for Grid Systems • myproject: ETICS Test project, used for unit ant system tests • ppt-apt: AIS project for the PPT/APT application • quattor: The ELFMS/Quattor Project • SAGA: The Simple API for Grid Applications (SAGA) is a OGF standard for a high level API for developers of grid applications. This project covers the SAGA reference implementations • tutorialProject: The ETICS tutorialProject • vdt: The Virtual Data Toolkit (VDT) is an ensemble of grid middleware that can be easily installed and configured • VL-e: The Virtual Laboratory for e-Science tries to bridge the technology gap ETICS Final Review - WP5 - CERN, 15 February 2008

  18. Getting ETICS known Conferences and events participated to: 46 • Qualipso Conference 16-17 January, 2008 Rome • HICSS-41 7-10 January, 2008 Hilton Waikoloa Village Resort • EELA 3rd Conference - e-Infrastrucure - Grid Conference 3-5 December 2007 Catania, Italy • Open Grid Forum 21 15-19 October, 2007 Grand Hyatt Seattle • EGEE'07 Conference 1-5 October, 2007 Budapest, Hungary • CHEP 2007 2-7 September, 2007 Victoria, British Columbia, Canada • 5th International Summer School on Grid Computing 8-20 July 2007 Mariefred, Sweden • First ETICS User Workshop 28 June, 2007 CERN, Switzerland • BELIEF-EELA e-Infrastructures Conference 25-28 June, 2007 Rio de Janeiro, Brazil • ETICS All Hands 23-25 May, 2007 University of Wisconsin- Madison, Madison, USA • Training: Interoperability testing on the Grid using OMII-Europe components and ETICS tools 12 May, 2007 Manchester Central • Open Grid Forum 20 7-11 May, 2007 Manchester Central • 1st International Conference 24-27 April 2007 Beijing, China • EGEE / EUChinaGrid / ETICS IPv6 meeting 17 April 2007 CC-IN2P3, Lyon, France • EGEE JRA1 All Hands 7 - 9 March, 2007 University of Catania, Italy • EGEE Industry Day 23 February, 2007 Budapest, Hungary • EGEE IPv6 meeting 19-20 February, 2007 GARR headquarters, Rome, Italy • EUChinaGrid WP2 - Network planning and interoperability study 27 February, 2007 Madrid, Spain ETICS Final Review - WP5 - CERN, 15 February 2008

  19. Getting ETICS known (2) • ETICS 1st Year Review 9 February, 2007 CERN, Switzerland • Open Grid Forum 19 29 January-2 February, 2007 Chapel Hill, NC, USA • EGEE SA3 All Hands 27-29 November, 2006 CERN , Switzerland • 3rd Concertation meeting on e-Infrastructure, Specific theme: FP6-funded test-beds 21-23 November, 2006 Helsinki, Finland • Super Computing 2006 11-17 November, 2006 Tampa, Florida, USA • EGEE JRA1 All Hands 8-10 November, 2006 Abingdon, UK • ETICS All Hands 23-25 October, 2006 Bologna, Italy • eInfrastructure Reflection Group (eIRG) Workshop 4-5 October, 2006 Espoo, Finland • ETICS Training (DILIGENT Technical Coordination Meeting) 4 October, 2006 University of Basel, Basel, Switzerland • EGEE '06 Conference 25-29 September, 2006 Geneva, Switzerland • ETICS Training (as part of the EGEE'06 Conference) 24 September, 2006 Cern, Switzerland • RISE 2006 International Workshop on Rapid Integration of Software Engineering techniques 13-15 September, 2006 University of Geneva, Switzerland • Open Grid Forum 18 11-14 September, 2006 Congress Center, Washington, USA • EGEE JRA1 All Hands meeting 10-12 July, 2006 Pilsen, Czech Republic • International Grid Summer School on Grid Computing 9-21 July, 2006 Ischia, Italy ETICS Final Review - WP5 - CERN, 15 February 2008

  20. Getting ETICS known (3) • Europython 2006 3-5 July, 2006 CERN, Switzerland • DILIGENT Technical Coordination Meeting 26-30 June, 2006 Frascati (Rome) - Italy • European Condor Week 26-29 June, 2006 INFN - Milano, Italy • HP Event: CERN openlab/EGEE/ETICS gLite Industry Readiness Workshop 15-16 June, 2006 Meyrin, Switzerland • Global Grid Forum 17 10-12 May 2006 Tokyo International Forum, • Condor Week 24-27 April 2006 University of Wisconsin • Belief brainstorming event: Future Knowledge Infrastructures - Scientific Repositories and content management over the grid 11-12 April 2006 Johannes Kepler University Linz, Austria • e-Infrastructure Reflection Group Workshop 10-11 April 2006 Johannes Kepler University Linz, Austria • DILIGENT Technical Coordination meeting 27-30 March 2006 CERN, Switzerland • EGEE JRA1 All-Hands meeting 22-24 March 2006 CERN, Switzerland • 3ème Cycle Romand d'Informatique 10 March Montana, Switzerland • EGEE User Forum 1-3 March 2006 CERN, Switzerland • ETICS Kick-off meeting 20 January 2006 CERN, Switzerland ETICS Final Review - WP5 - CERN, 15 February 2008

  21. Web Interfaces • Web applications • Application Portal / MyETICS • Configuration Editor • Repository Service • Trend analysis • More details in the dedicated demos in the afternoon ETICS Final Review - WP5 - CERN, 15 February 2008

  22. Web Interfaces: Application Portal ETICS Final Review - WP5 - CERN, 15 February 2008

  23. Web Interfaces: Configuration Editor ETICS Final Review - WP5 - CERN, 15 February 2008

  24. Web Interfaces: Repository Service ETICS Final Review - WP5 - CERN, 15 February 2008

  25. Trend Analysis ETICS Final Review - WP5 - CERN, 15 February 2008

  26. Training • In collaboration with all other activities, WP5 has developed a flexible and modular training program, including presentations, tutorials and demos • 8 Training events • 23 - 24 October 2007: ETICS workshop • 24 - 26 September 2007: ETICS workshop for the OMII-Europe community • 28 June 2007: First ETICS User Workshop • 12 May 2007: Interoperability testing on the Grid using OMII-Europe components and ETICS tools • 10 May 2007: ETICS Service Presentation for OGF BTC Community Group • 07 March 2007: ETICS Service • 04 October 2006: ETICS Service • 24 September 2006: ETICS Service • For details: http://indico.cern.ch/categoryDisplay.py?categId=1168 • ~90 people trained • ~2 000 email in the etics-support@cern.ch mailing list, although not training nor WP5 specific, still represents an important aspect of getting users to better understand the system ETICS Final Review - WP5 - CERN, 15 February 2008

  27. Exploitable results • ETICS Software • The “Plug-in Framework” allows it to integrate external tools, even commercial ones! • It’s licensed as Open Source in Apache 2.0 compliance • A great opportunity to create an active Open Source Community (helped by re-hosting source code in SourceForge) • ETICS Service • Can be hosted on publicly funded institutions owning infrastructures (e.g. CERN, UoW, INFN) or other ad-hoc consortia/projects • Independent from any development environment • Suitable for a pay-per-use model • We’re investigating any support to EGI ( European Grid Initiative) • Grid-QCM • Quality assurance model for software products • Good foundations, standardisation could be possible in 2009 ETICS Final Review - WP5 - CERN, 15 February 2008

  28. Sustainability • CERN and ENG will promote the Open Source nature of ETICS • This will be eased by hosting the source code to SourceForge, joining thousands of other open source projects • ENG will experiment using Grid-QCM and ETICS as part of its CMMi level 3 certification • Great opportunity to improve the software and the services during ETICS 2 (under negotiation) • EGEE and DILIGENT pledged to continue using ETICS for automating their build and test procedures • 4DSOFT to include ETICS in their commercial strategy as consultancy ETICS Final Review - WP5 - CERN, 15 February 2008

  29. Metrics and Statistics ETICS Final Review - WP5 - CERN, 15 February 2008

  30. Metrics and Statistics Deliverables, including intermediate requested versions for D5.7 and D5.9 > Including early drafts requested during 1st EU Review: D5.7 and D5.9 ETICS Final Review - WP5 - CERN, 15 February 2008

  31. Metrics and Statistics (2) Milestones ETICS Final Review - WP5 - CERN, 15 February 2008

  32. Metrics and Statistics (3) SIZE OF THE ETICS USER COMMUNITY • Description: The user confidence plays an important role for the ETICS results. Hence the goal is to attract as many users of the ETICS Service as possible. During the project lifetime a large community will be build (hopefully). • Metric: Number of registered members • Metrics: Number of registered projects • Statistics from Repository: 24 Projects, 774 Modules, 33544 Packages, 765 Main Reports, 33356 Module Reports, 9746 Metrics ETICS Final Review - WP5 - CERN, 15 February 2008 32

  33. Metrics and Statistics (4) COMMUNITY WEB SITE IMPACT • Description: The web site (www.etics-eu.org) is one of the main ways for ETICS to reach out and disseminate results. This indicator tries to measure the impact of this tool by calculating the number of accesses, files downloaded, etc. • Metric: Number of accesses (not hits): * Unique visitors ETICS Final Review - WP5 - CERN, 15 February 2008

  34. Metrics: Number of accesses ETICS Final Review - WP5 - CERN, 15 February 2008

  35. Metrics and Statistics (6) NEWS ECHOES • Description: Press/news echoes and articles on ETICS show the relevance of the project to the press and news media. • Metric: Number of press/news releases: • Metrics: Number of press echoes at national/European or overseas level: ETICS Final Review - WP5 - CERN, 15 February 2008

  36. Metrics and Statistics (7) NUMBER OF CONFERENCES, WORKSHOPS AND EVENTS • Description: the participation to and/or organisation of conference, workshops and other events indicates the coverage area ETICS has. • Metric: Number of training events organised and/or participated to: • Metric: Number of dissemination/workshop events organised and/or participated to: • Metric: Number of papers published: ETICS Final Review - WP5 - CERN, 15 February 2008

  37. Metrics and Statistics (8) DISSEMINATION MATERIAL • Description: Different dissemination material is required to attract attention on ETICS and to reach a critical mass of users and supporters of ETICS. • Metric: Number of flyers and fact sheets: • Metric: Number of posters: ETICS Final Review - WP5 - CERN, 15 February 2008

  38. Metrics and Statistics (9) WEB INTERFACE QUALITY OF SERVICE • Description: In order to maintain high level of satisfaction from ETICS users, we need to offer a high service availability and quality of service. • Metric: Percentage of up-time of the ETICS service, based on service instrumentation and collection using CERN’s SLS Service: • Metric: Number of unexpected server behaviour (e.g. crash), resulting in total or partial loss of service availability, based on service instrumentation (without permanent lost of data) *Number of unexpected server behaviour: 0 (only problems experienced where related to incompatible browser versions, and once slow performance, due to server issues) ETICS Final Review - WP5 - CERN, 15 February 2008

  39. Challenges ETICS Final Review - WP5 - CERN, 15 February 2008

  40. Challenges • Growing community means large usage of infrastructure and deployed software, with direct consequences on all WP5 delivered subsystems • Repository requirements are much more challenging than originally expected • New design required • Needed to use new technologies (e.g. REST, Jack Rabbit, Web 2.0) – harder to manage development schedule • Larger user community also means larger usecase spectrum, which led to a redesign of the Build and Test Web Client • Increasing richness of plugins means more metrics collected, generating more data for Repository service • Sustainability is hard for project with short term funding • No comparative model existed for Certification of complex and distributed software (e.g. Grid) -> we had to create Grid-QCM ETICS Final Review - WP5 - CERN, 15 February 2008 40

  41. Conclusions • ETICS has established itself as the “Grid Quality Process” in the e-Infrastructure arena • With over 200 registered users and 20+ projects, the system has exceeded all growth targets • ETICS is leading a world-wide standardisation effort, through an Open Grid Forum “Build, Test and Certification Community Group” and with the proposed Grid-QCM model • ETICS provides a rich and user friendly web user interface ETICS is the Grid Quality Process! ETICS Final Review - WP5 - CERN, 15 February 2008

  42. Thanks http://www.eu-etics.org ETICS Final Review - WP5 - CERN, 15 February 2008 42

More Related