220 likes | 324 Vues
How to get involved and what it means to join the NGS. David Wallom Technical Director. Content. Membership Types Site Level Services What we’re supporting Membership process. NGS Internally. Split into 3 themes Operations Runs the central services upon which NGS is based
E N D
How to get involved and what it means to join the NGS David Wallom Technical Director
Content Membership Types Site Level Services What we’re supporting Membership process
NGS Internally • Split into 3 themes • Operations • Runs the central services upon which NGS is based • Develops software stack and creates UK repository of e-infrastructure best practice • Liaison • Partnership, and developing new member institutions, facilities and research organisations • Outreach • Training • Research and Development • New user/institution led services, e.g. cloud computing • Open ‘call’ for new services from e-Science/Resaerch projects and centres • Development of the utilization of the UK high performance network
Organisational Membership • Personnel • Appointment of an institutional Campus Champion • Liaison between HEI/research organisation and NGS
Campus Champions • The first level of NGS membership, they are; • A source of information regarding NGS resources and services • A source of user accounts on their campus • A conduit for the campus e-infrastructure needs, requirements and challenges • A host for an NGS training event giving visibility to the institutions commitment • The direct access to the outreach and training group in the NGS
Organisational Membership • Personnel • Appointment of an institutional Campus Champion • Liaison between HEI/research organisation and NGS • Resource Exchanging • Regularly tested installation of NGS defined interfaces as described in the NGS Sits Level Services Document • Affiliate • Maintains control over permitted users • Partner • Supporting access by a significant body of NGS users • Publish a service level description (SLD) detailing the services offered
Collaboration Board Partner sites are able to nominate a high level representative to sit on this board Representative at academic level to liaise between NGS and institutions Give us institutional requirements Nominated at an institutional level by senior staff such as Pro Vice Chancellor/Provost Meeting once/twice per year
Membership Process • Contact by Technical Director with Research Computing centre or known academic • Liaison Theme • Organise roadshow event • Identify Campus Champion • Identify resource for exchange • Operations Theme • Nomination of support buddy to work with site • Partnership team work with site for website and if necessary SLD
Membership Process Buddy works with site to install software as per a compliant profile Use manual INCA tests to determine installation success Add to automated compliance testing framework After 7 days successful conformance testing has been completed Site is then recommended to the board
Membership Pipeline • Sites needing completion • NWGrid, HECTOR, Edinburgh (Partnership), Aston, Aberystwyth • Roadshow competed sites • Bath, Exeter, OU, Norwich Biosciences • In progress sites • Christchurch Canterbury, Sussex(GridPP), QMUL(GridPP) • New sites • ATLAS Datastore, NSCCS, DIAMOND
NGS Site Level Services Document • Description of the different solutions to service requirements challenges • A set of different modules describing a particular function, each with a number of solutions which are grouped together as profiles • Supported interfaces are community driven, we will not/cannot dictate what we make available. • For example we are currently supporting the following computational interfaces: VDT gLite Globus 4 GridSAM
NGS Recommended Profile User Authentication and Authorisation: x509 (VDT) Information System: GLUE (VDT) Compute resource Service: Pre-WS GRAM (VDT) Data Transfer Tools: GridFTP (VDT) Storage Management, Database Hosting & User Data access Services: Clients (SRB, SRM, OGSA-DAI) User Interface Service: GSISSH (VDT)
EGEE/GridPP Node User Authentication and Authorisation: x509 (gLite) Information System: GLUE (gLite) Compute resource Services: Pre-WS GRAM (gLite) Data Transfer Tools: GridFTP (gLite) Storage Management, Database Hosting & User Data access Services: Client & Server (SRM)
Data services • Database (Oracle & MySQL) • Supports both user communities and NGS core services • STFC and University of Manchester • Storage Resource Broker • Share, replicate and access data with colleagues more efficiently • Distributed metadata capable storage system • Filesystem access to disk storage • SCP, GSI-SCP, AFS (on the way) • Service based methods to access structured data using OMII-UK OGSA-DAI • All integrated with the NGS user authentication and authorisation mechanisms
Specialist services • Belfast e-Science Centre • Web Service Hosting Container Service • Web service containers into which projects or VOs can deploy their own Web or Grid services, using automatic deployment technology • Oxford e-Research Centre • OMII-UK GridSAM • OGF HPC-Basic Profile compliant Job submission • Promoting interoperability with international grids • Eucalyptus Cloud system • Exposing AWS compatible interfaces and functionality to NGS users • Edinburgh • Eucalyptus Cloud system • STFC Rutherford Appleton Laboratory • Visualisation using specialised cluster from within the STFC e-Science Viz group Westminster • Operates and supports P-GRADE portal and GEMLCA legacy application support services
Process for a New Service • User/Research community propose new service • Research and Development Team • Deploy test service, working with community • Develop appropriate service documentation • Final test service deployed on further NGS sites • Service ready for production deployment • Operations Team • Deploy operational production service • Liaison Team • Publicize the availability of the new service • Training materials developed with the community and training events held
Conclusions We are supporting successfully a number of different software profiles for different communities The resource membership process has been well exercised and with increased manpower new resources will be more rapidly processed Collaboration Board will enable academic priorities to be fed into the project