1. Accessing and using Cloud services Hands on with data infrastructure that can power your agricultural data products, December 12th, 2013 Riccardo BRUNO – INFN, division of Catania, Italy (giuseppe.larocca@ct.infn.it)

2. Outline Introduction The Science Gateway and its applications The Cloud based infrastructure and its services/applications MyCloudPortlet Conclusions

3. Evolution of distributed computing Cost of hw Cost of networks Time 90’s-00’s Grid Computing 00’s-10’s Cloud Computing 80’s-90’s Cluster Computing Mainframe Computing Power of COTS WAN bandwidth

4. The e-Infrastructure Vision Virtual Research Community (VRC) e-Infrastructure“an environment where research resources (hardware, software and content) can be readily shared and accessed where necessary to promote better and more efficient research” The Research Grid/Cloud Infrastructureprovides a distributed environment for sharing computing power, storage, instruments and databases through the appropriate software (middleware) Grid/Cloud Infrastructure e-Infrastructure The Research Network Infrastructure provides fast interconnection and advanced services among Research and Education institutes of different countries Network Infrastructure

5. Research Networks at “global” scale

6. The “Global” Grid and middleware Genesis II

7. Grid middleware is not straightforward  Users have to cope with complex security procedures, execution scripts, job description languages, command line based interfaces and lack of standards This makes the learning curve very steep and keeps non IT-expertsaway

8. The Catania Science Gateway • Intuitive and collaborative environment • No more complicated certificate handling • Federated Authentication • Fine grained Authorization • No more technical issues • Shareable applications (market) • User friendly environment • More secure access to shared resources • Standard-based approach for sustainability • Compliant with EGI traceability policy • http://www.catania-science-gateways.it • http://sourceforge.net/projects/ctsciencegtwys/

9. The GridEngine • GRID ENGINE Usage • Java Libraries accessible from JSR 286 Portletsor by stand-alone applications • REST interface for programmatic access (new) • api.ct.infn.it(under development) • Client-Server interactions through OAUTH2 keys • Server-Server SSH key exchange • Developers/External services must request the keys • AUP has to be signed to obtain the Keys • The Key requestor will be the responsible of anyservice activity making use of the REST APIs(EGI traceabilty policy: user, IP, action, …) • The Science Gateway owner will be the responsible of any activity performed by the GridEngine • OGF SAGA standard • JSAGA implementation

10. The Science Gateway MyCloud Orchestrator(based on OCCI) Cloud#1 Cloud#n • Open Cloud Computing Interface • REST approach to manage Clouds • Best solution seeking for Standards Single domain

11. The cloudstack

12. PaaS/IaaS(1/2) Survey available from the agINFRA SG 29 questions

13. PaaS/IaaS(2/2) • 2 Possibilities • Requestorprovides a VM • More details must be provided • The user must provide a VM image file • Requestor just asks for a new VM, three image types: • Three different CPU, RAM and Storage configurations • Small, Medium, Large • Requestor must agree and then sign an AuP • 2 questions in the Survey • 1 A MoU to be signed and send • The VM content will be under full responsibility of the requestor

14. SaaS Science Gateway Catania Grid/Cloud Engine Security context Job management Stage-in/out SG VM Adaptor robot certificate start VM SG VM 1) stage-out VM SG stage-in & runapp 2) kill VM

15. MyCloud • Current functionalities • Federated authentication • Fine-grained authorisation • Single/multi-deployment of VMs on a cloud and across clouds • Single/multi-move of VMs across clouds • Single/multi-deletion of VMs on a cloud and across clouds • SSH connection to VMs • Direct web access to VMs hosting web services • Same domain name across clouds

16. Conclusions • The Catania Science Gateway Framework changes the way Gridinfrastructures are used, hugelywideningtheirpotentialuser base across continents and organisations, especially non-IT experts and the “citizen scientist” • Developedapplicationsare ‘shareable’ amongdifferent Science Gateway isntances, thisleads to a portfolio of appealingapplicationsdeveloped by international task forces • The MyCloudportletease the VM management (PaaSand IaaS)targetingdifferentCloud management systems (OCCI compliant) • The standards OCCI combined with SAGA, allowapplicationsto be executed in a SaaS fashion intoa FederatedCloudenvironment; no matterwhere the applicationphysicallyruns.