An Introduction to Test Support-as-a-Service

1. An Introduction to Test Support-as-a-Service University-Industry Consortium Meeting May 12, 2011. Moorhead, MN, USA Presenter: Tariq M. King

2. Outline • Introduction • Background • Motivation • Test Support-as-a-Service • Conclusion • Questions

3. Introduction • National Defense Industrial Association states that Software Testing In The Cloud (STITC) is an area that will grow in importance in the next few years • STITC is an emerging discipline that has potential to significantly change the way testing is done • STITC lies at the intersection of software testing, cloud computing, and system migration, and canbe divided into three facets: • TestingIN, OF, and TO the Cloud

4. Background Cloud Computing • The cloud provides ubiquitous, on-demand access to computing resources “as services” via Internet Software-as-a-Service| Google Docs, Office Web Apps Platform-as-a-Service| Google App Engine, Windows Azure Infrastructure-as-a-Service | Amazon EC2, Rackspace

5. Background Virtualization • Creating abstract computing resources from more powerful physical resources

6. Background Software testing • The process of operating software under specifiedconditions, observing the results, and making an evaluation of the software. [IEEE 610.12 Std.] • Testing is the primary means of validation used in the software industry, and can account for as much as 50 to 75 percent of software development costs • Automating the testing process is not an easy task but can have long-term benefits: • Reduced costs, time, and risks • Increased coverage

7. Motivation Testing of the cloud • What makes cloud-based applications easier or more difficult to test than conventional applications during development and maintenance? Cloud Testability Impact on Application Development

8. Dark Side of Cloud Testability High Dependability & Performance Requirements Statefulness Complexity Autonomy InformationHiding Paradigm Infancy Remoteness

9. Bright Side of Cloud Testability Computational Power Storage Virtualization Testing requires lots of resources and the cloud is certainly powerful enough to handle it

10. Test Support as-a-Service (TSaaS) Provider A and B in a Cloud Community Expose TSaaS to Provider C

11. TSaaS Development Methodology Describes How To Extend Existing Test Automation To Develop TSaaS for Partners

12. TSaaS Architecture Major Components of the TSaaS Architecture

13. TSaaS Prototype Proof of concept Designed for the Windows Azure Cloud Platform

14. Research Status and Conclusion • Building the prototype established the feasibility of TSaaS development but still much work to be done to evaluate the proposed testing approach • Seeking to apply TSaaS in the context of a real world problem where various aspects of the approach would be practically useful • Collaborative or “Community Cloud” • Testing plays a central or vital role • Benefit from virtualization or simulation • Possible cloud or testing projects for consortium.

15. Acknowledgements • Annaji Ganti, PhD Student, NDSU • David Froslie, Test Architect, Microsoft Fargo • Dr. Scott Tilley, Professor, Florida Tech • Reviewers and participants of the 2010 Workshop on Software Testing in the Cloud

16. Thank You! Questions?¿Preguntas?問題Sawwalвопросы質問domandeερωτήσεις