120 likes | 292 Vues
Milen Georgiev November 2013. Test Automation overview Some products and approach. Common challenges. v Industry terms game - Test Automation is a necessary pre-requisite, in order to do Automated Testing of computer software (systems).
E N D
Milen Georgiev November 2013 Test AutomationoverviewSome products and approach
Common challenges • v Industry terms game - Test Automation is a necessary pre-requisite, in order to do Automated Testing of computer software (systems). • v We consider three test types – GUI functional test, API functional test and API load/performance test. The applicatoin context includes – web/http, mobile and SOAP/web services. • How to implement our test cases (and organize them in suites) in such a way, that we would be able to: • do fast (parallel) and fully automated regression testing; • have re-usable, easily maintained, granular/modular, pattern-based test objects. Note: Let’s define, that our test scripts generate test cases and contain/use test objects; • handle SUT (system under test) changes in a timely manner. • Note: We have middle-size or large-size enterprise software system for SUT.
Two alternative end-to-end solutions • Commercial product set, sample • - HP Unified Functional Testing (former Quick Test Professional), • - Quality Center (part of HP Application Lifecycle Mgmnt sw solution set), • - Load Runner, Perfecto for mobile apps (HP partner) • - Service Test • Commercial plus open-source product set, sample • More specifically - open-source and API based, java-centered. • - Selenium WebDriver • - JUnit and Jmeter these three are assembled in the Eclipse IDE • - XXX-some software for bug-tracking and process-organization/facilitation • Other popular products/tools, which eventually could be grouped in solutions – SoapUI; Sahi, Watir; Silk Test, Silk Performer, …
Case-study • What we are going to test? • 1. Let's pick 3 search engines • https://www.google.de/ • http://www.bing.com/ • http://www.delta-search.com/ • 2. Let's search for 6 different texts • big data adastra, business intelligence adastra • data warehouse adastra • adastra big data, adastra business intelligence • adastra data warehouse • 3. For each of these searches let's EXPECT/REQUIRE to have 2 url/web_addresses on the first results web page • adastragrp.com • adastracorp.com • 4. If the addresses from point 3 were found, the corresponding test case PASSES. • If the addresses from point 3 were NOT found, the corresponding test case FAILS. • Here, we have 3 test suites * 12 test cases.
Data-fed test script (app,framework), 1 • What software does one QA or development project need - tools, frameworks, applications-part of our deliveries from past similar projects. • We can call it facilitating IT infrastructure.
Competitive solution 1, demo, p1/2 • 1_HP_UFT_searchEngines_sample.swf • Load Runner, there are middle-tier .Net/Java/other application servers
Competitive solution 1, demo, p2/2 • Load Runner, root-cause analysis, • Automated load simulation is the only way. Get 9 scenarios from func test. • What is not load testing -> 10 browsers/clients working. MobileCloud for UFT is the official HP mobile testing solution, jointly developed by HP and Perfecto Mobile. Utilizing breakthrough technology, MobileCloud for UFT is the only complete and seamless solution for automated functional and regression testing of mobile applications within HP's UFT environment.
Thank You! Your questions are welcome. • - What are the advantages and disadvantages of the two competitive solutions? What about agile teams? • QA Team 1 needs 1 or 2 programmers out of 9 professionals, • QA Team 2 needs 2 programmers out of 9 professionals. • - Would you like real-time demos of the two apps in addition to the videos? • - ISTA conference 2013 • - ...other questions to discuss...