Management for Manual Software Testing aptest/atm2

1. Applied Testing and Technology Management for Manual Software Testing www.aptest.com/atm2

2. Overview • Manages and tracks testing status and results • Provides consistent, repeatable QA process • WWW based • Persistent information repository • Integrated requirements management • Extensive reporting • Role-based security • Highly flexible and customizable

3. QA Testing Challenges • Process inconsistent and is not repeatable • Personnel turnover loses knowledge • Time consuming and difficult to • monitor progress • measure productivity • assess quality • share information

4. The ApTest Manager Solution • Consistent, repeatable process • Permanent information store • Real time access to tests, results, status • Geographically distributed users • QA, customers, development, . . . • Test method and tool neutral

5. ApTest Manager Benefits • Higher product quality • Better tests, better coverage, better process • Find and fix bugs sooner in the development cycle • Shorter projects at a lower cost • Improved, measurable productivity

6. Manage Manual/Automated testing Requirements Test Cases Manual Testing Reporting Test Results Automated Testing

7. Requirements Repository • User defined tree of FoldersAs deep and wide as you want • Folders contain Requirements and Files • Requirements fields totally configurable. As many fields as you want: menu fields, text fields, date fields, tables, etc. • Requirement names can be strings or automatically assigned numbers

8. Test Repository • User defined tree of FoldersAs deep and wide as you want • Folders contain Test Cases and Files • Test Case fields totally configurable. As many fields as you want: menu fields, text fields, date fields, tables, etc. • Test Case names can be strings or automatically assigned numbers

9. Link Requirements and Tests • Tests can be linked to Requirements in any relationshipOne-to-one, many-to-one, and one-to-many • Tests can be automatically created and linked to Requirements

10. Execution • Unlimited number of different groups of tests (Test Sets) • Created by querying test characteristics: e.g. the tests for a particular version or feature. • Each Test Set can be run as many times as you want, results stored separately for different test environments (Test Sessions)

11. Typical Project Reqs Tests Sets Sessions test subsets execution results . . . . . .

12. Customization • Easily customized • What fields make up a Test Case • Name, Format, Default Value • How a Test Case is displayed • Editing, Executing, Reporting • Session Variables • Characterize test environment H/W-S/W • Design your own ‘gold standard’ configuration

13. Reports • On part or all of a project composed of different Sets and Sessions • Status: %done, results, vs. schedule • Coverage of test cases • Productivity of users • Compare Sessions • On specific sessions • Custom queries can be defined and saved

14. Integrates with Existing Tools

15. Test Repository • Tree of folders of tests • Create • Edit • Copy • Rename • Delete • View

16. Test Editing • Field Types • Menus • Text Areas • Tables • Field Styles • WYSIWYG HTML Editor • Text

17. Requirements Repository • Tree of Reqs • Create • Edit • Copy • Rename • Delete • View

18. Repository Reports • Test Requirements Reports • Test Specification Reports

19. Test Execution • Run specificgroups of Tests (Test Sets) • Run them inspecific TestEnvironments(Test Sessions)

20. Test Execution • Any number of Test Sets (subset of Test Cases for different test cycles, product versions, etc.) • Any number of Test Sessions, each recording the execution of a Test Set (in a different H/W-S/W environment). • Test Cases only need be defined once, so easily maintained and evolved

21. Test Set • Group ofTest Cases based onan ad hocquery ofTest Casefield values

22. Test Sets • Queries select different groups of tests

23. Test Session • Results ofrunningTest Casesfor a Test Set • SessionVariablesspecify testenvironment

24. Test Sessions • Session Variables tag the session with info on where and how it was run. e.g. O.S., browser, hardware, product version, tester, . . . • You can search for and report on Sessions based on a variety of criteria, including session variables, e.g. compare the results of all the Sessions run on Windows XP with Oracle.

25. Test Execution • Tester is given • Requirements • Procedure • Tester enters • Test result • Time spent (optional) • Notes

26. Reports • Are generated for one or moresessions • Sessions can beselected with ad hoc queries

27. Status Report • Multiple sessions • % Complete • Time remaining • Trends • Result Details • Links to persession reports

28. Users Report • Results • Productivity • Schedule analysis

29. Results Report • Test Case detailsand results

30. Regression Report • Multiple Sessions • ComparesResults

31. Coverage Report • Coverage ofTest Casesby Sessions • Can createTest Sets of uncoveredTest Cases

32. Configuration • Specify Test Case Fieldsand their formats

33. Configuration • Specify TestResults

34. Configuration • Specify how a Test Case is displayed for editing,execution, reports

35. Configuration • Specify SessionVariables

36. Security • Password protected accounts • Access controls per user by Test Suite

37. Security • Admin functionscontrolled by admin users

38. Email Notifications • Per User,Per Suite • Multiple event triggers

39. Other Features • Integrates with third-party tools • Bug tracking • Source control • Import and Export Test Cases and Requirements via CSV files (e.g. from Excel spreadsheets) • Import of automated test results from test harnesses

40. Support & Maintenance • Multiple releases annually • Bug fixes • Enhancements • Updated OS, browser and server compatibility

41. What’s Coming Up • ApTest Manager Automation Edition • Adds Test Automation support • Scripts can be associated with tests and executed over your network • Results stored and reported with manual tests • Separately priced add-on

42. System Requirements • Windows, Linux, or MacOS • Perl • Web Server, e.g. Apache, IIS • Server of moderate size (e.g. 2.8GHz P4) • Server does not have to be dedicated

43. Licensing/Pricing • Purchase and run on your server • Per Seat floating licenses. Number of Seats limits number of logged in users.     #seats       $/seat       discount    1-5           $500        n/a    6-10         $475        5%    11-15       $450        10%    16-20       $425        15%    21-30       $400        20%    31-40       $375        25%    41-50       $350        30%    51+          call factory • Can add more licenses at any time • Support: $100/seat/year

44. Licensing/Pricing • As a service, hosted on our servers • For short term projects • High up time, fast connections • $45/user/month, $200 set up fee • Support included

45. Performance • ApTest QAs the product • With Test Suites containing 30,000 tests • With 100 concurrent users

46. What customers say We love the use of your software, it's doing a lot to streamline our software development cycle. This is a great product. The support you offered has been magnificent, far better than I have seen from your competitors. I have been thoroughly impressed. AP Test Manager is a good product and I base this opinion on my 20 plus years in R&D, test management and testing. I've gotten good responses from the users - they really like the tool.