Insight Into Mobile Application Testing Rumesh Palaniswamy

1. Insight Into Mobile Application Testing Rumesh Palaniswamy

2. Mobile Applications Overview Mobile Testing Types Mobile Test Methodology Agenda Mobile Applications Testing Layers Factors Affecting Mobile Testing Unique challenges - Mobile Testing Success Factors – Mobile Testing Mobile Test Solution /Automation Mobile Test Automation Overview Mobile Testing Lab

3. Mobile Application Testing Overview Unit Software verification method testing individual units of source code Functional 3rd Party Developers Types of Testing Testing of all features and functions of a system to ensure requirements and specifications are met Vendor/Operator Applications Unit Functional Compatibility Prototype Testing conducted on the mobile applications to evaluate the application's compatibility with OS, Software / Hardware Platforms etc Compatibility Enterprise Applications Automated Test Use of software to control the execution of tests, the comparison of actual outcomes to predicted outcomes. Implementation Stress Load Stress Process of determining the stability of a mobile device / application beyond normal operational capacity, often to a breaking point. Automated Testing Proprietary Applications Load Application behavior under load up to and including its Limits Handset Manufacturers

4. Mobile Testing Types

5. Test Methodology Design Draft Planning Pre Study Testing 1) On real devices 2) Using Emulators 3) Remote devices Quality Control Device Test Environment Test Data Preparation Tools Tools Use Case Spec Forum Spec User Interface Spec Functional Spec Defect Management Certification Maintenance and Post - Production Functional Testing Test Automation Consumers & Customers Test Strategy Specialized Performance

6. Types of Testing in Mobile Applications Partially Automated

7. Mobile Application Testing - Layers Highlights A mobile application will be structured as a multilayered application consisting of user experience (presentation), business, and data layers The testing process spans across all the components of the framework to verify it’s functionality and consistency

8. Test Strategy – Factors Affecting Mobile Testing Mobile test strategy does not differ from standard testing barring a few factors. • The factors that need to be considered are. • Multiple Platforms / OS • Multiple Devices with various form factors • Different modes of network connectivity. • Mobile Network Operators. • Multiple Browsers. • Mobile Emulators. • Test tools – Manual/Automation Factors

9. Unique challenges in Testing 1 2 • Diversity of Device Environment • Exhaustive testing of User Interfaces • Rendering of images and positioning of elements in screen • Compatibility with mobile runtimes • Hardware Configuration • Less memory & processing power for computing • Application compatibility with WAP enabled & HTTP enabled devices 3 4 • Rapid Application Development (RAD) • Benefits include faster time to market • Reduced Development time • Reduced Testing cycle time • Network related challenges • Network Latency • Gateways as Data Optimizers

10. Success Factors 1 2 • Use of Test Automation • Automating appropriate areas • Use of Emulators and actual devices • Emulators are useful for unit testing • Usability • Application should download quickly • Horizontal and Vertical Navigation should be easy • Images used should be clear • Font of Texts should be legible • Color scheme used 5 3 • Testing for wide mobile environments • GUI & Compatibility tests 4 • Measuring application complexity • Enterprise applications subjected to Performance Testing, Security Testing & Synchronization Testing

11. Mobile Test Solution Overview Mobile Test Solution Emulators Real Device on Live N/W Testing Tools ~40% ~30% ~30% Sanity Test UAT Functional Test Compatibility Test Compatibility Test Functional Test Interoperability Compatibility Test Functional Test • Free downloadable • Available for all platforms • Actual devices used for validating • the results Interrupt Test Live Carrier Network Regression Test Benefits • Maximum Test coverage • Effective test management and efficient execution • Reduced cost (due to combination of Simulator & DA) • Faster product launch • Percentage values for testing on specific categories are approximate

12. Mobile Test Automation Overview Challenges Faced Reusability of scripts is a pain point Test Data handling is very challenging during automation No predefined automation process is available for scripting device selection

13. Mobile Testing Lab Mobile Testing lab Elements of a Mobile Lab Set up • Smart phones across platforms such as iPhone, Android, Blackberry, Windows Mobile and Symbian • GPRS/3G enabled SIM cards • Windows /MAC Desktops and Infrastructure for setting up Wi-Fi, Bluetooth networks. • Environment for working with various mobile automation tools such as Jamo ,Test quest , Squish etc • Licensing for the automation tools.

14. Closing Thoughts.. The devices out there are getting really powerful and connected.. They are as easy to test for as desktop machines.. This is a genuinely new area where the scope for innovation is huge.. So get out there and get started!

15. Thank You