Software for Wearable Devices : Challenges and Opportunities

1. 2017 Fall CS2310 Seminar Software for Wearable Devices : Challenges and Opportunities WEONJI CHOI (LUCIA) WEC69@pitt.edu

2. Contents 0. Topic 1. Introduction 2. What makes wearable devices different? 3. Software for wearable devices 4. Conclusion + Sub paper

3. 0. Topic 2017 Fall CS2310 Seminar • Main paper Jiang, H., Chen, X., Zhang, S., Zhang, X., Kong, W., & Zhang, T. (2015). Software for wearable devices: Challenges and opportunities. Proceedings - International Computer Software and Applications Conference, 3, 592–597. http://doi.org/10.1109/COMPSAC.2015.269 • Sub paper Muccini, H., Di Francesco, A., & Esposito, P. (2012). Software Testing of Mobile Applications: Challenges and Future Research Directions. AST 2012, Proceedings of the 2012 International Workshop on Automation of Software Test, 29–35. http://doi.org/10.1109/IWAST.2012.6228987

4. 1. Introduction 2017 Fall CS2310 Seminar

5. 1. Introduction 2017 Fall CS2310 Seminar • The Definition of Wearable devices A wearable device is a computer that is subsumed into the personal space of a user, controlled by the user, and has both operational and interactional constancy, i.e., is always on and alwaysaccessible.

6. 1. Introduction 2017 Fall CS2310 Seminar • The Development of Wearable Devices 2007 Fitbit Company was founded 2013 Google launched Google glass Apple, Samsung, Sony and other companies… 1975 First wrist calculator was invented 1966 First wearable device was invented Great improvement of wearable devices… 21C 1960 1970 1980 … • The Classification Standards for Wearable Devices

7. 2. What Makes Wearable Devices Different? 2017 Fall CS2310 Seminar • Characteristics that a wearable device should have 1) be used while the wearer is in motion 2) be used while one or both hands are free or occupied with tasks 3) exist within the corporeal envelope of the user, i.e., it should be not merely attached to the body but becomes and integral part of the person’s clothing 4) must allow the user to maintain control 5) must exhibit constancy, in the sense that it should be constantly available.

8. 3. Software for Wearable Devices 2017 Fall CS2310 Seminar • Some primary issues… Operating System Data Transmission Energy Consumption Confidentiality Database Management … Application Development Platform

9. 3. Software for Wearable Devices 2017 Fall CS2310 Seminar Operating System • Development history - Early 2000, WatchPad with Linux by IBM - 2013, first smart watch using Android, Samsung second generation of smart watch Tizen, Samsung - 2014, smart watch dedicated Android Wear, Google • Current Problem - Variety of operating systems - Not convenient for users to use - Difficult to choose which operating system for developers, - The application for one operating system is not suitable for another.

10. 3. Software for Wearable Devices 2017 Fall CS2310 Seminar Operating System • Objectives for wearable operating systems 1) Convenience : for users to use 2) Effectiveness : be managed more effectively and take advantage of resources like hardware, software and data of wearable devices 3) Scalability : permit new system functions to be developed, tested and included 4) Openness : support integrated and collaborative network work of different manufacturers and devices so that it can achieve the portability and interoperability of applications 5) Multi-tasking: run multiple applications concurrently

11. 3. Software for Wearable Devices 2017 Fall CS2310 Seminar Database Management System • DBMS of wearable device can… store user’s basic information including gender, age, height, weight, health status, consumption habits, personal temper, and preference information to color and food, etc… for further useful function Network Communication Protocol • Now, wearable devices are using relatively simple and focus primarily on wireless functions • In near future, wearable devices will eventually implement more and more functions (WAP, GRS, GPRS, large file or data transmission, etc.) • Need to design special network communication protocols for wearable devices, which is more energy-efficient, safe and with high throughput.

12. 3. Software for Wearable Devices 2017 Fall CS2310 Seminar Application Development Platform • One of the obstacles for the rapid development of wearable devices : the lack of applications • In 2014, Google released the SDK including an emulator and other tools for Android Wear. • At present, we can think that Tizen will contribute to the development of wearable devices. • Developers have options Develop application software that supports particular operating systems for a single platform. Develop native applications for each platform Develop mobile web applications, so as to reduce the native code for each platform

13. 3. Software for Wearable Devices 2017 Fall CS2310 Seminar Privacy And Security • Wearable devices collect real-time user information (geographical location, living habits, heart rate, body temperature, account password and conversation, etc.) • The communication of wearable devices is mainly based on wireless network. Thus, more private information may be easily attacked or stolen. • We can consider from the following aspects 1) Research on reliable network communication protocols 2) The system should have permission setting. 3) Reasonable software patterns should be proposed to solve these problems.

14. 3. Software for Wearable Devices 2017 Fall CS2310 Seminar Energy Consumption Wearable devices can only use battery, rather than stationary power. The large amount of energy consumption for devices can produce great heat. Energy consumption management is an essential issue. • The control of energy consumption at each application layer 1) Reduce hardware electricity consumption through reasonable invoke of system APIs. 2) Create adaptive energy-sensitive applications to adjust automatically energy usage. 3) Adopt load-balancing method to transfer complex calculation to the mobile terminal via wireless communication network.

15. 3. Software for Wearable Devices 2017 Fall CS2310 Seminar Human-Computer Interaction • Ways for users to interact with wearable devices 1) Contextual Awareness 2) Augmented Reality : apply virtual information to the real world 3) Non-keyboard input : non-keyboard ways such as voice, handwriting, gestures, data glove etc. • Ways to strengthen the human-computer interaction tech 1) Apply existing mature human-computer interaction ways (hand writing, voice and other non-keyboard input) 2) Strengthen the research of currently-immature human- computer interaction ways(contextual awareness, augmented reality, mediated reality, etc.) 3) Propose new human-computer interaction ways.

16. 3. Software for Wearable Devices 2017 Fall CS2310 Seminar Software Engineering • Some aspects/issues that may be of value and worth studying 1) Demand analysis : using user’s feedback 2) Code recommendation 3) Application transplantation : create API mapping among different platforms and develop an ideal compiler

17. 3. Software for Wearable Devices 2017 Fall CS2310 Seminar “ Big data and wearable device complement each other and pursue a common development ” Big Data We can gain a lot of useful information generated by wearable devices(basic personal information, health status, the preference to food, cloth and color etc.) Big data analysis technology will provide a great help for scientific research, social development and users’ life. Compared to mobile phones, wearable devices will produce larger amount of data. So it needs big data technology to deal with these collected data even more. Wearable Device

18. 3. Software for Wearable Devices 2017 Fall CS2310 Seminar “ Big data and wearable device complement each other and pursue a common development ” Big Data The analysis for heart rate and blood pressure can understand user’s body status and potential risks. Wearable devices need big data technology for processing these data to provide useful information to users. Wearable Device

19. 4. Conclusion 2017 Fall CS2310 Seminar • Wearable devices dramatically change modern way of life • The development of wearable devices is still in its immature and limited stage • Especially, application software development is still in the initial stage.

20. 0. Topic 2017 Fall CS2310 Seminar • Main paper Jiang, H., Chen, X., Zhang, S., Zhang, X., Kong, W., & Zhang, T. (2015). Software for wearable devices: Challenges and opportunities. Proceedings - International Computer Software and Applications Conference, 3, 592–597. http://doi.org/10.1109/COMPSAC.2015.269 • Sub paper Muccini, H., Di Francesco, A., & Esposito, P. (2012). Software Testing of Mobile Applications: Challenges and Future Research Directions. AST 2012, Proceedings of the 2012 International Workshop on Automation of Software Test, 29–35. http://doi.org/10.1109/IWAST.2012.6228987

21. 5. Sub paper 2017 Fall CS2310 Seminar • 3 Research Questions (RQ) 1) Are mobile applications (so) different from traditional ones, so to require different and specialized new testing techniques? 2) What are the new challenges and research directions on testing mobile applications? 3) Which is the role automation may play in testing mobile applications?

22. 5. Sub paper 2017 Fall CS2310 Seminar RQ1) Are mobile applications (so) different from traditional ones, so to require different and specialized new testing techniques?

23. 5. Sub paper 2017 Fall CS2310 Seminar RQ1) Are mobile applications (so) different from traditional ones, so to require different and specialized new testing techniques?

24. 5. Sub paper 2017 Fall CS2310 Seminar RQ2) What are the new challenges and research directions on testing mobile applications? RQ3) Which is the role automation may play in testing mobile applications? • Testing process : test selection and execution (Challenge):unpredictability and high variability of the inputs (Research Direction):new testing criteria are required to provide the guidelines, rules, and strategies • Testing artifacts : structural and Functional Testing (Challenge):new program languages for managing mobility, sensing, and energy consumption & testing requires to specify both the application and the environment (Research Direction):new coverage criteria, control and data flow graphs, state-based approaches

25. 5. Sub paper 2017 Fall CS2310 Seminar RQ2) What are the new challenges and research directions on testing mobile applications? RQ3) Which is the role automation may play in testing mobile applications? • Testing levels : unit and integration (Challenge):cooperating applications intra- and inter- application information flow must be followed (Research Direction):existing integration testing approaches have the potentials to be adapted for mobile application • Types of test to be run : different types OS testing strategies can be applied to mobile applications (Challenge):performance and reliability of mobile applications strongly depends on many complex contexts. (Research Direction):new techniques for performance and reliability analysis have to explicitly consider characteristics related to contexts and different devices.

26. References 2017 Fall CS2310 Seminar [1] Jiang, H., Chen, X., Zhang, S., Zhang, X., Kong, W., & Zhang, T. (2015). Software for wearable devices: Challenges and opportunities. Proceedings - International Computer Software and Applications Conference, 3, 592–597. http://doi.org/10.1109/COMPSAC.2015.269 [2] Muccini, H., Di Francesco, A., & Esposito, P. (2012). Software Testing of Mobile Applications: Challenges and Future Research Directions. AST 2012, Proceedings of the 2012 International Workshop on Automation of Software Test, 29–35. http://doi.org/10.1109/IWAST.2012.6228987 [3] S. Mann. Humanistic Computing: WearComp as a New Framework and Application for Intelligent Signal. Proceedings of The IEEE, 1998, 86(11): 2123- 2151 [4] Wearable Technology Market Suited for Rapid Growth. http://press.ihs.com/press-release/design-supply-chain/wearable-technologymarket-suited-rapid-growth, Accessed on 18 October 2014. [5] Press Release: Mobile Smart Wearable Device Shipments to Approach 130 Million by 2018, Juniper Research finds. http://www.juniperresearch.com/viewpressrelease.php?pr=414, Accessed on 18 October 2014. [6] Wearables market to take off, hit 112M devices in 2018. http://www.computerworld.com/article/2488133/emerging-technology/wearables-market-to-take-off--hit-112m-devices-in-2018.html, Accessed on 18 October 2014. [7] G. Chen. Smart Wearable Change the World: The Next Business Tides. Benjing: Publishing House of Electronics Industry, 2014. [8] L. BASS. Conveners report of CHI ' 97 Workshop on Wearable Computers. Personal Communication to attendees. http://www.bham.ac.uk/ManMechEng/ieg/w1.html, Accessed on 18 October 2014. [9] Palm OS. http://en.wikipedia.org/wiki/Palm_OS, Accessed on 18 October 2014. [10] D. Y. Chen. The Evolution and Trend of Wearable Computer (2). Journal of Chongqing University (Natural Science Edition), 2000, 23(4): 142-148. [11] Bluetooth Smart. https://learn.adafruit.com/introduction-to-bluetoothlow-energy/, Accessed on 18 October 2014. [12] Android Wear SDK available to download for developers from today, http://thenextweb.com/google/2014/06/25/android-wear-sdk -available-download-developers-today/, Accessed on 18 October 2014.

27. Questions - Thank you -