UbiCom Book Slides (Short Version)

1. UbiCom Book Slides (Short Version) Chapter 13 Ubiquitous System: Challenges & Outlook Stefan Poslad http://www.eecs.qmul.ac.uk/people/stefan/ubicom Ubiquitous computing: smart devices, environments and interaction

2. Related Chapter Links • Underlying form of this model is given in chapter 1 • Challenges & Outlook is related to UbiCom management in Chapter 12 Ubiquitous computing: smart devices, environments and interaction

3. UbiCom Challenges & Outlook

4. Chapter 13: Overview The slides for this chapter are split into several parts: • Part A: Overview of Future Challenges  • Part B: Smart Devices • Part C: Smart Interaction • Part D: Smart CPI - Energy Usage • Part E: Smart CPI - ECO-Friendly UbiCom Devices • Part F: Smart HCI • Part G: Human Intelligence versus Machine Intelligence • Part H: Social Issues: Promise Versus Peril Ubiquitous computing: smart devices, environments and interaction

5. Overview of Challenges • Key Challenges • Multi-Level Support for UbiCom Properties • Evolution Versus Revolution • Future Technologies Ubiquitous computing: smart devices, environments and interaction

6. Key Challenges Key Challenges for each of the core UbiCom system properties are considered: • Distributed • Context-Aware • iHCI • Artificial Intelligent • Autonomous Ubiquitous computing: smart devices, environments and interaction

7. Key Challenges: Distributed • Reliability • Openness • Less clearly defined system boundary • Synchronising data • Privacy & security • Event floods • Ad hoc interactions • Overwhelming choice, multiple versions, heterogeneity • Reduced cohesion, •  Distribution computation and communication costs Ubiquitous computing: smart devices, environments and interaction

8. Key Challenges: iHCI • Users get overloaded. • Disappearing technology problems • Disruptions • Ambiguous user intentions • Loss of privacy & control • Loss of presence in physical real-world Ubiquitous computing: smart devices, environments and interaction

9. Key Challenges: Context-Awareness • Localized scalability • Unclear user goals and context • Context adaptation leads to quicker commitments. • Balancing system versus application versus user control of context adaptation Ubiquitous computing: smart devices, environments and interaction

10. Key Challenges: Autonomous • Loss of high value macro mobile resources • Loss of many low value micro resources • No-one wants to be an administrator • Undesired or unintelligible adaptation •  Interdependencies • Loss of control by user Ubiquitous computing: smart devices, environments and interaction

11. Key Challenges: Intelligent • System infers incorrectly • Greater reliance and dependencies on systems of systems interactions to operate. • Systems learn to operate unsafely • Systems exceed normal human behaviour limits • Virtual organisation can masquerade as real organisations. • Byzantine, disruptive and malicious behaviours Ubiquitous computing: smart devices, environments and interaction

12. Multi-Level Support for UbiCom Properties • It is not necessary, nor necessarily desirable, to support the full level for each UbiCom property: • Distributed • Context-aware • iHCI • Autonomous • Intelligent • Why not? • It depends upon the application and the situation. Ubiquitous computing: smart devices, environments and interaction

13. Multi-Level Support for UbiCom Properties • Propose that there are graduated levels of support by UbiCom systems for each of the five core UbiCom system properties: • level 1 (minimal), • level 2 (basic), • level 3 (medium), • level 4 (high), • level 5 (full). • Levels of support could be used to indicate of levels of maturity for a system and for a property Ubiquitous computing: smart devices, environments and interaction

14. Multi-Level Support for UbiCom Properties • For example, a recommender, location-aware system application for a mobile user could be designed to support medium levels of support for the core UbiCom properties: • ??? Ubiquitous computing: smart devices, environments and interaction

15. Multi-Level Support for UbiCom Properties

16. Multi-Level Support for Smart • In Section 1.4, the term smart was defined to mean that the entity can be: • Active, Digital, Networked • can operate to some extent autonomously • is reconfigurable • and has local control of the resources it needs such as energy and data storage. • A second way to define smart is in terms of the level of AI the system supports (Figure 13‑1) • minimal type of smartness is that a system has an explicit representation of its structure and state which it can share with others. • medium level of smartness is that systems support problem solving and reasoning. Ubiquitous computing: smart devices, environments and interaction

17. Evolution versus Revolution • Technology can be categorised as • disruptive • sustaining. • Disruptive technology is one that changes or replaces the accepted way of doing things. • Sustaining technology enhances an existing product or service by refining it or making its creation and delivery more efficient. Ubiquitous computing: smart devices, environments and interaction

18. Evolution versus Revolution Many visions for future computing assume • sustainable, incremental, evolutionary progress in technology, whereas history has shown repeatedly that markets are changed mostly by disruptive technologies • Examples ? Ubiquitous computing: smart devices, environments and interaction

19. Evolution versus Revolution • Examples of disruptive technologies along with famous companies and people that rejected them? • ?? • Technology sometimes tries to drive use rather than use drives technology. • ?? Ubiquitous computing: smart devices, environments and interaction

20. Future Technologies • There are many sources of ideas for future technology. • Many science fiction writers who may have trained or worked as scientists and engineers have described ideas which later turned into reality. Examples? • ?? • Many engineers and scientists in many different fields have proposed bold visions for the future use of ICT. Examples? • ??. Ubiquitous computing: smart devices, environments and interaction

21. Future Technologies • Technological revolutions or evolutions are just one of the environments which must be affected in such a multi-disciplinary world • We need to understand the novel secondary effects of technology, to understand the complex interplay between systems and their environment. Ubiquitous computing: smart devices, environments and interaction

22. Chapter 13: Overview The slides for this chapter are split into several parts: • Part A: Overview of Future Challenges • Part B: Smart Devices  • Part C: Smart Interaction • Part D: Smart CPI - Energy Usage • Part E: Smart CPI - ECO-Friendly UbiCom Devices • Part F: Smart HCI • Part G: Human Intelligence versus Machine Intelligence • Part H: Social Issues: Promise Versus Peril Ubiquitous computing: smart devices, environments and interaction

23. Smart Devices • Smaller, More Functional Smart Devices • More Fluid Ensembles of Diverse Devices • Richer System Interaction and Interoperability • Migrating from Analogue to Digital Device Interaction • Richer Digital Device Interaction Ubiquitous computing: smart devices, environments and interaction

24. Smaller, More Functional Smart Devices • Evolutionary trend towards smaller, lower power, higher resourced devices, • Phones can be manufactured to be much smaller, lighter, low powered & multi-functional • Phones can leverage MEMS technology further (Chapter 6) • . Ubiquitous computing: smart devices, environments and interaction

25. Smaller, More Functional Smart Devices

26. A Wider Range of Raw Materials from which Devices are Manufactured • The use of more flexible materials to act as ICT devices • This can lead to many more physical objects supporting dual or even multiple hidden virtual computing functions Ubiquitous computing: smart devices, environments and interaction

27. Micro & Nano Device Issues • Synthetic reality which combines self-organisation of multiple MEMS devices called catoms and tangible UIs. • Nano components can also act in a similar manner. Benefits? Ubiquitous computing: smart devices, environments and interaction

28. Microscopic Device Issues Problems? • These could get out of control. • etc Ubiquitous computing: smart devices, environments and interaction

29. More Fluid Device Networks

30. More Fluid Ensembles of Diverse Devices Many hidden and diverse devices • In a smart office, smart office ware …. • e.g., specific lights, on the desk, can switch on when activity on the desk is sensed whilst other lights in the vicinity can remain off • … • In the bathroom, smart (bath)ware …. • smart mirrors can provide information about predicted conditions • … • In kitchen, smart ware … • Ovens contain temperature probes to sense inside food being cooked • … Ubiquitous computing: smart devices, environments and interaction

31. Migrating from Analogue to Digital Device Interaction •  use of digital vs. analogue devices situated in physical and human environments. Why? • Many individual digital systems, particularly those which are embedded systems, currently operate in isolation. Why? • Drivers for richer, flexible and dynamic device interaction?: Ubiquitous computing: smart devices, environments and interaction

32. Migrating from Analogue to Digital Device Interaction • Many devices are still designed to be stand-alone analogue single function appliance devices. • Discuss what the pros and cons are in different devices being digital: • Toaster • Clothes Iron • Coffee / tea maker etc Ubiquitous computing: smart devices, environments and interaction

33. Richer Digital Device Interaction • Majority of this richer system interaction is still C2C interaction • with some limited HCI to support finely grained user configuration, rather than CPI or HPI (Section 1.3). • An evolution pathway towards richer & softer (Section 12.3.1) information interaction is proposed. • See Section 8.4 • Application data protocols enable different applications to: • exchange data structures. • be controlled remotely. • Richer interaction goes beyond sharing information • ??. • This system interaction needs to be managed within the constraints of their ICT, physical and human environments. Ubiquitous computing: smart devices, environments and interaction

34. Chapter 13: Overview The slides for this chapter are split into several parts: • Part A: Overview of Future Challenges • Part B: Smart Devices • Part C: Smart Device Interaction  • Part D: Smart CPI - Energy Usage • Part E: Smart CPI - ECO-Friendly UbiCom Devices • Part F: Smart HCI • Part G: Human Intelligence versus Machine Intelligence • Part H: Social Issues: Promise Versus Peril Ubiquitous computing: smart devices, environments and interaction

35. Smart Device CCI Trends Ubiquitous computing: smart devices, environments and interaction

36. Smart Interaction • Unexpected Connectivity: Accidentally Smart Environments • Impromptu Service Interoperability • Context-Awareness: Ill-Defined Contexts Versus a Context-Free World Ubiquitous computing: smart devices, environments and interaction

37. Smart Interaction • Smarter interaction between individual smart devices and smart environments is a key enabler to promote richer, more seamless, personal, social and public spaces. • Interaction with smart mobile & environment devices requires effective human computer interaction design to make these systems useful • Human interactions often need to be centred in physical world rather than centred in virtual computer devices. • User activity-oriented interaction is different to service or task-oriented interaction. How? • Interaction can benefit from being location aware Ubiquitous computing: smart devices, environments and interaction

38. Key challenges for Interaction in Smart Environments • Challenges have already been given in Part A • Multiplicity of interactions increase, • However, contexts can be hard to determine Ubiquitous computing: smart devices, environments and interaction

39. Key challenges for Interaction in Smart Environments • Key challenges for using ubiquitous computing applications in home type smart environments (Edwards & Grinter, 2001) are: • "accidentally" smart home, • impromptu interoperability, • no systems administrator, • designing for domestic use, • social implications of aware home technologies, • reliability, and inference in the presence of ambiguity. • Their analysis can be generalised to smart (physical world) environment interaction • New design models of connectivity with wireless technologies are needed Ubiquitous computing: smart devices, environments and interaction

40. Unexpected Connectivity: Accidently Smart Environments • Wireless networks are less deterministic. Why? Example 1 • Homeowners may not realise that their wireless speakers can actually connect themselves to sound sources in another house nearby just as easily as to sound sources within their own home. • New design models of connectivity with wireless technologies are needed Ubiquitous computing: smart devices, environments and interaction

41. Unexpected Connectivity: Accidently Smart Environments

42. Unexpected Connectivity: Accidently Smart Environments • But what if the wired interaction accesses the Internet rather than the interaction remains locally? Ubiquitous computing: smart devices, environments and interaction

43. Fluid Service Interoperability • Many ICT devices in physical environment are designed to be operate as appliances, not to interoperate on-line. • Some devices are designed to interoperate off-line via removal media. • Interoperability of many devices is practically constrained. Why? • Interoperability goes beyond simple connectivity. Ubiquitous computing: smart devices, environments and interaction

44. Fluid Service Interoperability • User's expectation is that systems should work together fluidly and flexibly. • New design models of interoperability need to interoperate at multiple levels: • at the I/O hardware, • plug and play level • at the network level • at the service level • At the connector / Wire level: Ubiquitous computing: smart devices, environments and interaction

45. Determine Environment Context versus Its State • Focus on meaning of environment context, how it affects an application goal rather on environment state. For example, the design of a human weighing scale, • Should we design context-aware weighing scales? • How can we design these? Ubiquitous computing: smart devices, environments and interaction

46. Context Awareness: Ill-Defined Contexts versus a Context Free World • Context-aware systems are often expected to make decisions with limited context information about the world and with limited adaptation. • Environments may be only partially observable, • Adaptation, when performed, should be predictable, Ubiquitous computing: smart devices, environments and interaction

47. Context Awareness: Ill-Defined Contexts versus a Context Free World Context awareness may be ill-defined for several reasons • Because contexts are derived • etc • Contexts may be aggregated from several factors or indirectly inferred, . Ubiquitous computing: smart devices, environments and interaction

48. Active Context-aware System Challenges • Active context-aware systems, • e.g., systems that issue location-aware alerts to persons • These can be problematic? Why? • Active context-aware systems should support some user interaction. Why? • Replicating the complexity of the real world can make context-aware systems complex and vulnerable to error. Ubiquitous computing: smart devices, environments and interaction

49. Chapter 13: Overview The slides for this chapter are split into several parts: • Part A: Overview of Future Challenges • Part B: Smart Devices • Part C: Smart Interaction • Part D: Smart CPI - Energy Usage  • Part E: Smart CPI - ECO-Friendly UbiCom Devices • Part F: Smart HCI • Part G: Human Intelligence versus Machine Intelligence • Part H: Social Issues: Promise Versus Peril Ubiquitous computing: smart devices, environments and interaction

50. Lower Power and Sustainable Energy Usage • A range of power management techniques can be used to enable devices to reduce their power consumption, e.g., • Passive electronic components can be used that do not require energy to maintain their state, • Active computation devices can adapt their power requirements based upon demand Etc Ubiquitous computing: smart devices, environments and interaction