imaginary phone— learning by transfer

1. imaginary phone— learning by transfer sean gustafson christian holz patrick baudisch

2. or projector to achieveultimatemobility: sacrifice screen  limited to gesture-based interaction gesture pendant[ISWC’00]

3. but spatial interaction (pointing) is the interaction style of current devices.

4. bring spatial interaction back, despite non-visual imaginary interfaces = “touch screen without the screen”

5. but the big problem is learning ?

6. imaginary phone

10. for this to work…

11. transfer learning 1. users repeatedly performa task usinga physical device

12. transfer learning 2. this builds up spatial memory, eventuallyallows performing the task without phone

13. to make this work, we make imaginaryphone mimics the layout of the physical phone

14. imaginary phone prototype does transfer learning work?

15. prototype

17. what we used our new camera

25. TUIO over WiFi

26. does transfer learning work?

27. main hypothesis: through repeated use of a physical deviceusers learn how to operate the imaginary counterpart

28. with repeated use of physical phone, usersbuild up spatial memory spatialmemory mapsto the hand on the hand users target accurately learn map target

29. learn map target 1) users build up spatial memory?

30. “Do you have an iPhone? (and do you like chocolate?)”

31. participant experimenter

33. results results 7 1% % 6 7 % 6 5 % percentage ofcorrectly placed apps apps used D a i l y W e e k l y R a r e l y

34. ✔ learn map target 2) does spatial memory map to the hand?

35. there was a second condition select on hand select on phone prop

36. results % % percentage ofcorrectly placed apps

37. results % % percentage ofcorrectly placed apps

38. ✔ ✔ learn map target 3) on the hand, users target accurately?

40. select on palm

41. select in empty space select on palm

48. 50% more accurate

49. ✔ ✔ ✔ learn map target

50. if users know 70% of functions…do we need to train them to 100%? no, actually knowledge of a single function gets you started