WithYou - A Communication System to provide Out Together Feeling

1. WithYou - A Communication System to provide Out Together Feeling Ching-Tzun Chang, Shin Takahashi and Jiro Tanaka IPLAB Department of Computer Science, University of Tsukuba, Japan

2. Backgrounds • Most video communication system are focus on face and body(like skype and etc…) • Most of video communication system are executed indoor, hard to use them at outside Here, we purposed… • A new system that focus to one's environment and his line of sight • Provide the feeling of go out together with remote user – we called “Out Together Feeling”

3. The Out Together Feeling • 2 user in a pair, indoor user and outdoor user • Feel to go out together with remote user To realize it, we designed 3 methods • Indoor user can look around the environment of the outdoor user • Indoor user can knows where the outdoor are facing to • Outdoor user can also knows where the indoor user are facing to

4. System Overview

5. Method 1:Free view for indoor user Let indoor user look around freely to see the place of the outdoor user

6. Free view for indoor user • Facing of camera is linked with indoor user's head • Camera remains shooting direction even outdoor user turns to other direction

7. Method 2: Sharing the focus Indoor user share his facing direction to outdoor user Outdoor user share his facing direction to indoor user

8. Outdoor user Indoor user LINE Showed on GUI GUI Check Camera Facing of indoor user Showed on Self GUI Notify to outdoor user Outdoor user HMD GUI Green Line Showed on GUI Red Line Graph Facing of outdoor user Notify to indoor User (Indoor side GUI)

9. Method 3: Joint Attention let the indoor user & outdoor user focus on the same object together

10. Indoor user Live image Indoor user facing front Indoor user facing right and focused on the pyramid Outdoor user Outdoor user also facing to right Camera facing front Camera facing to right STEP2 STEP3 STEP1

11. Then • Play sound & show message to inform both indoor and outdoor user • Joint Attention help user knows remote user are also looking at the same direction

12. Demo

13. Evaluation(1/2) • In room experiment • 4 tasks, 5 pairs of examinees participated • The purpose of experiment is • Can indoor user look around of the remote environment • Can indoor user handle the focusing direction of the outdoor user • Can outdoor user handle the focusing direction of the indoor user

14. Evaluation(2/2) Result • All task were been success executed by all examinees, success rate were 100% for all task • Basic methods in WithYou were worked well • Questionnaire after experiment Indoor user Outdoor user’s environment Watch camera Identify target(Poster)

15. Questionnaire 2.8 3.8 Did you feel doing something together with remote partners? Meaning of point5: Strong agree 4: Agree 3: Neither of them 2: Disagree 1: Strong Disagree 3.0 3.6 Can you handle the facing direction of remote partners? 2.2 4.0 Do you think "Joint attention" improved activities with remote partners?

16. CONCLUSION • We defined the “Out Together Feeling”, and implemented 3 methods to enhance this feeling • The indoor user can feel goes out virtually by looking around of the remote environment. • By “Sharing the Focus", the indoor and outdoor users can knows each other’s facing direction • In future work, we will make outdoor user to experience the “Out Together Feeling” at the same level as indoor user

17. Thank you for your kindly attention