1. Direct Display Interaction via Simultaneous Pen and Multi-Touch Input Michel Pahud Ken Hinckley Bill Buxton Principal Researcher Microsoft Research

2. DIRECT INPUT A SHIFT TO • Handhelds • Slates • Drafting Boards • Tabletops • Wall Displays • Touch, or • Pen.

3. ISN’T THIS ABOUTTHE FUTURE OF TOUCH? WHY THE PEN?

4. To help explain, let me introduce my nemesis.

5. MR. I.M.A. BIGBODY, CORPORATE DENIZEN, THIRD RATE INC.

6. “I CAN TYPE FASTER ” THAN I CAN WRITE.

8. TYPE THIS.

9. OR THIS.

10. OR MAYBE THIS.

11. YOU CAN’T TYPE THE SOUL OF A NEW IDEA.

12. BUT IT’S NOT ALL ABOUT THE PEN.

13. FIRST YOU NEED TO GRAB THE NAPKIN.

14. “JUST TELL ME WHICH IS ” BEST, TOUCH OR PEN.

16. PROPERTIES SHARED BY PEN AND TOUCH

17. PEN IS BEST! Mechanical intermediary: familiar tool, lever arm, affords precision!

18. TOUCH IS BEST! • No mechanical intermediary! • Nothing to lose! No time to unsheathe!

19. PEN IS BEST! Definite, intentional pressure to leave a mark

20. TOUCH IS BEST! • Just rest your hand… • No force required • BUT…“Midas Touch”

21. EVERY COIN HAS TWO SIDES.

22. OF HANDSANDHANDEDNESS

23. Q: Which hand do you write with, Right or Left?

24. A: Yes • Guiard, 1987: NPH defines frame of reference. • Right vs. Left is the wrong question to ask.

25. What is the logic of the division of labor between pen and touch in interface design?

26. Pen Writes Touch Manipulates

27. fluidity of annotation + • manipulation • navigation • zooming • object creation

28. Pen + Touch Yields New Tools

29. Video • Dell XT2 Demo

30. PEN + TOUCH GESTURES

31. SUMMARY

32. IF YOU’RE ONLY THINKING ABOUT TOUCH, YOU’RE BLOWING IT.

33. GET OFF THE MULTI-TOUCH ESCALATOR.

35. Not pen. Not touch.Not pen OR touch.Pen AND Touch, designed in concert

36. “TOUCH OR PEN ARE JUST NEW • WAYS TO CONTROL THE MOUSE, ” SO WHAT’S THE BIG DEAL?

37. “TOUCH OR PEN ARE JUST NEW • WAYS TO CONTROL THE MOUSE, ” SO WHAT’S THE BIG DEAL? • YOU’RE FIRED! • YOU’RE FIRED! • YOU’RE FIRED! • YOU’RE FIRED! • YOU’RE FIRED!