2-Dimensional Information Presentation Method through Tactile Perception with Touch Panel

1. 2-Dimensional Information Presentation Method through Tactile Perception with Touch Panel Kyota Aoki - kyota@is.utsunomiya-u.ac.jpMasaki Kimura - kimu7@softcdc.co.jpShinjiro Murayama - cjc42970@ams.odn.ne.jp

2. Goal • We propose the novel 2-dimensional information presentation method through tactile perception. • A Pin array display is good enough for an image presentation. • It is expensive and heavy. • A haptic paper is good as a map. • It is a fixed image. • Virtual tactile graphic display is very good for visually impaired persons[1].

3. Goal • The proposed method enables to share the same display with visually impaired persons and sighted persons. • This helps to work together. • A visually impaired person may ask “Who is this?” with pointing a face on the display.

4. Proposed system • The propose method acquire the absolute position directed by a finger. • A tactile stimulator at the finger generates the tactile stimulation at the finger. • Image input • Image transformation • Image presentation • Tactile stimulation based on the transformed image. • A tactile stimulator is placed at the point where the stimulation is needed.

5. Proposed system • This makes close action and reaction loop. The user of the proposed system directs the position on a touch panel with his finger and gets the information at the directed point through the finger. • This direct action and reaction loop makes the sensation much more realistic. • A haptic map is OK. Proposea stimulation Direct a position

6. Problems • If there is proper image for tactile stimulation, we can provide understandable tactile graphic easily. If we can have the intensity of each pixel through a finger, we can not understand the left image.

7. Problems If we can have the intensity of each pixel through a finger, we can not understand the left image. This is a similar action as looking at the documents through a telescope. We can look at any small part of the document. However, it is difficult to understande.

8. Experimental implementation • A tactile stimulation is vibration. • A toutch-panel gets an absolute position. • 1 channel. Touch panel display Estimating an image type Transforming the image Transforming to the vibration Vibration speaker

9. Experimental implemented system • Unlike tactile displays, our implementation enables to share the same display plane with both of visually disabled persons and sighted persons. • A visually disabled person can point the place on the display. • A sighted person can gain new information through his tactile sensation with visual information and audio information simultaneously. • Presentation of the clickable point. • Confirmation of a click. This is implemented and used.

10. Image processing • It transforms the image for visual presentation into the image for tactile presentation. • The tactile sensation is low resolution. • It has fewer levels. • It only sense at very limited regions. • These features are similar with the situation of weak sight. • The image transformation converts the original image into understandable image for tactile sensation.

11. Image type decision • The user of the proposed system is a visually disabled person. • There is no method to know the type of an image in the case where some images are send. • It is need to estimate the image type.

12. Image type estimation • On the histogram of pixel values, we can decide that the image is a binary image, when there are 2 values.

13. Image type estimation • There are large correlation among red, green and blue, we can decide that the image is gray scale image.

14. Image type estimation • There is small correlation among colors, we can decide that the image is full colored image.

15. Partial colored image • We divide an image into many parts of the image. • At each partial image, we estimate the image type. • In Japan, there is important to decide whether the red mark exists or not.

16. Images processings • Object • Decreasing the number of levels. • Decreasing the resolution. • The tactile sensation can not receive high frequency components. • Method • Binarize • differential • Decrease resolusion • Color emphasis

17. Image processing example • A tactile sensation easily find the existence．

18. Image processing example • Edge between textures • Edge between colors

19. Feed forward to compensate delay • Touch panel has sensing delay. • Scanning entire display, the delay of the presentation make difficult to understand. • Moving fast, the motion become to be straight. • It is easy to estimate the future positions.

21. Experimental implementation • touch panel display • Absolute position acquisition • Vibration speaker • This is 1 channel tactile stimulator. • PC＋UBSsound source • Displaying an image＋Generating tactile stimulation • Text reader

22. Direct tactile stimulation • We can feel when the stimulation point is equals to the place positioning point. • Same finger • Other finger • Sound

23. Comparison with Tactile graphic • １channel stimulation is not enough for total understanding of images. • １ channel stimulation has no direction. • It is difficult to trace the edge.

24. Comparison with Tactile graphic • １channel stimulation is not enough for total understanding of images. • １ channel stimulation has no direction. • It is difficult to trace the edge. • Multi-channel stimulation is needed.

25. Conclusion • This implementation has not enough image recognition and image processing.

26. References • Maucher, T.; Meier, K.; Schemmel, J.; , "An interactive tactile graphics display," Signal Processing and its Applications, Sixth International, Symposium on. 2001 , vol.1, no., pp.190-193 vol.1, 2001doi: 10.1109/ISSPA.2001.949809URL: http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=949809&isnumber=20554