Use of Sound to Provide Occluded Visual Information in Touch Gestural Interface
Direct touch gestures are getting popular as an input modality for mobile and tabletop interaction. However, the finger touch interface is considered as not accurate compared with pen-based interface. One of the main reasons is that the visual feedback of the finger touch is occluded because of the size of fingertip. It has made difficult for perceiving and correcting errors. We propose to utilize another modality to provide information on occluded area. Spatial information on visual channel is transformed to temporal and frequency information on another modality. We use sound modality to illustrate the proposed trans-modality. Results show that performance with additional modality is better for drawing where the visual information is important than only with the visual feedback.
, HyungSeok Kim, Hasup Lee, Jooyoung Lee, Jee-In Kim, ““, In Proc. ACM CHI 2015 Work-in-Progress, pp: 1277 – 1282, 2015.04, Seoul, Republic of Korea.