DCRC

Believability issue

Use of Sound to Provide Occluded Visual Information in Touch Gestural Interface


CHI figure 1.JPG

Direct touch gestures are getting popular as an input modality for mobile and tabletop interaction. However, the finger touch interface is considered as not accurate compared with pen-based interface. One of the main reasons is that the visual feedback of the finger touch is occluded because of the size of fingertip. It has made difficult for perceiving and correcting errors. We propose to utilize another modality to provide information on occluded area. Spatial information on visual channel is transformed to temporal and frequency information on another modality. We use sound modality to illustrate the proposed trans-modality. Results show that performance with additional modality is better for drawing where the visual information is important than only with the visual feedback.


Publications:

BoYu Gao, HyungSeok Kim, Hasup Lee, Jooyoung Lee, Jee-In Kim, “Use of Sound to Provide Occluded Visual Information in Touch Gestural Interface“, In Proc. ACM CHI 2015 Work-in-Progress, pp: 1277 – 1282, 2015.04, Seoul, Republic of Korea.


Research