Gesture-Recognizing Hand-Held Interface with Vibrotactile Feedback for 3D Interaction

Abstract

This article presents a hand-held interface system for 3D interaction with digital media contents. The system is featured with 1) tracking of the full 6 degrees-of-freedom position and orientation of a hand-held controller, 2) robust gesture recognition using continuous hidden Markov models based on the acceleration and position measurements, and 3) dual-mode vibrotactile feedback using both vibration motor and voice-coil actuator. We also demonstrate the advantages of the system through a usability experiment.(1)