TapID: Rapid Touch Interaction in Virtual Reality using Wearable Sensing #VR

We bring rapid touch interaction on surfaces to Virtual Reality—the input modality that users have grown used to on tablets for continued use. We present TapID, a wrist-based inertial sensing system that complements headset-tracked hand poses to trigger input in VR. TapID reliably detects surface touch events and, more importantly, identifies the finger used for touch. We demonstrate a series of applications that complement hand tracking with touch input and that are uniquely enabled by TapID, including UI control, rapid keyboard typing and piano playing, as well as surface gestures. More information: full publication: Manuel Meier, Paul Streli, Andreas Fender, and Christian Holz. TapID: Rapid Touch Interaction in Virtual Reality using Wearable Sensing. In Proceedings of IEEE VR 2021. Sensing, Interaction & Perception Lab Department of Computer Science ETH Zürich, Switzerland