Haptic & Multisensory Interaction
Research Overview
Alongside my work in computer vision, I collaborate on multisensory human–computer interaction. These projects explore how computer vision and learned visual semantics can drive physical feedback, extending video experiences beyond sight and sound.
A representative project is Feel What You See, an interactive system that interprets visual heat cues and produces corresponding non-contact thermal feedback. It illustrates how recognition of visual content can support a responsive multisensory interface.
Publication
- Xu J, Chen K, Kuroda Y, et al. Feel What You See: A Novel Sensory Interface Linking Visual Heat Cues and Instant Thermal Feedback. SIGGRAPH Asia 2025 Emerging Technologies, 2025.