Before Smelling the Video: A Two-Stage Pipeline for Interpretable Video-to-Scent Plans
Abstract
Olfactory cues can enhance immersion in interactive media, yet smell remains rare because it is difficult to author and synchronize with dynamic video. Prior olfactory interfaces rely on designer triggers and fixed event-to-odor mappings that do not scale to unconstrained content. This work examines whether semantic planning for smell is intelligible to people before physical scent delivery. We present a video-to-scent planning pipeline that separates visual semantic extraction using a vision-language model from semantic-to-olfactory inference using a large language model. Two survey studies compare system-generated scent plans with over-inclusive and naive baselines. Results show consistent preference for plans that prioritize perceptually salient cues and align scent changes with visible actions, supporting semantic planning as a foundation for future olfactory media systems.
Fields of Study & Subjects
Tactile and Sensory Interactions
Multimedia Communication and Technology
Interactive and Immersive Displays
Publication details
- Journal / source
- arXiv (Cornell University)
- Publication date
- 27 January 2026
- Document type
- Preprint