Can Individual Internal Models Predict Idiosyncratic Scene Exploration?

Abstract Each individual person looks at natural scenes in their own unique way, resulting in a distinct perceptual experience of the world. However, little is known about why such differences in gaze emerge. Here, we test the hypothesis that idiosyncrasies in gaze behavior are predicted by inter-subject variations in internal models—expectations about how scenes typically look. In two experiments, we first characterized participants’ personal internal models by asking them to draw typical bathroom and kitchen scenes. Individual differences in these drawings were quantified using an objective deep learning pipeline and, in turn, related to individual differences in gaze behavior. In Experiment 1, where participants freely viewed a set of kitchen and bathroom photographs, inter-subject similarities in internal models did not predict inter-subject similarities in gaze. In Experiment 2, we encouraged strategic exploration through gaze-contingent viewing and a memory task. Here, inter-subject similarities in internal models predicted similarities in fixation frequency and the sequence in which different object categories were inspected. These findings suggest that the influence of internal models on visual exploration is stronger under increased sensory uncertainty and when expectation-guided sampling of the environment is encouraged. Together, our results provide new insights into how individual expectations shape gaze behavior and help explain why people differ in how they explore the visual world.