Integration of Memory and Sensory Information in Skilled Sequence Production

Sequential movements rely on two information sources: external sensory cues and internal memory representations. Although often both sources jointly drive sequential behavior, previous research has primarily examined them in isolation. To address this, we trained participants ( n = 26, 15F) to perform sequences of rapid finger presses in response to numerical cues. Sensory influence was measured by varying the number of visible cues, and memory influence was determined by comparing repeating and random sequences. Early in learning, participants integrated sensory and memory information: repeating sequences were performed more quickly when more cues were visible. After learning, when repeating sequences were predictable with certainty, participants relied solely on memory and ignored sensory cues. However, when this certainty was manipulated by introducing occasional violations within repeating sequences, participants reverted to integrating memory with sensory cues. We propose a computational model that successfully predicted both speed and accuracy of individual presses. Critically, this model relied on the assumption that multiple movements are planned independently of each other. This independence assumption was then validated by examining response patterns to isolated violations in repeating sequences. Finally, we provide evidence into how sequence memories can be flexibly deactivated and reactivated in response to these violations. Together, these results reveal how brain dynamically integrates sensory and memory information to produce sequences of movements.