Touch interface as a co-author of a multimedia text narrative

Read full text
Authors: Dmytro HONCHAR
Cited by: 1
References: 8

Abstract

The article analyzes the evolution of narrative practices in digital journalism through haptic technologies of interaction with multimedia content. The relevance of the study is determined by the proliferation of devices with touch displays and the transformation of content interaction patterns. The advancement of touch displays has opened new possibilities for ordinary users, making touch one of the essential elements of storytelling. The subject matter comprises the characteristics of tactile interfaces as elements of textual structural organization. The objective is to identify the mechanisms that enable the sensory interface to transform from a neutral intermediary into an active participant in narrative construction within the Ukrainian digital space. The research uses a methodology that integrates media linguistics, sensory interface theory, cognitive science, semiotics, and cognitive studies. A structural-functional analysis of multimedia texts from Ukrainian publications has been applied. Semiotic analysis showed the nature of gestural interaction and enabled the interpretation of specific gesture types. The case study method was used to examine interactive projects by Ukrainian media professionals in detail. The empirical foundation of the research comprises eye-tracking data and results from experiments measuring cognitive demand. The results of the study led to the conclusion that the sensory interface has transformed from an intermediary into a participant of narrative creation. It was established that gestures acquire intuitive semantic meanings during interaction with multimedia content. The structure of multimedia texts is divided by authors into modules separated by visual elements or empty space, which facilitates convenient navigation. Ukrainian publications employ parallax technology, creating effects of depth and volume. Promising developments in this direction include more sophisticated haptics for tactile feedback with varying intensity and rhythm. The application of AR/VR technologies will enable opportunities for creating spatial narratives. The development of flexible displays in devices will require new approaches to modifying multimedia texts.

Fields of Study & Subjects

Subtitles and Audiovisual Media Tactile and Sensory Interactions Augmented Reality Applications

Publication details

Journal / source
Synopsis Text Context Media
Publisher
Borys Grinchenko Kyiv Metropolitan University
Pages
100–100
Publication date
31 March 2026
Language
UK