From Control to Command: A Bimanual Mimetic Gesture Interface for Drone Swarm Maneuvering in Distracted Environments

Read full text
Authors: Yiyun Ding, Xinmo Li, Mengyue Yuan, Wei Xiang
Cited by: 1
References: 14

Abstract

To address high cognitive load and latency in drone swarm control, we propose BiMime, an asymmetric bimanual system based on mimetic interaction. While traditional unimanual interfaces force inefficient serial switching between formation and flight, BiMime enables parallel execution by assigning discrete formation management to the left hand ("Commander") and continuous motion to the right ("Pilot"). By mapping hand spatial configurations directly to swarm geometries through intuitive metaphors, the system significantly reduces cognitive complexity. A preliminary pilot study suggests that BiMime shows promise in reducing task completion time, error rates, and workload (NASA-TLX) while achieving high usability (SUS), validating its efficacy in demanding tactical environments.

Fields of Study & Subjects

Social Robot Interaction and HRI Hand Gesture Recognition Systems Teleoperation and Haptic Systems

Publication details

Journal / source
Proceedings of the Extended Abstracts of the 2026 CHI Conference on Human Factors in Computing Systems
Publisher
ACM
Pages
1–5
Publication date
13 April 2026