Mobile, multimodal, vision-based data acquisition system for passive monitoring in production and intralogistics

The digitalization of chaotic intralogistics and production processes, including, e.g., humans and otherwise dynamic or static, non-tracked assets, as in the case of lot size one and large-object production facilities, requires non-invasive sensor solutions. One approach is to equip already movable assets on the shopfloor with multimodal 2D/2.5D/3D optical sensor systems that perceive the surrounding environment – such a solution requires methods for sensor calibration, sensor fusion, localization, and mapping. Besides, to comply with data privacy regulations, data must be de-personalized. This work proposes a mobile, multimodal sensor system that passively monitors the surroundings, localizes itself, outputs depersonalized data online, and can recreate the environment as a geometric digital twin.