Multimodal Human Digital Twin AI for Real Time Productivity and Fatigue Intelligence

Read full text Summarise with VIRAT
Authors: Ratchita B, Dr. Anandhi S.V
Cited by: 0
References: 16

Summary

No summary yet. VIRAT can read this paper and write a plain-language summary of its aim, methods, key findings and limitations.

Summarise with VIRAT Free to try with your Science Catalogs account.

Abstract

This project presents a Multi-modal Human Digital Twin System designed to continuously model human cognitive, emotional, and physical states through integrated vision, audio, and behavioral data. The system captures real-time facial expressions, voice characteristics, and interaction patterns to construct a comprehensive and dynamic digital representation of an individual. Deep learning techniques are employed to extract meaningful features from each modality, while advanced multi-modal fusion methods combine these features to capture complex inter-dependencies across human behaviors. Transformer-based and sequence modeling architectures analyze temporal patterns to estimate productivity, fatigue, and overall well-being. The framework supports both short-term monitoring and long- term trend analysis, enabling predictive assessment of performance degradation and health risks. Real-time insights, fatigue alerts, and personalized recommendations are generated to support proactive interventions. An interactive visualization dashboard presents interpret-able analytic, facilitating informed decision-making for individuals and organizations. By enabling continuous, accurate human state modeling, the proposed system aims to enhance productivity, improve well-being, and promote sustainable work practices through intelligent, data-driven support.

Fields of Study & Subjects

Emotion and Mood Recognition Sleep and Work-Related Fatigue AI and HR Technologies

Publication details

Journal / source
International Journal of Science Strategic Management and Technology
Volume
02
Issue
03
Pages
1–9
Publication date
23 March 2026
Language
EN