A Proposed Immersive Digital Twin Architecture for Automated Guided Vehicles Integrating Virtual Reality and Gesture Control

Author's Department

Computer Science & Engineering Department

Fifth Author's Department

Computer Science & Engineering Department

Find in your Library

https://doi.org/10.5220/0013176900003912

All Authors

Mokhtar Ba Wahal Maram Selsabila Mahmoudi Ahmed Bahssain Ikrame Rekabi Abdelhalim Saeed Mohamad Alzarif Mohamed Ellethy Neven Elsayed Mohamed Abdelsalam Tamer Elbatt

Document Type

Research Article

Publication Title

Proceedings of the International Joint Conference on Computer Vision Imaging and Computer Graphics Theory and Applications

Publication Date

1-1-2025

doi

10.5220/0013176900003912

Abstract

Digital Twins (DTs) are virtual replicas of physical assets, facilitating a better understanding of complex Cyber-Physical Systems (CPSs) through bidirectional communication. As CPS grows in complexity, the need for enhanced visualization and interaction becomes essential. This paper presents a framework for integrating virtual reality (VR) with a Dockerized private cloud to minimize communication latency between digital and physical assets, improving real-time communication. The integration, based on the Robot Operating System (ROS), leverages its modularity and extensive libraries to streamline robotic control and system scalability. Key innovations include a proximity heat map surrounding the digital asset for enhanced situational awareness and VR-based hand gesture control for intuitive interaction. The framework was tested using TurtleBot3 and a 5-degree-of-freedom robotic arm, with user studies comparing these techniques to traditional web-based control methods. Our results demonstrate the efficacy of the proposed VR and private cloud integration, providing a promising approach to advance Human-Robot Interaction (HRI).

First Page

267

Last Page

275

Link to Full Text
Find this item online

Share

COinS