Bi-directional communication bridge for state synchronization between digital twin simulations and physical construction robots

Abstract

Collaborative robot (co-robots) are being increasingly deployed on construction sites to assist human workers with physically demanding work tasks. However, due to inherent safety and trust-related concerns, human-robot collaborative work is subject to strict safety standards that require robot motion and forces to be sensitive to proximate human workers. Robot simulations in online digital twins can be used to extend designed construction models, such as BIM, to the construction phase for real-time monitoring of robot motion planning and control. Robots plan work tasks and execute them in the digital twin simulations allowing humans to review and approve robot trajectories. Once approved, commands can be sent to the physical robots to perform the tasks. This paper discusses the development of a system to bridge robot simulations and physical robots in construction and digital fabrication. The Robot Operating System (ROS) is leveraged as the primary framework for bi-directional communication and Gazebo is used for robot simulations. The virtual robots in Gazebo receive work tasks from a BIM model to plan their trajectories, and then send the commands to the physical robots for execution. The system is implemented with a digital fabrication case study with a fullscale mobile KUKA KR120 six-degrees-of-freedom robotic arm mounted on a track system for an additional degree-offreedom, and evaluated by comparing the pose between the physical robot and the virtual robot. The results show a high accuracy of the pose synchronization between two robots, which provide the opportunity for further deploying to real construction sites.

Ci-Jyun Polar Liang

Assistant Professor (Jan 2024)

My research interests include Human-Robot Collaboration, Computer Vision, Reinforcement Learning, BIM, Digital Twins, and Extended Reality.