Immersive Education in Robotics represents a paradigm shift in how workforce skills are acquired and refined for the factories of the future. We focus on transitioning from traditional, static instruction to XR-based (VR/AR/MR) methodologies that provide safe, risk-free, and highly engaging learning environments. By leveraging Digital Twins, we enable trainees to master complex robotic interactions in a virtual space before transitioning to physical hardware, ensuring a seamless and efficient skill transfer. The experience combines intuitive interaction methods such as point-based commanding, drag-to-teach approaches, and introductory ROS-based programming, allowing users to progressively build robotics knowledge from basic operation to more advanced task design.
Immersive Education in Robotics: Learning Robot Interaction, Programming, and Human-Centered Applications in XR
Research Focus Areas
Being a Serbian focal point in research and the leading regional hub for Industry 5.0 education, we combine pedagogical theory with cutting-edge engineering to redefine technical training. Our work is built on a modular ROS-based software architecture that facilitates the integration of immersive technologies with real-time robot control, specifically featuring the following:
- XR-based training protocols for complex industrial maneuvers, such as high-precision assembly and surface polishing.
- Digital Twin synchronization using NVIDIA Isaac Sim and ROS 2, allowing for high-fidelity physics-based simulations that mirror real-world dynamics.
- Real-time operator feedback through Augmented Reality (AR) overlays, providing intuitive guidance and safety alerts directly in the user’s field of view.
- Neuroergonomic assessment of the learning process, utilizing cognitive state monitoring (EEG, eye-tracking) to adapt training difficulty based on the trainee’s real-time cognitive load.
Through this integrative research direction, we aim to build a resilient workforce capable of thriving in human-centric industrial environments. In this mission, we have collaborated with and supported partners such as ABB Serbia, Galeb Group and EYE VIEW.
Research Infrastructure
We serve as a leading entry point and proof-of-concept site in Serbia for immersive learning technologies and human-centered training platforms, including:
- The Human-Centered XR Workstation for Industry 5.0: A dedicated environment for VR/MR-based assembly training.
- Integrated Sensing Suite: High-grade EEG and eye-tracking systems for deep learning analytics and neuroergonomic profiling.
- Physical Validation Platforms: The Franka Emika Panda and MAiRA M pro (cognitive cobot) for verifying skill transfer from virtual environments to real-world execution.
Related ETF Robotics TestBeds for Immersive Education:
- Learning Collaborative robotics
- Human-Centered XR Training Cell
Key References
M. Skakun, V. Vujičić, V. Todić, Z. Gordić, N. Knežević, K. Jovanović, “Advancing Human-Robot Collaboration Through Extended Reality – Assembly Use Case,” 2025 12th International Conference on Electrical, Electronic and Computing Engineering (IcETRAN), Cacak, Serbia, 2025