Generalization Capability of Autonomous Systems Research Topic 2.1

Smart Factory Grids (SFGs) consist of specialized Micro-Manufacturing Units (MMUs), such as 3D printing, transport, assembly, and quality control units. These MMUs are digitally connected and collaborate to enable flexible, distributed manufacturing environments, producing customized products efficiently. Autonomous cyber-physical systems at the core of SFGs coordinate, make decisions, and interact with humans.

This work focuses on improving the generalization capability of autonomous systems within SFGs. There, robots must adapt to semi-structured/dynamic environments, facilitating tasks such as material flow, health monitoring, or generalize to unforeseen tasks quickly and efficiently. The research will explore machine learning methods like multimodal learning and reinforcement learning to enable autonomous systems to generalize quickly and efficiently in dynamic production settings. By fostering cooperation between systems, allowing them to share data and learn collectively, the aim is to optimize system performance and reduce human intervention. The research will contribute to creating flexible, self-optimizing industrial systems capable of handling a high variability in production processes.

Challenges

Autonomous systems have been widely analyzed in (structured) environments, such as industrial robotics, household automation, and autonomous driving. Cooperative autonomous systems in predefined environments are also an ongoing topic of research. However, the ability of such systems to generalize and adapt in environments with frequent and significant changes, like the SFG, remains largely underexplored. But exactly this capability is crucial considering the dynamic nature of distributed production environments such as the SFG. There challenges like rapidly shifting operational configurations or high variability in task demands arise, necessitating the need for robots featuring enhanced reasoning and robustness.

Research Approach

This research combines theory, experiments, and simulations: It begins with a literature survey on the "Sense-Plan-Act" cycle and End-to-End approaches in single and multi-agent robotics, focusing on techniques for cooperative data collection and task execution. Emphasis is placed on real-time data sharing and decision-making in dynamic environments.

Additionally, an experimental setup will feature various robots each equipped with sensors, compute, and actuators, enabling testing of cooperative perception strategies and algorithms for resource allocation in the real world. Paralleled by this, a simulated environment using tools like NVIDIA Omniverse shall enable scalable testing and development, while also allowing for research into bridging the sim-to-real gaps.

Contact Person

apply

Interested? Apply now! for the summersemester 2025

Your personal contactContact us

Prof. Dr. rer. nat. Gabriele Gühring

Tel: +49 711 397-4376
E-Mail: Gabriele.Guehring@hs-esslingen.de
Send message