Toward Co-Working with Autonomous Agents: Rethinking Operations of Automation Systems
The growing complexity of commissioning industrial automation systems has increased the demand for simpler and more intuitive operation, often requiring domain-specific expertise. This paper explores task-oriented natural-language interaction with automation systems, a paradigm that is rapidly gaining traction particularly due to the advent of large language models (LLMs). Leveraging a multi-agent system (MAS), the authors introduce a two-phase approach for controlling an industrial gantry for pick-and-place operations. In phase one, the MAS generates an execution plan based on the user input; in phase two, the plan is executed deterministically on real-world hardware. Our preliminary results demonstrate the advantages of a chat-based human-in-the-loop (HiL) workflow for refining and validating execution plans, and they highlight the promise of natural-language interfaces for operating pick-and-place systems (Demo: Video 1, Video 2).
Cite this item
Kovacs, M., Baumgartl, J., Schreier, F., Hummel, F. C., Seyler, J., & Eivazi, S. (2025). Toward Co-Working with Autonomous Agents: Rethinking Operations of Automation Systems. 2025 IEEE 30th International Conference on Emerging Technologies and Factory Automation (ETFA). Proceedings, 1–4. https://doi.org/10.1109/etfa65518.2025.11205572
Click Copy to copy the citation, or select the text manually.
Festo (Germany)
Esslingen University of Applied Sciences
Festo (Germany)
École Polytechnique Fédérale de Lausanne
Festo (Germany)
Festo (Germany)
2025-09-09
979-8-3315-5383-8
1
4
REVIEWED
EPFL
| Event name | Event acronym | Event place | Event date |
ETFA 2025 | Porto, Portugal | 2025-09-09 - 2025-09-12 | |