Beyond Binary Dialogues: Research and Development of a Linguistically Nuanced Conversation Design for Social Robots in Group–Robot Interactions
- In this paper, we detail the technical development of a conversation design that is sensitive to group dynamics and adaptable, taking into account the subtleties of linguistic variations between dyadic (i.e., one human and one agent) and group interactions in human–robot interaction (HRI) using the German language as a case study. The paper details the implementation of robust person and group detection with YOLOv5m and the expansion of knowledge databases using large language models (LLMs) to create adaptive multi-party interactions (MPIs) (i.e., group–robot interactions (GRIs)). We describe the use of LLMs to generate training data for socially interactive agents including social robots, as well as a self-developed synthesis tool, knowledge expander, to accurately map the diverse needs of different users in public spaces. We also outline the integration of a LLM as a fallback for open-ended questions not covered by our knowledge database, ensuring it can effectively respond to both individuals and groups within the MPI framework.
| Author: | Christoph BenschORCiD, Ana MüllerORCiD, Oliver ChojnowskiORCiD, Anja RichertORCiD |
|---|---|
| URN: | urn:nbn:de:hbz:832-epub4-28592 |
| DOI: | https://doi.org/10.3390/app142210316 |
| ISSN: | 2076-3417 |
| Parent Title (English): | Applied Sciences |
| Publisher: | MDPI |
| Editor: | Antonio Fernández-Caballero |
| Document Type: | Article |
| Language: | English |
| Date of Publication (online): | 2025/04/25 |
| GND-Keyword: | Großes Sprachmodell |
| Tag: | Group–Robot Interaction; Human–Robot Interaction; Multi-Party Interaction; Social Robot |
| Volume: | 14 |
| Issue: | 22 |
| Page Number: | 16 |
| Institutes: | Anlagen, Energie- und Maschinensysteme (F09) / Fakultät 09 / Institut für Produktentwicklung und Konstruktionstechnik |
| Dewey Decimal Classification: | 600 Technik, Medizin, angewandte Wissenschaften |
| Open Access: | Open Access |
| DeepGreen: | DeepGreen |
| Licence (German): | Creative Commons - CC BY - Namensnennung 4.0 International |


