Document Type
Preprint
Publication Date
1-1-2024
Journal / Book Title
IEEE International Workshop on Robot and Human Communication Ro Man
Abstract
A robot's ability to effectively recognize human emotions is critical in human-robot collaboration. However, most of the current collaborative robots were designed to improve productivity. Few of these robots consider human emotions. This situation would cause humans to be unwilling to work with robots for a long time. Motivated by this gap, this research developed a human emotion recognition system for enhancing the interaction abilities of collaborative robots. In this project, both speech and facial information were analyzed for robust human emotion recognition in complex working environments like manufacturing assembly environments. In the experiment, the developed system has been tested through three different human-robot co-assembly scenarios: (1) the robot effectively assists humans in finishing the task, (2) the robot is slow in response, leading to the task failing, (3) the robot frequently picks up wrong tools leading to task failure. Experimental results have demonstrated the effectiveness of the developed system in recognizing human co-worker's emotions when the human and the robot were working in the above scenarios. It further shows the developed system has the potential to contribute to the development of an empathic collaborative robot companion in the manufacturing area.
DOI
10.1109/RO-MAN60168.2024.10731348
Journal ISSN / Book ISBN
85209807862 (Scopus)
Montclair State University Digital Commons Citation
Loor, Jianna; Murphy, Jordan; and Li, Rui, "A Speech and Facial Information based Emotion Recognition System of Collaborative Robot for Empathic Human-Robot Collaboration" (2024). School of Computing Faculty Scholarship and Creative Works. 77.
https://digitalcommons.montclair.edu/computing-facpubs/77
Rights
Available via the National Science Foundation Public Access Repository https://par.nsf.gov/biblio/10542201