Doctoral thesis
OA Policy
English

A Multimodal Approach for Identification, Analysis, and Comparison of Human Emotional and Behavioral Patterns between Human - Human and Human - Technology Interaction

ContributorsBaka, Evangelia
Imprimatur date2022
Defense date2022
Abstract

This research delves into Human-Human (H-H) and Human-NonHuman (H-NH) social interactions, exploring the impact of virtual environments and Human-Robot Interaction (HRI). Through EEG, audio recordings, and questionnaires, the study investigates brain activity, emotional states, and behavioral responses. Novel findings include distinct brain states in virtual environments and the human brain's ability to differentiate between robots and humans, with heightened concentration and motivation during HRI. Multidisciplinary analyses of H-H and H-NH interactions provide insights into diverse parameters. The study highlights the importance of designing nonhuman agents with human-like behavioral traits rather than focusing solely on appearance. A model achieving 82% accuracy in recognizing human voices based on interlocutor nature is developed. This research bridges gaps in existing literature, emphasizing the need for understanding human reactions to enhance nonhuman agent design and improve cognitive and emotional responses in social interactions. Further extensive research is recommended for a comprehensive understanding of H-NH interactions.

Research groups
Citation (ISO format)
BAKA, Evangelia. A Multimodal Approach for Identification, Analysis, and Comparison of Human Emotional and Behavioral Patterns between Human - Human and Human - Technology Interaction. Doctoral Thesis, 2022. doi: 10.13097/archive-ouverte/unige:173693
Main files (1)
Thesis
accessLevelPublic
Secondary files (1)
Identifiers
144views
877downloads

Technical informations

Creation06/12/2023 18:03:47
First validation11/12/2023 08:06:36
Update time03/04/2025 15:43:07
Status update03/04/2025 15:43:07
Last indexation03/04/2025 15:55:10
All rights reserved by Archive ouverte UNIGE and the University of GenevaunigeBlack