Using Brain Computer Interfaces to detect human satisfaction in human-robot interaction, IJHR Volume: 8, Issue: 1(2011) pp. 87-101

This article discusses the use of a brain–computer interface (BCI) to obtain emotional feedback from a human in response to the motion of humanoid robots in collaborative environments. The purpose of this study is to detect the human satisfaction level and use it as a feedback for correcting and improving the behavior of the robot to maximize human satisfaction. This article describes experiments and algorithms that use human brains activity collected through BCI in order to estimate the level of satisfaction. Users wear an electroencephalogram (EEG) headset and control the movement of the robot by mental imagination. The robots responds to the mental imagination may not be...

Predicting student emotions resulting from appraisal of ITS feedback, Research and Practice in Technology Enhanced Learning, Vol. 6, No. 2 (2011) 107 – 133. (in press)

Many researchers have shown the effectiveness of affective ITS for supporting student learning. Support provided to students is usually presented through pedagogical agents capable of expressing emotions through facial expressions, gestures and synthesized speech. Dialogue content is important as it contains information that will help the student learn new information, further understand concepts or correct misconceptions. Although these interventions are based on existing theories, there are still cases when feedback may not fit students as they are very diverse and can be in very different contexts. One very important aspect to consider is how students appraise the feedback given by an ITS....

Emotional instant messaging with the Epoc headset, M.S thesis., University of Maryland, Baltimore County, 2010, 114 pages; 1488509

Interpersonal communication benefits greatly from the emotional information encoded by facial expression, body language, and tone of voice, however this information is noticeably missing from typical instant message communication. This work investigates how instant message communication can be made richer by including emotional information provided by the Epoc headset. First, a study establishes that the Epoc headset is capable of inferring some measures of affect with reasonable accuracy. Then, the novel EmoChat application is introduced which uses the Epoc headset to convey facial expression and levels of basic affective states during instant messaging sessions. A study compares the emotionality...

ABE: An Agent-Based Software Architecture for a Multimodal Emotion Recognition Framework 9th Working IEEE/IFIP Conference on Software Architecture (WICSA), 187-193, 2011

The computer's ability to recognize human emotional states given physiological signals is gaining in popularity to create empathetic systems such as learning environments, health care systems and videogames. Despite that, there are few frameworks, libraries, architectures, or software tools, which allow systems developers to easily integrate emotion recognition into their software projects. The work reported here offers a first step to fill this gap in the lack of frameworks and models, addressing: (a) the modeling of an agent-driven component-based architecture for multimodal emotion recognition, called ABE, and (b) the use of ABE to implement a multimodal emotion recognition...