Akiyama, Toshiya and Osaka, Kyoko and Ito, Hirokazu and Tanioka, Ryuichi and Blaquera, Allan Paulo and Bollos, Leah Anne Christine and Tanioka, Tetsuya (2023) Analysis of Emotions Using Multimodal Data: A Case Study. Journal of Biosciences and Medicines, 11 (12). pp. 54-68. ISSN 2327-5081
![[thumbnail of jbm_2023120714085712.pdf]](http://publish7promo.com/style/images/fileicons/text.png)
jbm_2023120714085712.pdf - Published Version
Download (2MB)
Abstract
In this case study, we hypothesized that sympathetic nerve activity would be higher during conversation with PALRO robot, and that conversation would result in an increase in cerebral blood flow near the Broca’s area. The facial expressions of a human subject were recorded, and cerebral blood flow and heart rate variability were measured during interactions with the humanoid robot. These multimodal data were time-synchronized to quantitatively verify the change from the resting baseline by testing facial expression analysis, cerebral blood flow, and heart rate variability. In conclusion, this subject indicated that sympathetic nervous activity was dominant, suggesting that the subject may have enjoyed and been excited while talking to the robot (normalized High Frequency < normalized Low Frequency: 0.22 ± 0.16 < 0.78 ± 0.16). Cerebral blood flow values were higher during conversation and in the resting state after the experiment than in the resting state before the experiment. Talking increased cerebral blood flow in the frontal region. As the subject was left-handed, it was confirmed that the right side of the brain, where the Broca’s area is located, was particularly activated (Left < right: 0.15 ± 0.21 < 1.25 ± 0.17). In the sections where a “happy” facial emotion was recognized, the examiner-judged “happy” faces and the MTCNN “happy” results were also generally consistent.
Item Type: | Article |
---|---|
Subjects: | Euro Archives > Medical Science |
Depositing User: | Managing Editor |
Date Deposited: | 13 Dec 2023 12:04 |
Last Modified: | 13 Dec 2023 12:04 |
URI: | http://publish7promo.com/id/eprint/4263 |