File Download
There are no files associated with this item.
Supplementary
-
Citations:
- Appears in Collections:
Conference Paper: Audiovisual Information Processing in Emotion Recognition: An Eye Tracking Study
Title | Audiovisual Information Processing in Emotion Recognition: An Eye Tracking Study |
---|---|
Authors | |
Keywords | emotion recognition audiovisual processing facial expression eye movement EMHMM |
Issue Date | 2020 |
Publisher | Cognitive Science Society. The Proceedings' web site is located at https://cognitivesciencesociety.org/cogsci20/index.html |
Citation | Proceedings of the 42nd Annual Conference of the Cognitive Science Society (CogSci 2020), Virtual Conference, Toronto, Canada, 29 July - 1 August 2020, p. 2624-2630 How to Cite? |
Abstract | In audiovisual information processing, auditory information may interfere with eye movement planning in visual processing due to competition for attentional resources. Here we hypothesize that this interference may be mitigated in the recognition of emotions involving strong audiovisual coupling. Participants judged the emotion of a talking head video under audiovisual, video-only, and audio-only conditions. While participants generally performed the best in the audiovisual condition, their eye movement pattern did not change significantly across the three conditions except for the recognition of disgust. In disgust recognition, eye movements in the audiovisual condition were less eyes-focused than the video-only condition, and the larger the difference, the less the audiovisual advantage in performance. Disgust recognition develops later in life and may involve weaker audiovisual coupling. Accordingly, our results suggest that whether emotional voice information facilitates emotion recognition without interfering with eye movement planning depends on the strength of audiovisual coupling in emotion processing. |
Persistent Identifier | http://hdl.handle.net/10722/285367 |
ISSN |
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Zheng, Y | - |
dc.contributor.author | Hsiao, JHW | - |
dc.date.accessioned | 2020-08-18T03:52:48Z | - |
dc.date.available | 2020-08-18T03:52:48Z | - |
dc.date.issued | 2020 | - |
dc.identifier.citation | Proceedings of the 42nd Annual Conference of the Cognitive Science Society (CogSci 2020), Virtual Conference, Toronto, Canada, 29 July - 1 August 2020, p. 2624-2630 | - |
dc.identifier.issn | 1069-7977 | - |
dc.identifier.uri | http://hdl.handle.net/10722/285367 | - |
dc.description.abstract | In audiovisual information processing, auditory information may interfere with eye movement planning in visual processing due to competition for attentional resources. Here we hypothesize that this interference may be mitigated in the recognition of emotions involving strong audiovisual coupling. Participants judged the emotion of a talking head video under audiovisual, video-only, and audio-only conditions. While participants generally performed the best in the audiovisual condition, their eye movement pattern did not change significantly across the three conditions except for the recognition of disgust. In disgust recognition, eye movements in the audiovisual condition were less eyes-focused than the video-only condition, and the larger the difference, the less the audiovisual advantage in performance. Disgust recognition develops later in life and may involve weaker audiovisual coupling. Accordingly, our results suggest that whether emotional voice information facilitates emotion recognition without interfering with eye movement planning depends on the strength of audiovisual coupling in emotion processing. | - |
dc.language | eng | - |
dc.publisher | Cognitive Science Society. The Proceedings' web site is located at https://cognitivesciencesociety.org/cogsci20/index.html | - |
dc.relation.ispartof | Cognitive Science Society Annual Conference Proceedings | - |
dc.subject | emotion recognition | - |
dc.subject | audiovisual processing | - |
dc.subject | facial expression | - |
dc.subject | eye movement | - |
dc.subject | EMHMM | - |
dc.title | Audiovisual Information Processing in Emotion Recognition: An Eye Tracking Study | - |
dc.type | Conference_Paper | - |
dc.identifier.email | Hsiao, JHW: jhsiao@hku.hk | - |
dc.identifier.authority | Hsiao, JHW=rp00632 | - |
dc.identifier.hkuros | 312840 | - |
dc.identifier.spage | 2624 | - |
dc.identifier.epage | 2630 | - |
dc.publisher.place | United States | - |
dc.identifier.issnl | 1069-7977 | - |