File Download

There are no files associated with this item.

  Links for fulltext
     (May Require Subscription)
  • Find via Find It@HKUL
Supplementary

Conference Paper: Audiovisual Information Processing in Emotion Recognition: An Eye Tracking Study

TitleAudiovisual Information Processing in Emotion Recognition: An Eye Tracking Study
Authors
Keywordsemotion recognition
audiovisual processing
facial expression
eye movement
EMHMM
Issue Date2020
PublisherCognitive Science Society. The Proceedings' web site is located at https://cognitivesciencesociety.org/cogsci20/index.html
Citation
Proceedings of the 42nd Annual Conference of the Cognitive Science Society (CogSci 2020), Virtual Conference, Toronto, Canada, 29 July - 1 August 2020, p. 2624-2630 How to Cite?
AbstractIn audiovisual information processing, auditory information may interfere with eye movement planning in visual processing due to competition for attentional resources. Here we hypothesize that this interference may be mitigated in the recognition of emotions involving strong audiovisual coupling. Participants judged the emotion of a talking head video under audiovisual, video-only, and audio-only conditions. While participants generally performed the best in the audiovisual condition, their eye movement pattern did not change significantly across the three conditions except for the recognition of disgust. In disgust recognition, eye movements in the audiovisual condition were less eyes-focused than the video-only condition, and the larger the difference, the less the audiovisual advantage in performance. Disgust recognition develops later in life and may involve weaker audiovisual coupling. Accordingly, our results suggest that whether emotional voice information facilitates emotion recognition without interfering with eye movement planning depends on the strength of audiovisual coupling in emotion processing.
Persistent Identifierhttp://hdl.handle.net/10722/285367
ISSN

 

DC FieldValueLanguage
dc.contributor.authorZheng, Y-
dc.contributor.authorHsiao, JHW-
dc.date.accessioned2020-08-18T03:52:48Z-
dc.date.available2020-08-18T03:52:48Z-
dc.date.issued2020-
dc.identifier.citationProceedings of the 42nd Annual Conference of the Cognitive Science Society (CogSci 2020), Virtual Conference, Toronto, Canada, 29 July - 1 August 2020, p. 2624-2630-
dc.identifier.issn1069-7977-
dc.identifier.urihttp://hdl.handle.net/10722/285367-
dc.description.abstractIn audiovisual information processing, auditory information may interfere with eye movement planning in visual processing due to competition for attentional resources. Here we hypothesize that this interference may be mitigated in the recognition of emotions involving strong audiovisual coupling. Participants judged the emotion of a talking head video under audiovisual, video-only, and audio-only conditions. While participants generally performed the best in the audiovisual condition, their eye movement pattern did not change significantly across the three conditions except for the recognition of disgust. In disgust recognition, eye movements in the audiovisual condition were less eyes-focused than the video-only condition, and the larger the difference, the less the audiovisual advantage in performance. Disgust recognition develops later in life and may involve weaker audiovisual coupling. Accordingly, our results suggest that whether emotional voice information facilitates emotion recognition without interfering with eye movement planning depends on the strength of audiovisual coupling in emotion processing.-
dc.languageeng-
dc.publisherCognitive Science Society. The Proceedings' web site is located at https://cognitivesciencesociety.org/cogsci20/index.html-
dc.relation.ispartofCognitive Science Society Annual Conference Proceedings-
dc.subjectemotion recognition-
dc.subjectaudiovisual processing-
dc.subjectfacial expression-
dc.subjecteye movement-
dc.subjectEMHMM-
dc.titleAudiovisual Information Processing in Emotion Recognition: An Eye Tracking Study-
dc.typeConference_Paper-
dc.identifier.emailHsiao, JHW: jhsiao@hku.hk-
dc.identifier.authorityHsiao, JHW=rp00632-
dc.identifier.hkuros312840-
dc.identifier.spage2624-
dc.identifier.epage2630-
dc.publisher.placeUnited States-

Export via OAI-PMH Interface in XML Formats


OR


Export to Other Non-XML Formats