Recognizing facially expressed emotions in videos of people with visual impairments in online settings

Article type: Research Article

Authors: Kim, Hyung Nam

Affiliations: North Carolina Agricultural and Technical State University, Greensboro, NC, USA | E-mail: hnkim@ncat.edu

Correspondence: [*] Corresponding author: North Carolina Agricultural and Technical State University, Greensboro, NC, USA. E-mail: hnkim@ncat.edu.

Abstract: BACKGROUND: Facial expressions are critical for conveying emotions and facilitating social interaction. Yet, little is known about how accurately sighted individuals recognize emotions facially expressed by people with visual impairments in online communication settings. OBJECTIVE: This study aimed to investigate sighted individuals’ ability to understand facial expressions of six basic emotions in people with visual impairments during Zoom calls. It also aimed to examine whether education on facial expressions specific to people with visual impairments would improve emotion recognition accuracy. METHODS: Sighted participants viewed video clips of individuals with visual impairments displaying facial expressions. They then identified the emotions displayed. Next, they received an educational session on facial expressions specific to people with visual impairments, addressing unique characteristics and potential misinterpretations. After education, participants viewed another set of video clips and again identified the emotions displayed. RESULTS: Before education, participants frequently misidentified emotions. After education, their accuracy in recognizing emotions improved significantly. CONCLUSIONS: This study provides evidence that education on facial expressions of people with visual impairments can significantly enhance sighted individuals’ ability to accurately recognize emotions in online settings. This improved accuracy has the potential to foster more inclusive and effective online interactions between people with and without visual disabilities.

Keywords: Cyberspace, non-verbal communication, visual disabilities, emotion recognition, facial expression

DOI: 10.3233/TAD-230040

Journal: Technology and Disability, vol. Pre-press, no. Pre-press, pp. 1-10, 2024