Affiliations: Centre for Speech Technology, School of Computer Science and Communication, Kungliga Tekniska Högskolan (KTH), Stockholm, Sweden | Department of Communication Engineering, Brandenburg University of Technology Cottbus, Germany
Correspondence:
[*]
Address for correspondence: B. Granström, Centre for Speech Technology, Lindstedtsv. 24, KTH, SE-100 44 Stockholm, Sweden. E-mail: bjorn@speech.kth.se.
Abstract: Speech and sounds are important sources of information in our everyday lives for communication with our environment, be it interacting with fellow humans or directing our attention to technical devices with sound signals. For hearing impaired persons this acoustic information must be supplemented or even replaced by cues using other senses. We believe that the most natural modality to use is the visual, since speech is fundamentally audiovisual and these two modalities are complementary. We are hence exploring how different visualization methods for speech and audio signals may support hearing impaired persons. The goal in this line of research is to allow the growing number of hearing impaired persons, children as well as the middle-aged and elderly, equal participation in communication. A number of visualization techniques are proposed and exemplified with applications for hearing impaired persons.
Keywords: Sound classification, speech processing, hearing impairment, communication support, talking heads, speech reading, speech training
