Emotional Speech Comprehension in Deaf Children with Cochlear Implant

Gaïd Le Maner-Idrissi 1 , Sandrine Le Sourn Bissaoui 1 , Virginie Dardier 1 , Maxime Codet 2 , Nathalie Botte-Bonneton 1 , Fanny Delahaye 1 , Virginie Laval 3 , Marc Aguert 4 , Géraldine Tan-Bescond 2  and Benoit Godey 2
  • 1 Univ Rennes-Rennes 2- LP3C, Rennes, France
  • 2 Centre Hospitalier Universitaire, Rennes, France
  • 3 Université de Poitiers-CerCA, France
  • 4 Université de Caen Basse Normandie, Caen, France

Abstract

We examined the understanding of emotional speech by deaf children with cochlear implant (CI). Thirty deaf children with CI and 60 typically developing controls (matched on chronological age or hearing age) performed a computerized task featuring emotional prosody, either embedded in a discrepant context or without any context at all. Across the task conditions, the deaf participants with CI scored lower on the prosody-bases responses than their peers matched on chronological age or hearing age. Additionally, we analyzed the effect of age on determining correct prosody-based responses and we found that hearing age was a predictor of the accuracy of prosody-based responses. We discuss these findings with respect to delay in prosody and intermodal processing. Future research should aim to specify the nature of the cognitive processes that would be required to process prosody.

If the inline PDF is not rendering correctly, you can download the PDF file here.

  • Achim. A. M., Guitton, M., Jackson, P., Boutin, A., & Monetta, L. (2013). On what ground do we mentalize? Characteristics of current tasks and sources of information that contribute to mentalizing judgments. Psychological Assessments, 25, 117–126. doi:10.1037/a0029137

  • Agrawal, D., Thorne, J. D., Viola, F. C., Timm, L., Debenar, S., Büchner, A., … Wittfoth, M. (2013). Electrophysiological responses to emotional prosody perception in cochlear implant users. NeuroImage: Clinical, 2, 229–238. doi:10.1016/j.nicl.2013.01.001

  • Aguert, M., Laval, V., Le Bigot, L., & Bernicot, J. (2010). Understanding expressive speech acts: The role of prosody and situational context in French-speaking 5- to 9-year-olds. Journal of Speech, Language, and Hearing Research, 53(6), 1629–1641.

  • Baltaxe, C. A. M. (1991). Vocal communication of affect and its perception in three- to four-year-old children. Perceptual and Motor Skills, 72, 1187–1202.

  • Banse, R., & Scherer, K. R. (1996). Acoustic profiles in vocal emotion expression. Journal of Personality and Social Psychology, 70(3), 614–636. doi:10.1037/0022-3514.70.3.614

  • Bänziger, T., & Scherer, K. R. (2005).The role of intonation in emotional expressions. Speech Communication, 46, 252–267.

  • Barkhuysen, P., Krahmer, E., & Swerts, M. (2010). Crossmodal and incremental perception of audiovisual cues to emotional speech. Language and Speech, 53, 3–30.

  • Beer, J., Kronenberger, W. G., Castellanos, I., Colson, B. G., Henning, S. C., & Pisoni, D. B. (2014). Executive functioning skills in preschool-age children with cochlear implants. Journal of Speech, Language, and Hearing Research, 57(4), 1521–1534.

  • Boersma, P., & Weenink, D. (2004). PRAAT: Doing phonetics by computer. Retrieved from www.praat.org

  • Bond, M., Mealing, S., Anderson, R., Elston, J., Weiner, G., Taylor, R. S., … Stein, K. (2009). The effectiveness and cost-effectiveness of cochlear implants for severe to profound deafness in children and adults: A systematic review and economic model. Health Technology Assessment, 13(44), 1–330. doi:10.3310/hta13440

  • Bonns, T., de Raeve, L., Langereis, M., Peeraer, L., Wouters, J., & van Wieringen, A. (2013). Expressive vocabulary, morphology, syntax and narrative skills in profoundly deaf children after cochlear implantation. Research in Developmental Disabilities, 34(6), 2008–2022.

  • Bouchard, M. -È., Ouellet, C., & Cohen, H. (2009). Speech development in prelingually deaf children with cochlear implants. Language and Linguistics Compass, 3, 1–18.

  • Chin, S. B., Bergeson, T. R., & Phan, J. (2012). Speech intelligibility and prosody production in children with cochlear implants. Journal of Communication Disorders, 45, 355–366. doi:10.1016/j.jcomdis.2012.05.003

  • Clearly, M., Pisoni, D. B., & Kirk, K. I. (2005). Influence of voice similarity on talker discrimination in children with normal hearing and children with cochlear implants. Journal of Speech, Language and Hearing Research, 48, 204–223.

  • Convertino, C., Borgna, G., Marschark, M., & Durkin, A. (2014). Word and world knowledge among deaf learners with and without cochlear implants. Journal of Deaf Studies and Deaf Education, 19(4), 471–483.

  • Cutler, A., Dahan, D., & van Donselaar, W. (1997). Prosody in the comprehension of spoken language: A literature review. Language and Speech, 40(2), 141–201.

  • Dettman, S. J., Pinder, D., Briggs, R. J. S., Dowell, R. C., & Leigh, J. R. (2007). Communication development in children who receive the cochlear implant younger than 12 months: Risks versus benefits. Ear and Hearing, 28(2), 11–18.

  • Dillon, C. M., de Jong., K., & Pisoni, D. B. (2012). Phonological awareness, reading skills, and vocabulary knowledge in children who use cochlear implants. Journal of Deaf Studies Deaf Education, 17(2), 205–226.

  • Drennan, W. R., & Rubinstein, J. T. (2008). Music perception in cochlear implant users and its relationship with psychophysical capabilities. Journal of Rehabilitation Research and Development, 45, 779–789.

  • Friend, M., & Bryant, J. B. (2000). A developmental lexical bias in the interpretation of discrepant messages. Merrill-Palmer Quarterly, 46(2), 342–369.

  • Happé, F. (1994). An advanced test of theory of mind: Understanding of story characters’ thoughts and feelings by able autistic, mentally handicapped, and normal children and adults. Journal of Autism and Developmental Disorders, 24(2), 129–154.

  • Hegarty, L., & Faulkner, L. (2013). The perception of stress and intonation in children with a cochlear implant and a hearing aid. Cochlear Implants International, 14, 35–39. doi:10.1179/1467010013Z.000000000132

  • Hopyan, T. M., Gordon, K. A., & Papsin, B. C. (2011). Identifying emotions in music through electrical hearing in deaf children using cochlear implants. Cochlear Implants International, 12, 21–26.

  • Hopyan, T. M., Manno, F. A., Papsin, B. C., & Gordon, K. A. (2015). Sad and happy emotion discrimination in music by children with cochlear implants. Child Neurolpsychology: A Journal on Normal and Abnormal Development in childhood and Adolescence, 6(3), 1–15. doi:10.1080/0929 7049.2014.992400

  • Hopyan-Misakyan, T. M., Gordon, K. A., Dennis, M., & Papsin, B. C. (2009). Recognition of affective speech prosody and facial affect in deaf children with unilateral right cochlear implants. Child Neuropsychology, 15, 136–146. doi:10.1080/0929704080240368

  • Jiam, N. T., Caldwell, M., Deroche, M. L., Chatterjee, M., & Limb, C. J. (2017). Voice emotion perception and production in cochlear implant users. Hearing Research, 352, 30–39.

  • Juslin, P. N., & Laukka, P. (2003). Communication of emotions in vocal expression and music performance: Different channels, same code? Psychological Bulletin, 129, 770–814.

  • Kahneman, D., & Tversky, A. (1984). Choices, values, and frames. American Psychologist, 39, 341–350.

  • Kalathottukaren, R. T., Purdy, S. C., & Ballard, E. (2015). Prosody perception and musical pitch discrimination in adults using cochlear implants. International Journal of Audiology, 54, 444–452. doi:10.3109/14992027.2014.997314

  • Khomsi, A. (1999). Lecture de mots et compréhension-révisée: LMC-R, épreuve d'évaluation de la compétence en lecture. E.C.P.A. Paris

  • Kronenberger, W. G., Colson, B. G., Henning, S. C., & Pisoni, D. B. (2014). Executive functioning and speech-language skills following long-term use of cochlear implants. Journal of Deaf Studies and Deaf Education, 19(4), 456–470.

  • Ladd, D. R. (1996). International Phonology. Cambridge: Cambridge University Press.

  • Langus, A., Marchetto, E., Bion, R., Hoffmann, A., & Nespor, M. (2012). Journal of Memory and Language, 66(1), 285–306.

  • Laval, V., Dardier, V., Laval, C., & Monetta, L. (2016). La compréhension de l’intention d’autrui est-elle sous l’influence d’un biais négatif? Bulletin de Psychologie, 2, 117–126.

  • Laukka, P., Juslin, P. N., & Bresin, R. (2005). A dimensional approach to vocal expression of emotion. Cognition & Emotion, 19, 633–653.

  • Lieberman, P., & Michaels, S. B. (1962). Some Aspects of Fundamental Frequency and Envelope Amplitude as Related to the Emotional Content of Speech. Journal of the Acoustical Society of America, 34, 922–927.

  • Lehiste, I. (1970). Suprasegmentals. Cambridge: MIT Press.

  • Le Maner-Idrissi, G., Rouxel, G., Pajon, C., Dardier, V., Baligand, Z., Tan-Bescond, G., & Godey, B. (2009). Cochlear implant and lexical diversity development in deaf children: Intra- and interindividual differences. Current Psychology Letters, 25(2), 1–13.

  • Le Sourn-Bissaoui, S., Aguert, M., Girard, P., Chevreuil, C., & Laval, V. (2013). Emotional speech comprehension in children and adolescents with autism spectrum disorders. Journal of Communication Disorders, 46(4), 309–320

  • Luo, X., Fu, Q. J., & Galvin, J. (2007). Vocal emotion recognition by normal-hearing listeners and cochlear implant users. Trends in Amplification, 11, 301–315.

  • Manrique, M., Cervera-Paz, F. J., Huarte, A., & Molina, M. (2004). Prospective long-term auditory results of cochlear implantation in prelinguistically deafened children: The importance of early implantation. Acta Oto Laryngologica. Supplement, 552, 55–63.

  • Marx, M., James, C., Foxton, J., Capber, A., Fraysse, B., Barone, P., & Deguine, O. (2015). Speech prosody perception in cochlear implant users with and without residual hearing. Ear and Hearing, 36, 239–248. doi:0196/0202/2015/362-0239/0

  • Meerum Terwogt, M., & Rieffe, C. (2004). Behavioral problems in deaf children: Theory of mind delay or communication failure? European Journal of Developmental Psychology, 1, 231–240. doi:10.1080/17405620444000139

  • Moein, N., Khoddami, S. M., & Shahbodaghi, M. R. (2017). A comparison of speech intonation production and perception abilities of Farsi speaking cochlear implanted and normal hearing children. International Journal of Pediatric Otorhinolaryngology, 101, 1–6. doi:10.1016/j.ijporl.2017.07.018

  • Moeller, M. P., Tomblin, J. B., Yoshinaga-Itano, C., Connor, C. M., & Jerger, S. (2007). Current state of knowledge: Language and literacy of children with hearing impairment. Ear and Hearing, 28, 740–753. doi:10.1097/AUD.060113318157f07f

  • Morton, J. B., & Trehub, S. E. (2001). Children’s understanding of emotion in speech. Child Development, 72(3), 834–843.

  • Most, T. (2016). Perception of the prosodic characteristics of spoken language by individuals with hearing loss. In M. Marschark, P. E. Spencer (Eds.), The Oxford Handbook of Deaf Studies in Language (pp. 79–93). Oxford: Oxford University Press.

  • Most, T., & Aviner, C. (2009). Auditory, visual, and auditory-visual perception of emotions by individuals with cochlear implants, hearing aids, and normal hearing. Journal of Deaf studies and Deaf Education, 14, 449–464. doi:10.1093/deafed/enp007

  • Mumme, D. L., Fernald, A., & Herrera, C. (1996). Infants’ responses to facial and vocal emotional signals in a social referencing paradigm. Child Development, 67, 3219–3237.

  • Nakata, T., Trehub, S. E., & Kanda, Y. (2012). Effect of cochlear implants on children’s perception and production of speech prosody. The Journal of the Acoustical Society of. America, 131, 1307–1314. doi:10.1121/1.3672697

  • Nicholas, J. G. (1994). Sensory aid use and the development of communicative function. The Volta Review, 96, 181–198.

  • Nicholas, J. G., & Geers, A. E. (2007). Will they catch up? The role of age at cochlear implantation in the spoken language development of children with severe to profound hearing loss. Journal of Speech, Language, and Hearing Research, 50(4), 1048–1062.

  • Nott, P., Cowan, R., Brown, P. M., & Wigglesworth, G. (2009). Early language development in children with profound hearing loss fitted with a device at a young age: Part I–The time period taken to acquire first words and first word combinations. Ear and Hearing, 30(5), 526–540.

  • Papoušek, M. (1992). Early ontogeny of vocal communication in parent–infant interactions. In: Papoušek, H., Jürgens, U., Papoušek, M. (Eds.) Nonverbal vocal communication: Comparative and developmental approaches (pp. 230–261). New York: Cambridge University Press.

  • Peeters, G., & Czapinski, J. (1990). Positive-negative asymmetry in evaluations: The distinction between affective and informational negativity effects. European Review of Social Psychology, 1, 33–60.

  • Quam, C., & Swingley, D. (2012). Development in children’s interpretation of pitch cues to emotions. Child Development, 83(1), 236–250. doi:10.1111/j.1467-8624.2011.01700

  • Rieffe, C., & Meerum Terwogt, M. (2000). Deaf children’s understanding of emotions: Desires take preference. Journal of Child Psychology and Psychiatry, 41, 601 pp. 230–261 608. doi:10.1017/S0021963099005843

  • Rinaldi, P., & Caselli, M. C. (2014). Language development in a bimodal bilingual child with cochlear implant: A longitudinal study. Bilingualism: Language and Cognition, 17(4), 798–809.

  • Robbins, A. M., Svirsky, M., & Kirk, K. I. (1997). Children with implants can speak, but can they communicate? American Academy of Otolaryngology, 17(3), 155–160.

  • Russell, J. A., Bachorowski, J.-A., & Fernandez-Dols, J.-M. (2003). Facial and vocal expressions of emotion. Annual Review of Psychology, 54, 329.

  • Scherer, K. R. (1986). Vocal affect expression: a review and a model for future research. Psychological Bulletin, 99, 143–165.

  • See, R. L., Driscoll, V. D., Gfeller, K., Kliethermes, S., & Oleson, J. (2013). Speech intonation and melodic contour recognition in children with cochlear implants and with normal hearing. Otology and Neurotology, 34(3), 490–498. doi:10.1097/MAO.0b013e318287c985

  • Spackman, M. P., Brown, B. L., & Otto, S. (2009). Do emotions have distinct vocal profiles? A study of idiographic patterns of expression. Cognition and Emotion, 23, 1565–1588.

  • Stifter, C. A., & Fox, N. A. (1987). Preschool children’s ability to identify and label emotions. Journal of Nonverbal Behavior, 11, 43–54.

  • Straatman, L. V., Rietveld, A. C., Beijen, J., Mylanus, E. A. M., & Mens, L. H. M. (2010). Advantage of bimodal fitting in prosody perception for children using a cochlear implant and a hearing aid. The Journal of the Acoustical Society of America, 128, 1884–1895.

  • Tait, M., de Raeve, L., & Nikolopoulos, T. P. (2007). Deaf children with cochlear implants before the age of 1 year: Comparison of preverbal communication with normally hearing children. International Journal of Pediatric Otorhinolaryngology, 71, 1605–1611.

  • Taitelbaum-Swead, R., Kishon-Rabin, L., Kaplan-Neeman, R., Muchnik, C., Kronenberg, J., & Hildesheimer, M. (2005). Speech perception of children using Nucleus, Clarion or Med-El cochlear implants. International Journal of Pediatric Otorhinolaryngology, 69(12), 1675–1683.

  • Tomaszewski P., Krzysztofiak, P., & Moroń, E. (2019). From sign language to spoken language? A new discourse of language development in deaf children. Psychology of Language and Communication, 23(1), 48–84.

  • Tomblin, J. B., Spencer, S. C., Peng, L. J., & Lu, N. (2008). Long-term trajectories of the development of speech sound production in pediatric cochlear implant recipients. Journal of Speech Language and Hearing Research, 51(5), 1353–1368.

  • Torppa, R., Faulkner, A., Huotilainen, M., Järvikivi, J., Lipsanen, J., Laasonen, M., & Vainio, M. (2014). The perception of prosody and associated auditory cues in early-implanted children: The role of auditory working memory and musical activities. International Journal of Audiology, 53, 182–191. doi:10. 3109/14992027.2013.872302

  • Vaish, A., Grossmann, T., & Woodward. A. (2008). Not all emotions are created equal: The negativity bias in social-emotional development. Psychological Bulletin, 134(3), 383–403.

  • Välimaa, T., Kunnari, S., Laukkanen, N. P., & Lonka, E. (2018). Early vocabulary development in children with bilateral cochlear implants. International Journal of Language & Communication Disorders, 53(1), 3–15.

  • Volkova, A., Trehub, S. E., Schellenberg, E. G., Papsin, B. C., & Gordon, K. A. (2013). Children with bilateral cochlear implants identify emotion in speech and music. Cochlear Implants International, 14(2), 80 91. doi:101179/1754762812Y00E000004

  • Wang, D. Y., Trehub, S. E., Volkova, A., & van Lieshout, P. (2013). Child implant users’ imitation of happy- and sad-sounding speech. Frontiers in Psychology, 4, 1–8. doi:10.3389/fpsyg.2013.00351

  • Waxer, M., & Morton, J. B. (2011). Children’s judgments of emotion from conflicting cues in speech: Why 6-year-olds are so inflexible. Child Development, 82(5), 1648–1660. doi:10.1111/j.1467-8624.2011.01624.x

  • Wiefferink, C. H., Rieffe, C., Ketelaar, L., & Frijns, J. H. M. (2012). Predicting social functioning in children with a cochlear implant and in normal-hearing children: The role of emotion regulation. International Journal of Pediatric Otorhinolaryngology, 76, 883–889. doi:10.1016/j. ijporl.2012.02 065

  • Zeng, F. G. (2004). Trends in cochlear implants. Trends in Amplification, 8, 1–34.

OPEN ACCESS

Journal + Issues

Search