Hostname: page-component-cd9895bd7-gvvz8 Total loading time: 0 Render date: 2024-12-22T10:48:33.510Z Has data issue: false hasContentIssue false

Effects of acoustic and linguistic experience on Japanese pitch accent processing*

Published online by Cambridge University Press:  10 May 2016

XIANGHUA WU*
Affiliation:
University of California, Berkeley, U.S.A.
SAYA KAWASE
Affiliation:
University of Western Sydney, Australia
YUE WANG
Affiliation:
Simon Fraser University, Canada
*
Address for correspondence: Xianghua Wu, Department of East Languages and Cultures, University of California, Berkeley, 3110 Dwinelle Hall, Berkeley, California 94720, U.S.A.xhwu@berkeley.edu

Abstract

This study investigated the effects of L2 learning experience in relation to L1 background on hemispheric processing of Japanese pitch accent. Native Mandarin Chinese (tonal L1) and English (non-tonal L1) learners of Japanese were tested using dichotic listening. These listener groups were compared with those recruited in Wu, Tu & Wang (2012), including native Mandarin and English listeners without Japanese experience and native Japanese listeners. Results revealed an overall right-hemisphere preference across groups, suggesting acoustically oriented processing. Individual pitch accent patterns also revealed pattern-specific laterality differences, further reflecting acoustic-level processing. However, listener group differences indicated L1 effects, with the Chinese but not English listeners approximating the Japanese patterns. Furthermore, English learners but not naïve listeners exhibited a shift towards the native direction, revealing effects of L2 learning. These findings imply integrated effects of acoustic and linguistic aspects on Japanese pitch accent processing as a function of L1 and L2 experience.

Type
Research Article
Copyright
Copyright © Cambridge University Press 2016 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Footnotes

*

Xianghua Wu and Yue Wang have made equal contributions to this paper. This research was conducted in the Language and Brain Lab at Simon Fraser University (SFU) and was funded by research grants to Yue Wang from the Natural Sciences and Engineering Research Council of Canada [NSERC Discovery Grants 312457-2006, 2011]. We thank Sam Gamble, Alison Kumpula, Chris Lightfoot, and Natalia Stratul from the SFU Language and Brain Lab for their assistance in stimuli development, data collection and analysis, and Jung-yueh Tu for her contributions to the first stage of this study. We also thank Drs. Alexander Francis, Kenneth de Jong, Allard Jongman, Joan Sereno, and Yuwen Lai for their valuable input at various stages of this project. Portions of this research were presented at the 164th Acoustical Society of America Meeting in Kansas City. Data from the naïve English and Chinese listeners as well as the native Japanese listeners have previously been reported in Wu, Tu, and Wang (2012).

References

Aasland, W., & Baum, S. (2003). Temporal parameters as cues to phrasal boundaries: A comparison of processing by left-hemisphere-damaged and right-hemisphere-damaged individuals. Brain and Language, 87, 385399.Google Scholar
Beckman, M. E. (1986). Stress and Non-stress Accent. Dordrecht, Holland: Foris.CrossRefGoogle Scholar
Boersma, P., & Weenink, D. (2013). Praat: doing phonetics by computer [Computer program]. Version 5.3.51, http://www.praat.org/.Google Scholar
Braun, B., & Johnson, E. K. (2011). Question or tone 2? How language experience and linguistic function guide pitch processing. Journal of Phonetics 39, 585594.Google Scholar
Broselow, E., Hurtig, R. R., & Ringen, C. (1987). The perception of second language prosody, in: Ioup, Georgette and Weinberger, Steven H., eds., Inter-language Phonology: The Acquisition of Second Language Sound System, Cambridge: Newbury House Publishers, 350361.Google Scholar
Chandrasekaran, B., Krishnan, A., & Gandour, J. T. (2007). Experience-dependent neural plasticity is sensitive to shape of pitch contours. Neuroreport, 18, 19631967.Google Scholar
Cruttenden, A. (1997). Intonation. Cambridge: Cambridge University Press.Google Scholar
Cutler, A. (1986). Forbear is a homophone: Lexical prosody does not constrain lexical access. Language and Speech, 29, 201220.Google Scholar
Gandour, J. (1983). Tone perception in Far Eastern languages. Journal of Phonetics, 11, 149175.Google Scholar
Gandour, J., Wong, D., & Hutchins, G. (1998). Pitch processing in the human brain is influenced by language experience. Neuroreport, 9, 2115.Google Scholar
Gandour, J., Wong, D., Hsieh, L., Weinzapfel, B., Van Lancker, D., & Hutchins, G. D. (2000). A cross-linguistic PET study of tone perception. Journal of Cognitive Neuroscience, 12, 207222.Google Scholar
Gandour, J., Wong, D., Lowe, M., Dzemidzic, M., Satthamnuwing, N., Tong, Y., & Li, X. (2002). A cross-linguistic fMRI study of spectral and temporal cues underlying phonological processing. Journal of Cognitive Neuroscience, 14, 10761087.Google Scholar
Gandour, J., Wong, D., Dzemidzic, M, Lowe, M., Tong, Y., & Li, X. (2003a). A cross-linguistic fMRI study of perception of intonation and emotion in Chinese. Human Brain Mapping, 18, 149157.Google Scholar
Gandour, J., Dzemidzic, M., Wong, D., Lowe, M., Tong, Y., Hsieh, L, Satthamnuwong, N., & Lurito, J. (2003b). Temporal integration of speech prosody is shaped by language experience: An fMRI study. Brain and Language, 84, 318336.Google Scholar
Gandour, J., Tong, Y., Wong, D., Talavage, T., Dzemidzic, M., Xu, Y, Li, X., & Lowe, M. (2004). Hemispheric roles in the perception of speech prosody. Neuroimage, 23, 344357.CrossRefGoogle ScholarPubMed
Gandour, J., Tong, Y., Talavage, T., Wong, D., Dzemidzic, M., Xu, Y., Li, X., & Lowe, M. (2007). Neural basis of first and second language processing of sentence-level linguistic prosody. Human Brain Mapping, 28 (2), 94108.Google Scholar
Gu, F., Zhang, C., Hu, A., & Zhao, G. (2013). Left hemisphere lateralization for lexical and acoustic pitch processing in Cantonese speakers as revealed by mismatch negativity. Neuroimage, 83, 637645.Google Scholar
Hallé, P. A., Chang, Y. C., & Best, C. T. (2004). Identification and discrimination of Mandarin Chinese tones by Mandarin Chinese vs. French listeners. Journal of Phonetics, 32, 395421.Google Scholar
Hasegawa, Y., & Hata, K. (1992). Fundamental frequency as an acoustic cue to accent perception. Language and Speech, 35, 8798.CrossRefGoogle ScholarPubMed
Hayashi, R., Imaizumi, S., Mori, K., Niimi, S., Ueno, S., & Kiritani, S. (2001). Elicitation of N400m in sentence comprehension due to lexical prosody incongruity. Neuroreport, 12, 17531756.CrossRefGoogle ScholarPubMed
Hirano-Cook, E. (2011). Japanese pitch accent acquisition by learners of Japanese : Effects of training on Japanese accent instruction, perception, and production. Unpublished Ph.D. Dissertation, University of Kansas.Google Scholar
Hsieh, L., Gandour, J., Wong, D., & Hutchins, G. D. (2001). Functional heterogeneity of inferior frontal gyrus is shaped by linguistic experience. Brain and Language, 76 (3), 227252.CrossRefGoogle ScholarPubMed
Huang, T., & Johnson, K. (2010). Language specificity in speech perception:Perception of Mandarin tones by native and nonnative listeners. Phonetica, 67, 243267.Google Scholar
Ivry, R. B., & Robertson, L. C. (1998). The two sides of perception. Cambridge, MA: The MIT Press.Google Scholar
Kaan, E., Wayland, R., Bao, M., & Barkley, C. M. (2007). Effects of native language and training on lexical tone perception: An event-related potential study. Brain Research, 1148, 113122.Google Scholar
Kanamura, R., & Imaizumi, S. (2008). Linguistic versus non-linguistic processing of speech prosody in dichotic listening. Acoustics 08 Paris, 87338737.Google Scholar
Kindaichi, H. (1967). Nihongo on'in no kenkyu [Study of Japanese Phonology]. Tokyo: Tokyodo Shuppan.Google Scholar
Kimura, D. (1961). Cerebral dominance and the perception of verbal stimuli. Canadian Journal of Psychology, 15 (3), 166.Google Scholar
King, R. D. (1967). Functional load and sound change. Language, 831852.Google Scholar
Kitahara, M. (2001). Category structure and function of pitch accent in Tokyo Japanese. Unpublished Ph.D. Dissertation, Indiana University.Google Scholar
Klein, D., Zatorre, R. J., Milner, B., & Zhao, V. (2001). A cross-linguistic PET study of tone perception in Mandarin Chinese and English speakers. Neuroimage, 13, 646653.Google Scholar
Koso, A., & Hagiwara, H. (2009). Event-related potential evidence of processing lexical pitch accent in auditory Japanese sentences. Neuroreport, 20, 12701274.Google Scholar
Lee, C. Y., Lekich, A., & Zhang, Y. (2014). Perception of pitch height in lexical and musical tones by English-speaking musicians and nonmusicians. Journal of the Acoustical Society of America, 135, 16071615.Google Scholar
Lehiste, I. (1970). Suprasegmentals, Cambridge, MA: MIT Press.Google Scholar
Li, X., Gandour, J., Talavage, T., Wong, D., Hoffa, A., Lowe, M., & Dzemidzic, M. (2010). Hemispheric asymmetries in phonological processing of tones vs. segmental units. Neuroreport, 21 (10), 690694.CrossRefGoogle Scholar
Liu, C., Azimi, B., Bhandary, M., & Hu, Y. (2014). Contribution of low-frequency harmonics to Mandarin Chinese tone identification in quiet and six-talker babble background. Journal of the Acoustical Society of America, 135 (1), 428438.Google Scholar
Luo, H., Ni, J.-T., Li, Z.-H., Li, X.-O., Zhang, D.-R., Zeng, F.-G., & Chen, L. (2006). Opposite patterns of hemisphere dominance for early auditory processing of lexical tones and consonants. Proceedings of the National Academy of Sciences of the United States of America, 103 (51), 1955819563.Google Scholar
Maniwa, K. (2002). Acoustic and perceptual evidence of complete neutralization of word-final tonal specification in Japanese. Kansas Working Papers in Linguistics, 26, 93112.Google Scholar
Mildner, V. (2004). Hemispheric asymmetry for linguistic prosody: A study of stress perception in Croatian. Brain and Cognition, 55, 358361.CrossRefGoogle ScholarPubMed
Oldfield, R. C. (1971). The assessment and analysis of handedness: The Edinburgh inventory. Neuropsychologia, 9, 97113.Google Scholar
Pierrehumbert, J., & Beckman, M. (1988). Japanese tone structure. Linguistic Inquiry Monograph 15. Cambridge, MA: MIT Press.Google Scholar
Poeppel, D. (2003). The analysis of speech in different temporal integration windows: Cerebral lateralization as ‘asymmetric sampling in time’. Speech Communication, 41 (1), 245255.Google Scholar
Sato, Y., Sogabe, Y., & Mazuka, R. (2007). Brain responses in the processing of lexical pitch-accent by Japanese speakers. Neuroreport, 18, 20012004.Google Scholar
Shibata, T., & Shibata, R. (1990). Akusento wa doo'ongo o donoteido benbetsu shiuruno ka: Nihongo, eigo, chuugokugo no baai (How much can accent distinguish homophones cases of Japanese, English and Chinese). Keiryoo Kokugo-gaku (Mathematical Linguistics), 17, 317327.Google Scholar
Shipley-Brown, F., Dingwall, W. O., Berlin, C. I., Yeni-Komshian, G., & Gordon-Salant, S. (1988). Hemispheric processing of affective and linguistic intonation contours in normal subjects. Brain and Language, 33, 1626.Google Scholar
Surendran, D., & Niyogi, P. (2006). Quantifying the functional load of phonemic oppositions, distinctive features, and suprasegmentals. In Thomsen, O. Nedergaard (ed.), Competing models of language change: Evolution and beyond. John Benjamins.Google Scholar
Sugito, M. (1972). Ososagari-koo: Dootai-sokutei ni yoru nihongo akusento no kenkyu [Delayed pitch fall: An acoustic study]. Shoin Joshi Daigaku Ronshuu 10. Reprinted in Tokugawa, M. (Ed.), Akusento [Accent] (pp. 201229). Tokyo: Yuuseidoo, 1980.Google Scholar
Sugito, M. (1983). Nihongo no akusento to intoneeshon – Tokyo hogen no ‘hana’ to ‘hana’ no soui [Japanese accent and intonation – the difference between ‘hana (flower)’ and ‘hana (nose)’ in the Tokyo dialect]. Kotoba to onsei (‘Sotoba’ Series 18), 2337.Google Scholar
Sugiyama, Y. (2006). Japanese pitch accent: Examination of final-accented and unaccented minimal pairs. Toronto Working Papers in Linguistics, 26, 7388.Google Scholar
Sugiyama, Y. (2008). The nature of Japanese pitch accent: An experimental study. Unpublished Ph.D. Dissertation. The State University of New York at Buffalo.Google Scholar
Sugiyama, Y. (2014). Perceiving pitch accent in the absence of F0. Proceedings of the annual meetings of the Berkeley Linguistics Society, 482493.Google Scholar
Tamaoka, K., Saito, N., Kiyama, S., Timmer, K., Verdonschot, G., Timmer, K., & Verdonschot, R. (2014). Is pitch accent necessary for comprehension by native Japanese speakers? – An ERP investigation. Journal of Neurolinguistics, 27, 3140.Google Scholar
Tong, Y., Gandour, J., Talavage, T., Wong, D., Dzemidzic, M., Xu, Y., Li, X., & Lowe, M. (2005). Neural circuitry underlying sentence-level linguistic prosody. Neuroimage, 28, 417428.CrossRefGoogle ScholarPubMed
Van Lancker, D. (1980). Cerebral lateralization of pitch cues in the linguistic signal. Papers in Linguistics, 13, 201277.Google Scholar
Van Lancker, D., & Fromkin, V. (1973). Hemispheric specialization for pitch and tone: Evidence from Thai. Journal of Phonetics, 1, 101109.Google Scholar
Walsh, D. L. (1996). Limiting-domains in lexical access: Processing of lexical prosody. In Dickey, M. & Tunstall, S. (eds.), University of Massachusetts Occasional Papers in Linguistics 19: Linguistics in the Laboratory. Amherst: GLSA.Google Scholar
Wang, X., Wang, Y., & Chen, L. (2013). Hemispheric lateralization for early auditory processing of lexical tones: Dependence on pitch level and pitch contour. Neuropsychologia, 51, 22382244.Google Scholar
Wang, Y., Behne, D. M., Jongman, A., & Sereno, J. A. (2004). The role of linguistic experience in the hemispheric processing of lexical tone. Applied Psycholinguistics, 25 (3), 449466.Google Scholar
Wang, Y., Sereno, J. A., & Jongman, A. (2001). Dichotic perception of Mandarin tones by Chinese and American listeners. Brain and Language, 78, 332348.Google Scholar
Wang, Y., Sereno, J. A., Jongman, A., & Hirsch, J. (2003). fMRI evidence for cortical modification during learning of Mandarin lexical tone. Journal of Cognitive Neuroscience, 15 (7), 10191027.Google Scholar
Weintraub, S., Mesulam, M.-M., & Kramer, L. (1981). Disturbances in prosody: A right-hemisphere contribution to language. Archives of Neurology, 38, 742745.CrossRefGoogle ScholarPubMed
Westerhausen, R., & Hugdahl, K. (2008). The corpus callosum in dichotic listening studies of hemispheric asymmetry: a review of clinical and experimental evidence. Neuroscience and Biobehavioral Reviews, 32, 10441054.Google Scholar
Wong, P. (2002). Hemispheric specialization of linguistic pitch patterns. Brain Research Bulletin, 59 (2), 8395.Google Scholar
Wong, P., Parsons, L. M., Martinez, M., & Diehl, R. L. (2004). The role of the insular cortex in pitch pattern perception: the effect of linguistic contexts. The Journal of Neuroscience, 24 (41), 91539160.CrossRefGoogle ScholarPubMed
Wong, P., & Perrachione, T. K. (2007). Learning pitch patterns in lexical identification by native English-speaking adults. Applied Psycholinguistics, 28, 565585.Google Scholar
Wong, P., Perrachione, T. K., & Parrish, T. B. (2007a). Neural characteristics of successful and less successful speech and word Learning in adults. Human Brain Mapping, 28, 9951006.Google Scholar
Wong, P., Skoe, E., Russo, N. M., Dees, T., & Kraus, N. (2007b). Musical experience shapes human brainstem encoding of linguistic pitch patterns. Nature Neuroscience, 10, 420422.CrossRefGoogle ScholarPubMed
Wong, P., Warrier, C. M., Penhune, V. B., Roy, A. K., Sadehh, A., Parrish, T. B., & Zatorre, R. J. (2008). Volume of left Heschl's Gyrus and linguistic pitch learning. Cerebral Cortex, 18, 828836.Google Scholar
Wu, X. (2013). A Cross-Language Investigation of Phonetic and Phonological Processing of Lexical Tone. Ph.D. dissertation, Simon Fraser University.Google Scholar
Wu, X., Munro, J. M., & Wang, Y. (2014). Tone assimilation by Mandarin and Thai listeners with and without L2 experience. Journal of Phonetics, 46, 86100.Google Scholar
Wu, X., Tu, J. Y., & Wang, Y. (2012). Native and nonnative processing of Japanese pitch accent. Applied Psycholinguistics, 33, 623641.Google Scholar
Xu, Y., Gandour, J., Talavage, T., Wong, D., Dzemidzic, M., Tong, Y., Li, X., & Lowe, M. (2006). Activation of the left planum temporale in pitch processing is shaped by language experience. Human Brain Mapping, 27, 2, 173183.Google Scholar
Zatorre, R. J., & Gandour, J. (2008). Neural specializations for speech and pitch: Moving beyond the dichotomies. Philosophical Transactions of the Royal Society, 363, 10871104.Google Scholar
Zatorre, R. J., & Belin, P. (2001) Spectral and temporal processing in human auditory cortex. Cerebral Cortex, 11, 946953.Google Scholar
Zhang, L., Shu, H., Zhou, F., Wang, X., & Li, P. (2010). Common and distinct neural substrates for the perception of speech rhythm and intonation. Human Brain Mapping, 7, 11061116.Google Scholar
Zhao, J., Shu, H., Zhang, L., Wang, X., Gong, Q., & Li, P. (2008). Cortical competition during language discrimination. NeuroImage, 43 (3), 624633.Google Scholar