Hostname: page-component-78c5997874-ndw9j Total loading time: 0 Render date: 2024-11-17T14:31:24.172Z Has data issue: false hasContentIssue false
  • English
  • Français

ASSESSING SECOND-LANGUAGE ORAL PROFICIENCY FOR RESEARCH

The Spanish Elicited Imitation Task

Published online by Cambridge University Press:  19 January 2016

Harriet Wood Bowden
Harriet Wood Bowden*
Affiliation:
University of Tennessee–Knoxville
Get access Rights & Permissions [Opens in a new window]

Abstract

Proficiency is a key variable in late second language (L2) learning, but one that is undermeasured in current research. This study investigates whether L2 oral proficiency can be quickly and reliably assessed via the Spanish “elicited imitation task” (EIT; Ortega, Iwashita, Rabie, & Norris, 1999). Thirty-seven L2 learners of Spanish with varied L2 experience (from low to very advanced) were tested. The EIT’s external validity was assessed via correlation with the simulated oral proficiency interview. Further analyses examined the EIT’s internal reliability, discriminatory power, and usefulness in identifying subgroups (clusters) of learners within the sample. Results strongly support the utility of the Spanish EIT for measurement of oral proficiency in SLA research. Moreover, the availability of parallel EITs in other languages promises to facilitate comparisons across studies. Thus, more precise measurement and analysis of proficiency in SLA research is called for via standardized measurements including the EIT.

Type
Articles
Information
Studies in Second Language Acquisition , Volume 38 , Issue 4 , December 2016 , pp. 647 - 675
Check for updates
Copyright
Copyright © Cambridge University Press 2016 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

REFERENCES

Abutalebi, J. (2008). Neural aspects of second language representation and language control. Acta Psychologica, 128, 466–478.Google Scholar
Abutalebi, J., Cappa, S. F., & Perani, D. (2001). The bilingual brain as revealed by functional neuroimaging. Bilingualism: Language and Cognition, 4, 179–190.Google Scholar
Ackerman, T. A., Gierl, M. J., & Walker, C. M. (2003). Using multidimensional item response theory to evaluate educational and psychological tests. Educational Measurement: Issues and Practice, 22(3), 37–53.CrossRefGoogle Scholar
Bley-Vroman, R., & Chaudron, C. (1994). Elicited imitation as a measure of second-language competence. In Tarone, E. E., Gass, S., & Cohen, A. D. (Eds.), Research methodology in second-language acquisition (pp. 245–261). Hillsdale, NJ: Lawrence Erlbaum.Google Scholar
Bowles, M. A. (2011). Measuring implicit and explicit knowledge: What can heritage learners contribute? Studies in Second Language Acquisition, 33, 247–271.CrossRefGoogle Scholar
Brown, J. D. (1997). Statistics Corner. Questions and answers about language testing statistics (skewness and kurtosis). Shiken: JALT Testing and Evaluation SIG Newsletter , 1(1), 20–23.Google Scholar
Brown, J. D. (2000). Statistics Corner. Questions and answers about language testing statistics (how can we calculate item statistics for weighted items?). Shiken: JALT Testing and Evaluation SIG Newsletter, 3(2), 19–21.Google Scholar
Brown, J. D. (2003). Norm-referenced item analysis (item facilitation and item discrimination). Shiken: JALT Testing and Evaluation SIG Newsletter, 7, 16–19.Google Scholar
Calinski, T., & Harabasz, J. (1974). A dendrite method for cluster analysis. Communications in Statistics, 3, 1–27.Google Scholar
Carrell, P. (1991). Second language reading: Reading ability or language proficiency? Applied Linguistics, 12(2), 159–179.CrossRefGoogle Scholar
Chaudron, C., & Russell, G. (1990). The validity of elicited imitation as a measure of second language competence. Unpublished manuscript. Manoa, HI: University of Hawai’i.Google Scholar
Ellis, R. (2005). Measuring implicit and explicit knowledge of a second language: A psychometric study. Studies in Second Language Acquisition, 27, 141–172.Google Scholar
Grigg, T. (1986). The effects of task, time, and rule knowledge on grammar performance for three English structures. University of Hawai’i Working Papers in ESL, 5, 37–60.Google Scholar
Henning, G. (1992). The ACTFL oral proficiency interview: Validity evidence. System, 20(3), 365–372.Google Scholar
Hulstijn, J. H. (2011). Language proficiency in native and nonnative speakers: An agenda for research and suggestions for second-language assessment. Language Assessment Quarterly, 8, 229–249.Google Scholar
Hulstijn, J. H. (2012). The construct of language proficiency in the study of bilingualism from a cognitive perspective. Bilingualism: Language and Cognition, 15(2), 422–433.Google Scholar
Indefrey, P. (2006). A meta-analysis of hemodynamic studies on first and second language processing: Which suggested differences can we trust and what do they mean? Language Learning, 56, 279–304. doi:10.1111/j.1467-9922.2006.00365.x CrossRefGoogle Scholar
Kane, M. T. (2006). Validation. In Brennan, R. (Ed.), Educational measurement (4th ed., pp. 17–64). Westport, CT: American Council on Education and Praeger.Google Scholar
Kormos, J. (2000). The role of attention in monitoring second language speech production. Language Learning, 50, 343–384.Google Scholar
Kotz, S. A. (2009). A critical review of ERP and fMRI evidence on L2 syntactic processing. Brain and Language, 109, 68–74.CrossRefGoogle ScholarPubMed
Malone, M. E. (2000). The simulated oral proficiency interview: Recent developments. In ERIC, ERIC Digest. Washington, DC: ERIC Clearinghouse on Languages and Linguistics. Retrieved from http://files.eric.ed.gov/fulltext/ED447729.pdf.Google Scholar
McDade, H. L., Simpson, M. S., & Lamb, D. E. (1982). The use of elicited imitation as a measure of expressive grammar. Journal of Speech and Hearing Disorders, 47, 19–24.Google Scholar
Mozgalina, A. (2015). Applying an argument-based approach for validating language proficiency assessments in second language acquisition research: The elicited imitation test for Russian (Unpublished doctoral dissertation). Washington, DC: Georgetown University.Google Scholar
Naiman, N. (1974). The use of elicited imitation in second language acquisition research. Working Papers on Bilingualism, 2, 1–37 . Google Scholar
Norris, J. M., & Ortega, L. (2012). Assessing learner knowledge. In Gass, S. M. & Mackey, A. (Eds.), The Routledge handbook of second language acquisition (pp. 573–589). New York: Routledge.Google Scholar
Ortega, L. (2000). Understanding syntactic complexity: The measurement of change in the syntax of instructed L2 Spanish learners (Unpublished doctoral dissertation). University of Hawai’i at Manoa.Google Scholar
Ortega, L., Iwashita, N., Norris, J., & Rabie, S. (2002, October). An investigation of elicited imitation tasks in crosslinguistic SLA research. Paper presented at the Second Language Research Forum Conference, Toronto.Google Scholar
Ortega, L., Iwashita, N., Rabie, S., & Norris, J. M. (1999). A multilanguage comparison of measures of syntactic complexity [Funded project]. Honolulu: University of Hawai’i, National Foreign Language Resource Center.Google Scholar
Savignon, S. J. (1982). Dictation as a measure of communicative competence in French as a second language. Language Learning, 32(1), 33–51.Google Scholar
Slobin, D. I., & Welsh, C. A. (1973). Elicited imitation as a research tool in developmental psycholinguistics. In Ferguson, C. & Slobin, D. I. (Eds.), Studies of child language development (pp. 485–497). New York: Holt, Rinehart & Winston. (Reprinted from Working Paper No 10, Language Behavior Research Laboratory, pp. 485–497, 1968, University of California, Berkeley.) Google Scholar
Stansfield, C. W., & Kenyon, D. M. (1992a). The development and validation of a simulated oral proficiency interview. Modern Language Journal, 76(2), 129–141.Google Scholar
Stansfield, C. W., & Kenyon, D. M. (1992b). Research on the comparability of the oral proficiency interview and the simulated oral proficiency interview. System, 20(3), 347–364.Google Scholar
Steinhauer, K., White, E. J., & Drury, J. E. (2009). Temporal dynamics of late second language acquisition: Evidence from event-related brain potentials. Second Language Research, 25(1), 13–41.Google Scholar
Thissen, D., & Steinberg, L. (2009). Item response theory. In Millsap, R. E. & Maydeu-Olivares, A. (Eds.), The Sage handbook of quantitative methods in psychology (pp. 148–177). Thousand Oaks, CA: Sage.Google Scholar
Thomas, M. (1994). Assessment of L2 proficiency in second language acquisition research. Language Learning, 44, 307–336.CrossRefGoogle Scholar
Thomas, M. (2006). Research synthesis and historiography: The case of assessment of second language proficiency. In Norris, J. & Ortega, L. (Eds.), Synthesizing research on language learning and teaching (pp. 279–298). Amsterdam: John Benjamins.Google Scholar
Tracy-Ventura, N., McManus, K., Norris, J., & Ortega, L. (2014). “Repeat as much as you can”: Elicited imitation as a measure of oral proficiency in L2 French. In Leclercq, P., Edmonds, A., & Hilton, H. (Eds.), Measuring L2 proficiency: Perspectives from SLA (pp. 143–166). Bristol: Multilingual Matters.Google Scholar
Tremblay, A. (2011). Proficiency assessment standards in second language acquisition research: “Clozing” the gap. Studies in Second Language Acquisition, 33, 339–372.Google Scholar
Tremblay, A., & Garrison, M. D. (2010). Cloze tests: A tool for proficiency assessment in research on L2 French. In Prior, M. T., Watanabe, Y., & Lee, S.-K. (Eds.), Selected proceedings of the Second Language Research Forum 2008 (pp. 73–88). Somerville, MA: Cascadilla Press.Google Scholar
Vinther, T. (2002). Elicited imitation: A brief review. International Journal of Applied Linguistics 12, 54–73.Google Scholar
Wu, S., & Ortega, L. (2013). Measuring global oral proficiency in SLA research: A new elicited imitation test of L2 Chinese. Foreign Language Annals, 46(4), 680–704.CrossRefGoogle Scholar
Zhou, S. (2011). Learning to express motion events in L2 Chinese: A cognitive linguistic perspective (Unpublished doctoral dissertation). Manoa, HI: University of Hawaii.Google Scholar