Syntactic complexity in a learner written corpus and L2 speaking quality: Suggestions for distinguishing L2 speaking proficiency

Shinjae Park

Abstract


Based on the quantitative analysis of L2 English texts from Korean undergraduates, the present paper demonstrates the possibility of distinguishing L2 speaking proficiency with differing measures of syntactic complexity in English writing. To this end, 14 measures of complexity were gauged using an L2 Syntactic Analyzer (Lu, 2010) in 89 EFL essays from a learner corpus to find out the best indicators of L2 speaking proficiency. As a result of the normality assumption test, the logistic regression analysis was applied and the model was significant in classification according to L2 proficiency and the classification was correct in 62.9% of the studied cases. Furthermore, it showed that the best predictor of L2 speaking proficiency was the complex nominal per T-unit (CNT). Specifically, upon the acquisition of CNT, EFL learners are 6.4 times more likely to achieve higher proficiency in speaking English. Taken together, this paper suggests that EFL students’ quality of writing can be effectively used to distinguish their speaking ability.

Keywords


learner written corpus; syntactic complexity; EFL; logistic regression; assessment

Full Text:

PDF

References


Ahmadian, M. J. (2012). The effects of careful guided online planning on complexity, accuracy and fluency in intermediate EFL learners’ oral production: The case of English articles. Language Teaching Research, 16(1), 129-149.

Ai, H., & Lu, X. (2013). A corpus-based comparison of syntactic complexity in NNS and NS university students’ writing. Automatic treatment and analysis of learner corpus data, 249-264.

Biber, D., Gray, B., & Poonpon, K. (2011). Should we use characteristics of conversation to measure grammatical complexity in L2 writing development?. TESOL Quarterly, 45(1), 5-35.

Biber, D., Gray, B., & Staples, S. (2016). Predicting patterns of grammatical complexity across language exam task types and proficiency levels. Applied Linguistics, 37(5), 639-668.

Bulté, B., & Housen, A. (2014). Conceptualizing and measuring short-term changes in L2 writing complexity. Journal of second language writing, 26, 42-65.

Casal, J. E., & Lee, J. J. (2019). Syntactic complexity and writing quality in assessed first-year L2 writing. Journal of Second Language Writing, 44, 51-62.

Cleland, A. A., & Pickering, M. J. (2006). Do writing and speaking employ the same syntactic representations?. Journal of Memory and Language, 54(2), 185-198.

Crossley, S. A., & McNamara, D. S. (2012). Predicting second language writing proficiency: The roles of cohesion and linguistic sophistication. Journal of Research in Reading, 35(2), 115-135.

Crossley, S., & McNamara, D. (2013). Applications of text analysis tools for spoken response grading. Language Learning & Technology, 17(2), 171-192.

Espada-Gustilo, L. (2011). Linguistic features that impact essay scores: A corpus linguistic analysis of ESL writing in three proficiency levels. 3L: Language, Linguistics, Literature, 17(1), 55-64.

Ferris, D. R. (1994). Lexical and syntactic features of ESL writing by students at different levels of L2 proficiency. TESOL Quarterly, 28(2), 414-420.

Flahive, D. E., & Snow, B. G. (1980). Measures of syntactic complexity in evaluating ESL compositions. Research in language testing, 171-176.

Gong, J., & Sun, S. (2009, June). A new approach of stock price prediction based on logistic regression model. In 2009 International Conference on New Trends in Information and Service Science (pp. 1366-1371). IEEE.

Halliday, A. K., & Webster, J. J. (2006). Language of Science (Vol. Volume 5). London: Bloomsbury Academic.

Homburg, T. J. (1984). Holistic evaluation of ESL compositions: Can it be validated objectively?. TESOL quarterly, 18(1), 87-107.

Hunt, K. W. (1966). Recent measures in syntactic development. Elementary English, 43(7), 732-739.

Hwang, H., Jung, H., & Kim, H. (2020). Effects of Written Versus Spoken Production Modalities on Syntactic Complexity Measures in Beginning‐Level Child EFL Learners. The Modern Language Journal, 104(1), 267-283.

Khushik, G. A., & Huhta, A. (2020). Investigating Syntactic Complexity in EFL Learners' Writing across Common European Framework of Reference Levels A1, A2, and B1. Applied Linguistics, 41(4), 506-532.

Kim, J. Y. (2014). Predicting L2 Writing Proficiency Using Linguistic Complexity Measures: A Corpus-Based Study. English Teaching, 69(4), 27-51.

Kormos, J. (2014). Differences across modalities of performance. In H. Byrnes and R. M. Manchón (Eds), Task-based language learning: Insights from and for L2 writing (pp. 193-216). Amsterdam: John Benjamins.

Kuiken, F., Vedder, I., & Gilabert, R. (2010). Communicative adequacy and linguistic complexity in L2 writing. Communicative proficiency and linguistic development: Intersections between SLA and language testing research, 1, 81-100.

Kyle, K., & Crossley, S. A. (2018). Measuring syntactic complexity in L2 writing using fine‐grained clausal and phrasal indices. The Modern Language Journal, 102(2), 333-349.

Lan, G., & Sun, Y. (2019). A corpus-based investigation of noun phrase complexity in the L2 writings of a first-year composition course. Journal of English for Academic Purposes, 38, 14-24.

Lu, X. (2010). Automatic analysis of syntactic complexity in second language writing. International journal of corpus linguistics, 15(4), 474-496.

Lu, X. (2011). A corpus‐based evaluation of syntactic complexity measures as indices of college‐level ESL writers’ language development. TESOL Quarterly, 45, 36-62.

Lu, X., & Ai, H. (2015). Syntactic complexity in college-level English writing: Differences among writers with diverse L1 backgrounds. Journal of Second Language Writing, 29, 16-27.

Martínez, A. C. L. (2018). Analysis of syntactic complexity in secondary education EFL writers at different proficiency levels. Assessing Writing, 35, 1-11.

McNamara, D. S., Crossley, S. A., & McCarthy, P. M. (2010). Linguistic features of writing quality. Written Communication, 27, 57-86.

Ortega, L. (2003). Syntactic complexity measures and their relationship to L2 proficiency: A research synthesis of college‐level L2 writing. Applied Linguistics, 24, 492-518.

Ortega, L. (2015). Syntactic complexity in L2 writing: Progress and expansion. Journal of Second Language Writing, 29, 82-94.

Park, S. (2020a). A Corpus Study of Modal Verbs in Korean Learners' Speech. Journal of Linguistic Studies, 25(2), 121-137.

Park, S. (2020b). Determining L2 Proficiency in the Production and Perception of Consonant Clusters. 3L: Language, Linguistics, Literature®, 26(3), 41-52.

Park, S. & Yoon, S. (2021). Syntactic Complexity of EFL Learners’ Casual Conversation, Monologue, and Writing. The Journal of Studies in Language, 37, 75-89

Rajadurai, J. (2007). Capturing L2 Spoken English: Methodological Challenges. Linguistics Journal, 2(3), 41-58.

Rimmer, W. (2006). Measuring grammatical complexity: The Gordian knot. Language Testing, 23, 497-519.

Sio, J. & Ismail, R. (2019). Binary logistic regression analysis of instructional leadership factors affecting English language literacy in primary schools. 3L: Language, Linguistics, Literature®, 25(2), 25-37.

Szmrecsanyi, B., & Kortmann, B. (2012). Introduction: Linguistic complexity. In Linguistic Complexity (pp. 6-34). de Gruyter.

Taguchi, N., Crawford, W., & Wetzel, D. Z. (2013). What linguistic features are indicative of writing quality? A case of argumentative essays in a college composition program. TESOL Quarterly, 47, 420-430.

Wolfe-Quintero, K., Inagaki, S., & Kim, H. Y. (1998). Second Language Development in Writing: Measures of Fluency, Accuracy, and Complexity (No. 17). University of Hawaii Press, Hawaii.

Wu, S. & Ortega, L. (2013). Measuring global oral proficiency in SLA research: A new elicited imitation test of L2 Chinese. Foreign Language Annals, 46, 680-704.

Yang, W., Lu, X., & Weigle, S. C. (2015). Different topics, different discourse: Relationships among writing topic, measures of syntactic complexity, and judgments of writing quality. Journal of Second Language Writing, 28, 53-67.


Refbacks

  • There are currently no refbacks.


Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

Journal of Language and Linguistic Studies
ISSN 1305-578X (Online)
Copyright © 2005-2022 by Journal of Language and Linguistic Studies