COLL-IT: UNO STRUMENTO DI VALUTAZIONE DELLA COMPETENZA COLLOCAZIONALE. REALIZZAZIONE E SOMMINISTRAZIONE DI UN TEST SULLE COLLOCAZIONI VERBO-NOME PER APPRENDENTI DI ITALIANO L2/LS
DOI:
https://doi.org/10.54103/2037-3597/27759Abstract
Questo contributo presenta uno studio preliminare su COLL-IT, un test di valutazione della competenza collocazionale in italiano L2/LS basato su un sillabo di riferimento delle collocazioni verbo-nome per i livelli B1, B2 e C del QCER. COLL-IT è un test di completamento a scelta multipla volto a valutare la capacità degli apprendenti di abbinare ad una determinata base il collocato appropriato ed è stato somministrato a 103 apprendenti ispanofoni. Le analisi statistiche rivelano risultati incoraggianti in termini di affidabilità del punteggio e forniscono prove preliminari a sostegno della validità del costrutto. Nonostante una serie di limitazioni che potranno essere superate mediante future somministrazioni, COLL-IT rappresenta un contributo innovativo alla ricerca sulla competenza collocazionale in italiano L2/LS.
COLL-IT: an instrument for assessing collocational competence. Realisation and administration of a test on verb-name collocations for learners of Italian L2/LS
This contribution presents a preliminary study on COLL-IT, a collocational competence test for learners of Italian L2/LS. The test assesses learners’ ability to match appropriate verb-noun pairs and is based on a reference syllabus of collocations at B1, B2, and C CEFR levels. It was administered to 103 Spanish speaking learners of Italian. Statistical analyses reveal encouraging outcomes in terms of score reliability and provide preliminary evidence supporting construct validity. Despite a number of limitations that may be overcome in future administrations, COLL-IT makes an innovative contribution to collocational competence testing in Italian L2/LS research.
Downloads
Riferimenti bibliografici
Allen M. J., Yen W. M. (2002), Introduction to Measurement Theory, Waveland Press, Prospect Heights, Long Grove (IL-US).
ALTE Members (1998), Multilingual Glossary of Language Testing Terms, Cambridge University Press Cambridge, Cambridge.
Bachman L. F. (1990), Fundamental Considerations in Language Testing, Oxford University Press, Oxford.
Bachman L. F. (2004), Statistical Analyses for Language Assessment, University of California, Los Angeles: https://doi.org/10.1017/cbo9780511667350. DOI: https://doi.org/10.1017/CBO9780511667350
Bachman L. F., Palmer A. S. (2010), Language assessment in practice, Oxford University Press, Oxford.
Bardel C., Lindqvist C., Laufer B. (eds.) (2013), L2 Vocabulary Acquisition, Knowledge and Use. New Perspectives on Assessment and Corpus Analysis, Eurosla Monograph Series 2: http://www.eurosla.org/monographs/EM02/TOC.pdf.
Barni M. (2023), Valutare le competenze nelle L2. Teorie, metodi, strumenti, politiche linguistiche, Carocci, Roma.
Berišić Antić D. (2015), “Le Collocazioni italiane nell’insegnamento dell’italiano come L2”, in Strani jezici, 44, 4, pp. 260-278.
Bestgen Y., Granger S. (2014), “Quantifying the development of phraseological competence in L2 English writing: An automated approach”, in Journal of Second Language Writing, 26, pp. 28-41: https://doi.org/10.1016/j.jslw.2014.09.004. DOI: https://doi.org/10.1016/j.jslw.2014.09.004
Bini M., Pernas A., Pernas P. (2007), “Apprendimento e insegnamento collocazioni dell’italiano. Con i NUNC più facile”, in Barbera M., Corino E., Onesti C. (a cura di), Corpora e linguistica in rete, Guerra Edizioni, Perugia, pp. 323-333.
Biskup D. (1992), “L1 influence on learners’renderings of English collocations. A Polish/German empirical study”, in Arnaud P. J. L., Béjoint H. (eds.), Vocabulary and Applied Linguistics, Macmillan, London, pp. 85-93: https://doi.org/10.1007/978-1-349-12396-4_8. DOI: https://doi.org/10.1007/978-1-349-12396-4_8
Canty A., Ripley B. D. (2022), boot: Bootstrap R (S-Plus) Functions, R package version 1.328.1.
Chapelle C. A. (2012), “Validity argument for language assessment: The framework is simple…”, in Language Testing, 29, 1, pp. 19-27.
https://doi.org/10.1177/0265532211417211. DOI: https://doi.org/10.1177/0265532211417211
Chapelle C. A. (2021), Argument based validation in testing and assessment, Sage Publishing, Thousand Oaks (CA-US). DOI: https://doi.org/10.4135/9781071878811
Consiglio d’Europa (2002), Quadro comune europeo di riferimento per le lingue: apprendimento, insegnamento, valutazione, La Nuova Italia-Oxford, Firenze.
Cronbach L. (1951), “Coefficient alpha and the internal structure of tests”, in Psychometrika, 16, pp. 292-334:https://doi.org/10.1007/BF02310555. DOI: https://doi.org/10.1007/BF02310555
Daller H., Milton J., Treffers-Daller J. (eds.) (2007), Modelling and Assessing Vocabulary Knowledge, Cambridge University Press, Cambridge:
https://doi.org/10.1017/cbo9780511667268. DOI: https://doi.org/10.1017/CBO9780511667268
DeVellis R. F., Thorpe C. T. (20225), Scale development: Theory and applications, SAGE publications, Thousand Oaks (CA-US).
DeVellis R. F. (1991), Scale Development, Sage Publications, Newbury Park (NJ-US).
Dinno A. (2017). dunn.test: Dunn's Test of Multiple Comparisons Using Rank Sums, R package version 1.3.5.
Dóczi B., Kormos J. (2016), Longitudinal Development in Vocabulary Knowledge and Lexical Organization, Oxford University Press, Oxford: https://doi.org/10.1111/ijal.12179. DOI: https://doi.org/10.1093/acprof:oso/9780190210274.001.0001
Dunn T. J., Baguley T., Brunsden V. (2014), “From alpha to omega: A practical solution to the pervasive problem of internal consistency estimation”, in British Journal of Psychology, 105, pp. 399-412: https://doi.org/10.1111/bjop.12046. DOI: https://doi.org/10.1111/bjop.12046
Ebel R.L. (1979), Essentials of Educational Measurement, Prentice Hall, New Jersey.
Faerch C., Haastrup K., Phillipson R. (1984), Learner Language and Language Learning, Multilingual Matters, Clevedon (UK).
Farghal M., Obiedat H. (1995), “Collocations: A neglected variable in EFL”, in International Journal of Applied Linguistics, 28, 4, pp. 313-331:
https://doi.org/10.1515/iral.1995.33.4.315. DOI: https://doi.org/10.1515/iral.1995.33.4.315
Fox J., Weisberg S. (20193), An R Companion to Applied Regression, Sage Publishing, Thousand Oaks (CA-US).
Gallina F. (2018), “Studenti internazionali in mobilità: la questione del lessico della conoscenza in italiano L2”, in Coonan C. M., Bier A, Ballarin E. (a cura di), La didattica delle lingue nel nuovo millennio Le sfide dell’internazionalizzazione, pp. 323-339: https://doi.org/10.14277/6969-227-7/SR-13-20. DOI: https://doi.org/10.30687/978-88-6969-227-7/020
Gallina F. (2022), Osservare e valutare la competenza lessicale in italiano L2, Pacini Editore, Pisa.
Gitsaki C. (1999), Second Language Lexical Acquisition: A Study of the development of collocational knowledge, International Scholars Publications, San Francisco.
Green R. (2013), Statistical analyses for language testers, Palgrave Macmillan, Basingstoke (UK): https://doi.org/10.1057/9781137018298. DOI: https://doi.org/10.1057/9781137018298
Gyllstad H. (2005), “Words that go together well: Developing test formats for measuring learner knowledge of English collocations”, in Heinat F., Klingval E. (eds.), The Department of English in Lund: Working papers in linguistics, Lund University, Lund, pp. 1-31.
Gyllstad H. (2007), Testing English collocations: Developing receptive tests for use with advanced Swedish learners [tesi di dottorato], Lund University, Lund.
Gyllstad H. (2009), “Designing and evaluating tests of receptive collocation knowledge: COLLEX and COLLOMATCH”, in Barfield A., Gyllstad H. (eds.), Researching collocations in another language, Palgrave Macmillan, Basingstoke (UK), pp. 153-170: https://doi.org/10.1057/9780230245327_12. DOI: https://doi.org/10.1057/9780230245327_12
Hargreaves P. (2000), “How important is collocation in testing the learner’s language proficiency?”, in Lewis M. (ed.), Teaching Collocation: Further Developments in the Lexical Approach, Language Teaching Publications, Hove (UK), pp. 205-223.
Hasselgren A. (1994), “Lexical teddy bears and advanced learners: A study into the ways Norwegian students cope with English vocabulary”, in International Journal of Applied Linguistics, 4, pp. 237-258: https://doi.org/10.1111/j.1473-4192.1994.tb00065.x. DOI: https://doi.org/10.1111/j.1473-4192.1994.tb00065.x
Henning G. (1987), A guide to language testing: development, evaluation, and research, Newbury House, New York.
Henriksen B. (2013), “Research on L2 learners’ collocational competence and development – A progress report”, in Bardel C., Lindqvist C., Laufer B. (eds.), L2 vocabulary acquisition, knowledge and use: New perspectives on assessment and corpus analysis, EuroSLA Monographs Series, Amsterdam, pp. 29-56.
Jezek E. (2005), Lessico. Classi di parole, strutture, combinazioni, il Mulino, Bologna.
Kane M. (2012), “Validating score interpretations and uses”, in Language Testing, 29, 1, pp. DOI: https://doi.org/10.1177/0265532211417210
-17: https://doi.org/10.1027/1614-2241/a000036.
Kelley K., Cheng Y. (2012), “Estimation of and confidence interval formation for reliability coefficients of homogeneous measurement instruments”, in Methodology: European Journal of Research Methods for the Behavioral and Social Sciences, 8, 2, pp. 39-50:
https://doi.org/10.1027/1614-2241/a000036. DOI: https://doi.org/10.1027/1614-2241/a000036
Kilgarriff A., Husák M., McAdam K., Rundell M., Rychlý P. (2008), “GDEX: Automatically finding good dictionary examples in a corpus”, in Proceedings of the XIII EURALEX international congress, Vol. 1, Universitat Pompeu Fabra, Barcelona, pp. 425-432.
La Russa F., D’Alessio V., Suadoni A. (2023), “Designing a Corpus-Based Syllabus of Italian Collocations: Criteria, Methods and Procedures”, in Revue roumaine de linguistique, pp. 377-389: https://doi.org/10.54103/2037-3597/20398. DOI: https://doi.org/10.59277/RRL.2023.4.03
Laufer B., Waldman T. (2011), “Verb-Noun Collocations in Second Language Writing: A Corpus Analysis of Learners’ English”, in Language Learning, 61, 2, pp. 647-672: https://doi.org/10.1111/j.1467-9922.2010.00621.x. DOI: https://doi.org/10.1111/j.1467-9922.2010.00621.x
Lawrence M. (2016). ez: Easy Analysis and Visualization of Factorial Experiments, R package version 4.4-0.
Lewis M. (1993), The lexical approach, Language Teaching Publications, Hove (UK).
Lewis M. (ed.)(2000), Teaching collocation: Further developments in the lexical approach, Language Teaching Publications.
McNamara T. (2000), Language Testing, Oxford University Press, Oxford.
Meara P., Miralpeix I. (2017), Tools for Researching Vocabulary, Multilingual Matters, Bristol: https://doi.org/10.21832/9781783096473. DOI: https://doi.org/10.21832/9781783096473
Mel’Cuk I. A., Wanner L. (1994), “Lexical co-occurrence and lexical inheritance. Emotion lexemes in German: A lexicographic case study”, in Lexikos, 4, 4, pp. 86-161. DOI: https://doi.org/10.5788/4-1-1077
Messick S. (1989), “Validity”, in Linn R. L. (ed.) Educational measurement, American Council on education and Macmillan, New York, pp. 13-104.
Milton J. (2009), Measuring Second Language Vocabulary Acquisition, Multilingual Matters, Bristol: https://doi.org/10.21832/9781847692092. DOI: https://doi.org/10.21832/9781847692092
Nation P., Webb S. (2011), Researching and Analysing Vocabular, Heinle, Cengage Learning, Boston.
Nattinger J., DeCarrico J. (1992), Lexical Phrases and Language Teaching, Oxford University Press, Oxford.
Nesselhauf N. (2005). Collocations in a learner corpus, John Benjamins, Amsterdam. DOI: https://doi.org/10.1075/scl.14
Omidian T., Siyanova-Chanturia A., Spina S. (2021), “Development of formulaic knowledge in learner writing: A longitudinal perspective”, in Granger S. (ed.). Perspectives on the Second Language Phrasicon: The View from Learner Corpora, Multilingual Matters, Bristol, pp. 178-206: https://doi.org/10.21832/9781788924863-009. DOI: https://doi.org/10.2307/jj.22730562.11
Pallone S. (2023), Apprendimento di costruzioni a verbo supporto dell’italiano da parte di studenti lusofoni: un confronto tra contesto di immersione e di lingua straniera. Tesi di laurea magistrale sostenuta presso l’Università degli Studi Roma Tre.
Pérez Serrano M. (2017), “Evaluación de la competencia colocacional: Una revisión bibliográfica”, in Boletín de ASELE, 57, pp. 69-78.
Popham W. J. (20003), Modern Educational Measurement, Allyn & Bacon, Boston.
Read J. (2000), Assessing Vocabulary, Cambridge University Press, Cambridge:
https://doi.org/10.1017/CBO9780511732942. DOI: https://doi.org/10.1017/CBO9780511732942
Revelle W. (2017), Psych: Procedures for psychological, psychometric, and personality research:
https://cran.r-project.org/package=psych (R package version 1.8.12),
Revier R. (2009), “Evaluating a New Test on Whole English Collocations”, in Barfield A., Gyllstad H. (eds.), Researching collocations in another language, Palgrave Macmillan, Basingstoke (UK), pp. 125-138: https://doi.org/10.1057/9780230245327_10. DOI: https://doi.org/10.1057/9780230245327_10
RStudio Team (2021), RStudio: Integrated Development Environment for R., RStudio, PBC, Boston: http://www.rstudio.com/.
Schmitt N. (2010), Researching Vocabulary. A Vocabulary Research Manual, Palgrave Macmillan, Basingstoke (UK): https://doi.org/10.1057/9780230293977. DOI: https://doi.org/10.1057/9780230293977
Sijtsma K. (2009), “On the use, the misuse, and the very limited usefulness of Cronbach’s alpha”, in Psychometrika, 74, pp. 107-120: https://doi.org/10.1007/s11336-0089101-0. DOI: https://doi.org/10.1007/s11336-008-9101-0
Simone R. (1996), Fondamenti di linguistica, Laterza, Roma-Bari.
Sinclair J. (1991), Corpus, concordance, collocation, Oxford University Press, Oxford.
Siyanova-Chanturia A. (2015), “Collocation in beginner learner writing: A longitudinal study”, in System, 53, pp. 148-160: https://doi.org/10.1016/j.system.2015.07.003. DOI: https://doi.org/10.1016/j.system.2015.07.003
Siyanova-Chanturia A., Spina S. (2020), “Multi-word expressions in second language writing: A large-scale longitudinal learner corpus study”, in Language learning, 70, 2, pp. 420-463: https://doi.org/10.1111/lang.12383. DOI: https://doi.org/10.1111/lang.12383
Spina S. (2014), “Il Perugia Corpus: una risorsa di riferimento per l’italiano: composizione, annotazione e valutazione”, in Basili R., Lenci A., Magnini B. (a cura di), Proceedings of the First Italian Conference on Computational Linguistics CLiC-it 2014, Pisa University Press, Pisa, pp. 354-359: https://doi.org/10.12871/clicit2014168. DOI: https://doi.org/10.12871/clicit2014168
Spina S. (2016), “Learner corpus research and phraseology in Italian as a second language: The case of the DICI-A, a learner dictionary of Italian collocations”, in Sanromán Vilas B. (ed.), Collocations Cross-Linguistically. Corpora, Dictionaries and Language Teaching, Mémoires de la Société Néophilologique de Helsink, Uusfilologinen yhdistys ry, Helsinki, pp. 219-244.
Spina S. (2018), “Lo sviluppo longitudinale della fraseologia in apprendenti cinesi di italiano L2. Uno studio preliminare su alcune categorie di errori”, in Ricognizioni. Rivista di lingue, letterature e culture moderne, 10, 5, pp. 97-119.
Spina S. (2019), “The development of phraseological errors in Chinese learner Italian: A longitudinal study”, in Abel A., Glaznieks A., Lyding V., Nicolas L. (eds.), Widening the scope of learner corpus research. Selected papers from the fourth Learner Corpus Research Conference, Presses Universitaires de Louvain, Louvain, pp. 95-119.
Spina S. (2022), “The effect of time and dimensions of collocational relationship on phraseological accuracy: a study on Chinese learners of Italian”, in LeńkoSzymańska A., Götz S. (eds.), Complexity, Accuracy & Fluency in Learner Corpus Research, John Benjamins, Amsterdam, pp. 181-207: https://doi.org/10.1075/scl.104.08spi. DOI: https://doi.org/10.1075/scl.104.08spi
Spina S., Fioravanti I., Forti L., Santucci V., Serra A., Zanda F. (2022), “Il corpus CELI: una nuova risorsa per studiare l’acquisizione dell’italiano L2”, in Italiano LinguaDue, 14, 1, pp. 116-138: https://doi.org/10.54103/2037-3597/18161. DOI: https://doi.org/10.54103/2037-3597/18161
Spinelli B., Parizzi F. (2010), Profilo della lingua italiana. Livelli di riferimento del QCER A1, A2, B1, B2, La Nuova Italia, Firenze.
Suadoni A. (2020), “Acquisition of Italian multi-word verbs and collocations by Spanishspeaking learners”, in Rivista di psicolinguistica applicata, 20, 2, pp. 101-120: https://doi.org/10.19272/202007702007.
Wang Y. (2016), The Idiom Principle and L1 Influence. A contrastive learner-corpus study of delexical verb+noun collocations, John Benjamins, Amsterdam: https://doi.org/10.1075/scl.77. DOI: https://doi.org/10.1075/scl.77
Weir C. J. (2005), Language Testing and Validation: An Evidence-Based Approach, Palgrave Macmillan, Basingstoke (UK): https://doi.org/10.1057/9780230514577. DOI: https://doi.org/10.1057/9780230514577
Willse J. T. (2018), CTT: Classical test theory functions (Computer software manual): https://cran.r-project.org/package=CTT (R package version 2.3.3).
Yoon H. J. (2016), “Association strength of verb-noun combinations in experienced NS and less experienced NNS writing: Longitudinal and cross-sectional findings”, in Journal of Second Language Writing, 34, pp. 42-57: https://doi.org/10.1016/j.jslw.2016.11.001. DOI: https://doi.org/10.1016/j.jslw.2016.11.001
Dowloads
Pubblicato
Come citare
Fascicolo
Sezione
Licenza
Questo lavoro è fornito con la licenza Creative Commons Attribuzione - Condividi allo stesso modo 4.0.
