Assessing the Quality of AI and MT in Legal Translation
DOI:
https://doi.org/10.54103/2035-7680/28886Parole chiave:
AI; chatbots; legal translation; machine translation; AI and lawAbstract
Artificial Intelligence (AI) has made huge strides forward in the last few years and many AI-driven solutions have been developed to cater for the needs of legal professionals. Amongst its various applications, AI can be used to draft and translate documents. This paper wishes to assess the accuracy and reliability of the translation (from Italian into English) of an informative article on mortgage contracts. To do so, an MT-based platform (DeepL) and two generic AI-driven chatbots (i.e., ChatGPT and Copilot) are considered. In addition, the AI-powered Notebook LM is also addressed as it can provide more targeted and field-related feedback. The paper findings highlight that, although the MT- and AI-based interfaces do not produce inconsistencies, grammatical errors, word order issues or oddities of any kind, their outputs are not satisfactory. All the automated translations, in fact, lack references to system-bound terminology and system-specific legal principles. The MT and AI systems, in fact, are not capable of disambiguating terms (especially polysemous words) in context. Therefore, at the time being, MT and AI platforms still have considerable progress to make before being fully reliable and accurate in the legal translation domain.
Downloads
Riferimenti bibliografici
Alcaraz Varó, Enrique, and Brian Hughes. Legal Translation Explained. Routledge, 2014.
Antonazzi, Cirstiano. “Il mutuo di scopo e l’analisi trasversale degli istituti affini.” Annali del Dipartimento Ionico, Estratto, vol. 7, 2019, pp. 15-29.
Bhatia, Vijai K. Textbook on legal language and legal writing. Universal Law Publishing Co., 2010.
Brooks, Chay, et al. “Artificial intelligence in the legal sector: Pressures and challenges of transformation.” Cambridge Journal of Regions, Economy and Society, vol. 13, no. 1, 2020, pp. 135–152.
Brownsword, Roger, and Han Somsen. “Law, innovation and technology: fast forward to 2021.” Law, innovation and technology, vol. 13, no. 1, 2021, pp. 1-28.
Casemine.com (for case CGI Group (Europe) Ltd v Revenue & Customs, 2010), https://www.casemine.com/judgement/uk/5b2898022c94e06b9e19ee2a. Accessed 31 Mar 2025.
Country Compendium. A companion to the English Style Guide. 2023. https://commission.europa.eu/document/download/2d706ca2-0927-4a58-a0f4-ae76aae2d84c_en?filename=styleguide_english_dgt_country_compendium_en.pdf. Accessed 31 Mar 2025.
Emsley, Robin. “ChatGPT: these are not hallucinations - they're fabrications and falsifications.” Schizophrenia, vol. 9, no. 52, 2023, pp. 1-2.
Engberg, Jan. “Legal translation as communication of knowledge: On the creation of bridges.” Parallèles, vol. 33, no. 1, 2021, pp. 6-17.
Escribe, Marie, and Ruslan Mitkov. “Applying incremental learning to post-editing systems: towards online adaptation for automatic post-editing models.” Corpora and Translation Education, Advances and Challenges, edited by Jun Pan, and Sara Laviosa, Springer Nature Singapore, 2023, pp. 35-62.
Ethics Guidelines for Trustworthy AI. 2019. High-Level Expert Group on Artificial Intelligence: https://www.europarl.europa.eu/cmsdata/196377/AI%20HLEG_Ethics%20Guidelines%20for%20Trustworthy%20AI.pdf. Accessed 31 Mar 2025.
European Commission. Communication from the Commission to the European Parliament, the European Council, the Council, the European Economic and Social Committee and the Committee of the Regions on Artificial Intelligence for Europe. 25 Apr. 2018, COM(2018) 237, https://eur-lex.europa.eu/legal-content/EN/TXT/?uri=COM%3A2018%3A237%3AFIN. Accessed 31 Mar 2025.
Floris, Antonella, et al. “Il collegamento negoziale ed il contratto di credito ai consumatori.” Ricerche Giuridiche, vol. 2, no. 1, 2013, pp. 119-164.
Giampieri, Patrizia. Legal Machine Translation Explained: MT in legal contexts. Cambridge Scholars Publishing, 2023.
Investopedia: https://www.investopedia.com/terms/m/mortgage.asp. Accessed 31 Mar 2025.
Jacometti, Valentina, and Barbara Pozzo. Traduttologia e linguaggio giuridico. Wolters Kluwer, 2018.
Kenny, Dorothy. “Machine translation.” The Routledge encyclopedia of translation studies, edited by Mona Baker and Gabriela Saldanha, Routledge, 2019, pp. 305–310.
Mileto, Fiorenza. 2019. “Post-editing and legal translation.” HD, Revista de Humanidades Digitais, vol. 1, no. 1.
Monostori, Lazlo. “Artificial Intelligence.” CIRP Encyclopedia of Production Engineering, edited by Luc Laperrière, and Gunther Reinhart, Springer, 2019, pp. 47-50.
Piraino Leto, Angelo. I contratti atipici e innominati. UTET, 1974.
Ralli, Natascia. “Terminografia e comparazione giuridica: metodo, applicazioni e problematiche chiave.” InTRAlinea Special Issue: Specialized Translation I, 2009. https://www.intralinea.org/specials/article/1727. Accessed 31 Mar 2025.
Rolli, Rita. Causa in astratto e causa in concreto. Cedam, 2008.
Šarčević Susan 1997. New approach to legal translation. The Hague: Kluwer Law International.
Schwarcz, Daniel, and Jonathan H. Choi. “AI Tools for Lawyers: A Practical Guide AI Tools for Lawyers: A Practical Guide.” Minnesota Law Review Headnotes, vol. 1, 2023, pp. 1-39.
Sheeba, Nirmalanathan. “Artificial intelligence's effects on the legal sector: transforming legal practice.” International Journal for Legal Research and Analysis, vol. 2, no. 7, 2023, pp. 4-18.
Simone Legal Dictionary: https://dizionari.simone.it/1/contratto. Accessed 31 Mar 2025.
Susskind, Richard. Online Courts and the Future of Justice. Oxford University Press, 2019.
Sycz-Opoń, Joanna. “Machine Translation. Can it assist in professional translation of contracts?” Comparative Legilinguistics, vol. 20, 2014, pp. 81-99.
Thomson Reuter. Stepping into the future: How generative AI will help lawyers improve legal service delivery., 2023. https://legal.thomsonreuters.com/content/dam/ewp-m/documents/legal/en/pdf/rep
orts/lawyers-harnessing-power-of-ai.pdf. Accessed 31 Mar 2025.
Tiersma, Peter. Legal language. The University of Chicago Press, 1999.
Vigier Moreno, Francisco J., and Lorena Pérez-Macías. “Assessing neural machine translation of court documents: A case study on the translation of a Spanish remand order into English.” Revista de Llengua i Dret, Journal of Language and Law, vol. 78, 2022, pp. 73-91.
Williams, Christopher. The Impact of Plain Language on Legal English in the United Kingdom. Routledge, 2023.
Yamane, Nicole. “Artificial Intelligence in the Legal Field and the Indispensable Human Element Legal Ethics Demands.” The Georgetown Journal of Legal Ethics, vol. 33, 2020, pp. 877-890.
Dowloads
Pubblicato
Come citare
Fascicolo
Sezione
Licenza
Questo lavoro è fornito con la licenza Creative Commons Attribuzione - Condividi allo stesso modo 4.0.
Questa opera è pubblicata sotto 