Comparative analysis of similarity levels between texts generated by ChatGPT-3.5 and human texts through Turnitin Software evaluation
DOI:
https://doi.org/10.15517/eci.v14i2.57267Keywords:
Generative artificial intelligence, information technologies, similarity, documentsAbstract
The research focused on identifying the degree of similarity between documents generated by the generative artificial intelligence ChatGPT-3.5 and those created without its assistance, comparing them with the documents available in the Turnitin software databases. To achieve this objective, a descriptive research study with a quantitative approach was conducted, evaluating a total of 300 documents: 150 created entirely by ChatGPT-3.5 and 150 without the use of technological tools. These documents were produced by students from the University of Costa Rica, Guanacaste Campus, and uploaded to the Moodle platform in a space enabled with Turnitin software during the first semester of 2023. The results showed that the documents generated by ChatGPT-3.5 had an average similarity level of 22% with respect to the Turnitin system databases, significantly lower compared to the documents created without its intervention, which had an average similarity level of 33%. Additionally, the collected data indicate that, whether using generative artificial intelligence or not, it is essential to exercise caution in properly referencing documents to avoid plagiarism.
Downloads
References
Arévalo, J., y Quinde, M. (2023). ChatGPT: La creación automática de contenidos con Inteligencia Artificial y su impacto en la comunicación académica y educativa. Desiderata, 22(1), 136-142. https://dialnet.unirioja.es/servlet/articulo?codigo=8965142
Berrones, L., y Buenaño, P. (2023). ChatGPT en el ámbito educativo. Esprint, 2(2), 45-54. https://rei.esprint.tech/index.php/esprint-investigacion/article/view/57/101
Díaz, D. (2015). El uso de Turnitin con retroalimentación mejora la probidad académica de estudiantes de bachillerato. Ciencia, Docencia y Tecnología, 51(26), 197-2016. https://www.redalyc.org/pdf/145/14542676009.pdf
Díaz, D. (2017). Herramientas “Antiplagio”: ¿Son Confiables? Estudio De Casos. Tecnología Educativa, 61(1), 1-13. https://www.edutec.es/revista/index.php/edutec-e/article/view/919/pdf
Díaz, D. (2023). Plagio a la Inteligencia Artificial en estudiantes de bachillerato: un problema real. Innova Educación, 2(5), 108-116. https://www.researchgate.net/publication/369372098_Plagio_IA_en_estudiantes_de_bachillerato_un_problema_real
Diego, F., Morales, I., y Vidal, M. (2023). Chat GPT: origen, evolución, retos e impactos en la educación. Editorial ciencias médicas, 37(2), 1-23. https://ems.sld.cu/index.php/ems/article/view/3876/1508
García, F., Llorens, F., y Vidal, J. (2023). La nueva realidad de la educación ante los avances de la inteligencia artificial generativa. RIED-Revista Iberoamericana de Educación a Distancia, 27(1), 9-39. https://repositorio.grial.eu/bitstream/grial/2935/1/37716-Texto%20del%20art%C3%ADculo-105396-5-10-20230713.pdf
Guzmán, A. (2023). ChatGPT, el nuevo y asombroso chatbot de inteligencia artificial. Academia mexicana de las ciencias, 74(3), 80-87. https://www.revistaciencia.amc.edu.mx/images/revista/74_3/PDF/14_74_3_1524.pdf
Hernández, M. (2016). El plagio académico en la investigación científica. Perfiles Educativos, 153(1), 120-135. https://www.redalyc.org/pdf/132/13246712008.pdf
Hernandez, R. (2017). Impacto de las TIC en la educación: Retos y Perspectivas. Propósitos y representaciones, 5(1), 325-347. doi:http://dx.doi.org/10.20511/pyr2017.v5n1.149
Matías, J., y Lannelongue, G. (2013). Técnicas De Ayuda En El Proceso De Aprendizaje: El Caso De Los Sistemas Anticopia.Teoría de la Educación y Cultura en la Sociedad de la Información, 14(1), 170-188. https://www.redalyc.org/pdf/2010/201025739003.pdf
Pinargote-Baque, K., y Cevallos-Cedeño, A. (2020). El uso y abuso de las nuevas tecnologías en el área educativa. Dominio de Las Ciencias, 6(3), 517-532. https://dominiodelasciencias.com/ojs/index.php/es/article/view/1297/2216
Prendes, M., y Sánchez, M. (2014). Arquímedes y la tecnología educativa. Revista Interuniversitaria de Formación del Profesorado, 28(1), 29-49. https://www.redalyc.org/pdf/274/27431190003.pdf
Rouhiainen, L. (2018). Inteligencia artificial. Alienta. https://proassetspdlcom.cdnstatics2.com/usuaris/libros_contenido/arxius/40/39307_Inteligencia_artificial.pdf
Salas, E., y Amador, M. (2022). La normativa sobre el plagio en las universidades públicas costarricenses. Innovaciones Educativas, 24(1), 41-52. https://revistas.uned.ac.cr/index.php/innovaciones/article/view/4204/6072
Torres, P., y Cobo, J. (2017). Tecnología educativa y su papel en el logro de los fines de la educación. Educere, 68(21), 31-40. https://www.redalyc.org/pdf/356/35652744004.pdf
Turnitin. (2023). El lanzamiento del detector de escritura con IA de Turnitin y el camino a seguir. Turnitin.com. https://www.turnitin.com/blog/the-launch-of-turnitins-ai-writing-detector-and-the-road-ahead
Organización de las Naciones Unidas para la Educación. (2023). ChatGPT e Inteligencia Artificial en la educación superior. UNESCO IESALC. https://unesdoc.unesco.org/ark:/48223/pf0000385146_spa/PDF/385146spa.pdf.multi
Universidad de San Buenaventura. (2022). Orientaciones para el uso de Turnitin. Biblioteca Fray Arturo Calle Restrepo OFM. https://www.usbmed.edu.co/Portals/0/PDF/Editorial/Orientaciones-para-uso-Turnitin.pdf
Downloads
Published
Issue
Section
License
Copyright (c) 2024 Beyker Stefan Obando Zambrano
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
e-Ciencias de la Información informs to authors and readers that any proposal must be submitted along with the Letter of Aceptance of Copyright Conditions (Carta de Aceptación de las Condiciones de Derechos de Autor. Spanish version only available). With the letter, we ask the authors to authorize e-Ciencias de la Información to complete any of the following activities:
- Graphic and style edition of the complete work or a part of it.
- Publication and reproduction of the complete work or a part of it on printed or electronic means, including internet or any other already known or to know technology.
- Partial or complete translation of the work to any other language.
- Adaptation of the work to different reading, sound, or voice formats, or to any other available representation or technical mechanism that will ensure acess for people with partial or total visual impairment, or with any other form of disability that could impede their access to the conventional reading of the paper.
- Distribution and dispossal of the work to the public, in such a way that public can haveaccess to the work from the place and at the moment that each person chooses, using the physical and electronic means at her/his disposition.
- Any other form of use, process, or known system or to be known related to the activities or editorial goals to which e-Ciencias de la Información is vinculated.
The letter format is PDF with auto field for adding the work and the author’s basic data. e-Ciencias de la Información puts at the author disposal the letter its Spanish version only. If you need a format in English, please email: revista.ebci@ucr.ac.cr
Additionally, in the same letter the authors must accept that, with their collaboration, the journal, throught the editorial teamwork, adjusts their paper to the Author Guideliness previously established and published on the e-Ciencias de la Información official website, regarding procedures, format, proofreading, edition, translation, last of the editorial process, and other requirements that appear in such norms.
Furthermore, this website content is registered under the License Creative Commons Attribution - NonCommercial - ShareAlike (by-nc-sa), which allows third parties no commercial use of the work or derivative works; in addition, it indicates that distribution of derivative works must be done under the same license of the original work. Graphic design, images, and text created by the journal e-Ciencias de la Información are property of the University of Costa Rica, and are registered under the License Creative Commons Attribution - NonCommercial - ShareAlike (by-nc-sa) 4.0 International.
Authors who publish with the journal accept the following conditions:
- Authors preserve their moral rights on the publication, and authorize the economic rights mentioned at the Right Assignment Letter (Carta de Aceptación de Derechos. Spanish version) under the License Creative Commons Attribution - NonCommercial - ShareAlike (by-nc-sa) 4.0 International, that allows third parties to use the published work always that they mention the authoriship and the first publication of the work, that has been done at e-Ciencias de la Información.
- The authors may perform other independent and additional contractual arrangements for the non-exclusive distribution of the version of the article published in this issue (eg. Include it at an institutional repository or publish it into a book), showing that the work was first published in this journal.
This policy is established in accordance with Law 6638 on Copyright and Related Rights of the Republic of Costa Rica (Ley 6638 sobre Derechos de Autor y Conexos de la República de Costa Rica. Spanish version only available).
