Towards a context-flexible methodology for automated reviewer recommendation
DOI:
https://doi.org/10.15517/eci.v15i1.62426Keywords:
Reviewer Recommendation, Automated Methodology, Socio-technical cultural perspectiveAbstract
This essay proposes the adoption of a cultural socio-technical perspective for the development of an automated methodology for recommending reviewers in publications in the field of Science and Technology. The objective is to argue about the main guidelines to be considered so that such a methodology is flexible and dynamically adapts to the specific requirements of an Editorial Board (EB), in line with its policies and practices for selecting evaluators. Starting from a systematic and updated mapping of research on automatic recommendation of reviewers, and based on the theoretical framework of the Dynamic Intermedial Device, a study was carried out focusing on a scientific publication in Education Sciences from a research institute in Argentina. As part of the analysis, a survey was designed for members with experience in EB, which allowed obtaining key information. The results underline the importance of the EB establishing consensus to define the inclusion of various factors and their configuration parameters, which gives flexibility to the methodology. It is also highlighted that socio-technical participation is essential to ensure that an IT innovation responds adaptively to different contexts through the weighted inclusion of multiple factors, using advanced natural language processing techniques.
Downloads
References
Abduljaleel, A. Q., Naser, M. A., & Al-Mamory, S. O. (2021). Reviewer assignment using weighted matching and Hungarian algorithm. Turkish Journal of Computer and Mathematics Education (TURCOMAT), 12(7), Article 7. https://doi.org/10.17762/turcomat.v12i7.2629
Aksoy, M., Yanik, S., & Amasyali, M. F. (2023). Reviewer assignment problem: A systematic review of the literature. Journal of Artificial Intelligence Research, 76, 761–827. https://doi.org/10.1613/jair.1.14318
Almarza Meñica, J. M. (2023). El diálogo que somos. Estudios Filosóficos, 72(211), 585–609.
Andrés, G., San Martín, P., & Rodríguez, G. (2023). Análisis multidimensional de la sostenibilidad-DID en el contexto físico-virtual. Cuadernos.info, (54), 1–22. https://doi.org/10.7764/cdi.54.52515
Cuevas, R. F. & Mestanza, M. (2002). La evaluación científica y el sistema de revisión por pares. Consejo Nacional de Ciencia y Tecnología. http://200.62.146.19/bibvirtualdata/publicaciones/consejo/boletin46/art_interes.pdf
Decoppet, G. O., & San Martin, P. S. (2024). Systematic mapping of automated reviewer recommendation solutions. Journal of Computer Science and Technology, 24(2), e16. https://doi.org/10.24215/16666038.24.e16
Latypova, V. (2023). Reviewer assignment decision support in an academic journal based on multicriteria assessment and text mining. En IX International Conference on Information Technology and Nanotechnology (ITNT) (pp. 1–4). IEEE. https://doi.org/10.1109/ITNT57377.2023.10139187
Li, K., Cao, Z., & Qu, D. (2017). Fair reviewer assignment considering academic social network. En L. Chen, C. S. Jensen, C. Shahabi, X. Yang, & X. Lian (Eds.), Web and Big Data (pp. 362–376). Springer International Publishing. https://doi.org/10.1007/978-3-319-63579-8_28
Liu, X., Suel, T., & Memon, N. (2014). A robust model for paper reviewer assignment. En Proceedings of the 8th ACM Conference on Recommender Systems (pp. 25–32). Association for Computing Machinery. https://doi.org/10.1145/2645710.2645749
Manovich, L. (2020). Cultural Analytics. MIT Press.
Medakene, A. N., Bouanane, K., & Eddoud, M. A. (2019). A new approach for computing the matching degree in the paper-to-reviewer assignment problem. En International Conference on Theoretical and Applicative Aspects of Computer Science (ICTAACS) (pp. 1–8). IEEE. https://doi.org/10.1109/ICTAACS48474.2019.8988127
Organización de las Naciones Unidas (2015). Transformar nuestro mundo: La Agenda 2030 para el Desarrollo Sostenible. Resolución aprobada por la Asamblea. https://undocs.org/es/A/RES/70/1
Ortiz Núñez, R. (2024). La revisión por pares como herramienta de evaluación de la ciencia: Principales tensiones y algunas propuestas alternativas. E-Ciencias de la Información, 14(1). https://doi.org/10.15517/eci.v14i1.55921
Patil, A. H., Mahalle, P. N., Patil, V. H., & Bhavsar, S. A. (2023). Proactive system for reviewer paper assignment. Journal of Data Acquisition and Processing, 38(2), 1569–1609. https://doi.org/10.5281/zenodo.776779
Pradhan, T., Sahoo, S., Singh, U., & Pal, S. (2021). A proactive decision support system for reviewer recommendation in academia. Expert Systems with Applications, 169, 114331. https://doi.org/10.1016/j.eswa.2020.114331
Protasiewicz, J., Pedrycz, W., Kozłowski, M., Dadas, S., Stanisławek, T., Kopacz, A., & Gałezewska, M. (2016). A recommender system of reviewers and experts in reviewing problems. Knowledge-Based Systems, 106, 164–178. https://doi.org/10.1016/j.knosys.2016.05.041
San Martín, P. (Ed.). (2022). Patrimonio cultural inmaterial e inclusión social. Aportes para la agenda de desarrollo de la era post-COVID en América Latina y el Caribe. UNESCO.
San Martín, P. S., Rodríguez, G. L., Andrés, G., Manero, L., & Cenacchi, M. (2023). Del Dispositivo Hipermedial Dinámico (DHD) al Dispositivo Intermedial Dinámico (DID). En P. S. San Martín (Ed.), La apropiación creativa de la tecnología en educación: Claves para su comprensión (pp. 361–394). Editorial Teseo.
Thomas, H. (2012). Tecnologías para la inclusión social en América Latina: De las tecnologías apropiadas a los sistemas tecnológicos sociales. Problemas conceptuales y soluciones estratégicas. En H. Thomas, M. Fressoli, & G. Santos (Eds.), Tecnología, desarrollo y democracia: Nueve estudios sobre dinámicas sociotécnicas de exclusión/inclusión social (pp. 25–76). Ministerio de Ciencia, Tecnología e Innovación Productiva de la Nación.
Thomas, H., Becerra, L., & Bidinost, A. (2019). ¿Cómo funcionan las tecnologías? Alianzas socio-técnicas y procesos de construcción de funcionamiento en el análisis histórico. Pasado Abierto, 10, 127–158.
UNESCO. (2021). Recomendación de la UNESCO sobre la ciencia abierta. Conferencia General de la UNESCO, 41ª reunión, 9-24 de noviembre de 2021, París. https://doi.org/10.54677/YDOG4702
Verón, E. (2015). Teoría de la mediatización: Una perspectiva semio-antropológica. Cuadernos de Información y Comunicación, 20, 173–182. https://doi.org/10.5209/rev_ciyc.2015.v20.50682
Xu, L., Zeng, D., Dai, J., & Gui, L. (2022). Combining coverage with TMPS for reviewer assignment. In Proceedings of the International Conference on Intelligent Education and Intelligent Research (IEIR) (pp. 107–113). IEEE. https://doi.org/10.1109/IEIR56323.2022.10050060
Downloads
Published
Issue
Section
License
Copyright (c) 2025 Guillermo Omar Decoppet, Patricia Silvana San Martin
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
e-Ciencias de la Información informs to authors and readers that any proposal must be submitted along with the Letter of Aceptance of Copyright Conditions (Carta de Aceptación de las Condiciones de Derechos de Autor. Spanish version only available). With the letter, we ask the authors to authorize e-Ciencias de la Información to complete any of the following activities:
- Graphic and style edition of the complete work or a part of it.
- Publication and reproduction of the complete work or a part of it on printed or electronic means, including internet or any other already known or to know technology.
- Partial or complete translation of the work to any other language.
- Adaptation of the work to different reading, sound, or voice formats, or to any other available representation or technical mechanism that will ensure acess for people with partial or total visual impairment, or with any other form of disability that could impede their access to the conventional reading of the paper.
- Distribution and dispossal of the work to the public, in such a way that public can haveaccess to the work from the place and at the moment that each person chooses, using the physical and electronic means at her/his disposition.
- Any other form of use, process, or known system or to be known related to the activities or editorial goals to which e-Ciencias de la Información is vinculated.
The letter format is PDF with auto field for adding the work and the author’s basic data. e-Ciencias de la Información puts at the author disposal the letter its Spanish version only. If you need a format in English, please email: revista.ebci@ucr.ac.cr
Additionally, in the same letter the authors must accept that, with their collaboration, the journal, throught the editorial teamwork, adjusts their paper to the Author Guideliness previously established and published on the e-Ciencias de la Información official website, regarding procedures, format, proofreading, edition, translation, last of the editorial process, and other requirements that appear in such norms.
Furthermore, this website content is registered under the License Creative Commons Attribution - NonCommercial - ShareAlike (by-nc-sa), which allows third parties no commercial use of the work or derivative works; in addition, it indicates that distribution of derivative works must be done under the same license of the original work. Graphic design, images, and text created by the journal e-Ciencias de la Información are property of the University of Costa Rica, and are registered under the License Creative Commons Attribution - NonCommercial - ShareAlike (by-nc-sa) 4.0 International.
Authors who publish with the journal accept the following conditions:
- Authors preserve their moral rights on the publication, and authorize the economic rights mentioned at the Right Assignment Letter (Carta de Aceptación de Derechos. Spanish version) under the License Creative Commons Attribution - NonCommercial - ShareAlike (by-nc-sa) 4.0 International, that allows third parties to use the published work always that they mention the authoriship and the first publication of the work, that has been done at e-Ciencias de la Información.
- The authors may perform other independent and additional contractual arrangements for the non-exclusive distribution of the version of the article published in this issue (eg. Include it at an institutional repository or publish it into a book), showing that the work was first published in this journal.
This policy is established in accordance with Law 6638 on Copyright and Related Rights of the Republic of Costa Rica (Ley 6638 sobre Derechos de Autor y Conexos de la República de Costa Rica. Spanish version only available).
