Enhancing Location Entity Recognition in Spanish Medical Texts by Leveraging Domain Language Models and Data Augmentation

  1. Garitano, Irati
  2. Martínez, Raquel
Journal:
Procesamiento del lenguaje natural

ISSN: 1135-5948

Year of publication: 2026

Issue Title: Procesamiento del Lenguaje Natural, Revista nº 76, marzo de 2026

Issue: 76

Pages: 123-134

Type: Article

DIALNET GOOGLE SCHOLAR lock_openOpen access editor

More publications in: Procesamiento del lenguaje natural

Sustainable development goals

info

SDG classification obtained using Aurora SDG artificial intelligence model.

Abstract

This work focuses on the automatic recognition of location entities in Spanish clinical reports, using the MEDDOPLACE challenge (IberLEF 2023) as the experimental framework. We evaluated both general-domain pre-trained models and biomedical-specific models. Furthermore, we explored data augmentation techniques via back-translation and LLM-based paraphrase generation. Our results outperform previous state-of-the-art approaches, demonstrating the effectiveness of combining these data augmentation strategies with pre-trained clinical domain models.

Bibliographic References

  • Akiba, T., S. Sano, T. Yanase, T. Ohta, and M. Koyama. 2019. Optuna: A nextgeneration hyperparameter optimization framework. In Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pages 2623–2631.
  • Alsentzer, E., J. Murphy, W. Boag, W.-H. Weng, D. Jin, T. Naumann, and M. Mc-Dermott. 2019. Publicly available clinical BERT embeddings. In Proceedings of the 2nd Clinical Natural Language Processing Workshop, pages 72–78, Minneapolis, Minnesota, USA, June. Association for Computational Linguistics.
  • Beltagy, I., K. Lo, and A. Cohan. 2019. Scibert: A pretrained language model for scientific text. arXiv preprint arXiv:1903.10676.
  • Carrino, C., J. Llop, M. P`amies, A. Guti´errez-Fandi˜no, J. Armengol-Estap´e, J. Silveira-Ocampo, and M. Villegas. 2022. Pretrained biomedical language models for clinical nlp in spanish. In Proceedings of the 21st Workshop on Biomedical Language Processing, pages 193–199.
  • Carrino, C. P., J. Armengol-Estap´e, A. Guti´errez-Fandi˜no, J. Llop-Palao, M. P`amies, A. Gonzalez-Agirre, and M. Villegas. 2021. Biomedical and clinical language models for spanish: On the benefits of domain-specific pretraining in a mid-resource scenario.
  • Ca˜nete, J., G. Chaperon, R. Fuentes, and J. P´erez. 2020. Spanish pre-trained bert model and evaluation data. Papers with Code.
  • Chen, Q., R. Leaman, A. Allot, L. Luo, C.-H. Wei, S. Yan, and Z. Lu. 2021. Artificial intelligence (ai) in action: Addressing the covid-19 pandemic with natural language processing (nlp). arXiv preprint arXiv:2010.16413.
  • Chizhikova, M., J. Collado Monta˜nez, M. C. D´ıaz-Galiano, L. A. Ure˜na-L´opez, and M. T. Mart´ın Valdivia. 2023. Sinai@meddoplace: Detecting, normalizing, and classifying places and related information in spanish medical texts. In Proceedings of the Iberian Languages Evaluation Forum (IberLEF 2023) co-located with SEPLN 2023, CEUR Workshop Proceedings, Ja´en, Spain.
  • Culotta, A. 2014. Towards detecting influenza epidemics by analyzing twitter messages. In Proceedings of the first workshop on social media analytics, pages 115–122.
  • De la Iglesia, I., A. Atutxa, K. Gojenola, and A. Barrena. 2023. EriBERTa: A Bilingual Pre-Trained Language Model for Clinical Natural Language Processing.
  • Devlin, J., M.-W. Chang, K. Lee, and K. Toutanova. 2018. Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805.
  • Jiang, A. Q., A. Sablayrolles, A. Mensch, C. Bamford, D. S. Chaplot, D. de las Casas, F. Bressand, G. Lengyel, G. Lample, L. Saulnier, L. R. Lavaud, M.-A. Lachaux, P. Stock, T. L. Scao, T. Lavril, T. Wang, T. Lacroix, and W. E. Sayed. 2023. Mistral 7b.
  • Krallinger, M., S. Lima Lopez, E. Farr´e Maduell, L. Gasc´o S´anchez, and V. Briva Iglesias. 2023. Meddoplace shared task on location entity recognition in spanish clinical narratives. IberLEF 2023.
  • Lafferty, J. D., A. McCallum, and F. C. Pereira. 2001. Conditional random fields: Probabilistic models for segmenting and labeling sequence data. In Proceedings of the 18th International Conference on Machine Learning (ICML), pages 282–289.
  • Lee, J., W. Yoon, S. Kim, D. Kim, S. Kim, C. H. So, and J. Kang. 2020. Biobert: a pre-trained biomedical language representation model for biomedical text mining. Bioinformatics, 36(4):1234–1240.
  • Li, J., Y. Sun, R. J. Johnson, D. Sciaky, C.-H. Wei, R. Leaman, A. P. Davis, C. J. Mattingly, T. C. Wiegers, and Z. Lu. 2016. Biocreative v cdr task corpus: a resource for chemical disease relation extraction. Database, 2016:baw068, 05.
  • Peng, Y., S. Yan, and Z. Lu. 2019. Transfer learning in biomedical natural language processing: An evaluation of bert and elmo on ten benchmarking datasets. In Proceedings of the 18th BioNLP Workshop and Shared Task, pages 58–65.
  • Rold´an-´Alvarez, D., M. ´Angel Rodr´ıguez-Garc´ıa, S. Montalvo-Herranz, and R. Mart´ınez-Unanue. 2023. Urjc-team at meddoplace 2023: Bi-lstm and transformers for medical document place-related content extraction. In Proceedings of Iber-LEF 2023, Ja´en, Spain. CEUR Workshop Proceedings. September 2023.
  • Velupillai, S., H. Suominen, M. Liakata, A. Roberts, A. D. Shah, K. Morley, D. Osborn, J. Hayes, R. Stewart, J. Downs, W. Chapman, and R. Dutta. 2018. Using clinical natural language processing for health outcomes research: Overview and actionable suggestions for future advances. Journal of Biomedical Informatics, 88:11–19.
  • Wang, Y., L. Wang, M. Rastegar-Mojarad, S. Moon, F. Shen, N. Afzal, S. Liu, Y. Zeng, S. Mehrabi, S. Sohn, and H. Liu. 2018. Clinical information extraction applications: a literature review. Journal of Biomedical Informatics, 77:34–49.
  • Xu, X., Z. Li, H. Zhang, and K. Ma. 2025. Named entity recognition for chinese electronic medical records by integrating knowledge graph and clinicalbert. Frontiers in Artificial Intelligence, Volume 8 - 2025.
Data source: Dialnet