Identificación del sesgo en los medios más allá de las palabrasuso de la identificación automática de técnicas persuasivas para la detección del sesgo mediático

  1. Carrillo-de-Albornoz, Jorge
  2. Plaza Morales, Laura
  3. Rodrigo-Ginés, Francisco-Javier
Journal:
Procesamiento del lenguaje natural

ISSN: 1135-5948

Year of publication: 2023

Issue: 71

Pages: 179-190

Type: Article

DIALNET GOOGLE SCHOLAR lock_openRUA editor

More publications in: Procesamiento del lenguaje natural

Abstract

Detecting media bias is a challenging task due to the complexity and ambiguity of language. Current approaches are limited in their ability to generalise across regions and styles of journalism. This paper proposes a new approach that focusses on detecting rhetorical linguistic techniques rather than just analysing words or contextual representations. We compare three different systems based on different techniques for identifying media bias, including a lexical-based system, a language transformers-based system, and a cascade transformers system that relies on persuasive techniques detection. We have evaluated these systems using a Ukraine crisis news dataset and splitting it by according to the country to generate training and test sets, i.e. different sets for each country. The results of the cascade system outperforms by at least a 6% the other approaches in identifying media bias when evaluating with different countries setup. Our results suggest that models capable of detecting rhetorical and persuasive linguistic techniques are necessary to generalise media bias effectively.

Bibliographic References

  • Aggarwal, S., T. Sinha, Y. Kukreti, and S. Shikhar. 2020. Media bias detection and bias short term impact assessment. Array, 6:100025.
  • Aires, V. P., J. Freire, and A. S. da Silva. 2020. An information theory approach to detect media bias in news websites.
  • Baly, R., G. D. S. Martino, J. Glass, and P. Nakov. 2020. We can detect your bias: Predicting the political ideology of news articles. arXiv preprint arXiv:2010.05338.
  • Chen, W.-F., K. Al-Khatib, B. Stein, and H. Wachsmuth. 2020. Detecting media bias in news articles using gaussian bias distributions. arXiv preprint arXiv:2010.10649.
  • Cremisini, A., D. Aguilar, and M. A. Finlayson. 2019. A challenging dataset for bias detection: the case of the crisis in the ukraine. In Social, Cultural, and Behavioral Modeling: 12th International Conference, SBP-BRiMS 2019, Washington, DC, USA, July 9– 12, 2019, Proceedings 12, pages 173–183. Springer.
  • Enomoro, S. and T. Eda. 2021. Learning to cascade: Confidence calibration for improving the accuracy and computational cost of cascade inference systems. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 35, pages 7331–7339.
  • Hsieh, C., C. Moreira, and C. Ouyang. 2021. Dice4el: interpreting process predictions using a milestone-aware counterfactual approach. In 2021 3rd International Conference on Process Mining (ICPM), pages 88–95. IEEE.
  • Hube, C. and B. Fetahu. 2018. Detecting biased statements in wikipedia. In Companion proceedings of the the web conference 2018, pages 1779–1786.
  • Kiesel, J., M. Mestre, R. Shukla, E. Vincent, P. Adineh, D. Corney, B. Stein, and M. Potthast. 2019. SemEval-2019 task 4: Hyperpartisan news detection. In Proceedings of the 13th International Workshop on Semantic Evaluation, pages 829–839, Minneapolis, Minnesota, USA, June. Association for Computational Linguistics.
  • Lazaridou, K. and R. Krestel. 2016. Identifying political bias in news articles. Bulletin of the IEEE TCDL, 12.
  • Lin, Y.-R., J. Bagrow, and D. Lazer. 2011. More voices than ever? quantifying media bias in networks. In Proceedings of the International AAAI Conference on Web and Social Media, volume 5, pages 193– 200.
  • Lundberg, S. M. and S.-I. Lee. 2017. A unified approach to interpreting model predictions. Advances in neural information processing systems, 30.
  • Ogawa, T., Q. Ma, and M. Yoshikawa. 2011. News bias analysis based on stakeholder mining. IEICE transactions on information and systems, 94(3):578– 586.
  • Patricia Aires, V., F. G. Nakamura, and E. F. Nakamura. 2019. A link-based approach to detect media bias in news websites. In Companion Proceedings of The 2019 World Wide Web Conference, pages 742–745.
  • Piskorski, J., N. Stefanovitch, G. Da San Martino, and P. Nakov. 2023. Semeval-2023 task 3: Detecting the category, the framing, and the persuasion techniques in online news in a multilingual setup. In Proceedings of the 17th International Workshop on Semantic Evaluation, SemEval 2023, Toronto, Canada, July.
  • Rashkin, H., E. Choi, J. Y. Jang, S. Volkova, and Y. Choi. 2017. Truth of varying shades: Analyzing language in fake news and political fact-checking. In Proceedings of the 2017 conference on empirical methods in natural language processing, pages 2931–2937.
  • Ribeiro, M. T., S. Singh, and C. Guestrin. 2016. ” why should i trust you?” explaining the predictions of any classifier. In Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining, pages 1135– 1144.
  • Sanh, V., L. Debut, J. Chaumond, and T. Wolf. 2019. Distilbert, a distilled version of bert: smaller, faster, cheaper and lighter. arXiv preprint arXiv:1910.01108.
  • Wolf, T., L. Debut, V. Sanh, J. Chaumond, C. Delangue, A. Moi, P. Cistac, T. Rault, R. Louf, M. Funtowicz, J. Davison, S. Shleifer, P. von Platen, C. Ma, Y. Jernite, J. Plu, C. Xu, T. Le Scao, S. Gugger, M. Drame, Q. Lhoest, and A. Rush. 2020. Transformers: State-ofthe- art natural language processing. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: System Demonstrations, pages 38–45, Online, October. Association for Computational Linguistics.
Data source: Dialnet