Online Harms

We also study the online harms that users may be exposed to when navigating the cyber space. We particularly focus on online harms in online social networks, including: toxic, stereotyped and biased language; phenomenons like echo chambers and partizan (and cross-partizan) speech; and misinformation/disinformation.

We take an AI-based approach, where we use AI methods as a tool to study online harms. As part of this, we use the methods that we developed to study ethics in AI (see our work on AI Ethics), for instance the methods we developed to measure AI bias. Interestingly, AI very often reproduces existing instances of discrimination in the offline world by either inheriting the biases of prior decision makers, or simply reflecting widespread prejudices in society. Therefore, by developing methods to study AI discrimination, this also enables us to understand instances of human discrimination. For instance, we have applied our methods to discover biases in natural language processing models to discover dangerous prejudices in online communities using their own language (usually containing slang).

Related Projects
  • Discovering and Attesting Digital Discrimination (EPSRC) - DADD
  • National Research Centre on Privacy, Harm Reduction and Adversarial Influence Online (UKRI) - REPHRAIN

Selected Publications

  1. ICWSM
    Cross-Partisan Interactions on Twitter
    Yusuf Mücahit Çetinkaya, Vahid Ghafouri, Guillermo Suarez-Tangil, Jose Such, and Tugrulcan Elmas
    In Proceedings of the Nineteenth International AAAI Conference on Web and Social Media (ICWSM), 2025
  2. ICWSM
    Differences in the Toxic Language of Cross-Platform Communities
    Kumar Singh Ashwini, Vahid Ghafouri, Jose Such, Guillermo Suarez-Tangil, and others
    In International AAAI Conference on Web and Social Media (ICWSM), 2024
  3. CSCW
    Transformer-Based Quantification of the Echo Chamber Effect in Online Communities
    Vahid Ghafouri, Faisal Alatawi, Mansooreh Karami, Huan Liu, Jose Such, and Guillermo Suarez-Tangil
    In PACM on Human-Computer Interaction - ACM Conference on Computer-Supported Cooperative Work and Social Computing (CSCW), 2024
  4. AIES
    Misinformation in Third-Party Voice Applications
    Mary Bispham, Suliman Kalim Sattar, Clara Zard, Xavier Ferrer-Aran, Jide Edu, Guillermo Suarez-Tangil, and Jose Such
    In Proceedings of the 5th ACM International Conference on Conversational User Interfaces (CUI), 2023
  5. CSCW
    Intersectional Experiences of Unfair Treatment Caused by Automated Computational Systems
    Tom Nuenen, Jose Such, and Mark Coté
    In PACM on Human-Computer Interaction - ACM Conference on Computer-Supported Cooperative Work and Social Computing (CSCW), 2022
  6. TKDE
    Discovering and Interpreting Conceptual Biases in Online Communities
    Xavier Ferrer-Aran, Tom Nuenen, Natalia Criado, and Jose Such
    IEEE Transactions on Knowledge and Data Engineering (TKDE), 2023
  7. ICWSM
    Discovering and Categorising Language Biases in Reddit
    Xavier Ferrer, Tom Nuenen, Jose Such, and Natalia Criado
    In The International AAAI Conference on Web and Social Media (ICWSM), 2021
See more related publications in our Publications page.