We are surrounded by artificial intelligence. We have AI in our phones, in our computers, in our homes, in our cities, in an increasingly interconnected reality. We use AI to save time and make more accurate and automated decisions in many applications from healthcare to finance to policing to hiring. While this has brought amazing advancements, it has been shown, and there have been several headlines in the news about it, that AI may not be secure and may cause privacy violations. We need to ensure that AI treats us humans, and our data, fairly and safely, if we are to trust AI systems.
We are developing techniques for secure and privacy-respecting AI, particularly taking a human-centred approach, so that anyone, regardless of their knowledge of AI, could feel safe and in control when using it. We mainly focus on security and privacy in systems that use or embed AI, from voice-based or text-based AI Assistants (like ChatGPT, Gemini, Alexa, and Siri) to other types of Autonomous Systems and automated decision-making systems.
@inproceedings{zhan2025malicious,author={Zhan, Xiao and Carrillo, Juan-Carlos and Seymour, William and Such, Jose},title={Malicious LLM-Based Conversational AI Makes Users Reveal Personal Information},booktitle={{USENIX Security Symposium (SEC)}},year={2025},pages={In press.},}
ICML
CASE-Bench: Context-Aware Safety Evaluation Benchmark for Large Language Models
Guangzhi Sun, Xiao Zhan, Shutong Feng, Philip C. Woodland, and Jose Such
In Proceedings of the International Conference on Machine Learning (ICML), 2025
@inproceedings{sun2025case,author={Sun, Guangzhi and Zhan, Xiao and Feng, Shutong and Woodland, Philip C. and Such, Jose},title={CASE-Bench: Context-Aware Safety Evaluation Benchmark for Large Language
Models},booktitle={Proceedings of the International Conference on Machine Learning {(ICML)}},pages={In press.},year={2025},}
CHI
Privacy Perceptions of Custom GPTs by Users and Creators
Rongjun Ma, Caterina Maidhof, Juan Carlos Carrillo, Janne Lindqvist, and Jose Such
In Proceedings of the Conference on Human Factors in Computing Systems (CHI), 2025
@inproceedings{ma2025privacy,author={Ma, Rongjun and Maidhof, Caterina and Carrillo, Juan Carlos and Lindqvist, Janne and Such, Jose},title={Privacy Perceptions of Custom GPTs by Users and Creators},booktitle={Proceedings of the Conference on Human Factors in Computing
Systems {(CHI)}},pages={237:1--237:18},publisher={{ACM}},year={2025},}
Usenix SEC
Voice Application Developer Experiences with Alexa and Google Assistant: Juggling Risks, Liability, and Security
William Seymour, Noura Abdi, Kopo Ramokapane, Jide Edu, Guillermo Suarez-Tangil, and Jose Such
@inproceedings{seymour2024voice,author={Seymour, William and Abdi, Noura and Ramokapane, Kopo and Edu, Jide and Suarez-Tangil, Guillermo and Such, Jose},title={Voice Application Developer Experiences with Alexa and Google Assistant: Juggling Risks, Liability, and Security},booktitle={{USENIX Security Symposium (SEC)}},year={2024},pages={5035--5052},}
CHI
Legal Obligation and Ethical Best Practice: Towards Meaningful Verbal Consent for Voice Assistants
William Seymour, Mark Coté, and Jose Such
In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI), 2023
@inproceedings{seymour2023legal,author={Seymour, William and Cot{\'{e}}, Mark and Such, Jose},title={Legal Obligation and Ethical Best Practice: Towards Meaningful Verbal
Consent for Voice Assistants},booktitle={Proceedings of the ACM Conference on Human Factors in Computing Systems ({CHI})},pages={166:1--166:16},year={2023},}
TIFS
MalProtect: Stateful Defense Against Adversarial Query Attacks in ML-Based Malware Detection
Aqib Rashid and Jose Such
IEEE Transactions on Information Forensics and Security (TIFS), 2023
@article{rashid2023malprotect,author={Rashid, Aqib and Such, Jose},title={MalProtect: Stateful Defense Against Adversarial Query Attacks in
ML-Based Malware Detection},journal={{IEEE} Transactions on Information Forensics and Security {(TIFS)}},volume={18},pages={4361--4376},year={2023},}
ECAI
Privacy-enhanced Personal Assistants based on Dialogues and Case Similarity
Xiao Zhan, Stefan Sarkadi, and Jose Such
In Proceedings of the European Conference on Artificial Intelligence (ECAI), 2023
@inproceedings{zhan2023privacy,title={Privacy-enhanced Personal Assistants based on Dialogues and Case Similarity},author={Zhan, Xiao and Sarkadi, Stefan and Such, Jose},booktitle={Proceedings of the European Conference on Artificial Intelligence (ECAI)},year={2023},pages={670--680},}
CHI
Privacy Norms for Smart Home Personal Assistants
Noura Abdi, Xiao Zhan, Kopo Ramokapane, and Jose Such
In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI), 2021
@inproceedings{abdi2021privacy,title={Privacy Norms for Smart Home Personal Assistants},author={Abdi, Noura and Zhan, Xiao and Ramokapane, Kopo and Such, Jose},booktitle={Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI)},year={2021},pages={558:1--558:14},}
IJCAI
Privacy and Autonomous Systems
Jose Such
In Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI), 2017
@inproceedings{such2017privacy,title={Privacy and Autonomous Systems},author={Such, Jose},booktitle={Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI)},pages={4761--4767},year={2017},}
KER
A survey of privacy in multi-agent systems
Jose Such, Agustin Espinosa, and Ana Garcia-Fornes
@article{such2014survey,title={A survey of privacy in multi-agent systems},author={Such, Jose and Espinosa, Agustin and Garcia-Fornes, Ana},journal={The Knowledge Engineering Review},volume={29},number={03},pages={314--344},year={2014},}
See more related publications in our Publications page.
