TY - GEN
T1 - Assisting Users in Privacy Conflicts with Partially Observable Multi-Agent Reinforcement Learning
AU - Aydln, Hüseyin
N1 - Publisher Copyright:
© 2024 The Authors.
PY - 2024/6/5
Y1 - 2024/6/5
N2 - Avoiding violations of privacy-invading technologies is difficult enough for an individual, yet the complexity escalates when online collaborations and social media jeopardize the privacy of multiple parties over co-owned contents. While existing approaches offer solutions for possible conflicts among users' privacy preferences, they either assume static rules for the preferences of users or require the users to declare separate decisions for each content. In any case, the long term satisfaction of all users remains uncertain. Reinforcement learning (RL) emerges at this point as a suitable candidate for balancing the users' utilities as their satisfactions about decisions over time. The decentralized and dynamic nature of the problem suggests an RL setting that involves multiple agents interacting not only with the humans whom they model and represent but also with each other. Furthermore, as the knowledge of agents about the factors that lead to other users' preferences will be limited, the setting has to handle partial observability. Although this introduces new challenges for the framework, it also brings a potential generalization of any solution to multi-party conflicts in different real life contexts with minor adaptations. This study delves deeper into the features of the proposed framework and the ways to construct it.
AB - Avoiding violations of privacy-invading technologies is difficult enough for an individual, yet the complexity escalates when online collaborations and social media jeopardize the privacy of multiple parties over co-owned contents. While existing approaches offer solutions for possible conflicts among users' privacy preferences, they either assume static rules for the preferences of users or require the users to declare separate decisions for each content. In any case, the long term satisfaction of all users remains uncertain. Reinforcement learning (RL) emerges at this point as a suitable candidate for balancing the users' utilities as their satisfactions about decisions over time. The decentralized and dynamic nature of the problem suggests an RL setting that involves multiple agents interacting not only with the humans whom they model and represent but also with each other. Furthermore, as the knowledge of agents about the factors that lead to other users' preferences will be limited, the setting has to handle partial observability. Although this introduces new challenges for the framework, it also brings a potential generalization of any solution to multi-party conflicts in different real life contexts with minor adaptations. This study delves deeper into the features of the proposed framework and the ways to construct it.
KW - human-AI collaboration
KW - multi-agent systems
KW - multi-party privacy conflicts
KW - reinforcement learning
KW - user modeling
UR - http://www.scopus.com/inward/record.url?scp=85198749950&partnerID=8YFLogxK
U2 - 10.3233/FAIA240182
DO - 10.3233/FAIA240182
M3 - Conference contribution
AN - SCOPUS:85198749950
T3 - Frontiers in Artificial Intelligence and Applications
SP - 55
EP - 63
BT - HHAI 2024
A2 - Lorig, Fabian
A2 - Tucker, Jason
A2 - Lindstrom, Adam Dahlgren
A2 - Dignum, Frank
A2 - Murukannaiah, Pradeep
A2 - Theodorou, Andreas
A2 - Yolum, Pinar
PB - IOS Press
T2 - 3rd International Conference on Hybrid Human-Artificial Intelligence, HHAI 2024
Y2 - 10 June 2024 through 14 June 2024
ER -