TY - GEN
T1 - (Local) Differential Privacy has NO Disparate Impact on Fairness
AU - Arcolezi, Héber H.
AU - Makhlouf, Karima
AU - Palamidessi, Catuscia
N1 - Publisher Copyright:
© 2023, IFIP International Federation for Information Processing.
PY - 2023/1/1
Y1 - 2023/1/1
N2 - In recent years, Local Differential Privacy (LDP), a robust privacy-preserving methodology, has gained widespread adoption in real-world applications. With LDP, users can perturb their data on their devices before sending it out for analysis. However, as the collection of multiple sensitive information becomes more prevalent across various industries, collecting a single sensitive attribute under LDP may not be sufficient. Correlated attributes in the data may still lead to inferences about the sensitive attribute. This paper empirically studies the impact of collecting multiple sensitive attributes under LDP on fairness. We propose a novel privacy budget allocation scheme that considers the varying domain size of sensitive attributes. This generally led to a better privacy-utility-fairness trade-off in our experiments than the state-of-art solution. Our results show that LDP leads to slightly improved fairness in learning problems without significantly affecting the performance of the models. We conduct extensive experiments evaluating three benchmark datasets using several group fairness metrics and seven state-of-the-art LDP protocols. Overall, this study challenges the common belief that differential privacy necessarily leads to worsened fairness in machine learning.
AB - In recent years, Local Differential Privacy (LDP), a robust privacy-preserving methodology, has gained widespread adoption in real-world applications. With LDP, users can perturb their data on their devices before sending it out for analysis. However, as the collection of multiple sensitive information becomes more prevalent across various industries, collecting a single sensitive attribute under LDP may not be sufficient. Correlated attributes in the data may still lead to inferences about the sensitive attribute. This paper empirically studies the impact of collecting multiple sensitive attributes under LDP on fairness. We propose a novel privacy budget allocation scheme that considers the varying domain size of sensitive attributes. This generally led to a better privacy-utility-fairness trade-off in our experiments than the state-of-art solution. Our results show that LDP leads to slightly improved fairness in learning problems without significantly affecting the performance of the models. We conduct extensive experiments evaluating three benchmark datasets using several group fairness metrics and seven state-of-the-art LDP protocols. Overall, this study challenges the common belief that differential privacy necessarily leads to worsened fairness in machine learning.
KW - Fairness
KW - Local Differential Privacy
KW - Machine Learning
UR - https://www.scopus.com/pages/publications/85169000286
U2 - 10.1007/978-3-031-37586-6_1
DO - 10.1007/978-3-031-37586-6_1
M3 - Conference contribution
AN - SCOPUS:85169000286
SN - 9783031375859
T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
SP - 3
EP - 21
BT - Data and Applications Security and Privacy XXXVII - 37th Annual IFIP WG 11.3 Conference, DBSec 2023, Proceedings
A2 - Atluri, Vijayalakshmi
A2 - Ferrara, Anna Lisa
PB - Springer Science and Business Media Deutschland GmbH
T2 - 37th Annual IFIP WG 11.3 Conference on Data and Applications Security and Privacy, DBSec 2023
Y2 - 19 July 2023 through 21 July 2023
ER -