Open AccessPosted Content
Algorithmic Fairness
Dana Pessach,Erez Shmueli +1 more
TL;DR: An overview of the main concepts of identifying, measuring and improving algorithmic fairness when using AI algorithms is presented and the most commonly used fairness-related datasets in this field are described.
read more
Abstract: An increasing number of decisions regarding the daily lives of human beings are being controlled by artificial intelligence (AI) algorithms in spheres ranging from healthcare, transportation, and education to college admissions, recruitment, provision of loans and many more realms. Since they now touch on many aspects of our lives, it is crucial to develop AI algorithms that are not only accurate but also objective and fair. Recent studies have shown that algorithmic decision-making may be inherently prone to unfairness, even when there is no intention for it. This paper presents an overview of the main concepts of identifying, measuring and improving algorithmic fairness when using AI algorithms. The paper begins by discussing the causes of algorithmic bias and unfairness and the common definitions and measures for fairness. Fairness-enhancing mechanisms are then reviewed and divided into pre-process, in-process and post-process mechanisms. A comprehensive comparison of the mechanisms is then conducted, towards a better understanding of which mechanisms should be used in different scenarios. The paper then describes the most commonly used fairness-related datasets in this field. Finally, the paper ends by reviewing several emerging research sub-fields of algorithmic fairness.
read more
Chat with Paper
AI Agents for this Paper
Find similar papers on Google Scholar, PubMed and Arxiv
Write a critical review of this paper
Analyze citations of this paper to find unaddressed research gaps
Figures
Table 1. Measures and Definitions for Algorithmic Fairness 
Table 4. Additional Measures and Definitions for Algorithmic Fairness 
Fig. 1. If the SAT scores were used for hiring, then unprivileged candidates with high potential would be excluded, whereas lower potential candidates from the privileged group would be hired instead 
Table 3. Common Benchmark Datasets for Algorithmic Fairness 
Table 2. Pre-Process, In-Process and Post-Process Mechanisms for Algorithmic Fairness
Citations
Artificial Intelligence in Human Resources Management: Challenges and a Path Forward:
TL;DR: There is a substantial gap between the promise and reality of artificial intelligence in human resource (HR) management, and four challenges in using data science techniques for HR management are identified.
848
•Posted Content
Fairness in Machine Learning: A Survey.
Simon Caton,Christian Haas +1 more
TL;DR: An overview of the different schools of thought and approaches to mitigating (social) biases and increase fairness in the Machine Learning literature is provided, organises approaches into the widely accepted framework of pre-processing, in- processing, and post-processing methods, subcategorizing into a further 11 method areas.
Algorithmic Fairness: Choices, Assumptions, and Definitions
TL;DR: It is shown how choices and assumptions made—often implicitly—to justify the use of prediction-based decision-making can raise fairness concerns and a notationally consistent catalog of fairness definitions from the literature is presented.
491
A Framework for Understanding Sources of Harm throughout the Machine Learning Life Cycle
Harini Suresh,John V. Guttag +1 more
- 05 Oct 2021
TL;DR: In this paper, the authors identify seven potential sources of downstream harm in machine learning, spanning data collection, development, and deployment, and propose a framework to facilitate more productive and precise communication around these issues.
417
References
•Proceedings Article
Fair Inference on Outcomes.
Razieh Nabi,Ilya Shpitser +1 more
- 01 Feb 2018
TL;DR: It is argued that the existence of discrimination can be formalized in a sensible way as the presence of an effect of a sensitive covariate on the outcome along certain causal pathways, a view which generalizes (Pearl 2009).
Identifying and reducing gender bias in word-level language models
Shikha Bordia,Samuel R. Bowman +1 more
- 01 Jun 2019
TL;DR: This study proposes a metric to measure gender bias and proposes a regularization loss term for the language model that minimizes the projection of encoder-trained embeddings onto an embedding subspace that encodes gender and finds this regularization method to be effective in reducing gender bias.
217
Beyond Personalization: Research Directions in Multistakeholder Recommendation.
Himan Abdollahpouri,Gediminas Adomavicius,Robin Burke,Ido Guy,Dietmar Jannach,Toshihiro Kamishima,Jan Krasnodebski,Luiz Augusto Pizzato +7 more
TL;DR: The multistakeholder perspective on recommendation is outlined, highlighting example research areas and discussing important issues, open questions, and prospective research directions.
217
FairTest: Discovering Unwarranted Associations in Data-Driven Applications
Florian Tramèr,Vaggelis Atlidakis,Roxana Geambasu,Daniel Hsu,Jean-Pierre Hubaux,Mathias Humbert,Ari Juels,Huang Lin +7 more
- 26 Apr 2017
TL;DR: FairTest as discussed by the authors is a framework for the discovery of unfair, discriminatory, or offensive user treatment in data-driven applications, which is based on the Unwarranted Association (UA) framework.
212
•Proceedings Article
Fair Clustering Through Fairlets
Flavio Chierichetti,Ravi Kumar,Silvio Lattanzi,Sergei Vassilvitskii +3 more
- 01 Jan 2017
TL;DR: In this article, the fair clustering problem is formulated under both the k-center and k-median objectives, and it is shown that even with two protected classes the problem is challenging, as the optimum solution can violate common conventions.