论文标题
关于识别公平审核员以根据新颖的非光谱公平概念评估推荐系统
On the Identification of Fair Auditors to Evaluate Recommender Systems based on a Novel Non-Comparative Fairness Notion
论文作者
论文摘要
决策支持系统是信息系统,可在司法,房地产和银行业等各种应用程序中为人们的决策提供支持。最近,在许多实际部署的背景下,发现这些支持系统具有歧视性。为了评估和减轻这些偏见,使用比较正义的概念来培养算法公平文献,该概念主要依赖于该系统支持的社会中的两个/更多个人或群体。但是,这种公平的概念在识别被雇用来评估决策支持系统中潜在偏见的公平审计师方面并不是很有用。作为解决方案,我们通过提出基于非避免司法原则的新公平概念来引入算法公平的范式转变。假设审核员根据决策支持系统的某些(可能未知的)所需的属性进行公平评估,则提出的公平性概念将系统的结果与审计师的期望结果进行了比较。我们表明,拟议的公平性概念还可以通过比较公平的概念来证明任何系统可以从比较公平的角度来证明任何系统(例如,个人公平和统计平等),如果与相同公平的公平概念相对于公平的审计师,那是不公平的。我们还表明,在个人公平的背景下,匡威是正确的。还介绍了有关如何使用我们的公平概念来识别公平可靠的审计师以及如何使用它们来量化决策支持系统中的偏见的简短讨论。
Decision-support systems are information systems that offer support to people's decisions in various applications such as judiciary, real-estate and banking sectors. Lately, these support systems have been found to be discriminatory in the context of many practical deployments. In an attempt to evaluate and mitigate these biases, algorithmic fairness literature has been nurtured using notions of comparative justice, which relies primarily on comparing two/more individuals or groups within the society that is supported by such systems. However, such a fairness notion is not very useful in the identification of fair auditors who are hired to evaluate latent biases within decision-support systems. As a solution, we introduce a paradigm shift in algorithmic fairness via proposing a new fairness notion based on the principle of non-comparative justice. Assuming that the auditor makes fairness evaluations based on some (potentially unknown) desired properties of the decision-support system, the proposed fairness notion compares the system's outcome with that of the auditor's desired outcome. We show that the proposed fairness notion also provides guarantees in terms of comparative fairness notions by proving that any system can be deemed fair from the perspective of comparative fairness (e.g. individual fairness and statistical parity) if it is non-comparatively fair with respect to an auditor who has been deemed fair with respect to the same fairness notions. We also show that the converse holds true in the context of individual fairness. A brief discussion is also presented regarding how our fairness notion can be used to identify fair and reliable auditors, and how we can use them to quantify biases in decision-support systems.