Can BiasPainter Help Curb Bias in AI?

BiasPainter’s effectiveness in measuring social bias is tested on five commercial and research image generation models. We investigate if BiasPainter can accurately detect bias, validate its results through manual inspection, and help in mitigating bias in image generation models.


This content originally appeared on HackerNoon and was authored by Media Bias [Deeply Researched Academic Papers]

:::info Authors:

(1) Wenxuan Wang, The Chinese University of Hong Kong, Hong Kong, China;

(2) Haonan Bai, The Chinese University of Hong Kong, Hong Kong, China

(3) Jen-tse Huang, The Chinese University of Hong Kong, Hong Kong, China;

(4) Yuxuan Wan, The Chinese University of Hong Kong, Hong Kong, China;

(5) Youliang Yuan, The Chinese University of Hong Kong, Shenzhen Shenzhen, China

(6) Haoyi Qiu University of California, Los Angeles, Los Angeles, USA;

(7) Nanyun Peng, University of California, Los Angeles, Los Angeles, USA

(8) Michael Lyu, The Chinese University of Hong Kong, Hong Kong, China.

:::

Abstract

1 Introduction

2 Background

3 Approach and Implementation

3.1 Seed Image Collection and 3.2 Neutral Prompt List Collection

3.3 Image Generation and 3.4 Properties Assessment

3.5 Bias Evaluation

4 Evaluation

4.1 Experimental Setup

4.2 RQ1: Effectiveness of BiasPainter

4.3 RQ2 - Validity of Identified Biases

4.4 RQ3 - Bias Mitigation

5 Threats to Validity

6 Related Work

7 Conclusion, Data Availability, and References

4 EVALUATION

To validate the effectiveness of BiasPainter and get more insights on the bias in image generation models, we use BiasPainter to test 5 commercial image generation software products and research models. In this section, we detail the evaluation process and empirically explore the following three research questions (RQs).

\ • RQ1: Can BiasPainter effectively measure social bias in image generation models?

\ • RQ2: Are the social bias found by BiasPainter valid?

\ • RQ3: Can BiasPainter help mitigate the bias in image generation models?

\ In RQ1, our goal is to investigate the effectiveness of BiasPainter in identifying and measuring social bias in image generation models. In other words, we evaluate the capability of BiasPainter in measuring the biased extent of different systems. In addition, to the best of our knowledge, BiasPainter is the first approach to reveal hidden associations between social groups and biases properties in image generation models. Therefore, we also analyze whether the results generated by BiasPainter can provide an intuitive and constructive impression of social bias in the tested systems. Since BiasPainter adopts diverse computer vision methods, which are generally imperfect (i.e., the methods may produce false positives and true negatives) [14, 26], in RQ2, we evaluate the validity of the identified bias through manual inspection. Finally, measuring the bias is the first step in mitigating the bias. Hence, in RQ3, we illustrate how BiasPainter be helpful for mitigating the bias in image generation models.

\

:::info This paper is available on arxiv under CC0 1.0 DEED license.

:::

\


This content originally appeared on HackerNoon and was authored by Media Bias [Deeply Researched Academic Papers]


Print Share Comment Cite Upload Translate Updates
APA

Media Bias [Deeply Researched Academic Papers] | Sciencx (2024-08-05T22:00:20+00:00) Can BiasPainter Help Curb Bias in AI?. Retrieved from https://www.scien.cx/2024/08/05/can-biaspainter-help-curb-bias-in-ai/

MLA
" » Can BiasPainter Help Curb Bias in AI?." Media Bias [Deeply Researched Academic Papers] | Sciencx - Monday August 5, 2024, https://www.scien.cx/2024/08/05/can-biaspainter-help-curb-bias-in-ai/
HARVARD
Media Bias [Deeply Researched Academic Papers] | Sciencx Monday August 5, 2024 » Can BiasPainter Help Curb Bias in AI?., viewed ,<https://www.scien.cx/2024/08/05/can-biaspainter-help-curb-bias-in-ai/>
VANCOUVER
Media Bias [Deeply Researched Academic Papers] | Sciencx - » Can BiasPainter Help Curb Bias in AI?. [Internet]. [Accessed ]. Available from: https://www.scien.cx/2024/08/05/can-biaspainter-help-curb-bias-in-ai/
CHICAGO
" » Can BiasPainter Help Curb Bias in AI?." Media Bias [Deeply Researched Academic Papers] | Sciencx - Accessed . https://www.scien.cx/2024/08/05/can-biaspainter-help-curb-bias-in-ai/
IEEE
" » Can BiasPainter Help Curb Bias in AI?." Media Bias [Deeply Researched Academic Papers] | Sciencx [Online]. Available: https://www.scien.cx/2024/08/05/can-biaspainter-help-curb-bias-in-ai/. [Accessed: ]
rf:citation
» Can BiasPainter Help Curb Bias in AI? | Media Bias [Deeply Researched Academic Papers] | Sciencx | https://www.scien.cx/2024/08/05/can-biaspainter-help-curb-bias-in-ai/ |

Please log in to upload a file.




There are no updates yet.
Click the Upload button above to add an update.

You must be logged in to translate posts. Please log in or register.