| Téléchargement | - Voir la version finale : Projective methods for mitigating gender bias in pre-trained language models (PDF, 430 Kio)
|
|---|
| Lien | https://aclanthology.org/2024.lrec-main.1146 |
|---|
| Auteur | Rechercher : Dawkins, Hillary1; Rechercher : Nejadgholi, Isar1; Rechercher : Gillis, Daniel; Rechercher : McCuaig, Judi |
|---|
| Affiliation | - Conseil national de recherches du Canada. Technologies numériques
|
|---|
| Format | Texte, Article |
|---|
| Conférence | 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024), May 20-25, 2024, Torino, Italia |
|---|
| Sujet | gender bias; bias mitigation; StereoSet |
|---|
| Résumé | Mitigation of gender bias in NLP has a long history tied to debiasing static word embeddings. More recently, attention has shifted to debiasing pre-trained language models. We study to what extent the simplest projective debiasing methods, developed for word embeddings, can help when applied to BERT’s internal representations. Projective methods are fast to implement, use a small number of saved parameters, and make no updates to the existing model parameters. We evaluate the efficacy of the methods in reducing both intrinsic bias, as measured by BERT’s next sentence prediction task, and in mitigating observed bias in a downstream setting when fine-tuned. To this end, we also provide a critical analysis of a popular gender-bias assessment test for quantifying intrinsic bias, resulting in an enhanced test set and new bias measures. We find that projective methods can be effective at both intrinsic bias and downstream bias mitigation, but that the two outcomes are not necessarily correlated. This finding serves as a warning that intrinsic bias test sets, based either on language modeling tasks or next sentence prediction, should not be the only benchmark in developing a debiased language model. |
|---|
| Date de publication | 2024-05 |
|---|
| Maison d’édition | ELRA Language Resource Association
International Committee on Computational Linguistics (ICCL) |
|---|
| Licence | |
|---|
| Dans | |
|---|
| Langue | anglais |
|---|
| Publications évaluées par des pairs | Oui |
|---|
| Exporter la notice | Exporter en format RIS |
|---|
| Signaler une correction | Signaler une correction (s'ouvre dans un nouvel onglet) |
|---|
| Identificateur de l’enregistrement | 321b8422-c559-4430-a185-e21e4de47f91 |
|---|
| Enregistrement créé | 2024-05-24 |
|---|
| Enregistrement modifié | 2024-05-27 |
|---|
