WMT24 test suite: gender resolution in speaker-listener dialogue roles

Download	View final version: WMT24 test suite: gender resolution in speaker-listener dialogue roles (PDF, 865 KiB)
Link	https://aclanthology.org/2024.wmt-1.25
Author	Search for: Dawkins, Hillary¹; Search for: Nejadgholi, Isar¹ORCID identifier: https://orcid.org/0000-0001-6241-6114; Search for: Lo, Chi-Kiu¹ORCID identifier: https://orcid.org/0000-0001-8714-7846
Affiliation	National Research Council Canada. Digital Technologies
Format	Text, Article
Conference	Ninth Conference on Machine Translation (WMT24), November 15-16, 2024, Miami, Florida, United States
Abstract	We assess the difficulty of gender resolution in literary-style dialogue settings and the influence of gender stereotypes. Instances of the test suite contain spoken dialogue interleaved with external meta-context about the characters and the manner of speaking. We find that character and manner stereotypes outside of the dialogue significantly impact the gender agreement of referents within the dialogue.
Publication date	2024-11
Publisher	Association for Computational Linguistics
Licence	Creative Commons Attribution 4.0 International (CC BY 4.0) https://creativecommons.org/licenses/by/4.0/
In	Proceedings of the Ninth Conference on Machine Translation (November 2024): 307–326.
Language	English
Peer reviewed	Yes
Export citation	Export as RIS
Report a correction	Report a correction (opens in a new tab)
Record identifier	4f965531-9d32-4cd4-9377-641ba408c9a0
Record created	2024-11-15
Record modified	2024-11-15