Gender Bias in Coreference Resolution

Rachel Rudinger, Jason Naradowsky, Brian Leonard, Benjamin Van Durme


Abstract
We present an empirical study of gender bias in coreference resolution systems. We first introduce a novel, Winograd schema-style set of minimal pair sentences that differ only by pronoun gender. With these “Winogender schemas,” we evaluate and confirm systematic gender bias in three publicly-available coreference resolution systems, and correlate this bias with real-world and textual gender statistics.
Anthology ID:
N18-2002
Volume:
Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 2 (Short Papers)
Month:
June
Year:
2018
Address:
New Orleans, Louisiana
Editors:
Marilyn Walker, Heng Ji, Amanda Stent
Venue:
NAACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
8–14
Language:
URL:
https://aclanthology.org/N18-2002
DOI:
10.18653/v1/N18-2002
Bibkey:
Cite (ACL):
Rachel Rudinger, Jason Naradowsky, Brian Leonard, and Benjamin Van Durme. 2018. Gender Bias in Coreference Resolution. In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 2 (Short Papers), pages 8–14, New Orleans, Louisiana. Association for Computational Linguistics.
Cite (Informal):
Gender Bias in Coreference Resolution (Rudinger et al., NAACL 2018)
Copy Citation:
PDF:
https://aclanthology.org/N18-2002.pdf
Code
 rudinger/winogender-schemas +  additional community code
Data
Winogender SchemasWinoBias