SemEval 2018 Task 4: Character Identification on Multiparty Dialogues

Jinho D. Choi, Henry Y. Chen


Abstract
Character identification is a task of entity linking that finds the global entity of each personal mention in multiparty dialogue. For this task, the first two seasons of the popular TV show Friends are annotated, comprising a total of 448 dialogues, 15,709 mentions, and 401 entities. The personal mentions are detected from nominals referring to certain characters in the show, and the entities are collected from the list of all characters in those two seasons of the show. This task is challenging because it requires the identification of characters that are mentioned but may not be active during the conversation. Among 90+ participants, four of them submitted their system outputs and showed strengths in different aspects about the task. Thorough analyses of the distributed datasets, system outputs, and comparative studies are also provided. To facilitate the momentum, we create an open-source project for this task and publicly release a larger and cleaner dataset, hoping to support researchers for more enhanced modeling.
Anthology ID:
S18-1007
Volume:
Proceedings of the 12th International Workshop on Semantic Evaluation
Month:
June
Year:
2018
Address:
New Orleans, Louisiana
Editors:
Marianna Apidianaki, Saif M. Mohammad, Jonathan May, Ekaterina Shutova, Steven Bethard, Marine Carpuat
Venue:
SemEval
SIG:
SIGLEX
Publisher:
Association for Computational Linguistics
Note:
Pages:
57–64
Language:
URL:
https://aclanthology.org/S18-1007
DOI:
10.18653/v1/S18-1007
Bibkey:
Cite (ACL):
Jinho D. Choi and Henry Y. Chen. 2018. SemEval 2018 Task 4: Character Identification on Multiparty Dialogues. In Proceedings of the 12th International Workshop on Semantic Evaluation, pages 57–64, New Orleans, Louisiana. Association for Computational Linguistics.
Cite (Informal):
SemEval 2018 Task 4: Character Identification on Multiparty Dialogues (Choi & Chen, SemEval 2018)
Copy Citation:
PDF:
https://aclanthology.org/S18-1007.pdf