LaSTUS/TALN at Complex Word Identification (CWI) 2018 Shared Task

Ahmed AbuRa’ed, Horacio Saggion


Abstract
This paper presents the participation of the LaSTUS/TALN team in the Complex Word Identification (CWI) Shared Task 2018 in the English monolingual track . The purpose of the task was to determine if a word in a given sentence can be judged as complex or not by a certain target audience. For the English track, task organizers provided a training and a development datasets of 27,299 and 3,328 words respectively together with the sentence in which each word occurs. The words were judged as complex or not by 20 human evaluators; ten of whom are natives. We submitted two systems: one system modeled each word to evaluate as a numeric vector populated with a set of lexical, semantic and contextual features while the other system relies on a word embedding representation and a distance metric. We trained two separate classifiers to automatically decide if each word is complex or not. We submitted six runs, two for each of the three subsets of the English monolingual CWI track.
Anthology ID:
W18-0517
Volume:
Proceedings of the Thirteenth Workshop on Innovative Use of NLP for Building Educational Applications
Month:
June
Year:
2018
Address:
New Orleans, Louisiana
Editors:
Joel Tetreault, Jill Burstein, Ekaterina Kochmar, Claudia Leacock, Helen Yannakoudakis
Venue:
BEA
SIG:
SIGEDU
Publisher:
Association for Computational Linguistics
Note:
Pages:
159–165
Language:
URL:
https://aclanthology.org/W18-0517
DOI:
10.18653/v1/W18-0517
Bibkey:
Cite (ACL):
Ahmed AbuRa’ed and Horacio Saggion. 2018. LaSTUS/TALN at Complex Word Identification (CWI) 2018 Shared Task. In Proceedings of the Thirteenth Workshop on Innovative Use of NLP for Building Educational Applications, pages 159–165, New Orleans, Louisiana. Association for Computational Linguistics.
Cite (Informal):
LaSTUS/TALN at Complex Word Identification (CWI) 2018 Shared Task (AbuRa’ed & Saggion, BEA 2018)
Copy Citation:
PDF:
https://aclanthology.org/W18-0517.pdf