How Document Pre-processing affects Keyphrase Extraction Performance

Florian Boudin, Hugo Mougard, Damien Cram


Abstract
The SemEval-2010 benchmark dataset has brought renewed attention to the task of automatic keyphrase extraction. This dataset is made up of scientific articles that were automatically converted from PDF format to plain text and thus require careful preprocessing so that irrevelant spans of text do not negatively affect keyphrase extraction performance. In previous work, a wide range of document preprocessing techniques were described but their impact on the overall performance of keyphrase extraction models is still unexplored. Here, we re-assess the performance of several keyphrase extraction models and measure their robustness against increasingly sophisticated levels of document preprocessing.
Anthology ID:
W16-3917
Volume:
Proceedings of the 2nd Workshop on Noisy User-generated Text (WNUT)
Month:
December
Year:
2016
Address:
Osaka, Japan
Editors:
Bo Han, Alan Ritter, Leon Derczynski, Wei Xu, Tim Baldwin
Venue:
WNUT
SIG:
Publisher:
The COLING 2016 Organizing Committee
Note:
Pages:
121–128
Language:
URL:
https://aclanthology.org/W16-3917
DOI:
Bibkey:
Cite (ACL):
Florian Boudin, Hugo Mougard, and Damien Cram. 2016. How Document Pre-processing affects Keyphrase Extraction Performance. In Proceedings of the 2nd Workshop on Noisy User-generated Text (WNUT), pages 121–128, Osaka, Japan. The COLING 2016 Organizing Committee.
Cite (Informal):
How Document Pre-processing affects Keyphrase Extraction Performance (Boudin et al., WNUT 2016)
Copy Citation:
PDF:
https://aclanthology.org/W16-3917.pdf
Code
 boudinfl/semeval-2010-pre