From Paraphrase Database to Compositional Paraphrase Model and Back

John Wieting, Mohit Bansal, Kevin Gimpel, Karen Livescu


Abstract
The Paraphrase Database (PPDB; Ganitkevitch et al., 2013) is an extensive semantic resource, consisting of a list of phrase pairs with (heuristic) confidence estimates. However, it is still unclear how it can best be used, due to the heuristic nature of the confidences and its necessarily incomplete coverage. We propose models to leverage the phrase pairs from the PPDB to build parametric paraphrase models that score paraphrase pairs more accurately than the PPDB’s internal scores while simultaneously improving its coverage. They allow for learning phrase embeddings as well as improved word embeddings. Moreover, we introduce two new, manually annotated datasets to evaluate short-phrase paraphrasing models. Using our paraphrase model trained using PPDB, we achieve state-of-the-art results on standard word and bigram similarity tasks and beat strong baselines on our new short phrase paraphrase tasks.
Anthology ID:
Q15-1025
Original:
Q15-1025v1
Version 2:
Q15-1025v2
Erratum e1:
Q15-1025e1
Volume:
Transactions of the Association for Computational Linguistics, Volume 3
Month:
Year:
2015
Address:
Cambridge, MA
Editors:
Michael Collins, Lillian Lee
Venue:
TACL
SIG:
Publisher:
MIT Press
Note:
Pages:
345–358
Language:
URL:
https://aclanthology.org/Q15-1025
DOI:
10.1162/tacl_a_00143
Bibkey:
Cite (ACL):
John Wieting, Mohit Bansal, Kevin Gimpel, and Karen Livescu. 2015. From Paraphrase Database to Compositional Paraphrase Model and Back. Transactions of the Association for Computational Linguistics, 3:345–358.
Cite (Informal):
From Paraphrase Database to Compositional Paraphrase Model and Back (Wieting et al., TACL 2015)
Copy Citation:
PDF:
https://aclanthology.org/Q15-1025.pdf
Video:
 https://aclanthology.org/Q15-1025.mp4