On the Compositionality Prediction of Noun Phrases using Poincaré Embeddings

Abhik Jana, Dima Puzyrev, Alexander Panchenko, Pawan Goyal, Chris Biemann, Animesh Mukherjee


Abstract
The compositionality degree of multiword expressions indicates to what extent the meaning of a phrase can be derived from the meaning of its constituents and their grammatical relations. Prediction of (non)-compositionality is a task that has been frequently addressed with distributional semantic models. We introduce a novel technique to blend hierarchical information with distributional information for predicting compositionality. In particular, we use hypernymy information of the multiword and its constituents encoded in the form of the recently introduced Poincaré embeddings in addition to the distributional information to detect compositionality for noun phrases. Using a weighted average of the distributional similarity and a Poincaré similarity function, we obtain consistent and substantial, statistically significant improvement across three gold standard datasets over state-of-the-art models based on distributional information only. Unlike traditional approaches that solely use an unsupervised setting, we have also framed the problem as a supervised task, obtaining comparable improvements. Further, we publicly release our Poincaré embeddings, which are trained on the output of handcrafted lexical-syntactic patterns on a large corpus.
Anthology ID:
P19-1316
Volume:
Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics
Month:
July
Year:
2019
Address:
Florence, Italy
Editors:
Anna Korhonen, David Traum, Lluís Màrquez
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
3263–3274
Language:
URL:
https://aclanthology.org/P19-1316
DOI:
10.18653/v1/P19-1316
Bibkey:
Cite (ACL):
Abhik Jana, Dima Puzyrev, Alexander Panchenko, Pawan Goyal, Chris Biemann, and Animesh Mukherjee. 2019. On the Compositionality Prediction of Noun Phrases using Poincaré Embeddings. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pages 3263–3274, Florence, Italy. Association for Computational Linguistics.
Cite (Informal):
On the Compositionality Prediction of Noun Phrases using Poincaré Embeddings (Jana et al., ACL 2019)
Copy Citation:
PDF:
https://aclanthology.org/P19-1316.pdf
Data
ConceptNet