Neural Compositional Denotational Semantics for Question Answering

Nitish Gupta, Mike Lewis


Abstract
Answering compositional questions requiring multi-step reasoning is challenging. We introduce an end-to-end differentiable model for interpreting questions about a knowledge graph (KG), which is inspired by formal approaches to semantics. Each span of text is represented by a denotation in a KG and a vector that captures ungrounded aspects of meaning. Learned composition modules recursively combine constituent spans, culminating in a grounding for the complete sentence which answers the question. For example, to interpret “not green”, the model represents “green” as a set of KG entities and “not” as a trainable ungrounded vector—and then uses this vector to parameterize a composition function that performs a complement operation. For each sentence, we build a parse chart subsuming all possible parses, allowing the model to jointly learn both the composition operators and output structure by gradient descent from end-task supervision. The model learns a variety of challenging semantic operators, such as quantifiers, disjunctions and composed relations, and infers latent syntactic structure. It also generalizes well to longer questions than seen in its training data, in contrast to RNN, its tree-based variants, and semantic parsing baselines.
Anthology ID:
D18-1239
Volume:
Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing
Month:
October-November
Year:
2018
Address:
Brussels, Belgium
Editors:
Ellen Riloff, David Chiang, Julia Hockenmaier, Jun’ichi Tsujii
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
2152–2161
Language:
URL:
https://aclanthology.org/D18-1239
DOI:
10.18653/v1/D18-1239
Bibkey:
Cite (ACL):
Nitish Gupta and Mike Lewis. 2018. Neural Compositional Denotational Semantics for Question Answering. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pages 2152–2161, Brussels, Belgium. Association for Computational Linguistics.
Cite (Informal):
Neural Compositional Denotational Semantics for Question Answering (Gupta & Lewis, EMNLP 2018)
Copy Citation:
PDF:
https://aclanthology.org/D18-1239.pdf
Attachment:
 D18-1239.Attachment.pdf