Incorporating Image Matching Into Knowledge Acquisition for Event-Oriented Relation Recognition

Yu Hong, Yang Xu, Huibin Ruan, Bowei Zou, Jianmin Yao, Guodong Zhou


Abstract
Event relation recognition is a challenging language processing task. It is required to determine the relation class of a pair of query events, such as causality, under the condition that there isn’t any reliable clue for use. We follow the traditional statistical approach in this paper, speculating the relation class of the target events based on the relation-class distributions on the similar events. There is minimal supervision used during the speculation process. In particular, we incorporate image processing into the acquisition of similar event instances, including the utilization of images for visually representing event scenes, and the use of the neural network based image matching for approximate calculation between events. We test our method on the ACE-R2 corpus and compared our model with the fully-supervised neural network models. Experimental results show that we achieve a comparable performance to CNN while slightly better than LSTM.
Anthology ID:
C18-1015
Volume:
Proceedings of the 27th International Conference on Computational Linguistics
Month:
August
Year:
2018
Address:
Santa Fe, New Mexico, USA
Editors:
Emily M. Bender, Leon Derczynski, Pierre Isabelle
Venue:
COLING
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
177–189
Language:
URL:
https://aclanthology.org/C18-1015
DOI:
Bibkey:
Cite (ACL):
Yu Hong, Yang Xu, Huibin Ruan, Bowei Zou, Jianmin Yao, and Guodong Zhou. 2018. Incorporating Image Matching Into Knowledge Acquisition for Event-Oriented Relation Recognition. In Proceedings of the 27th International Conference on Computational Linguistics, pages 177–189, Santa Fe, New Mexico, USA. Association for Computational Linguistics.
Cite (Informal):
Incorporating Image Matching Into Knowledge Acquisition for Event-Oriented Relation Recognition (Hong et al., COLING 2018)
Copy Citation:
PDF:
https://aclanthology.org/C18-1015.pdf