Detecting Context Dependent Messages in a Conversational Environment

Chaozhuo Li, Yu Wu, Wei Wu, Chen Xing, Zhoujun Li, Ming Zhou


Abstract
While automatic response generation for building chatbot systems has drawn a lot of attention recently, there is limited understanding on when we need to consider the linguistic context of an input text in the generation process. The task is challenging, as messages in a conversational environment are short and informal, and evidence that can indicate a message is context dependent is scarce. After a study of social conversation data crawled from the web, we observed that some characteristics estimated from the responses of messages are discriminative for identifying context dependent messages. With the characteristics as weak supervision, we propose using a Long Short Term Memory (LSTM) network to learn a classifier. Our method carries out text representation and classifier learning in a unified framework. Experimental results show that the proposed method can significantly outperform baseline methods on accuracy of classification.
Anthology ID:
C16-1187
Volume:
Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers
Month:
December
Year:
2016
Address:
Osaka, Japan
Editors:
Yuji Matsumoto, Rashmi Prasad
Venue:
COLING
SIG:
Publisher:
The COLING 2016 Organizing Committee
Note:
Pages:
1990–1999
Language:
URL:
https://aclanthology.org/C16-1187
DOI:
Bibkey:
Cite (ACL):
Chaozhuo Li, Yu Wu, Wei Wu, Chen Xing, Zhoujun Li, and Ming Zhou. 2016. Detecting Context Dependent Messages in a Conversational Environment. In Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers, pages 1990–1999, Osaka, Japan. The COLING 2016 Organizing Committee.
Cite (Informal):
Detecting Context Dependent Messages in a Conversational Environment (Li et al., COLING 2016)
Copy Citation:
PDF:
https://aclanthology.org/C16-1187.pdf