Efficient Large-Scale Neural Domain Classification with Personalized Attention

Young-Bum Kim, Dongchan Kim, Anjishnu Kumar, Ruhi Sarikaya


Abstract
In this paper, we explore the task of mapping spoken language utterances to one of thousands of natural language understanding domains in intelligent personal digital assistants (IPDAs). This scenario is observed in mainstream IPDAs in industry that allow third parties to develop thousands of new domains to augment built-in first party domains to rapidly increase domain coverage and overall IPDA capabilities. We propose a scalable neural model architecture with a shared encoder, a novel attention mechanism that incorporates personalization information and domain-specific classifiers that solves the problem efficiently. Our architecture is designed to efficiently accommodate incremental domain additions achieving two orders of magnitude speed up compared to full model retraining. We consider the practical constraints of real-time production systems, and design to minimize memory footprint and runtime latency. We demonstrate that incorporating personalization significantly improves domain classification accuracy in a setting with thousands of overlapping domains.
Anthology ID:
P18-1206
Volume:
Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
July
Year:
2018
Address:
Melbourne, Australia
Editors:
Iryna Gurevych, Yusuke Miyao
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
2214–2224
Language:
URL:
https://aclanthology.org/P18-1206
DOI:
10.18653/v1/P18-1206
Bibkey:
Cite (ACL):
Young-Bum Kim, Dongchan Kim, Anjishnu Kumar, and Ruhi Sarikaya. 2018. Efficient Large-Scale Neural Domain Classification with Personalized Attention. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 2214–2224, Melbourne, Australia. Association for Computational Linguistics.
Cite (Informal):
Efficient Large-Scale Neural Domain Classification with Personalized Attention (Kim et al., ACL 2018)
Copy Citation:
PDF:
https://aclanthology.org/P18-1206.pdf
Video:
 https://aclanthology.org/P18-1206.mp4