Tagging a Norwegian Dialect Corpus

Andre Kåsen, Anders Nøklestad, Kristin Hagen, Joel Priestley


Abstract
This paper describes an evaluation of five data-driven part-of-speech (PoS) taggers for spoken Norwegian. The taggers all rely on different machine learning mechanisms: decision trees, hidden Markov models (HMMs), conditional random fields (CRFs), long-short term memory networks (LSTMs), and convolutional neural networks (CNNs). We go into some of the challenges posed by the task of tagging spoken, as opposed to written, language, and in particular a wide range of dialects as is found in the recordings of the LIA (Language Infrastructure made Accessible) project. The results show that the taggers based on either conditional random fields or neural networks perform much better than the rest, with the LSTM tagger getting the highest score.
Anthology ID:
W19-6140
Volume:
Proceedings of the 22nd Nordic Conference on Computational Linguistics
Month:
September–October
Year:
2019
Address:
Turku, Finland
Editors:
Mareike Hartmann, Barbara Plank
Venue:
NoDaLiDa
SIG:
Publisher:
Linköping University Electronic Press
Note:
Pages:
350–355
Language:
URL:
https://aclanthology.org/W19-6140
DOI:
Bibkey:
Cite (ACL):
Andre Kåsen, Anders Nøklestad, Kristin Hagen, and Joel Priestley. 2019. Tagging a Norwegian Dialect Corpus. In Proceedings of the 22nd Nordic Conference on Computational Linguistics, pages 350–355, Turku, Finland. Linköping University Electronic Press.
Cite (Informal):
Tagging a Norwegian Dialect Corpus (Kåsen et al., NoDaLiDa 2019)
Copy Citation:
PDF:
https://aclanthology.org/W19-6140.pdf