Noun-Modifier Questions (State of the art)

From ACL Wiki
Revision as of 06:06, 28 April 2014 by Pdturney (talk | contribs) (Created page with "* [http://jair.org/media/3640/live-3640-6413-jair.txt multiple-choice noun-modifier questions] * 2,180 seven-choice questions for evaluating noun-modifier composition models *...")
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to navigation Jump to search
The printable version is no longer supported and may have rendering errors. Please update your browser bookmarks and please use the default browser print function instead.
  • multiple-choice noun-modifier questions
  • 2,180 seven-choice questions for evaluating noun-modifier composition models
  • questions derived from WordNet
  • split into 680 questions for training (e.g., development, parameter tuning) and 1,500 questions for testing
  • introduced in Turney (2012)

Sample question

Stem: coin collector
Choices: (a) numismatist
(b) coin
(c) collector
(d) coinage
(e) aggregator
(f) reflectiveness
(g) plasma
Solution: (a) numismatist

Table of results

References

Turney, P.D. (2012). Domain and function: A dual-space model of semantic relations and compositions, Journal of Artificial Intelligence Research (JAIR), 44, 533-585.

Turney, P.D. (2013), Distributional semantics beyond words: Supervised learning of analogy and paraphrase, Transactions of the Association for Computational Linguistics (TACL), 1, 353-366.