Difference between revisions of "WordSimilarity-353 Test Collection (State of the art)"
Jump to navigation
Jump to search
(Created page with " WordSimilarity-353 Test Collection http://www.cs.technion.ac.il/~gabr/resources/data/wordsim353/ 0.75 Spearman rank correlation http://www.cs.technion.ac.il/~gabr/papers/ijc...") |
|||
| Line 1: | Line 1: | ||
| − | WordSimilarity-353 Test Collection | + | * [http://www.cs.technion.ac.il/~gabr/resources/data/wordsim353/ WordSimilarity-353 Test Collection] |
| − | http://www.cs.technion.ac.il/~gabr/resources/data/wordsim353/ | + | * contains two sets of English word pairs along with human-assigned similarity judgements |
| + | * first set (set1) contains 153 word pairs along with their similarity scores assigned by 13 subjects | ||
| + | * second set (set2) contains 200 word pairs with similarity assessed by 16 subjects | ||
| + | * WordSimilarity-353 dataset is available [http://www.cs.technion.ac.il/~gabr/resources/data/wordsim353/ here] | ||
| + | * performance is measured by [http://en.wikipedia.org/wiki/Spearman_rank_correlation Spearman's rank correlation coefficient] | ||
| + | * introduced by [http://www.cs.technion.ac.il/~gabr/papers/tois_context.pdf Finkelstein et al. (2002)] | ||
| + | * subsequently used by many other researchers | ||
| + | |||
| + | |||
| + | |||
0.75 Spearman rank correlation | 0.75 Spearman rank correlation | ||
Revision as of 12:22, 3 October 2013
- WordSimilarity-353 Test Collection
- contains two sets of English word pairs along with human-assigned similarity judgements
- first set (set1) contains 153 word pairs along with their similarity scores assigned by 13 subjects
- second set (set2) contains 200 word pairs with similarity assessed by 16 subjects
- WordSimilarity-353 dataset is available here
- performance is measured by Spearman's rank correlation coefficient
- introduced by Finkelstein et al. (2002)
- subsequently used by many other researchers
0.75 Spearman rank correlation
http://www.cs.technion.ac.il/~gabr/papers/ijcai-2007-sim.pdf
0.65 Spearman rank correlation http://nlp.stanford.edu/~lmthang/data/papers/conll13_morpho.pdf