Difference between revisions of "WordSimilarity-353 Test Collection (State of the art)"

From ACL Wiki
Jump to: navigation, search
(Created page with " WordSimilarity-353 Test Collection http://www.cs.technion.ac.il/~gabr/resources/data/wordsim353/ 0.75 Spearman rank correlation http://www.cs.technion.ac.il/~gabr/papers/ijc...")
 
Line 1: Line 1:
  
WordSimilarity-353 Test Collection
+
* [http://www.cs.technion.ac.il/~gabr/resources/data/wordsim353/ WordSimilarity-353 Test Collection]
http://www.cs.technion.ac.il/~gabr/resources/data/wordsim353/
+
* contains two sets of English word pairs along with human-assigned similarity judgements
 +
* first set (set1) contains 153 word pairs along with their similarity scores assigned by 13 subjects
 +
* second set (set2) contains 200 word pairs with similarity assessed by 16 subjects
 +
* WordSimilarity-353 dataset is available [http://www.cs.technion.ac.il/~gabr/resources/data/wordsim353/ here]
 +
* performance is measured by [http://en.wikipedia.org/wiki/Spearman_rank_correlation Spearman's rank correlation coefficient]
 +
* introduced by [http://www.cs.technion.ac.il/~gabr/papers/tois_context.pdf Finkelstein et al. (2002)]
 +
* subsequently used by many other researchers
 +
 
 +
 
 +
 
  
 
0.75 Spearman rank correlation
 
0.75 Spearman rank correlation

Revision as of 11:22, 3 October 2013



0.75 Spearman rank correlation http://www.cs.technion.ac.il/~gabr/papers/ijcai-2007-sim.pdf

0.65 Spearman rank correlation http://nlp.stanford.edu/~lmthang/data/papers/conll13_morpho.pdf