Difference between revisions of "WordSimilarity-353 Test Collection (State of the art)"

From ACL Wiki
Jump to navigation Jump to search
Line 30: Line 30:
 
| Collobert and Weston (2008)
 
| Collobert and Weston (2008)
 
| Corpus-based
 
| Corpus-based
| 0.498
+
| 0.50
 
|-
 
|-
 
| simVB+simWN
 
| simVB+simWN
Line 45: Line 45:
 
| Huang et al. (2012)
 
| Huang et al. (2012)
 
| Corpus-based
 
| Corpus-based
| 0.713
+
| 0.71
 
|-
 
|-
 
| ESA-Wikipedia
 
| ESA-Wikipedia
Line 55: Line 55:
 
| Radinsky et al. (2011)
 
| Radinsky et al. (2011)
 
| Hybrid
 
| Hybrid
| 0.800
+
| 0.80
 
|-
 
|-
 
| CLEAR
 
| CLEAR
 
| Halawi et al. (2012)
 
| Halawi et al. (2012)
 
| Corpus-based
 
| Corpus-based
| 0.810
+
| 0.81
 
|}
 
|}
  

Revision as of 13:49, 4 December 2013


Table of results

Algorithm Reference Type Spearman's rho
WikiRelate Strube and Ponzetto (2006) Wikipedia 0.48
C&W Collobert and Weston (2008) Corpus-based 0.50
simVB+simWN Finkelstein et al. (2002) Hybrid 0.55
HSMN+csmRNN Luong et al. (2013) Corpus-based 0.65
multi-prototype Huang et al. (2012) Corpus-based 0.71
ESA-Wikipedia Gabrilovich and Markovitch (2007) Hybrid 0.75
TSA Radinsky et al. (2011) Hybrid 0.80
CLEAR Halawi et al. (2012) Corpus-based 0.81

References

Finkelstein, Lev, Evgeniy Gabrilovich, Yossi Matias, Ehud Rivlin, Zach Solan, Gadi Wolfman, and Eytan Ruppin. (2002) Placing Search in Context: The Concept Revisited. ACM Transactions on Information Systems, 20(1):116-131.

Gabrilovich, Evgeniy, and Shaul Markovitch. (2007). Computing Semantic Relatedness Using Wikipedia-based Explicit Semantic Analysis. In IJCAI, vol. 7, pp. 1606-1611.

Halawi, Guy, Gideon Dror, Evgeniy Gabrilovich, and Yehuda Koren. (2012). Large-scale learning of word relatedness with constraints. In Proceedings of the 18th ACM SIGKDD international conference on Knowledge discovery and data mining, pp. 1406-1414. ACM, 2012.

Luong, Minh-Thang, Richard Socher, and Christopher D. Manning. (2013). Better word representations with recursive neural networks for morphology. CoNLL-2013: 104.

Strube, Michael and Simone Paolo Ponzetto. (2006). WikiRelate! Computing Semantic Relatedness Using Wikipedia. Proceedings of The 21st National Conference on Artificial Intelligence (AAAI), Boston, MA.