SemEval-2012 Task 2 (State of the art)

From ACLWiki
(Difference between revisions)
Jump to: navigation, search
Line 17: Line 17:
 
! [http://en.wikipedia.org/wiki/Spearman%27s_rank_correlation_coefficient Spearman]
 
! [http://en.wikipedia.org/wiki/Spearman%27s_rank_correlation_coefficient Spearman]
 
|-
 
|-
| Random
+
| Random baseline
 
| Jurgens et al. (2012)
 
| Jurgens et al. (2012)
 
| 31.2
 
| 31.2
Line 42: Line 42:
 
| 0.050
 
| 0.050
 
|-
 
|-
| PMI
+
| PMI baseline
 
| Jurgens et al. (2012)
 
| Jurgens et al. (2012)
 
| 33.9
 
| 33.9

Revision as of 13:56, 16 October 2013


Table of results


Algorithm Reference MaxDiff Spearman
Random baseline Jurgens et al. (2012) 31.2 0.018
BUAP Tovar et al. (2012) 31.7 0.014
Duluth-V2 Pedersen (2012) 31.1 0.038
Duluth-V1 Pedersen (2012) 31.5 0.039
Duluth-V0 Pedersen (2012) 32.4 0.050
PMI baseline Jurgens et al. (2012) 33.9 0.112
UTD-SVM Rink & Harabagiu (2012) 34.7 0.116
UTD-NB Rink & Harabagiu (2012) 39.4 0.229
RNN-1600 Mikolov et al. (2013) 41.8 0.275
UTD-LDA Rink & Harabagiu (2013) ---- 0.334
Com Zhila et al. (2013) 45.2 0.353
SuperSim Turney (2013) 47.2 0.408


References

Isaac I. Bejar, Roger Chaffin, and Susan E. Embretson. (1991). Cognitive and Psychometric Analysis of Analogical Problem Solving. Springer-Verlag.

David A. Jurgens, Saif M. Mohammad, Peter D. Turney, and Keith J. Holyoak. (2012). SemEval-2012 Task 2: Measuring degrees of relational similarity. In Proceedings of the First Joint Conference on Lexical and Computational Semantics (*SEM), pages 356-364, Montreal, Canada.

Tomas Mikolov, Wen-tau Yih, and Geoffrey Zweig. (2013). Linguistic regularities in continuous space word representations. In Proceedings of the 2013 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL 2013), Atlanta, Georgia.

Ted Pedersen (2012), Duluth: Measuring Degrees of Relational Similarity with the Gloss Vector Measure of Semantic Relatedness, In Proceedings of the First Joint Conference on Lexical and Computational Semantics (*SEM), Montreal, Canada, pp. 497-501.

Bryan Rink and Sanda Harabagiu (2012), UTD: Determining Relational Similarity Using Lexical Patterns, In Proceedings of the First Joint Conference on Lexical and Computational Semantics (*SEM), Montreal, Canada, pp. 413-418.

Bryan Rink and Sanda Harabagiu. (2013). The impact of selectional preference agreement on semantic relational similarity. In Proceedings of the 10th International Conference on Computational Semantics (IWCS 2013), Potsdam, Germany.

Mireya Tovar, J. Alejandro Reyes, Azucena Montes, Darnes Vilariño, David Pinto, and Saul León (2012), BUAP: A First Approximation to Relational Similarity Measuring, In Proceedings of the First Joint Conference on Lexical and Computational Semantics (*SEM), Montreal, Canada, pp. 502-505.

Mireya Tovar, David Pinto, Azucena Montes, and Darnes Vilariño (2013). Determining the degree of semantic similarity using prototype vectors. Pattern Recognition, Volume 7914, 364-373.

Peter D. Turney. (2013), Distributional semantics beyond words: Supervised learning of analogy and paraphrase, In Transactions of the Association for Computational Linguistics (TACL), 1, 353-366.

Alisa Zhila, Wen-tau Yih, Christopher Meek, Geoffrey Zweig, and Tomas Mikolov. (2013). Combining heterogeneous models for measuring relational similarity. In Proceedings of the 2013 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL 2013), Atlanta, Georgia.

Personal tools