Difference between revisions of "SemEval Portal"

From ACL Wiki
Jump to navigation Jump to search
Line 1: Line 1:
 
This page serves as a community portal for everything related to Semantic Evaluation.  
 
This page serves as a community portal for everything related to Semantic Evaluation.  
*[[Semantic Evaluation Exercises]]
+
 
*[[Upcoming and Past Events]]
+
==Semantic Evaluation Exercises==
  
 
The purpose of the [http://www.senseval.org SENSEVAL] and SemEval exercises is to evaluate semantic analysis systems. The first three evaluations, Senseval-1 through Senseval-3, were focused on word sense disambiguation, each time growing in the number of languages offered in the tasks and in the number of participating teams. Beginning with the 4th workshop, SemEval-2007, the nature of the tasks evolved to include semantic analysis tasks outside of word sense disambiguation. [http://www.clres.com/siglex.html SIGLEX] is the umbrella organization for the SemEval semantic evaluations and the SENSEVAL word-sense evaluation exercises. This portal will be used to provide a comprehensive view of the issues involved in semantic evaluations. Initially, the portal provides links to the current and past exercises.
 
The purpose of the [http://www.senseval.org SENSEVAL] and SemEval exercises is to evaluate semantic analysis systems. The first three evaluations, Senseval-1 through Senseval-3, were focused on word sense disambiguation, each time growing in the number of languages offered in the tasks and in the number of participating teams. Beginning with the 4th workshop, SemEval-2007, the nature of the tasks evolved to include semantic analysis tasks outside of word sense disambiguation. [http://www.clres.com/siglex.html SIGLEX] is the umbrella organization for the SemEval semantic evaluations and the SENSEVAL word-sense evaluation exercises. This portal will be used to provide a comprehensive view of the issues involved in semantic evaluations. Initially, the portal provides links to the current and past exercises.
Line 7: Line 7:
 
* [http://www.clres.com/siglex.html SIGLEX] is the umbrella organization for the SemEval semantic evaluations and the SENSEVAL word-sense evaluation exercises.
 
* [http://www.clres.com/siglex.html SIGLEX] is the umbrella organization for the SemEval semantic evaluations and the SENSEVAL word-sense evaluation exercises.
 
* [http://www.senseval.org/ SENSEVAL] is the home page for SENSEVAL 1-3
 
* [http://www.senseval.org/ SENSEVAL] is the home page for SENSEVAL 1-3
 
== Semantic Evaluation Exercises ==
 
  
 
The purpose of the [http://www.senseval.org SENSEVAL] and SemEval exercises is to evaluate semantic analysis systems. The first three evaluations, Senseval-1 through Senseval-3, were focused on word sense disambiguation, each time growing in the number of languages offered in the tasks and in the number of participating teams. Beginning with the 4th workshop, SemEval-2007, the nature of the tasks evolved to include semantic analysis tasks outside of word sense disambiguation.
 
The purpose of the [http://www.senseval.org SENSEVAL] and SemEval exercises is to evaluate semantic analysis systems. The first three evaluations, Senseval-1 through Senseval-3, were focused on word sense disambiguation, each time growing in the number of languages offered in the tasks and in the number of participating teams. Beginning with the 4th workshop, SemEval-2007, the nature of the tasks evolved to include semantic analysis tasks outside of word sense disambiguation.
  
== Upcoming and Past Events ==
+
==Upcoming and Past Events==
  
 
{| border="1" cellpadding="7" cellspacing="0"  
 
{| border="1" cellpadding="7" cellspacing="0"  
Line 54: Line 52:
  
  
== Issues in Semantic Evaluation ==
+
==Issues in Semantic Evaluation==
  
  
 
[[Category:SemEval Portal]]
 
[[Category:SemEval Portal]]

Revision as of 13:39, 11 October 2010

This page serves as a community portal for everything related to Semantic Evaluation.

Semantic Evaluation Exercises

The purpose of the SENSEVAL and SemEval exercises is to evaluate semantic analysis systems. The first three evaluations, Senseval-1 through Senseval-3, were focused on word sense disambiguation, each time growing in the number of languages offered in the tasks and in the number of participating teams. Beginning with the 4th workshop, SemEval-2007, the nature of the tasks evolved to include semantic analysis tasks outside of word sense disambiguation. SIGLEX is the umbrella organization for the SemEval semantic evaluations and the SENSEVAL word-sense evaluation exercises. This portal will be used to provide a comprehensive view of the issues involved in semantic evaluations. Initially, the portal provides links to the current and past exercises.

  • SIGLEX is the umbrella organization for the SemEval semantic evaluations and the SENSEVAL word-sense evaluation exercises.
  • SENSEVAL is the home page for SENSEVAL 1-3

The purpose of the SENSEVAL and SemEval exercises is to evaluate semantic analysis systems. The first three evaluations, Senseval-1 through Senseval-3, were focused on word sense disambiguation, each time growing in the number of languages offered in the tasks and in the number of participating teams. Beginning with the 4th workshop, SemEval-2007, the nature of the tasks evolved to include semantic analysis tasks outside of word sense disambiguation.

Upcoming and Past Events

Event Year Location Notes
SemEval 3 to be determined to be determined - discussion at SemEval 3 Group
SemEval 2 2010 Uppsala, Sweden - proceedings
SemEval 1 2007 Prague, Czech Republic - proceedings
- copy of website at Internet Archive
SENSEVAL 3 2004 Barcelona, Spain - proceedings
SENSEVAL 2 2001 Toulouse, France - main link provides links to results, data, system descriptions, task descriptions, and workshop program
- copy of website at Internet Archive
SENSEVAL 1 1998 East Sussex, UK - papers in Computers and the Humanities, subscribers or pay per view


Issues in Semantic Evaluation