Difference between revisions of "Competitions and Challenges"

From ACL Wiki
Jump to: navigation, search
m (Reverted edits by Creek (talk) to last revision by Ioan)
 
(44 intermediate revisions by 12 users not shown)
Line 1: Line 1:
The competitions and challenges below are categorized by their '''closing dates'''.
+
The competitions and challenges below are categorized by year. In cases in where an event begins in one year and ends in a later year,
 +
it is placed under the year in which it was or will be completed.
 +
 
 +
 
 +
== 2012 ==
 +
<!-- Please keep this list in alphabetical order -->
 +
* [[SemEval 3]] - in planning, with tentative schedule
 +
 
 +
== 2011 ==
 +
* [http://clef2011.org/ CLEF 2011]
 +
 
 +
== 2010 ==
 +
<!-- Please keep this list in alphabetical order -->
 +
* [http://semeval2.fbk.eu/semeval2.php SemEval 2010]
 +
* [http://nlp.uned.es/weps/weps-3/ WePS 3: searching information about entities in the Web]
 +
 
 +
== 2009 ==
 +
<!-- Please keep this list in alphabetical order -->
 +
* [http://evalita.itc.it/ EVALITA 2009] - Evaluation of NLP Tools for Italian
 +
* [http://www.nist.gov/tac/2009/ TAC 2009] Text Analysis Conference
 +
* [http://nlp.uned.es/weps/weps-2/ WePS 2: Second Web People Search Evaluation Workshop]
 +
 
 +
== 2008 ==
 +
<!-- Please keep this list in alphabetical order -->
 +
* [http://www.itl.nist.gov./iad/894.01/tests/ace/2008/ ACE 2008] - Automatic Content Extraction (task: entity/relation detection and recognition)
 +
* [http://clef.isti.cnr.it/2008.html CLEF 2008] - Cross Language Evaluation Forum
 +
* [http://ltrc.iiit.ac.in/ner-ssea-08 NER-SSEAL 2008] - IJCNLP Workshop on NER for South and South East Asian Languages
 +
* [http://www.nist.gov/tac/tracks/2008/ TAC 2008] - Text Analysis Conference
  
 
== 2007 ==
 
== 2007 ==
 
<!-- Please keep this list in alphabetical order -->
 
<!-- Please keep this list in alphabetical order -->
  
* [http://www.nist.gov/speech/tests/ace/ace07/index.htm ACE 2007] - Automatic Content Extraction 2007
+
* [http://www.nist.gov/speech/tests/ace/ace07/ ACE 2007] - Automatic Content Extraction 2007
 +
* [http://cleaneval.sigwac.org.uk/ CLEANEVAL 2007] - Cleaning pages for Web corpus creation
 +
* [http://www.clef-campaign.org/ CLEF 2007] - Cross Language Evaluation Forum
 +
* [http://duc.nist.gov/duc2007/call.html DUC-2007] - Document Understanding Conference (task: [[Text Summarization]])
 +
* [http://evalita.itc.it/ EVALITA 2007] - Evaluation of NLP Tools for Italian
 +
* [http://www.computationalmedicine.org/challenge/index.php Medical NLP Challenge] - The Computational Medicine Center's 2007 Medical Natural Language Processing Challenge
 
* [http://www.cis.hut.fi/morphochallenge2007/ Morpho Challenge 2007] - unsupervised segmentation of words into morphemes
 
* [http://www.cis.hut.fi/morphochallenge2007/ Morpho Challenge 2007] - unsupervised segmentation of words into morphemes
* [http://www.pascal-network.org/Challenges/RTE3 RTE3] - Third Recognising Textual Entailment Challenge, 1 December 2006 to 1 June 2007
+
* [http://www.pascal-network.org/Challenges/RTE3 RTE-3] - Third Recognising Textual Entailment Challenge ([[Recognizing Textual Entailment|RTE-3 Resources Pool]])
* [[Recognizing Textual Entailment|RTE3 Resources Pool]] - shared resources for Recognising Textual Entailment Challenges
+
 
* [http://nlp.cs.swarthmore.edu/semeval/index.shtml SemEval-2007] - 4th International Workshop on Semantic Evaluations
 
* [http://nlp.cs.swarthmore.edu/semeval/index.shtml SemEval-2007] - 4th International Workshop on Semantic Evaluations
 +
* [http://www.cs.utk.edu/tmw07/ SIAM Text Mining Competition] - document classification
 +
* [http://challenge.spock.com Spock Challenge] - (task: name discrimination/disambiguation in Web text)
 +
* [http://trec.nist.gov/ TREC 2007] Text REtrieval Conference
  
 
== 2006 ==  
 
== 2006 ==  
 
<!-- Please keep this list in alphabetical order -->
 
<!-- Please keep this list in alphabetical order -->
  
* [http://www.pascal-network.org/Challenges/RTE2/ RTE2] - Second Recognising Textual Entailment Challenge, 1 October 2005 to 10 April 2006
+
* [http://www.clef-campaign.org/ CLEF 2006] - Cross Language Evaluation Forum
 +
* [http://duc.nist.gov/duc2006/call.html DUC-2006] - Document Understanding Conference (task: [[Text Summarization]])
 +
* [http://www.pascal-network.org/Challenges/RTE2/ RTE-2] - Second Recognising Textual Entailment Challenge
 +
* [http://trec.nist.gov/ TREC 2006] Text REtrieval Conference
  
 
== 2005 ==
 
== 2005 ==
 
<!-- Please keep this list in alphabetical order -->
 
<!-- Please keep this list in alphabetical order -->
  
 +
* [http://www.itl.nist.gov./iad/894.01/tests/ace/2005/ ACE 2005] - Automatic Content Extraction
 +
* [http://www.clef-campaign.org/ CLEF 2005] - Cross Language Evaluation Forum
 +
* [http://duc.nist.gov/duc2005/call.html DUC-2005] - Document Understanding Conference (task: [[Text Summarization]])
 
* [http://www.cis.hut.fi/morphochallenge2005/ Morpho Challenge 2005] - unsupervised segmentation of words into morphemes
 
* [http://www.cis.hut.fi/morphochallenge2005/ Morpho Challenge 2005] - unsupervised segmentation of words into morphemes
* [http://www.pascal-network.org/Challenges/RTE/ RTE1] - Recognising Textual Entailment Challenge, 1 June 2004 to 10 April 2005
+
* [http://www.pascal-network.org/Challenges/RTE/ RTE-1] - Recognising Textual Entailment Challenge
 +
* [http://trec.nist.gov/ TREC 2005] Text REtrieval Conference
  
 
== 2004 ==
 
== 2004 ==
 
<!-- Please keep this list in alphabetical order -->
 
<!-- Please keep this list in alphabetical order -->
  
* [http://www.senseval.org/ Senseval 3] - evaluation exercises for Word Sense Disambiguation
+
* [http://www.itl.nist.gov./iad/894.01/tests/ace/2004/ ACE 2004] - Automatic Content Extraction
 +
* [http://www.clef-campaign.org/ CLEF 2004] - Cross Language Evaluation Forum
 +
* [http://duc.nist.gov/duc2004/call.html DUC-2004] - Document Understanding Conference (task: [[Text Summarization]])
 +
* [http://www.senseval.org/ Senseval 3] - evaluation exercises for [[Word Sense Disambiguation]]
 +
* [http://trec.nist.gov/ TREC 2004] Text REtrieval Conference
 +
 
 +
== 2003 ==
 +
<!-- Please keep this list in alphabetical order -->
 +
* [http://www.itl.nist.gov./iad/894.01/tests/ace/2003/ ACE 2003] - Automatic Content Extraction
 +
* [http://duc.nist.gov/duc2003/call.html DUC-2003] - Document Understanding Conference (task: [[Text Summarization]])
 +
 
 +
== 2002 ==
 +
<!-- Please keep this list in alphabetical order -->
 +
* [http://duc.nist.gov/duc2002/call.html DUC-2002] - Document Understanding Conference (task: [[Text Summarization]])

Latest revision as of 04:14, 25 June 2012

The competitions and challenges below are categorized by year. In cases in where an event begins in one year and ends in a later year, it is placed under the year in which it was or will be completed.


2012

  • SemEval 3 - in planning, with tentative schedule

2011

2010

2009

2008

  • ACE 2008 - Automatic Content Extraction (task: entity/relation detection and recognition)
  • CLEF 2008 - Cross Language Evaluation Forum
  • NER-SSEAL 2008 - IJCNLP Workshop on NER for South and South East Asian Languages
  • TAC 2008 - Text Analysis Conference

2007

2006

2005

2004

2003

2002