Difference between revisions of "Competitions and Challenges"

From ACL Wiki
Jump to navigation Jump to search
m (Reverted edits by Creek (talk) to last revision by Ioan)
 
(32 intermediate revisions by 11 users not shown)
Line 1: Line 1:
The competitions and challenges below are categorized by the '''year in which they were or will be completed''', in those cases in which they begin in one year and end in a later year.
+
The competitions and challenges below are categorized by year. In cases in where an event begins in one year and ends in a later year,
 +
it is placed under the year in which it was or will be completed.
 +
 
 +
 
 +
== 2012 ==
 +
<!-- Please keep this list in alphabetical order -->
 +
* [[SemEval 3]] - in planning, with tentative schedule
 +
 
 +
== 2011 ==
 +
* [http://clef2011.org/ CLEF 2011]
 +
 
 +
== 2010 ==
 +
<!-- Please keep this list in alphabetical order -->
 +
* [http://semeval2.fbk.eu/semeval2.php SemEval 2010]
 +
* [http://nlp.uned.es/weps/weps-3/ WePS 3: searching information about entities in the Web]
 +
 
 +
== 2009 ==
 +
<!-- Please keep this list in alphabetical order -->
 +
* [http://evalita.itc.it/ EVALITA 2009] - Evaluation of NLP Tools for Italian
 +
* [http://www.nist.gov/tac/2009/ TAC 2009] Text Analysis Conference
 +
* [http://nlp.uned.es/weps/weps-2/ WePS 2: Second Web People Search Evaluation Workshop]
 +
 
 +
== 2008 ==
 +
<!-- Please keep this list in alphabetical order -->
 +
* [http://www.itl.nist.gov./iad/894.01/tests/ace/2008/ ACE 2008] - Automatic Content Extraction (task: entity/relation detection and recognition)
 +
* [http://clef.isti.cnr.it/2008.html CLEF 2008] - Cross Language Evaluation Forum
 +
* [http://ltrc.iiit.ac.in/ner-ssea-08 NER-SSEAL 2008] - IJCNLP Workshop on NER for South and South East Asian Languages
 +
* [http://www.nist.gov/tac/tracks/2008/ TAC 2008] - Text Analysis Conference
  
 
== 2007 ==
 
== 2007 ==
 
<!-- Please keep this list in alphabetical order -->
 
<!-- Please keep this list in alphabetical order -->
  
* [http://www.nist.gov/speech/tests/ace/ace07/index.htm ACE 2007] - Automatic Content Extraction 2007
+
* [http://www.nist.gov/speech/tests/ace/ace07/ ACE 2007] - Automatic Content Extraction 2007
 +
* [http://cleaneval.sigwac.org.uk/ CLEANEVAL 2007] - Cleaning pages for Web corpus creation
 
* [http://www.clef-campaign.org/ CLEF 2007] - Cross Language Evaluation Forum
 
* [http://www.clef-campaign.org/ CLEF 2007] - Cross Language Evaluation Forum
* [http://duc.nist.gov/duc2007/call.html DUC-2007] - Document Undestanding Confernece (task: [[Text Summarization]])
+
* [http://duc.nist.gov/duc2007/call.html DUC-2007] - Document Understanding Conference (task: [[Text Summarization]])
 +
* [http://evalita.itc.it/ EVALITA 2007] - Evaluation of NLP Tools for Italian
 +
* [http://www.computationalmedicine.org/challenge/index.php Medical NLP Challenge] - The Computational Medicine Center's 2007 Medical Natural Language Processing Challenge
 
* [http://www.cis.hut.fi/morphochallenge2007/ Morpho Challenge 2007] - unsupervised segmentation of words into morphemes
 
* [http://www.cis.hut.fi/morphochallenge2007/ Morpho Challenge 2007] - unsupervised segmentation of words into morphemes
* [http://www.pascal-network.org/Challenges/RTE3 RTE-3] - Third Recognising Textual Entailment Challenge
+
* [http://www.pascal-network.org/Challenges/RTE3 RTE-3] - Third Recognising Textual Entailment Challenge ([[Recognizing Textual Entailment|RTE-3 Resources Pool]])
* [[Recognizing Textual Entailment|RTE-3 Resources Pool]] - shared resources for Recognising Textual Entailment Challenges
 
 
* [http://nlp.cs.swarthmore.edu/semeval/index.shtml SemEval-2007] - 4th International Workshop on Semantic Evaluations
 
* [http://nlp.cs.swarthmore.edu/semeval/index.shtml SemEval-2007] - 4th International Workshop on Semantic Evaluations
 +
* [http://www.cs.utk.edu/tmw07/ SIAM Text Mining Competition] - document classification
 +
* [http://challenge.spock.com Spock Challenge] - (task: name discrimination/disambiguation in Web text)
 
* [http://trec.nist.gov/ TREC 2007] Text REtrieval Conference
 
* [http://trec.nist.gov/ TREC 2007] Text REtrieval Conference
  
Line 17: Line 48:
  
 
* [http://www.clef-campaign.org/ CLEF 2006] - Cross Language Evaluation Forum
 
* [http://www.clef-campaign.org/ CLEF 2006] - Cross Language Evaluation Forum
* [http://duc.nist.gov/duc2006/call.html DUC-2006] - Document Undestanding Confernece (task: [[Text Summarization]])
+
* [http://duc.nist.gov/duc2006/call.html DUC-2006] - Document Understanding Conference (task: [[Text Summarization]])
 
* [http://www.pascal-network.org/Challenges/RTE2/ RTE-2] - Second Recognising Textual Entailment Challenge
 
* [http://www.pascal-network.org/Challenges/RTE2/ RTE-2] - Second Recognising Textual Entailment Challenge
 
* [http://trec.nist.gov/ TREC 2006] Text REtrieval Conference
 
* [http://trec.nist.gov/ TREC 2006] Text REtrieval Conference
Line 24: Line 55:
 
<!-- Please keep this list in alphabetical order -->
 
<!-- Please keep this list in alphabetical order -->
  
 +
* [http://www.itl.nist.gov./iad/894.01/tests/ace/2005/ ACE 2005] - Automatic Content Extraction
 
* [http://www.clef-campaign.org/ CLEF 2005] - Cross Language Evaluation Forum
 
* [http://www.clef-campaign.org/ CLEF 2005] - Cross Language Evaluation Forum
* [http://duc.nist.gov/duc2005/call.html DUC-2005] - Document Undestanding Confernece (task: [[Text Summarization]])
+
* [http://duc.nist.gov/duc2005/call.html DUC-2005] - Document Understanding Conference (task: [[Text Summarization]])
 
* [http://www.cis.hut.fi/morphochallenge2005/ Morpho Challenge 2005] - unsupervised segmentation of words into morphemes
 
* [http://www.cis.hut.fi/morphochallenge2005/ Morpho Challenge 2005] - unsupervised segmentation of words into morphemes
 
* [http://www.pascal-network.org/Challenges/RTE/ RTE-1] - Recognising Textual Entailment Challenge
 
* [http://www.pascal-network.org/Challenges/RTE/ RTE-1] - Recognising Textual Entailment Challenge
Line 33: Line 65:
 
<!-- Please keep this list in alphabetical order -->
 
<!-- Please keep this list in alphabetical order -->
  
 +
* [http://www.itl.nist.gov./iad/894.01/tests/ace/2004/ ACE 2004] - Automatic Content Extraction
 
* [http://www.clef-campaign.org/ CLEF 2004] - Cross Language Evaluation Forum
 
* [http://www.clef-campaign.org/ CLEF 2004] - Cross Language Evaluation Forum
* [http://duc.nist.gov/duc2004/call.html DUC-2004] - Document Undestanding Confernece (task: [[Text Summarization]])
+
* [http://duc.nist.gov/duc2004/call.html DUC-2004] - Document Understanding Conference (task: [[Text Summarization]])
 
* [http://www.senseval.org/ Senseval 3] - evaluation exercises for [[Word Sense Disambiguation]]
 
* [http://www.senseval.org/ Senseval 3] - evaluation exercises for [[Word Sense Disambiguation]]
 
* [http://trec.nist.gov/ TREC 2004] Text REtrieval Conference
 
* [http://trec.nist.gov/ TREC 2004] Text REtrieval Conference
 
  
 
== 2003 ==
 
== 2003 ==
 
<!-- Please keep this list in alphabetical order -->
 
<!-- Please keep this list in alphabetical order -->
* [http://duc.nist.gov/duc2003/call.html DUC-2003] - Document Undestanding Confernece (task: [[Text Summarization]])
+
* [http://www.itl.nist.gov./iad/894.01/tests/ace/2003/ ACE 2003] - Automatic Content Extraction
 +
* [http://duc.nist.gov/duc2003/call.html DUC-2003] - Document Understanding Conference (task: [[Text Summarization]])
  
 
== 2002 ==
 
== 2002 ==
 
<!-- Please keep this list in alphabetical order -->
 
<!-- Please keep this list in alphabetical order -->
* [http://duc.nist.gov/duc2002/call.html DUC-2002] - Document Undestanding Confernece (task: [[Text Summarization]])
+
* [http://duc.nist.gov/duc2002/call.html DUC-2002] - Document Understanding Conference (task: [[Text Summarization]])

Latest revision as of 05:14, 25 June 2012

The competitions and challenges below are categorized by year. In cases in where an event begins in one year and ends in a later year, it is placed under the year in which it was or will be completed.


2012

  • SemEval 3 - in planning, with tentative schedule

2011

2010

2009

2008

  • ACE 2008 - Automatic Content Extraction (task: entity/relation detection and recognition)
  • CLEF 2008 - Cross Language Evaluation Forum
  • NER-SSEAL 2008 - IJCNLP Workshop on NER for South and South East Asian Languages
  • TAC 2008 - Text Analysis Conference

2007

2006

2005

2004

2003

2002