Difference between revisions of "Competitions and Challenges"

From ACL Wiki
Jump to: navigation, search
m (Reverted edits by Creek (talk) to last revision by Ioan)
 
(18 intermediate revisions by 6 users not shown)
Line 2: Line 2:
 
it is placed under the year in which it was or will be completed.
 
it is placed under the year in which it was or will be completed.
  
== 2008 ==
+
 
 +
== 2012 ==
 
<!-- Please keep this list in alphabetical order -->
 
<!-- Please keep this list in alphabetical order -->
 +
* [[SemEval 3]] - in planning, with tentative schedule
  
 +
== 2011 ==
 +
* [http://clef2011.org/ CLEF 2011]
 +
 +
== 2010 ==
 +
<!-- Please keep this list in alphabetical order -->
 +
* [http://semeval2.fbk.eu/semeval2.php SemEval 2010]
 +
* [http://nlp.uned.es/weps/weps-3/ WePS 3: searching information about entities in the Web]
 +
 +
== 2009 ==
 +
<!-- Please keep this list in alphabetical order -->
 +
* [http://evalita.itc.it/ EVALITA 2009] - Evaluation of NLP Tools for Italian
 +
* [http://www.nist.gov/tac/2009/ TAC 2009] Text Analysis Conference
 +
* [http://nlp.uned.es/weps/weps-2/ WePS 2: Second Web People Search Evaluation Workshop]
 +
 +
== 2008 ==
 +
<!-- Please keep this list in alphabetical order -->
 +
* [http://www.itl.nist.gov./iad/894.01/tests/ace/2008/ ACE 2008] - Automatic Content Extraction (task: entity/relation detection and recognition)
 
* [http://clef.isti.cnr.it/2008.html CLEF 2008] - Cross Language Evaluation Forum
 
* [http://clef.isti.cnr.it/2008.html CLEF 2008] - Cross Language Evaluation Forum
 
* [http://ltrc.iiit.ac.in/ner-ssea-08 NER-SSEAL 2008] - IJCNLP Workshop on NER for South and South East Asian Languages
 
* [http://ltrc.iiit.ac.in/ner-ssea-08 NER-SSEAL 2008] - IJCNLP Workshop on NER for South and South East Asian Languages
 +
* [http://www.nist.gov/tac/tracks/2008/ TAC 2008] - Text Analysis Conference
  
 
== 2007 ==
 
== 2007 ==
 
<!-- Please keep this list in alphabetical order -->
 
<!-- Please keep this list in alphabetical order -->
  
* [http://www.nist.gov/speech/tests/ace/ace07/index.htm ACE 2007] - Automatic Content Extraction 2007
+
* [http://www.nist.gov/speech/tests/ace/ace07/ ACE 2007] - Automatic Content Extraction 2007
 
* [http://cleaneval.sigwac.org.uk/ CLEANEVAL 2007] - Cleaning pages for Web corpus creation
 
* [http://cleaneval.sigwac.org.uk/ CLEANEVAL 2007] - Cleaning pages for Web corpus creation
 
* [http://www.clef-campaign.org/ CLEF 2007] - Cross Language Evaluation Forum
 
* [http://www.clef-campaign.org/ CLEF 2007] - Cross Language Evaluation Forum
Line 20: Line 40:
 
* [http://www.pascal-network.org/Challenges/RTE3 RTE-3] - Third Recognising Textual Entailment Challenge ([[Recognizing Textual Entailment|RTE-3 Resources Pool]])
 
* [http://www.pascal-network.org/Challenges/RTE3 RTE-3] - Third Recognising Textual Entailment Challenge ([[Recognizing Textual Entailment|RTE-3 Resources Pool]])
 
* [http://nlp.cs.swarthmore.edu/semeval/index.shtml SemEval-2007] - 4th International Workshop on Semantic Evaluations
 
* [http://nlp.cs.swarthmore.edu/semeval/index.shtml SemEval-2007] - 4th International Workshop on Semantic Evaluations
 +
* [http://www.cs.utk.edu/tmw07/ SIAM Text Mining Competition] - document classification
 
* [http://challenge.spock.com Spock Challenge] - (task: name discrimination/disambiguation in Web text)
 
* [http://challenge.spock.com Spock Challenge] - (task: name discrimination/disambiguation in Web text)
 
* [http://trec.nist.gov/ TREC 2007] Text REtrieval Conference
 
* [http://trec.nist.gov/ TREC 2007] Text REtrieval Conference
Line 34: Line 55:
 
<!-- Please keep this list in alphabetical order -->
 
<!-- Please keep this list in alphabetical order -->
  
 +
* [http://www.itl.nist.gov./iad/894.01/tests/ace/2005/ ACE 2005] - Automatic Content Extraction
 
* [http://www.clef-campaign.org/ CLEF 2005] - Cross Language Evaluation Forum
 
* [http://www.clef-campaign.org/ CLEF 2005] - Cross Language Evaluation Forum
 
* [http://duc.nist.gov/duc2005/call.html DUC-2005] - Document Understanding Conference (task: [[Text Summarization]])
 
* [http://duc.nist.gov/duc2005/call.html DUC-2005] - Document Understanding Conference (task: [[Text Summarization]])
Line 43: Line 65:
 
<!-- Please keep this list in alphabetical order -->
 
<!-- Please keep this list in alphabetical order -->
  
 +
* [http://www.itl.nist.gov./iad/894.01/tests/ace/2004/ ACE 2004] - Automatic Content Extraction
 
* [http://www.clef-campaign.org/ CLEF 2004] - Cross Language Evaluation Forum
 
* [http://www.clef-campaign.org/ CLEF 2004] - Cross Language Evaluation Forum
 
* [http://duc.nist.gov/duc2004/call.html DUC-2004] - Document Understanding Conference (task: [[Text Summarization]])
 
* [http://duc.nist.gov/duc2004/call.html DUC-2004] - Document Understanding Conference (task: [[Text Summarization]])
Line 50: Line 73:
 
== 2003 ==
 
== 2003 ==
 
<!-- Please keep this list in alphabetical order -->
 
<!-- Please keep this list in alphabetical order -->
 +
* [http://www.itl.nist.gov./iad/894.01/tests/ace/2003/ ACE 2003] - Automatic Content Extraction
 
* [http://duc.nist.gov/duc2003/call.html DUC-2003] - Document Understanding Conference (task: [[Text Summarization]])
 
* [http://duc.nist.gov/duc2003/call.html DUC-2003] - Document Understanding Conference (task: [[Text Summarization]])
  

Latest revision as of 05:14, 25 June 2012

The competitions and challenges below are categorized by year. In cases in where an event begins in one year and ends in a later year, it is placed under the year in which it was or will be completed.


2012

  • SemEval 3 - in planning, with tentative schedule

2011

2010

2009

2008

  • ACE 2008 - Automatic Content Extraction (task: entity/relation detection and recognition)
  • CLEF 2008 - Cross Language Evaluation Forum
  • NER-SSEAL 2008 - IJCNLP Workshop on NER for South and South East Asian Languages
  • TAC 2008 - Text Analysis Conference

2007

2006

2005

2004

2003

2002