Competitions and Challenges

The competitions and challenges below are categorized by year. In cases in where an event begins in one year and ends in a later year, it is placed under the year in which it was or will be completed.

2012

• SemEval 3 (in planning, with tentative schedule)

2010

• SemEval 2010
• WePS 3: searching information about entities in the Web

2009

• EVALITA 2009 - Evaluation of NLP Tools for Italian
• TAC 2009 Text Analysis Conference
• WePS 2: Second Web People Search Evaluation Workshop

2008

• ACE 2008 - Automatic Content Extraction (task: entity/relation detection and recognition)
• CLEF 2008 - Cross Language Evaluation Forum
• NER-SSEAL 2008 - IJCNLP Workshop on NER for South and South East Asian Languages
• TAC 2008 - Text Analysis Conference

2007

• ACE 2007 - Automatic Content Extraction 2007
• CLEANEVAL 2007 - Cleaning pages for Web corpus creation
• CLEF 2007 - Cross Language Evaluation Forum
• DUC-2007 - Document Understanding Conference (task: Text Summarization)
• EVALITA 2007 - Evaluation of NLP Tools for Italian
• Medical NLP Challenge - The Computational Medicine Center's 2007 Medical Natural Language Processing Challenge
• Morpho Challenge 2007 - unsupervised segmentation of words into morphemes
• RTE-3 - Third Recognising Textual Entailment Challenge (RTE-3 Resources Pool)
• SemEval-2007 - 4th International Workshop on Semantic Evaluations
• SIAM Text Mining Competition - document classification
• Spock Challenge - (task: name discrimination/disambiguation in Web text)
• TREC 2007 Text REtrieval Conference

2006

• CLEF 2006 - Cross Language Evaluation Forum
• DUC-2006 - Document Understanding Conference (task: Text Summarization)
• RTE-2 - Second Recognising Textual Entailment Challenge
• TREC 2006 Text REtrieval Conference

2005

• ACE 2005 - Automatic Content Extraction
• CLEF 2005 - Cross Language Evaluation Forum
• DUC-2005 - Document Understanding Conference (task: Text Summarization)
• Morpho Challenge 2005 - unsupervised segmentation of words into morphemes
• RTE-1 - Recognising Textual Entailment Challenge
• TREC 2005 Text REtrieval Conference

2004

• ACE 2004 - Automatic Content Extraction
• CLEF 2004 - Cross Language Evaluation Forum
• DUC-2004 - Document Understanding Conference (task: Text Summarization)
• Senseval 3 - evaluation exercises for Word Sense Disambiguation
• TREC 2004 Text REtrieval Conference

2003

• ACE 2003 - Automatic Content Extraction
• DUC-2003 - Document Understanding Conference (task: Text Summarization)

2002

• DUC-2002 - Document Understanding Conference (task: Text Summarization)