Difference between revisions of "Competitions and Challenges"
Jump to navigation
Jump to search
| (20 intermediate revisions by 6 users not shown) | |||
| Line 1: | Line 1: | ||
| − | The competitions and challenges below are categorized by the | + | The competitions and challenges below are categorized by year. In cases in where an event begins in one year and ends in a later year, |
| + | it is placed under the year in which it was or will be completed. | ||
| + | |||
| + | |||
| + | == 2012 == | ||
| + | <!-- Please keep this list in alphabetical order --> | ||
| + | * [[SemEval 3]] - in planning, with tentative schedule | ||
| + | |||
| + | == 2011 == | ||
| + | * [http://clef2011.org/ CLEF 2011] | ||
| + | |||
| + | == 2010 == | ||
| + | <!-- Please keep this list in alphabetical order --> | ||
| + | * [http://semeval2.fbk.eu/semeval2.php SemEval 2010] | ||
| + | * [http://nlp.uned.es/weps/weps-3/ WePS 3: searching information about entities in the Web] | ||
| + | |||
| + | == 2009 == | ||
| + | <!-- Please keep this list in alphabetical order --> | ||
| + | * [http://evalita.itc.it/ EVALITA 2009] - Evaluation of NLP Tools for Italian | ||
| + | * [http://www.nist.gov/tac/2009/ TAC 2009] Text Analysis Conference | ||
| + | * [http://nlp.uned.es/weps/weps-2/ WePS 2: Second Web People Search Evaluation Workshop] | ||
== 2008 == | == 2008 == | ||
<!-- Please keep this list in alphabetical order --> | <!-- Please keep this list in alphabetical order --> | ||
| − | + | * [http://www.itl.nist.gov./iad/894.01/tests/ace/2008/ ACE 2008] - Automatic Content Extraction (task: entity/relation detection and recognition) | |
| + | * [http://clef.isti.cnr.it/2008.html CLEF 2008] - Cross Language Evaluation Forum | ||
* [http://ltrc.iiit.ac.in/ner-ssea-08 NER-SSEAL 2008] - IJCNLP Workshop on NER for South and South East Asian Languages | * [http://ltrc.iiit.ac.in/ner-ssea-08 NER-SSEAL 2008] - IJCNLP Workshop on NER for South and South East Asian Languages | ||
| + | * [http://www.nist.gov/tac/tracks/2008/ TAC 2008] - Text Analysis Conference | ||
== 2007 == | == 2007 == | ||
<!-- Please keep this list in alphabetical order --> | <!-- Please keep this list in alphabetical order --> | ||
| − | * [http://www.nist.gov/speech/tests/ace/ace07/ | + | * [http://www.nist.gov/speech/tests/ace/ace07/ ACE 2007] - Automatic Content Extraction 2007 |
* [http://cleaneval.sigwac.org.uk/ CLEANEVAL 2007] - Cleaning pages for Web corpus creation | * [http://cleaneval.sigwac.org.uk/ CLEANEVAL 2007] - Cleaning pages for Web corpus creation | ||
* [http://www.clef-campaign.org/ CLEF 2007] - Cross Language Evaluation Forum | * [http://www.clef-campaign.org/ CLEF 2007] - Cross Language Evaluation Forum | ||
| Line 18: | Line 40: | ||
* [http://www.pascal-network.org/Challenges/RTE3 RTE-3] - Third Recognising Textual Entailment Challenge ([[Recognizing Textual Entailment|RTE-3 Resources Pool]]) | * [http://www.pascal-network.org/Challenges/RTE3 RTE-3] - Third Recognising Textual Entailment Challenge ([[Recognizing Textual Entailment|RTE-3 Resources Pool]]) | ||
* [http://nlp.cs.swarthmore.edu/semeval/index.shtml SemEval-2007] - 4th International Workshop on Semantic Evaluations | * [http://nlp.cs.swarthmore.edu/semeval/index.shtml SemEval-2007] - 4th International Workshop on Semantic Evaluations | ||
| + | * [http://www.cs.utk.edu/tmw07/ SIAM Text Mining Competition] - document classification | ||
* [http://challenge.spock.com Spock Challenge] - (task: name discrimination/disambiguation in Web text) | * [http://challenge.spock.com Spock Challenge] - (task: name discrimination/disambiguation in Web text) | ||
* [http://trec.nist.gov/ TREC 2007] Text REtrieval Conference | * [http://trec.nist.gov/ TREC 2007] Text REtrieval Conference | ||
| Line 32: | Line 55: | ||
<!-- Please keep this list in alphabetical order --> | <!-- Please keep this list in alphabetical order --> | ||
| + | * [http://www.itl.nist.gov./iad/894.01/tests/ace/2005/ ACE 2005] - Automatic Content Extraction | ||
* [http://www.clef-campaign.org/ CLEF 2005] - Cross Language Evaluation Forum | * [http://www.clef-campaign.org/ CLEF 2005] - Cross Language Evaluation Forum | ||
* [http://duc.nist.gov/duc2005/call.html DUC-2005] - Document Understanding Conference (task: [[Text Summarization]]) | * [http://duc.nist.gov/duc2005/call.html DUC-2005] - Document Understanding Conference (task: [[Text Summarization]]) | ||
| Line 41: | Line 65: | ||
<!-- Please keep this list in alphabetical order --> | <!-- Please keep this list in alphabetical order --> | ||
| + | * [http://www.itl.nist.gov./iad/894.01/tests/ace/2004/ ACE 2004] - Automatic Content Extraction | ||
* [http://www.clef-campaign.org/ CLEF 2004] - Cross Language Evaluation Forum | * [http://www.clef-campaign.org/ CLEF 2004] - Cross Language Evaluation Forum | ||
* [http://duc.nist.gov/duc2004/call.html DUC-2004] - Document Understanding Conference (task: [[Text Summarization]]) | * [http://duc.nist.gov/duc2004/call.html DUC-2004] - Document Understanding Conference (task: [[Text Summarization]]) | ||
| Line 48: | Line 73: | ||
== 2003 == | == 2003 == | ||
<!-- Please keep this list in alphabetical order --> | <!-- Please keep this list in alphabetical order --> | ||
| + | * [http://www.itl.nist.gov./iad/894.01/tests/ace/2003/ ACE 2003] - Automatic Content Extraction | ||
* [http://duc.nist.gov/duc2003/call.html DUC-2003] - Document Understanding Conference (task: [[Text Summarization]]) | * [http://duc.nist.gov/duc2003/call.html DUC-2003] - Document Understanding Conference (task: [[Text Summarization]]) | ||
Latest revision as of 04:14, 25 June 2012
The competitions and challenges below are categorized by year. In cases in where an event begins in one year and ends in a later year, it is placed under the year in which it was or will be completed.
2012
- SemEval 3 - in planning, with tentative schedule
2011
2010
2009
- EVALITA 2009 - Evaluation of NLP Tools for Italian
- TAC 2009 Text Analysis Conference
- WePS 2: Second Web People Search Evaluation Workshop
2008
- ACE 2008 - Automatic Content Extraction (task: entity/relation detection and recognition)
- CLEF 2008 - Cross Language Evaluation Forum
- NER-SSEAL 2008 - IJCNLP Workshop on NER for South and South East Asian Languages
- TAC 2008 - Text Analysis Conference
2007
- ACE 2007 - Automatic Content Extraction 2007
- CLEANEVAL 2007 - Cleaning pages for Web corpus creation
- CLEF 2007 - Cross Language Evaluation Forum
- DUC-2007 - Document Understanding Conference (task: Text Summarization)
- EVALITA 2007 - Evaluation of NLP Tools for Italian
- Medical NLP Challenge - The Computational Medicine Center's 2007 Medical Natural Language Processing Challenge
- Morpho Challenge 2007 - unsupervised segmentation of words into morphemes
- RTE-3 - Third Recognising Textual Entailment Challenge (RTE-3 Resources Pool)
- SemEval-2007 - 4th International Workshop on Semantic Evaluations
- SIAM Text Mining Competition - document classification
- Spock Challenge - (task: name discrimination/disambiguation in Web text)
- TREC 2007 Text REtrieval Conference
2006
- CLEF 2006 - Cross Language Evaluation Forum
- DUC-2006 - Document Understanding Conference (task: Text Summarization)
- RTE-2 - Second Recognising Textual Entailment Challenge
- TREC 2006 Text REtrieval Conference
2005
- ACE 2005 - Automatic Content Extraction
- CLEF 2005 - Cross Language Evaluation Forum
- DUC-2005 - Document Understanding Conference (task: Text Summarization)
- Morpho Challenge 2005 - unsupervised segmentation of words into morphemes
- RTE-1 - Recognising Textual Entailment Challenge
- TREC 2005 Text REtrieval Conference
2004
- ACE 2004 - Automatic Content Extraction
- CLEF 2004 - Cross Language Evaluation Forum
- DUC-2004 - Document Understanding Conference (task: Text Summarization)
- Senseval 3 - evaluation exercises for Word Sense Disambiguation
- TREC 2004 Text REtrieval Conference
2003
- ACE 2003 - Automatic Content Extraction
- DUC-2003 - Document Understanding Conference (task: Text Summarization)
2002
- DUC-2002 - Document Understanding Conference (task: Text Summarization)