Textual Entailment Resource Pool

From ACLWiki
(Difference between revisions)
Jump to: navigation, search
(Past campaigns data sets)
(Past campaigns data sets)
Line 23: Line 23:
 
* [http://pascallin.ecs.soton.ac.uk/Challenges/RTE3/Datasets RTE3 dataset] - provided by [http://pascallin.ecs.soton.ac.uk PASCAL]
 
* [http://pascallin.ecs.soton.ac.uk/Challenges/RTE3/Datasets RTE3 dataset] - provided by [http://pascallin.ecs.soton.ac.uk PASCAL]
 
* [http://www.nist.gov/tac/data/past/2008/RTE-4.html RTE4 dataset] - provided by [http://www.nist.gov/index.html NIST] - freely available upon request. For details see [http://www.nist.gov/tac/data/forms/index.html TAC User Agreements]
 
* [http://www.nist.gov/tac/data/past/2008/RTE-4.html RTE4 dataset] - provided by [http://www.nist.gov/index.html NIST] - freely available upon request. For details see [http://www.nist.gov/tac/data/forms/index.html TAC User Agreements]
 +
* [http://www.nist.gov/tac/data/past/2009/RTE-5.html RTE5 dataset] - provided by [http://www.nist.gov/index.html NIST] - freely available upon request. For details see [http://www.nist.gov/tac/data/forms/index.html TAC User Agreements]
 +
* [http://www.nist.gov/tac/2010/RTE/index.html RTE6 dataset] - provided by [http://www.nist.gov/index.html NIST] - freely available upon request. For details see [http://www.nist.gov/tac/data/forms/index.html TAC User Agreements]
  
 
=== Other data sets ===
 
=== Other data sets ===

Revision as of 13:07, 31 January 2011

Textual Entailment > Resources:


Textual entailment systems rely on many different types of NLP resources, including term banks, paraphrase lists, parsers, named-entity recognizers, etc. With so many resources being continuously released and improved, it can be difficult to know which particular resource to use when developing a system.

In response, the Recognizing Textual Entailment (RTE) shared task community initiated a new activity for building this Textual Entailment Resource Pool. RTE participants and any other member of the NLP community are encouraged to contribute to the pool.

In an effort to determine the relative impact of the resources, RTE participants are strongly encouraged to report, whenever possible, the contribution to the overall performance of each utilized resource. Formal qualitative and quantitative results should be included in a separate section of the system report as well as posted on the talk pages of this Textual Entailment Resource Pool.

Adding a new resource is very easy. See how to use existing templates to do this in Help:Using Templates.

Contents

Complete RTE Systems

RTE data sets

Past campaigns data sets

Other data sets

Knowledge Resources

The RTE Knowledge Resources page presents:

Tools

Parsers

Role Labelling

Entity Recognition Tools

Similarity / Relatedness Tools

  • UKB: Open source WordNet-based similarity/relatedness tool, includes also pre-computed semantic vectors for all words

Corpus Readers

  • NLTK provides a corpus reader for the data from RTE Challenges 1, 2, and 3 - see the Corpus Readers Guide for more information.

Related Libraries

  • PyPES general purpose library containing evaluation environment for RTE and McPIET text inference engine based on the ERG (English Resource Grammar)

Links

Personal tools