Morphology software for English

From ACL Wiki
Revision as of 04:07, 14 April 2011 by Kiwibird (talk | contribs) (Free software)

Jump to: navigation, search

Software - Morphology and part of speech tagging

For languages other than English, see List of resources by language.


Free software

  • Catvar 2.0 - The Categorial Variation Database for English (OSL)
  • lttoolbox -- lexical processing tools for building morphological analysers/generators with XML specification files. Includes data for English (both analysis and disambiguation). (GPL)
  • SFST - Stuttgart Finite State Transducer Tools (GPL)
    • Where is the data for English?
  • MULTEXT mmorph - (unmaintained) two-level morphology, package includes some data for English and German, (GPL2 or later)

Unknown license

  • MAP - Cambridge/Edinburgh Morphological Analyzer and Dictionary System (gratis download, no license information)

Proprietary software

  • CELEX database - Dutch, English, and German word forms
  • FONOL - Phonological Programming Language (non-commercial only)
  • German Morphology Browser
  • Hebrew Morphological Parser
  • MORLEX - A lexical database for French
  • morpha and morphg - fast and robust morphological analysis and generation for English, from John A. Carroll (non-commercial only)
  • MORFOGEN - a Morphology Grammar Builder and Dictionary Interface Tool
  • NOMLEX - a dictionary of English nominalizations
  • PC-KIMMO - a Two-level Processor for Morphological Analysis, including KGEN, KTEXT, and Englex
  • TULIP - a two level phonological formalism
  • Xerox/PARC - finite-state morphological analysis/generation using xfst, lexc, twolc

Part of speech tagging

Free software

  • ACOPOST - A Collection Of PoS Taggers Maximum Entropy Tagger, Trigram Tagger, Transformation-based Tagger, Example-based tagger
  • LBJ POS Tagger - Uses averaged perceptron based sequential model. Java API, Free, open source license.
  • GENiA- part-of-speech tagging, shallow parsing, and named entity recognition for biomedical text. C++, BSD license.
  • NLTK - Natural Language Toolkit Regexp Tagger, N-Gram Tagger, Brill Tagger, HMM Tagger, plus a freely downloadable book with a chapter on tagging
  • RelEx - provides English-language part-of-speech tagging, entity tagging, as well as other types of tags (gender, date, money ...), after performing a deep parse, so that tags agree with parse. Also provides resulting stems. Apache 2.0 License.
  • Spejd - Shallow Parsing and Disambiguation Engine a GPL tool for simultaneous rule-based morphosyntactic disambiguation and partial parsing
  • Tagger training on the Apertium Wiki (HMM + constraint based)
  • VISL Constraint Grammar rule based disambiguation (GPL)
    • Is there a Free set of rules for English?

Proprietary software

Combined morphology and tagging

Free software

Proprietary software

See also