Corpora, datasets, lexicons

Miscellaneous

• Resources

Corpora

English

(alphabetical order)

• American National Corpus (ANC)
• Biomedical corpora
• British National Corpus (BNC)
• Brown Corpus
• Collins Wordbanks
• Gutenberg
• Oxford English Corpus
• WebCorp

Multilingual

(alphabetical order)

• Bank of Swedish
• Oslo Corpus of Bosnian
• Croatian National Corpus (HNK)
• Czech National Corpus (CNC)
• Hungarian National Corpus
• IPI PAN Corpus of Polish
• Portuguese Corpus
• Russian National Corpus (RNK)
• Slovak National Corpus (SNK)
• Slovenian Corpus FIDA and FIDA+
• Spanish Corpus
• Tanaka Corpus: Japanese-English sentence pairs

Other lists of corpora

(alphabetical order)

• David Lee's Bookmarks for Corpus-based Linguists

Datasets

• Edinburgh Associative Thesaurus (EAT)
• Linguistic Data Consortium (LDC)
• MRC Psycholinguistic Database
• Noun Compound Repository
• Reuters-21578 Text Categorization Collection
• University of South Florida Free Association Norms
• WordSimilarity-353 Test Collection

Lexicons

• Catvar 2.0: The Categorial Variation Database
• General Inquirer
• JMdict: Japanese-Multilingual Dictionary file
• LCS Database: Lexical Conceptual Structures
• Moby lexicon project
• ThoughtTreasure

• WordNet - the original
  • eXtended WordNet - glosses are syntactically parsed, transformed into logic forms, and content words are semantically disambiguated
  • WordNet Domains - augmented with Domain Labels, such as POLITICS, ECONOMY, SPORT
  • SentiWordNet - assigns to each synset of WordNet three sentiment scores: positivity, negativity, objectivity