Awesome Linguistics

A curated list of anything remotely related to linguistics, sorted in alphabetical order.

• Programming
  • Platforms and toolkits
  • Algorithms
  • Data sets
• Resources
  • Deep learning models and transformers
  • On Wikipedia
  • On Youtube
  • Books
    • Free
    • Non free
    • Lists
• Standards
• Lists
• Communities

Programming

Libraries, frameworks and applications useful for developing applications.

Platforms and toolkits

• CLARIN-D web tools - Tools for Analysing Research Data
• CorpusExplorer - Software for corpus linguists and text/data mining enthusiasts. The CorpusExplorer combines over 50 interactive visualizations under a user-friendly interface.
• Haxe-linguistics - Early linguistical analysis and natural language processing library for Haxe.
• Natural - General natural language tools for Node.js.
• Natural Language ToolKit (NLTK) - The most complete platform for building Python programs to work with human language data.
• Snowball - Snowball is a language in which stemming algorithms can be easily represented.
• Spacy - Industrial-strength National Language Processing in Python.
• Mate Tools, webservice via WebLicht
• UBIAI - Easy-to-use text annotation tool for teams with most comprehensive auto-annotation features. Supports NER, relations and document classification as well as OCR annotation for invoice labeling.
• textblob-de - Nice alternative for spacy (see above).
• UralicNLP - An open source Python library for processing morphologically rich and, for the most part, endangered Uralic languages. It can do morphological analysis, generation, lemmatization, disambiguation and lexical lookup for a great many Uralic languages.

Algorithms

• Stemming algorithms for various European languages - Various stemming algorithms from snowball.
• The Porter Stemmer Algorithm - The ‘official’ home page for distribution of the Porter Stemming Algorithm, written and maintained by its author, Martin Porter.

Data sets

• EuroRomCom Data - JSON formatted Pan-Romance word lists.
• Araneum Germanicum
• CEHugeWebCorpus - German corpus based on CommonCrawl
• Digitales Wörterbuch der deutschen Sprache (DWDS)
• GC4 Corpus (CommonCrawl)
• IDS Corpora - German Reference Corpus
• Leipzig Corpora Collection - sampled sentences in different languages.
• SdeWaC - big german internet corpus
• C-WEP
• DysList (list of dyslexic errors)
• Falko
• Litkey
• OpinionSpam

Resources

• How To Label Data - Guide on managing large scale linguistic annotation projects.
• Low Resource Languages - A list of resources for conservation, development, and documentation of low resource (human) languages.
• Language Science Press - Language Science Press is a born-digital scholar-led open access publisher in linguistics.

Deep learning models and transformers

• dbmdz BERT models
• Deepset German BERT model
• Evaluating German Transformer Language Models with Syntactic Agreement Tests
• German ELMo Model
• german-transformer-training
• GermLM (NER exploration)
• GerPT2
• Sentence Transformers

On Wikipedia

• Bag of words model
• Document classification
• Language models
• Naive Bayes classification
• Natural language processing
• Outline of natural language processing
• Parts of speech tagging
• Sentiment analysis
• Term frequency - inverse document frequency
• Vector space model

On Youtube

• Computational Linguistics Lecture Playlist (Youtube) - Lectures for University of Maryland class on computational linguistics.
• The Virtual Linguistics Campus - CC-licensed educational videos interconnected with Marburg University’s e-learning platform of the same name.

Books

Some of the more interesting and complete books.

Free

• Essentials of Linguistics, 2nd edition - An introductory book (2nd edition).
• Introduction to Linguistics
• Natural Language Processing with Python - The book from the NLTK package.
• Text Mining with R

Non free

• Foundations of Computational Linguistics
• Foundations of Statistical Natural Language Processing
• Semisupervised Learning for Computational Linguistics
• Speech and Language Processing: An Introduction to Natural Language Processing, Computational Linguistics and Speech Recognition
• The Oxford Handbook of Computational Linguistics

Standards

• DTA Basisformat
• ISO TC 37 SC 4
• UIMA

Lists

• 15 most popular books on good reads
• GitHub topics corpus-linguistics & nlp
• nlp-datasets
• NLP-progress
• /r/LanguageTechnology/
• awesome-nlp
• Awesome Community-Curated NLP List
• awesome-chinese-nlp
• awesome-danish
• awesome-hungarian-nlp
• awesome Information Retrieval
• Indonesian NLP
• Norwegian NLP resources
• German NLP resources
• awesome-nlp-polish
• awesome-spanish-nlp
• M. Weisser’s list of NLP/Computational Linguistics Resources
• NLP tools (Saarland University)

Communities

• Linguistics Stack Exchange
• Untranslatable.co, Multilingual urban dictionary