ashokgit / the-nlp-path

Collection of Resources for travelers on the path of NLP

The NLP Path

Welcome to "The NLP Path" - your curated collection of essential resources for the journey through Natural Language Processing (NLP). Whether you're a beginner or an advanced learner, these resources are designed to guide you through the diverse and evolving landscape of NLP.

Resource Collection

This collection is meticulously organized to provide you with a comprehensive understanding of key concepts, methodologies, and advancements in NLP. Dive in and explore!

Understanding Word and Phrase Representations

• Title: "Distributed Representations of Words and Phrases and their Compositionality"
• Published: 2013
• Overview: This seminal paper introduces the concept of vector representations for millions of phrases, laying the groundwork for modern NLP applications. It's a must-read for understanding how words and phrases can be encoded to capture linguistic meanings.
• Access Paper: Read Here

Enhancing Word Vectors with Subword Information

• Title: "Enriching Word Vectors with Subword Information"
• Published: 2016
• Overview: This influential paper details the FastText model, an extension of the Word2Vec model incorporating subword information. It marks a significant advancement in handling rare words and understanding morphological nuances in various languages.
• Access Paper: Read Here

Deep contextualized word representations : 2018, ELMo Embdeddings

• Read Paper
• Watch Semantic Search using EMLo Embeddigns
• https://www.youtube.com/watch?v=9JfGxKkmBc0

Word Space

• Paper

Nepali NLP Papers and Resources

• NPVec1: Word Embeddings for Nepali - Construction and Evaluation Paper

Must Watch

• n-grams
  • https://www.youtube.com/watch?v=E_mN90TYnlg
• The Sigmoid Function
  • https://www.youtube.com/watch?v=TPqr8t919YM
  • https://www.youtube.com/watch?v=Aj7O9qRNJPY
• SoftMax
  • https://www.youtube.com/watch?v=8ps_JEW42xs
• Negative Sampling
  • https://www.youtube.com/watch?v=4PXILCmVK4Q
• Negative Log-Likelihood [Cross-Entropy Loss Log-likelihood]
  • https://www.youtube.com/watch?v=ziq967YrSsc
  • https://www.youtube.com/watch?v=6hrnMvYcKVE
  • https://www.youtube.com/watch?v=6ArSys5qHAU
  • https://www.youtube.com/watch?v=Pwgpl9mKars
• Embeddings: What they are and why they matter
  • https://www.youtube.com/watch?v=ArnMdc-ICCM
• Embeddings for Everything: Search in the Neural Network Era
  • https://www.youtube.com/watch?v=JGHVJXP9NHw

Training FastText

• https://github.com/PacktPublishing/fastText-Quick-Start-Guide/blob/master/chapter5/Training_visualizations.py
• https://radimrehurek.com/gensim/models/fasttext.html

Stay Updated

The field of NLP is continually evolving, and we aim to keep this collection up-to-date with the latest research and insights. Keep an eye on this space for more resources!