Language Modeling

A language model is a computational model designed to understand, generate, and predict human language. It captures language patterns, learns the likelihood of a specific term occurring in a given context, and assigns probabilities to word sequences through training on extensive text data.

Contents

• N-gram Models

• Smoothing

• Maximum Likelihood Estimation

• Entropy and Perplexity

• Assignments