A language model is really a chance distribution above words and phrases or word sequences. In exercise, it gives the likelihood of a specific word sequence staying “valid.” Validity In this particular context does not refer to grammatical validity. Alternatively, it means that it resembles how folks generate, which is exactly what the language