Concept
Perplexity
Perplexity is a standard metric for evaluating language models, measuring how well a model predicts a sequence of tokens. It is the exponential of the average per-token cross-entropy loss: if your model assigns probability p to each observed token on average, perplexity is…
The rest of “Perplexity” is a premium feature: every concept in the library gets a precise, practitioner-focused write-up like this one, cross-linked straight from the paper summaries that use it.
Log in to unlock→