Concept
Next sentence prediction
Next sentence prediction (NSP) is a self-supervised pre-training task, introduced in BERT, that teaches a model to judge whether one text segment plausibly follows another. It is a binary classification problem, like a document-level version of masked language modeling,…
The rest of “Next sentence prediction” is a premium feature: every concept in the library gets a precise, practitioner-focused write-up like this one, cross-linked straight from the paper summaries that use it.
Log in to unlock→