Concept
Block size
Block size is the number of tokens a model commits to generating or verifying in one step, rather than the strictly one-token-at-a-time loop of standard autoregressive decoding.
The rest of “Block size” is a premium feature: every concept in the library gets a precise, practitioner-focused write-up like this one, cross-linked straight from the paper summaries that use it.
Log in to unlock→