Concept
Causal transformer
A causal transformer is a transformer whose attention is masked so that each token can only attend to earlier positions, never later ones. t` and nothing after.
The rest of “Causal transformer” is a premium feature: every concept in the library gets a precise, practitioner-focused write-up like this one, cross-linked straight from the paper summaries that use it.
Log in to unlock→