Concept
Cross-attention
Cross-attention is an attention mechanism where the queries come from one sequence and the keys and values come from a different one. Contrast it with self-attention, where all three come from the same sequence.
The rest of “Cross-attention” is a premium feature: every concept in the library gets a precise, practitioner-focused write-up like this one, cross-linked straight from the paper summaries that use it.
Log in to unlock→