Fig.1

Concept

looped Transformer

A looped Transformer is a Transformer that reuses the same block (or small stack of blocks) multiple times, feeding each pass's output back in as the next pass's input, instead of stacking many distinct layers. Think of a standard 32-layer decoder, except you have 8 physical…

The rest of “looped Transformer” is a premium feature: every concept in the library gets a precise, practitioner-focused write-up like this one, cross-linked straight from the paper summaries that use it.

Log in to unlock

← Back to the library

looped Transformer, explained · Fig. 1