Concept
PiSSA
PiSSA (Principal Singular values and Singular vectors Adaptation) is a way to initialize LoRA adapters. Standard LoRA starts one of its two low-rank matrices at zero, so training begins from no change to the base weights and the adapter has to discover a useful direction…
The rest of “PiSSA” is a premium feature: every concept in the library gets a precise, practitioner-focused write-up like this one, cross-linked straight from the paper summaries that use it.
Log in to unlock→