Concept
Rank-decomposition matrices
Rank-decomposition matrices factor a large matrix into the product of two smaller matrices whose inner dimension (the rank) is much smaller than either outer dimension. Think of a full weight update ΔW of shape d × d, except instead of storing all d² values, you…
The rest of “Rank-decomposition matrices” is a premium feature: every concept in the library gets a precise, practitioner-focused write-up like this one, cross-linked straight from the paper summaries that use it.
Log in to unlock→