Concept
Gating network
A gating network is a small trainable subnetwork that decides which other subnetworks (the "experts") process a given input, and how much each contributes. Think of it like a learned router in front of an ensemble, except the routing weights are produced per input and…
The rest of “Gating network” is a premium feature: every concept in the library gets a precise, practitioner-focused write-up like this one, cross-linked straight from the paper summaries that use it.
Log in to unlock→