Concept
reverse KL
Reverse KL is the Kullback-Leibler divergence measured in the direction KL(student || teacher) rather than the more familiar KL(teacher || student). The two are not symmetric, and the direction changes what the student learns.
The rest of “reverse KL” is a premium feature: every concept in the library gets a precise, practitioner-focused write-up like this one, cross-linked straight from the paper summaries that use it.
Log in to unlock→