Concept
HBM
HBM stands for High Bandwidth Memory, the large DRAM stacked next to a GPU die and connected through a wide interface. It is the memory your tensors actually live in: when you read GPU specs like "80 GB, 3.35 TB/s" for an A100, that capacity and bandwidth figure is HBM.
The rest of “HBM” is a premium feature: every concept in the library gets a precise, practitioner-focused write-up like this one, cross-linked straight from the paper summaries that use it.
Log in to unlock→