What is High-bandwidth memory (HBM)?

High-bandwidth memory (HBM)

High-bandwidth memory (HBM): Fast memory stacked close to an AI chip, providing the huge data throughput that large models need to keep the processor busy.

Related terms

Memory bandwidth
Agent memory
Episodic memory
High-risk AI system
Long short-term memory (LSTM)
Long-term memory
Memory-bound
Remote direct memory access (RDMA)

Browse the full glossary →