Memory bandwidth
AIMemory bandwidth: The rate at which data moves between a chip and its memory, often the main limit on how fast large models run.
Memory bandwidth: The rate at which data moves between a chip and its memory, often the main limit on how fast large models run.