Memory-bound
AIMemory-bound: A workload limited by how fast data moves to and from memory rather than by arithmetic, the usual state of single-user token generation.
Memory-bound: A workload limited by how fast data moves to and from memory rather than by arithmetic, the usual state of single-user token generation.