Inter-token latency
AIInter-token latency: The average gap between successive output tokens during generation; low values give smooth, fast-flowing streamed text.
Inter-token latency: The average gap between successive output tokens during generation; low values give smooth, fast-flowing streamed text.