PagedAttention

A memory-management technique introduced by vLLM: KV cache memory is allocated in small blocks (pages) rather than one contiguous span, the way an operating system handles virtual memory. It removes fragmentation and wasted memory and lets many concurrent requests share the same GPU.