←

vLLM 0.32.0 widens low-precision KV cache and drops Python 3.10

vLLM

Tools official 1 src. ~1 min

vLLM 0.32.0 (October 18, 2026, 814 commits from 363 contributors) adds a POST /v1/systemone endpoint for structured choice and score queries, extends NVFP4 KV cache to SM8x, SM90, SM12x and SM100 GPUs with FP8 KV cache default for GLM-5.x on SM100, and makes Model Runner V2 the default on ROCm. Breaking changes drop Python 3.10, restrict default CORS origins and remove cascade attention.

Why it matters

Low-precision KV cache on older GPU generations cuts memory cost for self-hosted serving without new hardware.

Importance: 2/5

notable update (minor version with real changes)

Sources