vllm — AI Digest

13 июл vLLM v0.25.0: Model Runner V2 Default, PagedAttention Retired, Transformers Backend Parity tools
26 июн JetSpec: Breaking the Scaling Ceiling of Speculative Decoding with Parallel Tree Drafting Hao AI Lab, UC San Diego research
28 авг vLLM v0.28.0 ships Kimi-K3 perf push, full DeepSeek-V4 sparse-MLA, Model Runner V2 maturity, and tiered KV-cache offloading vLLM Project tools
10 мая vLLM v0.20.2: TurboQuant 2-bit KV Cache and FlashAttention 4 Default for MoE Serving tools
18 мая vLLM v0.21.0: Blackwell MLA Backend, HMA KV Offload, Spec Decode for Reasoning Models vLLM Project tools
2 июн vLLM v0.22.0: DeepSeek V4 Production Hardening, Rust Frontend, 28.9% Latency Drop tools
9 июн vLLM Semantic Router v0.3 Themis: Stateful Production Routing with Session-Aware Agentic Routing tools
14 июн vLLM Adds Day-0 Support for MiniMax M3 Open Weights with 1M-Context Sparse Attention MiniMax tools
17 июн vLLM v0.23.0: Model Runner V2 Default for Llama and Mistral, Transformers v5, Multi-Tier KV Cache tools
2 июл vLLM v0.24.0: Model Runner V2 Default, Rust Frontend, SM90 FP8 Speedups vLLM tools
11 авг vLLM v0.27.0 Ships Kimi K3 Support and DeepSeek-V4 Optimizations vLLM Project tools
29 апр vLLM v0.20.0 — third release in two weeks vLLM tools
2 июн BadHost (CVE-2026-48710): Host-Header Auth Bypass in Starlette Exposes vLLM, LiteLLM, and MCP Servers tools
6 мая vLLM v0.20.1: DeepSeek V4 Stabilization on CUDA 13 and PyTorch 2.11 tools
12 мая vLLM v0.21.0rc1: Python 3.14, CUDA 13.0, and Transformers v5 Compatibility tools
13 мая vLLM v0.21.0rc1: PyTorch 2.11, HuggingFace Transformers v5, and Python 3.14 Support tools
23 июл vLLM previews production-scale support for Moonshot AI's Kimi K3 ahead of its weight release vLLM / Moonshot AI tools
27 авг TRL v1.11.0 rewrites trl vllm-serve (~10x smaller) and ships AsyncDistillationTrainer Hugging Face tools
10 сен vLLM v0.29.0 makes Model Runner V2 the default and adds Mamba prefix caching vLLM tools