DeepSeek-V4.1-Flash: Pushing the Limits of KV Cache Compression
DeepSeek
DeepSeek's new 552B-parameter multimodal MoE supports 1M-token contexts while shrinking the HBM-resident KV cache to roughly 890 bytes per token (about 1/4 of DeepSeek-V4-Flash) via a Causal Encoder-Decoder architecture, cross-layer KV reuse in Compressed Sparse Attention 2, and FP4 KV caching; SWA Bounded Replay cuts the persistent footprint to about 1/8. Performance improves on text and multimodal agentic tasks despite the compression.
Why it matters
Aggressive KV-cache compression from a frontier open-weights lab directly attacks the memory wall of long-context agentic inference; the techniques are likely to propagate through the ecosystem.
Importance: 3/5
Notable efficiency paper from a frontier open-weights lab