Daily digest
5 items · ~5 min · Week 2026-W31
Must-read (1)
Kimi K3 Technical Report: Kimi Delta Attention and Stable LatentMoE Architecture Detailed
Moonshot AIMoonshot AI published the Kimi K3 technical report on arXiv, detailing the architecture behind the 2.8T-parameter (104B activated) MoE model released as open weights the day before: Kimi Delta Attention with Attention Residuals, a Stable LatentMoE routing 16-of-896 experts, and post-training RL across general, agentic, and coding domains at multiple reasoning-effort levels. The paper reports roughly 2.5x scaling efficiency over Kimi K2.
For reference (4)
VK Research: classical recommendation algorithms can account for users' future interests
VKAI VK Research presented a new approach that lets classical, non-neural recommendation algorithms factor in how a current recommendation will influence a user's future preferences, not just present interests. The method was accepted at the Customer Journey workshop of KDD 2026 and showed improved accuracy on open datasets including VK-LSVD.
Mage-VL: An Efficient Codec-Native Streaming Multimodal Foundation Model
MicrosoftMicrosoft researchers introduced Mage-VL, a 4B-parameter vision-language model with a visual encoder (Mage-ViT) trained from scratch on 560M images and 100M video frames. It uses codec-guided sparse token selection, borrowing I-frame/P-frame structure from video codecs, to cut visual tokens by roughly 75% versus dense frame sampling, giving up to 3.5x wall-clock inference speedup. A dual-system design pairs a lightweight streaming gate with a full reasoning decoder; it matches Qwen3-VL-4B on static VQA while beating it on video understanding and spatial reasoning.
Skill Self-Play: Pushing the Frontier of LLM Capability with Co-Evolving Skills
AlibabaThe Qwen team at Alibaba proposed Skill-SP, a reinforcement-learning framework with three co-evolving components: a proposer that generates tasks conditioned on dynamically sampled skills, a solver that explores solutions, and a skill controller that updates a skill library from execution feedback. It aims to bridge reliable-but-narrow environment-bound training with broad-but-unreliable open-ended task generation, showing gains on tool-use and reasoning benchmarks, including large improvements for initially weak models.
Codex CLI 0.146.0: named/pinned sessions, Agent Plugins, thread forking
OpenAIOpenAI shipped Codex CLI 0.146.0, adding named and pinnable sessions via /new or /clear, Agent Plugins manifests with workspace plugin publishing and new marketplaces (Amazon Bedrock, Claude Code), thread forking with paginated history, WebSocket connections from app-server to remote Code Mode hosts, standalone web search for compatible custom model providers, and discovery of executor-provided skills. The release also bundles a batch of proxy-configuration and MCP-reconnection bug fixes.