DreamX-Creator: native joint audio-video generation at 2K resolution
AMAP-ML (Alibaba)
DreamX-Creator 1.0 is a 7B model that generates synchronized audio and video jointly from a first frame and text prompt, instead of dubbing video in post-processing. It couples modality-specialized streams via Gated Cross-Modal Attention, applies modality-aware RL post-training, and uses an autoregressive 1-step refinement to reach 2K resolution, matching state-of-the-art open-source systems. The authors plan to release the 7B generator and 2K refiner.
Why it matters
Top paper on HF Daily Papers for Sep 1, 2026 with 49 upvotes; promises an open release of a compact native audio-video generator, a capability currently dominated by closed systems.
Importance: 2/5
Top-voted HF Daily Paper (49 upvotes), official sources