DreamX-Creator: native joint audio-video generation at 2K resolution

AMAP-ML (Alibaba)

Research official 2 src. ~1 min

DreamX-Creator 1.0 is a 7B model that generates synchronized audio and video jointly from a first frame and text prompt, instead of dubbing video in post-processing. It couples modality-specialized streams via Gated Cross-Modal Attention, applies modality-aware RL post-training, and uses an autoregressive 1-step refinement to reach 2K resolution, matching state-of-the-art open-source systems. The authors plan to release the 7B generator and 2K refiner.

Why it matters

Top paper on HF Daily Papers for Sep 1, 2026 with 49 upvotes; promises an open release of a compact native audio-video generator, a capability currently dominated by closed systems.

Importance: 2/5

Top-voted HF Daily Paper (49 upvotes), official sources

Sources