AURORA-LM: Autoencoding Unified Representation for Continuous-Latent Diffusion Language Modeling
Nanjing University
Proposes a continuous-latent diffusion language model that keeps a high-capacity, decodable text representation instead of collapsing to discrete tokens, using a query-based encoder-decoder plus a block-causal diffusion transformer trained with flow matching.
Why it matters
74 upvotes on HuggingFace Daily Papers; part of a growing wave of diffusion-based (non-autoregressive) LLM architectures competing with standard transformer decoding.
Importance: 3/5
Introduces a new continuous-latent diffusion LM architecture, a notable direction beyond standard autoregressive decoding.
Sources
official
AURORA-LM: Autoencoding Unified Representation for Continuous-Latent Diffusion Language Modeling
official
Paper page - AURORA-LM