Infinite-Parameter LLMs: arXiv paper proposes generating weights from live data
Independent researchers
An arXiv preprint (2609.18842, Sep 16; 122 points on HN) proposes a MoE-inspired architecture where a compact hypernetwork converts runtime data into a low-rank modulation of a shared base network, maintaining a Bayesian belief over a latent code that is updated online — so weights are continuously re-derived from the evolving belief while the fixed parameter footprint stays small.
Why it matters
Another shot at moving runtime adaptation out of context and into parameters — directly relevant to long-running agent sessions that re-read reams of facts every turn.
Importance: 2/5
Notable research preprint, 2 confirmations