Compile by Training: turning natural-language specifications into local neural functions
Instead of compiling a natural-language spec into code, the authors 'compile' it into trained adapter weights on a compact interpreter: teacher models synthesize task-specific training data, and the resulting neural function runs fully offline, with no teacher model or API at inference time. Compiled functions can be stored, versioned, and composed like ordinary software.
Why it matters
269 upvotes on HF Daily Papers (top of Sep 4). Reaches 83.6% semantic accuracy on FuzzyBench-Hard, where the fast Program-as-Weights compiler scored zero — a path to escaping per-query API cost and vendor lock-in for repetitive text-processing tasks. EMNLP 2026 System Demonstration with a public interactive service.
Importance: 4/5
Notable paper + 269 upvotes on HF Daily Papers