MinT: Managed Infrastructure for Training and Serving Millions of LLMs
Mind Lab
MinT is a production infrastructure system for managing millions of LoRA policy variants on top of shared base models up to 1T+ parameters. It scales in three directions: up to frontier-scale models, down by transferring only LoRA adapters (<1% of base model size), and out by supporting concurrent multi-policy training and cold-loading for a million-scale catalog. Efficiency gains: 18.3x on dense models, 2.85x on MoE models.
Why it matters
As personalization and domain adaptation drive demand for millions of fine-tuned model variants, MinT provides a concrete systems blueprint for operating at that scale efficiently. 147 upvotes on HF Daily (May 14).
Importance: 4/5
147 HF Daily upvotes (+1 bump); addresses critical infrastructure gap for million-scale LoRA serving