Mobile AI Factory is an agentic system that automatically builds task- and phone-specific fine-tuned quantized small language models, using an orchestrator LLM, real device measurements, and adaptive search to match or outperform larger models with much less GPU time.
Small language models (SLMs) running on mobile devices can keep user data private and work without connectivity. But they perform well only when fine-tuned for the target task and sized for the target device, a process that today requires repeated expert tuning. We present {\it Mobile AI Factory}, an agentic system that builds a fine-tuned, quantized SLM for a given task and phone. Given a task specification and a target phone, an orchestrator LLM chooses whether to tune hyperparameters, mine real data, or generate synthetic examples, while fixed rules roll back changes that hurt accuracy. The factory searches from small to large models across base models and quantizations, adapts its…
small language modelsfine-tuningquantizationagentic systemorchestrator LLMhyperparameter tuningsynthetic data generationbase modelsinference enginesbackends
- Upvotes
- 9
- Authors
- 4
- Published
- Nov 10, 2026
Summary and abstract excerpt via Hugging Face Papers ↗ · arXiv.