QDA: Closed-Loop LLM Quantization Design with Agents
Post-training quantization is the standard way to serve large language models at low cost. However, the best quantization recipe differs across models and precisions. As a result, experts must redesig
- Upvotes6