About this paper
PISA and PISA-E use prompt-adaptive capability estimation to route prompts or select cost-aware ensembles, improving cost-performance trade-offs across LLM routing benchmarks.
Large language models (LLMs) increasingly support Web-based services that must balance response quality and inference cost across heterogeneous requests. Conventional routing selects one model per prompt, while fixed ensembles cannot adapt their composition and cost to individual requests. We introduce PISA, a prompt-adaptive, cost-aware single-model router, and PISA-E, its extension to ensemble routing. At the core of both methods, PISA combines soft cluster memberships with model-specific predictors to estimate individual model capabilities. Building on these estimates, PISA-E jointly selects ensemble composition and cardinality under an explicit cost--quality preference that can be…
large language models (LLMs)prompt-adaptive routingcost-aware single-model routerensemble routingsoft cluster membershipsmodel-specific predictorsensemble compositionensemble cardinalitycost-quality preferenceensemble-success surrogate
- Upvotes
- 5
- Authors
- 4
- Published
- Nov 6, 2026
Summary and abstract excerpt via Hugging Face Papers ↗ · arXiv.
Trending history
Ensemble Routing for Prompt-Adaptive Cost-Aware LLM Inference was first seen on Hugging Face · Daily papers on Nov 12, 2026. Since then it has appeared in 20 checks on 2 different days. Its best position was #12 of 30, reached on Nov 13, 07:28 UTC. It dropped off the list after Nov 13, 21:28 UTC.