Drex open decision models return probability distributions over user-supplied options without autoregressive decoding, using supervised fine-tuning, RLAF, and consistency losses to improve accuracy, robustness, and latency.
Autoregressive approaches with large language models, such as long chain-of-thought reasoning, have become the default for new AI applications because they reach higher accuracy on a wide range of tasks. In production, however, they give inconsistent answers, require parsing of outputs, and add cost and latency. Decision models address this: given a question and a set of options supplied by the user, they return a probability distribution over the options without autoregressive decoding. We present Drex, a family of four open decision models with 8B (DLM), 9B (v1.5), 35B with 3B active (v2.0), and 27B (Max) parameters. Each request consists of a state (a document, record, or agent context,…
autoregressive approacheslarge language modelslong chain-of-thought reasoningautoregressive decodingdecision modelsprobability distribution over optionssupervised fine-tuningreinforcement learning from adjusted feedbackRLAFvision tuning
- Upvotes
- 6
- Authors
- 9
- Published
- Nov 5, 2026
Summary and abstract excerpt via Hugging Face Papers ↗ · arXiv.