About this paper
Flide is an exact inference engine that accelerates decision-model LLM agents by decoupling logical request trees from physical execution and using ForkAttention to preserve exact branch evaluations.
Decision models such as Jev have emerged as a highly promising paradigm for LLM agent systems, providing lightweight and reliable categorical reasoning for rapid System One execution. However, existing generation-oriented inference engines fail to support these workloads effectively, suffering from severe prefix recomputation overheads or distorted output probabilities. To address this challenge, we propose Flide, an efficient and exact inference engine that decouples the logical tree structure of a decision request from its physical execution within a single flattened token stream. Through ForkAttention, Flide navigates request dependencies using GPU-resident indices across both standard…
LLM agent systemscategorical reasoningSystem One executioninference enginesprefix recomputationoutput probabilitiesexact inference enginelogical tree structureflattened token streamForkAttention
- Upvotes
- 8
- Authors
- 5
- Published
- Oct 30, 2026
Summary and abstract excerpt via Hugging Face Papers ↗ · arXiv.
Trending history
Flide: Accelerating Decision Inference with Exact State Forking was first seen on Hugging Face · Daily papers on Nov 10, 2026. Since then it has appeared in 11 checks on 2 different days. Its best position was #7 of 30, reached on Nov 11, 03:28 UTC. It dropped off the list after Nov 11, 03:28 UTC.