Show HN: Flide: Make Jev-like decision models up to 9.5x faster
1 comments
- Points123
- Comments29
1 comments
Decision models need their own inference engine. So we developed Flide, a high-performance and exact inference engine for Jev-like decision models. Flide achieves up to a 9.5x speedup over vLLM and SGLang. It now supports 30+ popular local Jev-like decision models. Start to make your decision immediately: pip install flide
Story details from Hacker News ↗ · linked article on github.com.
Show HN: Flide: Make Jev-like decision models up to 9.5x faster was first seen on Hacker News · Front page on Nov 9, 2026. Since then it has appeared in 118 checks on 2 different days, across 3 lists (Hacker News · Front page, Hacker News · Show HN, Hacker News · Show HN · this week). Its best position was #13 of 30, reached on Nov 9, 17:09 UTC. It dropped off the list after Nov 10, 16:50 UTC. The same link also trended on GitHub, which raises its cross-platform score.
Position on Hacker News · Front page at every check (lower is better).
Best rank per day (UTC).
Platform metric as reported by Hacker News.
| List | Best | Days | Checks | Last seen |
|---|---|---|---|---|
| Hacker News · Front page | #13 | 1 | 43 | |
| Hacker News · Show HN | #1 | 2 | 44 | |
| Hacker News · Show HN · this week | #8 | 2 | 31 | |
| GHGitHub · Rising today omnijev/flide | same link | |||
A few top-level comments from Hacker News, shortened. Read the full thread on Hacker News.
Flide is extremely fast when one input carries many questions, as the shared input is computed only once. Even with a single question, it can still be up to 3x faster, depending on the model size and input length.
You really don't need an entire new inference engine for this. I modified vllm to work just fine for my decision model experiments. It properly uses the single shared context and only recomputes the questions, or if the questions are longer, I let the questions go first and then the context that changes often can go…
Hi HN! I'm one of the Flide team. We built Flide from scratch to make Jev-like decision model inference up to 9.5x faster than vLLM and SGLang, while keeping exactness. Here is the source code: https://github.com/OmniJev/Flide Look forward to hearing your feedback and ideas!
Archived daily, weekly and monthly lists that include this entry.
Not at the moment. It was last on the list on Nov 10, 16:50 UTC, after 2 days of trending.
#13 on Hacker News · Front page, on Nov 9, 17:09 UTC. Trendoday checks this list every 15 minutes.
It was first seen on Nov 9, 2026 and has been on the list on 2 days (118 checks) since.
123 points and 29 comments; submitted by unikcc on Nov 9, 2026.