affifuddin-hazam/ghost-infer
Fast local LLM inference for the GPU you already have: one Rust binary, GGUF models, an OpenAI-compatible server and a chat page with a ghost.
- Stars128
- LanguageRust
- LicenseApache-2.0
Fast local LLM inference for the GPU you already have: one Rust binary, GGUF models, an OpenAI-compatible server and a chat page with a ghost.
Fast local LLM inference for the GPU you already have: one Rust binary, GGUF models, an OpenAI-compatible server and a chat page with a ghost.
Most inference engines are built for data centres: many users, big GPUs, batching. ghost-infer is built for the other case: one person, one consumer GPU, one model at a time, and it is tuned for exactly that.
On an 8 GB RTX 2060 SUPER with 24 GB of RAM, on the same GGUF files:
Description and README excerpt from affifuddin-hazam/ghost-infer on GitHub ↗.
affifuddin-hazam/ghost-infer was first seen on GitHub · Rising today on Nov 14, 2026. Since then it has appeared in 37 checks on 2 different days. Its best position was #23 of 30, reached on Nov 14, 07:15 UTC. It dropped off the list after Nov 15, 03:01 UTC.
Position on GitHub · Rising today at every check (lower is better).
Best rank per day (UTC).
Platform metric as reported by GitHub.
Archived daily, weekly and monthly lists that include this entry.
Not at the moment. It was last on the list on Nov 15, 03:01 UTC, after 2 days of trending.
#23 on GitHub · Rising today, on Nov 14, 07:15 UTC. Trendoday checks this list every 60 minutes.
It was first seen on Nov 14, 2026 and has been on the list on 2 days (37 checks) since.
Mostly Rust; it is licensed under Apache-2.0. It has 128 stars and 8 forks.