Trendoday

wici-ai/inferssd

Run models larger than your RAM or VRAM by streaming MoE experts from SSD. Built on llama.cpp.

  • Stars621
  • LanguageC++
  • LicenseApache-2.0
–Rank now
#3Peak rank
3Days on list
343Score · 7d
Nov 12, 2026First seen
Rank · 7 days

About wici-ai/inferssd

Run models larger than your RAM or VRAM by streaming MoE experts from SSD. Built on llama.cpp.

Run models larger than your RAM or VRAM. InferSSD builds on llama.cpp to run large mixture-of-experts (MoE) models from SSD, using standard GGUF files, with browser chat and an OpenAI-compatible API. It supports DeepSeek-V4.1-Flash-1017, Muse-Spark-Open, Qwen3.6-35B-A3B and Qwen3.8 Flash Next, plus ordinary RAM inference for Gemma4 E4B.

These are the tested GGUF files, community conversions of the named model releases. DeepSeek's Q8_0 keeps the official bit widths: routed experts stay native 4-bit MXFP4, and FP8 tensors become 8-bit Q8_0. See weight-format details.

apple-siliconcudaggufinferencellama-cppllmmetalmixture-of-expertsssd
Stars
621
Forks
73
Language
C++
License
Apache-2.0
Last push
Nov 12, 2026
Created
Oct 22, 2026

Description and README excerpt from wici-ai/inferssd on GitHub ↗.

Trending history

wici-ai/inferssd was first seen on GitHub · Rising today on Nov 12, 2026. Since then it has appeared in 149 checks on 3 different days. Its best position was #3 of 30, reached on Nov 13, 23:15 UTC. It dropped off the list after Nov 14, 03:01 UTC.

Rank history

Position on GitHub · Rising today at every check (lower is better).

#1#11#20#30 14:0023:1508:3117:4603:01 Nov 12, 14:00 UTC · #20Nov 12, 14:16 UTC · #20Nov 12, 14:30 UTC · #20Nov 12, 14:46 UTC · #20Nov 12, 15:00 UTC · #18Nov 12, 15:15 UTC · #18Nov 12, 15:30 UTC · #18Nov 12, 15:46 UTC · #18Nov 12, 16:00 UTC · #17Nov 12, 16:16 UTC · #17Nov 12, 16:30 UTC · #17Nov 12, 16:46 UTC · #17Nov 12, 17:00 UTC · #16Nov 12, 17:15 UTC · #16Nov 12, 17:30 UTC · #16Nov 12, 17:46 UTC · #17Nov 12, 18:00 UTC · #14Nov 12, 18:15 UTC · #14Nov 12, 18:30 UTC · #14Nov 12, 18:46 UTC · #18Nov 12, 19:01 UTC · #16Nov 12, 19:15 UTC · #16Nov 12, 19:31 UTC · #16Nov 12, 19:46 UTC · #16Nov 12, 20:01 UTC · #16Nov 12, 20:16 UTC · #16Nov 12, 20:30 UTC · #16Nov 12, 20:46 UTC · #16Nov 12, 21:00 UTC · #16Nov 12, 21:15 UTC · #17Nov 12, 21:30 UTC · #17Nov 12, 21:46 UTC · #17Nov 12, 22:00 UTC · #17Nov 12, 22:15 UTC · #17Nov 12, 22:30 UTC · #17Nov 12, 22:46 UTC · #17Nov 12, 23:00 UTC · #16Nov 12, 23:15 UTC · #16Nov 12, 23:30 UTC · #16Nov 12, 23:46 UTC · #17Nov 13, 00:00 UTC · #14Nov 13, 00:15 UTC · #14Nov 13, 00:30 UTC · #14Nov 13, 00:46 UTC · #12Nov 13, 01:01 UTC · #16Nov 13, 01:15 UTC · #16Nov 13, 01:31 UTC · #16Nov 13, 01:46 UTC · #15Nov 13, 02:01 UTC · #18Nov 13, 02:16 UTC · #18Nov 13, 02:30 UTC · #18Nov 13, 02:46 UTC · #9Nov 13, 03:00 UTC · #11Nov 13, 03:15 UTC · #12Nov 13, 03:30 UTC · #12Nov 13, 03:46 UTC · #5Nov 13, 04:00 UTC · #5Nov 13, 04:15 UTC · #5Nov 13, 04:30 UTC · #5Nov 13, 04:46 UTC · #5Nov 13, 05:00 UTC · #8Nov 13, 05:15 UTC · #8Nov 13, 05:30 UTC · #8Nov 13, 05:46 UTC · #8Nov 13, 06:00 UTC · #8Nov 13, 06:15 UTC · #8Nov 13, 06:30 UTC · #8Nov 13, 06:46 UTC · #8Nov 13, 07:01 UTC · #7Nov 13, 07:15 UTC · #7Nov 13, 07:31 UTC · #7Nov 13, 07:46 UTC · #8Nov 13, 08:01 UTC · #7Nov 13, 08:16 UTC · #7Nov 13, 08:30 UTC · #7Nov 13, 08:46 UTC · #8Nov 13, 09:00 UTC · #6Nov 13, 09:15 UTC · #6Nov 13, 09:30 UTC · #6Nov 13, 09:46 UTC · #8Nov 13, 10:00 UTC · #6Nov 13, 10:15 UTC · #6Nov 13, 10:30 UTC · #7Nov 13, 10:46 UTC · #7Nov 13, 11:00 UTC · #6Nov 13, 11:15 UTC · #6Nov 13, 11:30 UTC · #6Nov 13, 11:46 UTC · #6Nov 13, 12:00 UTC · #6Nov 13, 12:15 UTC · #5Nov 13, 12:31 UTC · #5Nov 13, 12:46 UTC · #5Nov 13, 13:01 UTC · #5Nov 13, 13:16 UTC · #4Nov 13, 13:31 UTC · #6Nov 13, 13:46 UTC · #6Nov 13, 14:01 UTC · #6Nov 13, 14:16 UTC · #6Nov 13, 14:30 UTC · #6Nov 13, 14:46 UTC · #6Nov 13, 15:01 UTC · #6Nov 13, 15:15 UTC · #6Nov 13, 15:30 UTC · #6Nov 13, 15:46 UTC · #7Nov 13, 16:01 UTC · #6Nov 13, 16:15 UTC · #6Nov 13, 16:30 UTC · #5Nov 13, 16:46 UTC · #6Nov 13, 17:00 UTC · #6Nov 13, 17:15 UTC · #6Nov 13, 17:30 UTC · #6Nov 13, 17:46 UTC · #7Nov 13, 18:00 UTC · #7Nov 13, 18:15 UTC · #6Nov 13, 18:30 UTC · #6Nov 13, 18:46 UTC · #6Nov 13, 19:01 UTC · #6Nov 13, 19:15 UTC · #6Nov 13, 19:31 UTC · #6Nov 13, 19:46 UTC · #7Nov 13, 20:01 UTC · #6Nov 13, 20:16 UTC · #5Nov 13, 20:30 UTC · #5Nov 13, 20:46 UTC · #7Nov 13, 21:00 UTC · #4Nov 13, 21:15 UTC · #4Nov 13, 21:30 UTC · #4Nov 13, 21:46 UTC · #5Nov 13, 22:01 UTC · #4Nov 13, 22:15 UTC · #4Nov 13, 22:30 UTC · #4Nov 13, 22:46 UTC · #4Nov 13, 23:01 UTC · #4Nov 13, 23:15 UTC · #3Nov 13, 23:30 UTC · #3Nov 13, 23:46 UTC · #4Nov 14, 00:00 UTC · #4Nov 14, 00:16 UTC · #4Nov 14, 00:30 UTC · #4Nov 14, 00:46 UTC · #4Nov 14, 01:01 UTC · #4Nov 14, 01:15 UTC · #4Nov 14, 01:31 UTC · #4Nov 14, 01:46 UTC · #6Nov 14, 02:01 UTC · #6Nov 14, 02:16 UTC · #8Nov 14, 02:30 UTC · #8Nov 14, 02:46 UTC · #9Nov 14, 03:01 UTC · #9

Last 14 days

Best rank per day (UTC).

Nov 3today

Metric history

Platform metric as reported by GitHub.

0182364552 14:0023:1508:3117:4603:01 Nov 12, 14:00 UTC · 235Nov 12, 14:16 UTC · 235Nov 12, 14:30 UTC · 235Nov 12, 14:46 UTC · 228Nov 12, 15:00 UTC · 238Nov 12, 15:15 UTC · 238Nov 12, 15:30 UTC · 238Nov 12, 15:46 UTC · 228Nov 12, 16:00 UTC · 238Nov 12, 16:16 UTC · 238Nov 12, 16:30 UTC · 238Nov 12, 16:46 UTC · 229Nov 12, 17:00 UTC · 239Nov 12, 17:15 UTC · 239Nov 12, 17:30 UTC · 239Nov 12, 17:46 UTC · 233Nov 12, 18:00 UTC · 242Nov 12, 18:15 UTC · 242Nov 12, 18:30 UTC · 242Nov 12, 18:46 UTC · 233Nov 12, 19:01 UTC · 243Nov 12, 19:15 UTC · 243Nov 12, 19:31 UTC · 243Nov 12, 19:46 UTC · 237Nov 12, 20:01 UTC · 247Nov 12, 20:16 UTC · 247Nov 12, 20:30 UTC · 247Nov 12, 20:46 UTC · 238Nov 12, 21:00 UTC · 248Nov 12, 21:15 UTC · 248Nov 12, 21:30 UTC · 248Nov 12, 21:46 UTC · 239Nov 12, 22:00 UTC · 248Nov 12, 22:15 UTC · 248Nov 12, 22:30 UTC · 248Nov 12, 22:46 UTC · 239Nov 12, 23:00 UTC · 249Nov 12, 23:15 UTC · 249Nov 12, 23:30 UTC · 249Nov 12, 23:46 UTC · 239Nov 13, 00:00 UTC · 249Nov 13, 00:15 UTC · 249Nov 13, 00:30 UTC · 249Nov 13, 00:46 UTC · 258Nov 13, 01:01 UTC · 239Nov 13, 01:15 UTC · 239Nov 13, 01:31 UTC · 239Nov 13, 01:46 UTC · 247Nov 13, 02:01 UTC · 236Nov 13, 02:16 UTC · 236Nov 13, 02:30 UTC · 236Nov 13, 02:46 UTC · 281Nov 13, 03:00 UTC · 275Nov 13, 03:15 UTC · 275Nov 13, 03:30 UTC · 275Nov 13, 03:46 UTC · 549Nov 13, 04:00 UTC · 552Nov 13, 04:15 UTC · 552Nov 13, 04:30 UTC · 552Nov 13, 04:46 UTC · 533Nov 13, 05:00 UTC · 418Nov 13, 05:15 UTC · 418Nov 13, 05:30 UTC · 418Nov 13, 05:46 UTC · 408Nov 13, 06:00 UTC · 424Nov 13, 06:15 UTC · 424Nov 13, 06:30 UTC · 424Nov 13, 06:46 UTC · 412Nov 13, 07:01 UTC · 430Nov 13, 07:15 UTC · 430Nov 13, 07:31 UTC · 430Nov 13, 07:46 UTC · 414Nov 13, 08:01 UTC · 431Nov 13, 08:16 UTC · 431Nov 13, 08:30 UTC · 431Nov 13, 08:46 UTC · 414Nov 13, 09:00 UTC · 432Nov 13, 09:15 UTC · 432Nov 13, 09:30 UTC · 432Nov 13, 09:46 UTC · 416Nov 13, 10:00 UTC · 434Nov 13, 10:15 UTC · 434Nov 13, 10:30 UTC · 434Nov 13, 10:46 UTC · 422Nov 13, 11:00 UTC · 440Nov 13, 11:15 UTC · 440Nov 13, 11:30 UTC · 440Nov 13, 11:46 UTC · 422Nov 13, 12:00 UTC · 422Nov 13, 12:15 UTC · 446Nov 13, 12:31 UTC · 446Nov 13, 12:46 UTC · 430Nov 13, 13:01 UTC · 430Nov 13, 13:16 UTC · 449Nov 13, 13:31 UTC · 449Nov 13, 13:46 UTC · 431Nov 13, 14:01 UTC · 431Nov 13, 14:16 UTC · 448Nov 13, 14:30 UTC · 448Nov 13, 14:46 UTC · 431Nov 13, 15:01 UTC · 431Nov 13, 15:15 UTC · 450Nov 13, 15:30 UTC · 450Nov 13, 15:46 UTC · 433Nov 13, 16:01 UTC · 433Nov 13, 16:15 UTC · 451Nov 13, 16:30 UTC · 451Nov 13, 16:46 UTC · 433Nov 13, 17:00 UTC · 433Nov 13, 17:15 UTC · 448Nov 13, 17:30 UTC · 448Nov 13, 17:46 UTC · 431Nov 13, 18:00 UTC · 431Nov 13, 18:15 UTC · 449Nov 13, 18:30 UTC · 449Nov 13, 18:46 UTC · 434Nov 13, 19:01 UTC · 434Nov 13, 19:15 UTC · 449Nov 13, 19:31 UTC · 449Nov 13, 19:46 UTC · 432Nov 13, 20:01 UTC · 432Nov 13, 20:16 UTC · 450Nov 13, 20:30 UTC · 450Nov 13, 20:46 UTC · 432Nov 13, 21:00 UTC · 432Nov 13, 21:15 UTC · 450Nov 13, 21:30 UTC · 450Nov 13, 21:46 UTC · 435Nov 13, 22:01 UTC · 435Nov 13, 22:15 UTC · 453Nov 13, 22:30 UTC · 453Nov 13, 22:46 UTC · 434Nov 13, 23:01 UTC · 434Nov 13, 23:15 UTC · 453Nov 13, 23:30 UTC · 453Nov 13, 23:46 UTC · 437Nov 14, 00:00 UTC · 437Nov 14, 00:16 UTC · 435Nov 14, 00:30 UTC · 435Nov 14, 00:46 UTC · 419Nov 14, 01:01 UTC · 419Nov 14, 01:15 UTC · 417Nov 14, 01:31 UTC · 417Nov 14, 01:46 UTC · 400Nov 14, 02:01 UTC · 400Nov 14, 02:16 UTC · 360Nov 14, 02:30 UTC · 360Nov 14, 02:46 UTC · 345Nov 14, 03:01 UTC · 345

Questions

Is wici-ai/inferssd trending on Trendoday Rising right now?

Not at the moment. It was last on the list on Nov 14, 03:01 UTC, after 3 days of trending.

What is the highest rank wici-ai/inferssd reached?

#3 on GitHub · Rising today, on Nov 13, 23:15 UTC. Trendoday checks this list every 60 minutes.

How long has wici-ai/inferssd been trending?

It was first seen on Nov 12, 2026 and has been on the list on 3 days (149 checks) since.

What language is wici-ai/inferssd written in, and what is its license?

Mostly C++; it is licensed under Apache-2.0. It has 621 stars and 73 forks.