About synchopate/llama-modchip
🐋 Run 284B DeepSeek-V4-Flash (<59GiB RAM, 44.4 tok/s pp, 9.1-14.7 tok/s) & 30B MoEs (25-111 tok/s) on a pure 64GB CPU at 256K ctx (0 GPUs). SwiGLU-H2, Stockfish-PVS L3 & 13ms Claude Code restore.
Quickstart · Quantization & Memory Specs · Supported Models · Supported Hardware · Leaderboard · Technical Paper (paper/) · Architecture · FAQ
llama-modchip is a set of ggml/llama.cpp kernel patches, quantization transcoders, and runtime tools designed to run sparse Mixture-of-Experts (MoE) checkpoints entirely in system RAM on x86_64 (AVX-512 / AVX2) and ARM64 (NEON / SVE / Apple Metal) processors:
ai-agentsapple-siliconavx512claude-codecpu-inferencedeepseekdeepseek-v4ggufhpcllama-cpplocal-llmmamba2
- Stars
- 418
- Forks
- 25
- Language
- Python
- License
- Apache-2.0
- Last push
- Nov 8, 2026
- Created
- Oct 29, 2026
Description and README excerpt from synchopate/llama-modchip on GitHub ↗.
Trending history
synchopate/llama-modchip was first seen on GitHub · Rising today on Nov 8, 2026. Since then it has appeared in 2 checks on 1 different day. Its best position was #6 of 30, reached on Nov 8, 20:45 UTC. It dropped off the list after Nov 8, 21:00 UTC. The same link also trended on Hacker News, which raises its cross-platform score.