Open source inference engine that tunes its kernels on your hardware to find the fastest way to run each model. 2x faster than Ollama. Works on Apple Silicon, NVIDIA, AMD, Intel, or just a CPU.
Magnitude is an open source inference engine that tunes its kernels on your hardware to find the fastest way to run each model. It's over 2x faster than Ollama and works on Apple Silicon, NVIDIA, AMD, Intel, or just a CPU. One click connects it to the agent you already use (Pi, OpenCode, Hermes, Codex, and more).
⭐ Help us reach more developers and grow the Magnitude community. Star this repo!
- Stars
- 7595
- Forks
- 545
- Language
- Rust
- License
- Apache-2.0
- Last push
- Oct 30, 2026
- Created
- Jun 12, 2026
Description and README excerpt from magnitudedev/magnitude on GitHub ↗.