All 89 Dependencies
Every package Magnitude depends on, ranked by repo health score.
Magnitude is an open source inference engine built for running large language models on the hardware people already own. Instead of asking users to guess which model fits their machine, it profiles the chip, memory, and bandwidth first, estimates tokens-per-second for every model in its catalog, and ranks them by speed, accuracy, intelligence, and memory footprint before anything downloads.
Once a model is selected, Magnitude handles the rest of the lifecycle: downloading, hardware-specific tuning (including speculative decoding), and serving. Models load on demand when an agent needs them and unload automatically when idle or when memory pressure rises, so the desktop app can sit in the background without babysitting.
The project is aimed squarely at people already using AI coding agents locally. A one-click Connections flow wires Magnitude's local inference server into harnesses like Pi, OpenCode, Hermes, OpenClaw, Codex, Claude Code, Oh My Pi, and Cline, so those tools can point at locally-served models instead of a hosted API. Everything — prompts, files, and the models themselves — stays on the machine, and once a model is downloaded no network connection is required to use it.
Magnitude ships as native desktop apps for macOS, Windows, and Linux, bundling a `magnitude` CLI, with the core inference engine written in Rust for performance and the surrounding orchestration (CLI, desktop app, daemon, client SDKs) written in TypeScript on Bun. It is licensed under Apache 2.0 with no paid tier or license-gated functionality.