All 142 Dependencies

Every package mesh-llm depends on, ranked by repo health score.

Mesh LLM pools the GPUs and memory of every machine an operator owns and exposes the combined capacity as a single OpenAI-compatible API at `http://localhost:9337/v1`. Running `mesh-llm serve --auto` on a node picks a suitable backend, downloads a model if one isn't already present, joins the best available mesh, and starts both the inference API and a web console — so a laptop, a gaming rig, and a workstation can act as one inference cluster instead of three separate, underused servers.

Two design choices set it apart from single-box local-LLM runners. Skippy stage splits let a dense model too large for any one machine's VRAM load as contiguous transformer-layer stages spread across several peers: the coordinator plans the layer ranges, starts downstream stages first, waits for them to report ready, and only then publishes the stage-0 route, so a request for an oversized model is transparently served by a chain of machines instead of failing outright. An experimental Mixture-of-Agents gateway takes the opposite approach for a single request — sending `"model": "mesh"` fans the prompt out to every model currently running in the mesh, arbitrates the responses deterministically in code, and only calls out to a reducer LLM when the answers genuinely conflict.

Meshes can stay private (joined by invite token) or advertise themselves publicly through Nostr-based discovery, with an explicit owner-control plane kept separate from the public inference/gossip/routing plane so operator actions don't need to trust the same channel as anonymous public traffic. Releases ship as native binaries for macOS, Linux (CPU, ARM64, CUDA, ROCm, Vulkan), and Windows (CPU, CUDA, ROCm, Vulkan), distributed via a companion packaging repository with Homebrew, apt, and pacman channels, checksums, SBOMs, and embedded release attestation so a packaged binary's provenance can be verified after download.

29 urlencoding 2 31 crypto_box 0.9 outdated 33 dirs-rs 6.0.0 outdated 34 tabwriter 1 35 include_dir 0.7 37 hex 0.4 40 idb ^8.0.3 40 json5 1.3.1 40 rehype-highlight ^7.0.2 40 remark-gfm ^4.0.1 42 clsx 2.1.1 42 tw-animate-css 1.4.0 43 ansi-to-tui 8 44 remark-math ^6.0.0 46 nix 0.29.0 outdated 47 rpassword 5 outdated 49 ctrlc 3.5 50 serde_yaml 0.9 52 httparse 1 53 semver 1 54 csv 1.4.0 55 Tower 0.5 56 libloading 0.8 outdated 59 argon2 0.5 outdated 59 tracing 0.1 59 tracing 0.3 outdated 62 getrandom 0.3 outdated 62 tar 0.4 64 socket2 0.6 65 react-markdown ^10.1.0 65 Schemars 1 66 React Testing Library 16.3.2 outdated 67 react-diff-viewer-continued ^4.2.2 67 url 2 68 jest-dom 6.9.1 outdated 68 arboard 3 68 base64 0.22 outdated 68 prost 0.14 69 Anime.js ^4.5.0 69 eslint-config-prettier 10.1.8 69 serial_test 3 outdated 70 bytes 1 70 http-body 0.1 outdated 71 sha2 0.10 outdated 72 hf-hub 1.0.0-rc.1 74 zeroize 1 75 anyhow 1 75 globals ^17.7.0 75 tempfile 3 76 Radix UI ^1.2.14 76 Radix UI ^1.1.17 76 Radix UI 1.1.14 outdated 76 Radix UI 1.1.17 outdated 76 Radix UI ^2.1.18 outdated 76 Radix UI 1.1.17 outdated 76 Radix UI 1.2.16 outdated 76 Radix UI 1.1.17 outdated 76 Radix UI 1.4.1 outdated 76 Radix UI ^1.2.12 76 Radix UI 2.3.1 outdated 76 Radix UI ^1.1.10 76 Radix UI 1.4.1 outdated 76 Radix UI ^1.3.0 76 Radix UI 1.1.15 outdated 76 Radix UI ^1.1.13 76 Radix UI 1.2.10 outdated 76 serde_json 1 76 thiserror 2 76 toml 0.9 outdated 76 toml 0.25 outdated 77 async-trait 0.1 77 Chrono 0.4 77 flate2 1 77 http 1 77 serde 1 78 Transformers.js ^4.2.0 78 curve25519-dalek =3.0.0-rc.0 outdated 78 UniFFI =0.31.0 outdated 79 keyring-rs 3 outdated 80 user-event 14.6.1 outdated 80 Crossterm 0.28 outdated 81 Nostr SDK 0.44.1 outdated 81 regex 0.1 outdated 82 mdns-sd 0.19 outdated 82 rand 0.10 outdated 83 class-variance-authority 0.7.1 83 reqwest 0.12 outdated 84 Rustyline 18 84 uuid 1 85 TanStack AI ^0.38.0 outdated 85 TanStack AI ^0.19.0 outdated 85 TanStack AI ^0.16.0 outdated 86 Autoprefixer ^10.5.2 88 Ratatui 0.30 88 rmcp 1.8 outdated 88 tailwind-merge 3.6.0 88 tonic 0.14 88 Valibot ^1.4.2 88 zip 2 outdated 89 highlight.js ^11.11.1 89 rusqlite 0.37 outdated 90 Tailwind CSS 4.3.2 outdated 90 Tailwind CSS 4.3.1 outdated 90 Clap 4 90 napi-rs 2.16.17 outdated 90 napi-rs 2.16.13 outdated 90 prettier 3.9.1 outdated 90 Tailwind CSS 4.3.1 outdated 91 Playwright 1.61.1 outdated 91 axum 0.8 91 lucide-react ^1.22.0 91 lucide-react ^1.22.0 91 OpenTelemetry Rust 0.31.0 outdated 91 OpenTelemetry Rust 0.31.0 outdated 91 OpenTelemetry Rust 0.31.0 outdated 91 OpenTelemetry Rust 0.31.0 outdated 91 Playwright ^1.61.1 92 TanStack Query ^5.101.2 92 @vitejs/plugin-react 6.0.3 outdated 92 futures 0.3 92 futures 0.3 92 futures 0.3 92 iroh 1.0.0 92 jsdom ^29.1.1 outdated 92 KaTeX ^0.17.0 outdated 92 Mermaid ^11.16.0 92 Vitest 4.1.9 outdated 93 rustls 0.23 93 Tokio 1 93 Tokio 0.1 outdated 93 Vite 8.1.0 outdated 94 ESLint 10.0.1 outdated 94 TanStack Router ^1.170.16 94 TanStack Router ^1.168.18 94 ESLint ^10.6.0 94 libc 0.2 outdated 94 PDF.js ^6.1.200 94 typescript-eslint ^8.62.0 96 TypeScript 6.0.3 outdated 97 React 7.1.1 outdated 97 React 19.2.7 outdated 97 React DOM 19.2.7 outdated

Join founders buildingwith open source

Opinionated takes, migration guides, cost-saving tips, and insights from the open source ecosystem.

Subscribe on Substack
Join 750+ subscribers

Search