All 142 Dependencies

Every package mesh-llm depends on, ranked by repo health score.

Mesh LLM pools the GPUs and memory of every machine an operator owns and exposes the combined capacity as a single OpenAI-compatible API at `http://localhost:9337/v1`. Running `mesh-llm serve --auto` on a node picks a suitable backend, downloads a model if one isn't already present, joins the best available mesh, and starts both the inference API and a web console — so a laptop, a gaming rig, and a workstation can act as one inference cluster instead of three separate, underused servers.

Two design choices set it apart from single-box local-LLM runners. Skippy stage splits let a dense model too large for any one machine's VRAM load as contiguous transformer-layer stages spread across several peers: the coordinator plans the layer ranges, starts downstream stages first, waits for them to report ready, and only then publishes the stage-0 route, so a request for an oversized model is transparently served by a chain of machines instead of failing outright. An experimental Mixture-of-Agents gateway takes the opposite approach for a single request — sending `"model": "mesh"` fans the prompt out to every model currently running in the mesh, arbitrates the responses deterministically in code, and only calls out to a reducer LLM when the answers genuinely conflict.

Meshes can stay private (joined by invite token) or advertise themselves publicly through Nostr-based discovery, with an explicit owner-control plane kept separate from the public inference/gossip/routing plane so operator actions don't need to trust the same channel as anonymous public traffic. Releases ship as native binaries for macOS, Linux (CPU, ARM64, CUDA, ROCm, Vulkan), and Windows (CPU, CUDA, ROCm, Vulkan), distributed via a companion packaging repository with Homebrew, apt, and pacman channels, checksums, SBOMs, and embedded release attestation so a packaged binary's provenance can be verified after download.

27 urlencoding 2 32 crypto_box 0.9 outdated 34 tabwriter 1 35 include_dir 0.7 36 hex 0.4 40 rehype-highlight ^7.0.2 40 remark-gfm ^4.0.1 42 clsx 2.1.1 42 rpassword 5 outdated 42 tw-animate-css 1.4.0 43 libloading 0.8 outdated 44 remark-math ^6.0.0 44 semver 1 45 csv 1.4.0 45 httparse 1 46 base64 0.22 outdated 46 react-diff-viewer-continued ^4.2.2 50 Tower 0.5 50 serde_yaml 0.9 53 ansi-to-tui 8 53 ctrlc 3.5 53 tar 0.4 55 idb ^8.0.3 58 jest-dom 6.9.1 outdated 60 Chrono 0.4 60 React Testing Library 16.3.2 outdated 62 nix 0.29.0 outdated 63 async-trait 0.1 63 react-markdown ^10.1.0 64 prost 0.14 64 tempfile 3 66 Anime.js ^4.5.0 66 getrandom 0.3 outdated 66 json5 1.3.1 67 argon2 0.5 outdated 67 eslint-config-prettier 10.1.8 68 bytes 1 68 curve25519-dalek =3.0.0-rc.0 outdated 68 http-body 0.1 outdated 68 serial_test 3 outdated 68 url 2 69 anyhow 1 69 socket2 0.6 70 Schemars 1 70 regex 0.1 outdated 72 serde 1 72 user-event 14.6.1 outdated 73 hf-hub 1.0.0-rc.1 73 rand 0.10 73 sha2 0.10 outdated 74 aes-gcm 0.10 outdated 74 globals ^17.7.0 74 thiserror 2 76 arboard 3 77 Radix UI ^1.2.14 77 Radix UI ^1.1.17 77 Radix UI 1.1.14 outdated 77 Radix UI 1.1.17 outdated 77 Radix UI ^2.1.18 outdated 77 Radix UI 1.1.17 outdated 77 Radix UI 1.2.16 outdated 77 Radix UI 1.1.17 outdated 77 Radix UI 1.4.1 outdated 77 Radix UI ^1.2.12 77 Radix UI 2.3.1 outdated 77 Radix UI ^1.1.10 77 Radix UI 1.4.1 outdated 77 Radix UI ^1.3.0 77 Radix UI 1.1.15 outdated 77 Radix UI ^1.1.13 77 Radix UI 1.2.10 outdated 77 toml 0.9 outdated 77 toml 0.25 outdated 78 http 1 78 reqwest 0.12 outdated 79 UniFFI =0.31.0 outdated 80 tracing 0.1 80 tracing 0.3 outdated 81 keyring-rs 3 outdated 81 zeroize 1 82 Nostr SDK 0.44.1 outdated 82 flate2 1 82 serde_json 1 83 Crossterm 0.28 outdated 83 Transformers.js ^4.2.0 83 class-variance-authority 0.7.1 85 futures 0.3 85 futures 0.3 85 futures 0.3 86 Autoprefixer ^10.5.2 86 Valibot ^1.4.2 86 mdns-sd 0.19 outdated 87 Rustyline 18 outdated 87 TanStack AI ^0.38.0 outdated 87 TanStack AI ^0.19.0 outdated 87 TanStack AI ^0.16.0 outdated 87 uuid 1 88 highlight.js ^11.11.1 88 rmcp 1.8 outdated 88 tailwind-merge 3.6.0 outdated 89 Ratatui 0.30 89 rusqlite 0.37 outdated 89 zip 2 outdated 90 Clap 4 90 jsdom ^29.1.1 outdated 90 napi-rs 2.16.17 outdated 90 napi-rs 2.16.13 outdated 91 KaTeX ^0.17.0 outdated 91 Tailwind CSS 4.3.2 outdated 91 Tailwind CSS 4.3.1 outdated 91 Tailwind CSS 4.3.1 outdated 91 iroh 1.0.0 91 prettier 3.9.1 outdated 92 @vitejs/plugin-react 6.0.3 outdated 92 OpenTelemetry Rust 0.31.0 outdated 92 OpenTelemetry Rust 0.31.0 outdated 92 OpenTelemetry Rust 0.31.0 outdated 92 OpenTelemetry Rust 0.31.0 outdated 92 Playwright 1.61.1 outdated 92 Playwright ^1.61.1 92 TanStack Query ^5.101.2 92 axum 0.8 92 lucide-react ^1.22.0 92 lucide-react ^1.22.0 92 tonic 0.14 93 Mermaid ^11.16.0 outdated 93 TanStack Router ^1.170.16 93 TanStack Router ^1.168.18 93 Vitest 4.1.9 outdated 93 libc 0.2 94 PDF.js ^6.1.200 94 Vite 8.1.0 outdated 94 rustls 0.23 94 typescript-eslint ^8.62.0 95 ESLint 10.0.1 outdated 95 ESLint ^10.6.0 95 Tokio 1 95 Tokio 0.1 outdated 95 TypeScript 6.0.3 outdated 98 React 7.1.1 outdated 98 React 19.2.7 outdated 98 React DOM 19.2.7 outdated

Join founders buildingwith open source

Opinionated takes, migration guides, cost-saving tips, and insights from the open source ecosystem.

Subscribe on Substack
Join 750+ subscribers