Yardmaster

Yardmaster is a two-stage LLM router for a group of computers on the same
network. It merges two NVIDIA projects into one system: NeMo
Switchyard decides which model a
request should use, and Personal AI Router
(PAIR) decides which node runs
it. The two decisions are orthogonal; Yardmaster composes them and keeps PAIR's
product shape: install, pair with a six-digit PIN, add a model, point an app at
one local endpoint, watch jobs.

Prompts and responses stay on the local network by default. Off-LAN providers
exist but are disabled until you turn them on in the config file and the
desktop UI.

Yardmaster routes each independent request to one model on one node. It does
not pool GPU memory, combine GPUs into a larger logical GPU, shard one
model across machines, or split an in-flight request between nodes.

The two-stage router in one paragraph

Every request is translated into Switchyard's provider-neutral protocol, then
model selection runs: the request's model field names a Switchyard route,
whose typed algorithm (passthrough, random, stage_router, llm_classifier,
escalation, or Yardmaster's plan_execute) picks a logical model name for a
tier — qwen4:12b, nemotron-3.5-lightning, openrouter/anthropic/claude-....
Then placement runs: that logical model is resolved against the live cluster,
nodes whose running engine advertises it form the candidate set, PAIR's
model-blind scheduler orders them, and the request is forwarded to the first
candidate with PAIR's existing 404-is-retryable failover. Finally the response is
translated back to whatever protocol the client spoke. A bare model name that is
not a configured route falls through as a passthrough route, so PAIR's
"point curl at :11434 with qwen4:12b" flow works unchanged with no config
file present.

flowchart LR
    C[Client<br/>OpenAI / Anthropic / Ollama] --> I[Ingress translation<br/>:11434 / :1234 / :4000]
    I --> M[Stage 1 — Model selection<br/>Switchyard algorithm on the named route<br/>picks a logical model for a tier]
    M --> P[Stage 2 — Placement<br/>PAIR capability gate + scheduler ordering<br/>picks a node from the candidate set]
    P --> E[Egress translation<br/>to the engine's native wire format]
    E --> N[(Engine on chosen node<br/>Ollama / LM Studio / promoted LAN / remote provider)]
    N --> E2[Response + stream translation<br/>back to the client's protocol] --> C

What is supported

Yardmaster running on a machine does not mean an engine will. Each engine
sets its own OS, GPU, and driver requirements, and each model needs enough memory
to load. A node becomes a candidate for a request only once it is actually
running a compatible engine that advertises the model.

Quick start

The recommended path is a released desktop build. Building from source and the
terminal interface exist for changing Yardmaster and for machines with no
desktop; see docs/architecture.md and
docs/migrating-from-pair.md.

1. Install on two or more machines on the same LAN.
2. Pair them: one machine shows a six-digit PIN, the other enters it. This
   is the unchanged PAIR pairing flow and builds the mTLS cluster.
3. Add a model on a node through its managed engine (Ollama or LM Studio).
4. Point an app at one machine's local endpoint — http://localhost:11434
   (Ollama-compatible), http://localhost:1234/v1 (OpenAI-compatible), or
   http://localhost:4000/v1/messages (Anthropic Messages). Existing clients
   gain the cluster unchanged.
5. Send a request. With no yardmaster.toml, a bare model name is a
   passthrough route and behaves exactly like PAIR.
6. Start the agent. Open the Agent tab and press Start Harness (or
   run dsh headless --profile yardmaster-headless "<task>" from the TUI). This
   launches DeepSeek Harness with the Yardmaster profile as the default agent
   experience, using the cluster as its model substrate.

Add a first route from the Routes view when you want model selection — for
example a plan_execute route that sends planning turns to a heavier tier and
execution turns to cheap local models. See
docs/routing.md and docs/plan-execute.md.

Uninstalling

Yardmaster uses PAIR's installers and data directory. Uninstall the same way you
uninstall PAIR for your platform; remove yardmaster.toml and the metrics
database from PAIR's data directory to clear Yardmaster-specific state. Full
steps are in docs/migrating-from-pair.md.

Documentation

Project status

Yardmaster is bootstrapped: the repository structure, legal and governance
files, the git subtree import of PAIR's services/ and desktop/, the Cargo
workspace with typed crate skeletons, the yardmaster-lan-scanner Go worker
scaffold (config validation, store, and classification implemented and tested),
the DeepSeek Harness plugin and bundle (tier policy, adapter headers, and the
bundle patch implemented and tested), all CI workflows, and the full docs set
and ADRs are in place. Each subsystem's implementation is tracked by a
blocked
issue. See decisions/0002.

Releases

See the releases page.
Release artifacts are unsigned; code signing and notarization are not yet in
scope and the gap is noted in each release's notes. The first tag is deferred
until the workspace builds end to end
(#39).

Where Yardmaster is going

PAIR's README says routing "is the clearest example" of where it wants to grow —
a real policy layer, and letting you choose a policy. That layer is exactly what
Switchyard brings, and wiring the two together is what Yardmaster is. Near-term
directions: warm_first and vram_aware placement policies (opt-in today), a
richer cost model, more provider kinds, and tighter harness/routing feedback
(cache-hit-rate-aware tier demotion). Feedback from people running Yardmaster on
their own mixed hardware shapes this more than any plan written in advance —
open an issue.

Contributing and governance

• Contributing — DCO sign-off, Conventional Commits, upstream AGENTS.md rules
• Code of Conduct — Contributor Covenant 2.1
• Governance — single-maintainer BDFL, stated plainly

Support

See SUPPORT.md for public support channels and scope.

Security

Yardmaster serves local HTTP inference endpoints, discovers endpoints on the
LAN, bootstraps trust with a PIN, and can optionally reach off-LAN providers.
Read SECURITY.md and docs/security.md before
running it on an untrusted or shared network. Do not report vulnerabilities in
a public issue, and do not contact NVIDIA PSIRT or DeepSeek — Yardmaster is
neither project's product.

License

Apache License 2.0 (see LICENSE). Yardmaster composes NVIDIA NeMo
Switchyard and NVIDIA Personal AI Router (both Apache-2.0, Copyright NVIDIA
CORPORATION & AFFILIATES) and depends on DeepSeek Harness (MIT, Copyright
DeepSeek). See NOTICE and
THIRD_PARTY_NOTICES.md. Inference engines, models,
and providers used with Yardmaster have separate terms.