Skip to content

Teach remote-training skill local desktop/notebook serving - #399

Merged
vertix merged 1 commit into
Positronic-Robotics:mainfrom
vertix:skill-local-serving
May 19, 2026
Merged

Teach remote-training skill local desktop/notebook serving#399
vertix merged 1 commit into
Positronic-Robotics:mainfrom
vertix:skill-local-serving

Conversation

@vertix

@vertix vertix commented May 19, 2026

Copy link
Copy Markdown
Contributor

Summary

PR #392 rewrote the remote-training skill for Nebius Serverless and dropped the local Docker-context serving path entirely — but that path is still valid (the desktop/notebook contexts and docker/docker-compose.yml services remain in the repo) and is the right tool for consumer-GPU inference (LeRobot/ACT/SmolVLA, GR00T inference) without paying for H100.

  • Add a "Serving locally (desktop / notebook)" section: canonical docker --context <ctx> compose run --service-ports <server> pattern, the CACHE_ROOT=/home/vertix quirk, preset/serve subcommand, detached running, client wiring, and the GR00T-OOM / port-conflict gotchas. Defers to docker/CONTEXTS.md + docker-compose.yml as source of truth.
  • Broaden the skill's frontmatter trigger description so it activates for local-serving requests, not just Nebius ones.
  • Does not revert the Nebius rewrite or restore the obsolete VM/SSH (vm-train) machinery — that part is genuinely superseded by Serverless.

Test plan

The Nebius Serverless rewrite dropped the local Docker-context serving path, which is still valid for consumer-GPU inference. Add a concise local-serving section and broaden the skill trigger description.
@vertix
vertix merged commit ebe6cef into Positronic-Robotics:main May 19, 2026
7 checks passed
@vertix
vertix deleted the skill-local-serving branch May 19, 2026 10:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant