Skip to content

Latest commit

 

History

History
23 lines (18 loc) · 1.38 KB

File metadata and controls

23 lines (18 loc) · 1.38 KB

AGENTS.md

Strata runs the Qwen3.8-Flash-Next mixture-of-experts model (and its Coder, Swift 1.5 and Unsloth variants) on a normal PC: one NVIDIA or AMD graphics card plus system RAM, on Windows or Linux. It has a C++/CUDA/HIP engine (src/, include/), a Python server with an OpenAI- and Anthropic-compatible API and a web app (serve/), and a one-click installer (setup.py, started by START-HERE.bat / setup.sh).

Installing Strata for a user

Follow docs/AI_SETUP.md: check the PC, pick the model by RAM, run setup non-interactively, start and verify the server, and connect the user's apps. Never expose the server beyond 127.0.0.1 without --api-key. As an alternative to shell commands, Strata's MCP server (docs/MCP_SERVER.md) offers the same steps as tools.

Working on the code

  • How the engine works, every measured number, the API and all settings: docs/DETAILS.md and the paper.
  • AMD (HIP) build and validation: docs/AMD_HIP.md; multi-GPU: docs/MULTI_GPU.md.
  • Setup's own tests run without a GPU or downloads: python tools/test_setup_<name>.py (for example tools/test_setup_amd.py, tools/test_setup_choices.py).
  • Keep the docs' style: plain words, measured numbers with what they were measured on, no claims without a measurement.