Skip to content

SparkQwen on the shared Spark engine, with working image prompts (sparkqwen/atlas-20261015-vision) - #7

Merged
data-angel merged 7 commits into
mainfrom
release/shared-engine-20261015
Oct 16, 2026
Merged

data-angel merged 7 commits into
mainfrom
release/shared-engine-20261015

Conversation

@data-angel

@data-angel data-angel commented Oct 15, 2026 •

Copy link
Copy Markdown
Contributor

Moves SparkQwen onto the one Atlas engine layer it shares with SparkGLM, and makes image prompts work.

  • Engine: sparkqwen/atlas-20261015-vision at 1954e759. It is Atlas-Inf main 7ffd183f, plus the shared layer upstream/atlas-shared-20261015-vision (a9464810), plus the SparkQwen-only commits, each of which compiles. Image tag 4e29c8c22671.

  • RC16 content restored: fixes that lived only in RC16's merge resolutions were lost in the first linear replay and are back.

  • Images:

    • Interleaved image prompts get their own image, where production answered with the other request's.
    • A pasted <|image_pad|> string encodes as text, and a malformed layout fails only its request instead of crashing both ranks.
    • Image conversations hit the prefix cache: turns 2–5 start in 0.25–0.36 s instead of about 22 s, byte-identical to cold.
  • Text: prompt-logprob hash 8713a659d5d3, same as production. sq_bench in line with production.

  • RigMark, RC16's command line at 8x32k/0.88, with the GPU clock cap lifted for the run (production serving stays capped):

    Decode, code / prose / structured (tok/s) 16K cold prefill (tok/s) C1 / C2 / C4 / C8 (tok/s)
    This release 85.0 / 50.2 / 96.5 4,008 60.0 / 105.3 / 167.5 / 254.7
    Production, same pair, back to back 85.8 / 52.4 / 95.3 3,988 60.3 / 101.9 / 174.8 / 266.8
    README (RC16) 86.6 / 51.8 / 98.9 4,043 61.7 / 98.6 / 166.2 / 260.1

    All three runs pass 9/9 output gates. Each concurrency level is a single sampled run, and the capped pair of runs went the other way at C8. The capped runs are in the result too.

Details and receipts are in results/2026-10-15-shared-engine. Not deployed and not published to GHCR; both are left for review.

🤖 Generated with Claude Code

data-angel and others added 4 commits October 15, 2026 04:02
SparkQwen and SparkGLM now build on one Enntity/atlas engine layer,
upstream/atlas-shared-20261015 (fb80cbe0) on Atlas-Inf main 7ffd183f: the
GLM-5.3-Flash series, the Qwen3.8-Flash-Next series and the model-independent
work both products run. The SparkQwen-only RC15/RC16 commits sit on top as
sparkqwen/atlas-20261015-shared (b914c5e1, tree a966cba6); its tree is the
prefill-cache release fcf9735f plus the shared layer's newer work, with RC16's
merge resolutions restored and every commit compiling.

Same-pair A/B against the prefill-cache image: identical prompt-logprob hash
and matching decode, prefill, concurrency and warm-cache numbers
(results/2026-10-15-shared-engine).

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Production and the shared-engine build ran back to back on ennspark01/02,
followed by a smoke run of the release image built from the published pin.
Raw receipts and SHA256SUMS are included.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…-vision)

The vision fixes join the one shared layer (upstream/atlas-shared-20261015-vision
= fb80cbe0 + 5 commits): every vision tower encodes per chunk into
per-sequence state, a malformed vision layout fails only its request, MRoPE
positions come from the whole prompt, vision markup in message text encodes as
text, and every tower's image prompts are keyed for the prefix cache. Both
products pin layers on it.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
The release image on the shared engine with the vision fixes passed the
text, vision and fill checks on ennspark01/02. RigMark ran with the published
command lines.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@data-angel data-angel changed the title SparkQwen on the shared Spark engine (sparkqwen/atlas-20261015-shared) SparkQwen on the shared Spark engine, with working image prompts (sparkqwen/atlas-20261015-vision) Oct 15, 2026
data-angel and others added 3 commits October 15, 2026 12:19
The README's RigMark figures predate the 01/02 clock cap. The headline run
lifts the cap for its duration (CLOCKS=uncapped); production stays capped.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Alternating production and release starts with fixed prompts: step time and
decode are equal to production. The RigMark differences were run-to-run
sampling spread.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
… per layer

Enntity/atlas now has spark-shared, sparkglm and sparkqwen branches. Releases
are tags, and the former dated branches are tags of the same name.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@data-angel
data-angel marked this pull request as ready for review October 16, 2026 01:36
@data-angel
data-angel merged commit 85d00a9 into main Oct 16, 2026
1 check passed
@data-angel
data-angel deleted the release/shared-engine-20261015 branch October 17, 2026 04:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant