feat: add DCU kernel auto optimization task - #26
Merged
Conversation
fms-zth
force-pushed
the
feat/dcu-kernel-auto-opt
branch
2 times, most recently
from
August 31, 2026 07:34
3213cb9 to
9fdf083
Compare
…ema APIs - StateStore.init_or_resume() no longer takes task_type (SSOT in requirements.json); drop the extra argument at all call sites - next-app form schema no longer propagates override_module (override components self-register); drop the stale assertion
fms-zth
force-pushed
the
feat/dcu-kernel-auto-opt
branch
from
August 31, 2026 08:55
9fdf083 to
73c213c
Compare
dsh_agent.main() exits 1 without credentials (TENCENT_API_KEY env or ~/.dsh/.credentials.yaml), which CI runners lack, so three tests failed on the GitHub runner while passing on dev machines. Inject a dummy API key inside run_wrapper and restore the environment afterwards.
fms-zth
added a commit
to fms-zth/MetaInfer
that referenced
this pull request
Sep 11, 2026
Content imported from the DCU dev container tree (/root/zth_agent/MetaInfer), 3-way merged onto the merged PR HuangPuStar#26 head so the next-app alignment and CI fixes stay in place. Scope is limited to this task plugin. Added: - orchestrator: planner.py (+ planner_policy/manifest/gates), gate_policy.py, gpu_preflight.py, harness_io.py, predictions.py, validation_budget.py, variant_promote.py - harness_default/: planner_catalog.yaml, planner_policy.yaml, manifest.yaml, gates.yaml - reports/: best-variant tables (csv/json/xlsx) and the summary scripts - skills/: int8-w8a8-gemm foundations/decode/prefill skill packs - tools/baseline/: Triton INT8 benchmark harness, baseline graph JSONs - 11 new test modules (planner, gate policy, gpu preflight, harness io, predictions, validation budget, variant promote, plan render, prompt schema, planner wiring, planner policy) - retuned variant kernels for glm52/TP8 and hy3/TP4, refreshed WORKFLOW.md Changed: - gen_and_opt_pipeline.py, w8a8_pipeline.py, real_pipeline.py, pipeline.py, skill_store.py, variant_store.py, server/routes.py, static (detail view, shape input, css), form.yaml, bridge/dsh/dsh_agent.py, api/assets helpers - PR-side fixes kept: init_or_resume(task_id) alignment (73c213c) and the CPU-only-CI torch guards (3d70f58) / hermetic dsh tests (6a8f235) Excluded: *.bak-* kernel backups.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Add a new
dcu-kernel-auto-opttask plugin for automated DCU kernel generation and optimization on Hygon K500SM_AI / gfx928.The workflow uses multiple isolated agents and GPU workers to generate, benchmark, profile, optimize, synthesize, and validate HIP kernels. The initial production target is INT8 W8A8 GEMM for DeepSeek-V4 TP4/TP8 workloads.
Key changes
dcu-kernel-auto-opttask plugin, including:next-appform widget registry.Workflow
The task follows this high-level pipeline:
Agents are restricted to their assigned source files. Compilation, benchmarking, profiling, artifact verification, and final acceptance remain under control-plane ownership.
Compatibility with
next-appThis branch is rebased onto the latest
next-app.The DCU-specific form widget is registered through the new shared form widget registry, and the pipeline has been adapted to the current
StateStore.init_or_resume()API.Validation
Local non-GPU test suite: