Skip to content

[milestone Milestone 12] bench/smt-bench.md β€” SMT solver performance baseline: run 50 constraint prob...Β #260

Description

@telleroutlook

πŸ€– Auto-filed from milestone doc bullet.

Repo: WasmAgent/symkernel
Milestone: Milestone 12 β€” Advanced Symbolic Reasoning & Z3 Integration (Phase 2)
Bullet:

bench/smt-bench.md β€” SMT solver performance baseline: run 50 constraint problems of varying complexity (linear arithmetic, bitvector operations, array operations) across Z3, CVC5, and Yices2; output comparison table of solve time and memory usage

Relevant code context (from worktree)

new (does not exist yet): bench/smt-bench.md
contains 'bench': ""/tmp/tmp.ufhVOKX3Uq"/wasmagent-js"/examples/benchmarks/judge/judge.py
contains 'bench': ""/tmp/tmp.ufhVOKX3Uq"/wasmagent-js"/docs/.vitepress/config.ts
contains 'bench': ""/tmp/tmp.ufhVOKX3Uq"/wasmagent-js"/packages/claude-agent-sdk/src/index.ts
contains 'solver': ""/tmp/tmp.ufhVOKX3Uq"/wasmagent-js"/packages/compliance/src/ir/ConstraintIR.test.ts
contains 'solver': ""/tmp/tmp.ufhVOKX3Uq"/wasmagent-js"/packages/compliance/src/ir/ConstraintIR.ts
contains 'solver': ""/tmp/tmp.ufhVOKX3Uq"/wasmagent-js"/packages/compliance/src/verifier/ComplianceVerifier.ts
contains 'performance': ""/tmp/tmp.ufhVOKX3Uq"/wasmagent-js"/packages/compliance/src/runner/ComplianceRun.ts
contains 'performance': ""/tmp/tmp.ufhVOKX3Uq"/wasmagent-js"/packages/compliance/src/repair/RepairPlanner.ts
contains 'performance': ""/tmp/tmp.ufhVOKX3Uq"/wasmagent-js"/packages/compliance/benchmarks/ifeval/run.ts

Implementation note: Files marked "new (does not exist yet)" must be created from scratch. verify-first should return PROCEED (not NOT_YET) β€” there is no prerequisite blocking this work.

Acceptance criteria

  • Command test -s bench/smt-bench.md passes
  • The specific work described in the bullet above is implemented in the smallest number of files required.
  • No unrelated files touched (git status --short output limited to the intended change).

Notes for the implementer

This issue was auto-created by SweepMilestoneBulletToIssue. The bullet text is verbatim
from the milestone doc. If ambiguous or too large for a single implement cycle,
verify-first should return NEEDS_SPLIT with sub-issue proposals or NEEDS_HUMAN with the blocker.


Filed automatically.

Metadata

Metadata

Assignees

No one assigned

    Labels

    claudeBot-managed issue

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions