You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
mutate: dedicated template operators for semantic_rephrase and indirect_request #24
MutationEngine advertises six operators (ALL_OPERATORS in packages/mutiny_core/src/mutiny_core/mutate/engine.py). Without an LLM, template fallback aliases:
Logical operator
Template mapped to
semantic_rephrase
authority_escalation
indirect_request
confirmation_bypass
argument_nudging
argument_nudge_template (real)
So offline/template campaigns never exercise distinct rephrase or indirect-request strategies — lineage claims mutate:semantic_rephrase while template_operator is authority framing.
TemplateMutator / TEMPLATE_OPERATORS in templates.py — no semantic_rephrase / indirect_request implementations
tests/unit/test_mutate.py covers multi_turn / generic mutate, not these aliases
Why it matters
Most CI and sample runs are template-mode (MUTINY_SAMPLE_OFFLINE). Distinct operators improve search diversity without requiring Featherless.
Proposed direction
Implement deterministic template transforms:
semantic_rephrase — paraphrase last user turn via synonym/template bank; preserve tool/ask intent from AttackFocus.
indirect_request — wrap the ask as “draft/prepare a call to {tool} …” without APR/manager prefixes (those stay on confirmation_bypass / authority).
Keep LLM prompts as-is; only fix the no-LLM path. Add unit tests asserting metadata.template_operator matches the logical name (or equals a dedicated template id).
Acceptance criteria
Template path for semantic_rephrase and indirect_request no longer silently uses authority/confirmation templates
Seedable / deterministic with rng_seed
Unit tests for both operators + lineage fields
No Hosted or policy evaluator changes
Testing expectations
uv run pytest tests/unit/test_mutate.py -q
Scope / NOT included
New LLM providers; changing fitness; jailbreak corpora
Opened PR #144 with dedicated, deterministic templates for semantic_rephrase and indirect_request, plus lineage and fallback tests. All 780 tests and seven CI checks pass.
Activity
BasilZafar11 commentedon Nov 9, 2026
Opened PR #144 with dedicated, deterministic templates for semantic_rephrase and indirect_request, plus lineage and fallback tests. All 780 tests and seven CI checks pass.
#144