Add Modern Agent support with skill filtering

[adilei]

Summary

Introduces dual agent type support (Generative Orchestration vs Modern Agents) with deterministic skill filtering, 6 new modern agent authoring skills, and infrastructure fixes.

How skill filtering works

PreToolUse (fires on every Skill tool call)
    │
    ▼
filter-skills.js
    │
    ├─ reads the invoked skill's SKILL.md frontmatter (agent-types tag)
    ├─ if "both" → allow
    ├─ reads settings.mcs.yml to detect workspace agent type
    └─ if mismatch → block with helpful message

Single source of truth: the agent-types tag in each SKILL.md frontmatter. No generated files, no build step, no state files.

CI workflow

.github/workflows/validate-skill-types.yml — fails if any skill is missing agent-types frontmatter or has an invalid value.

New skills (Modern Agents)

Skill	Purpose
new-skill	Create an InlineAgentSkill in topics/ dir
list-skills	List all skills and tools in a modern agent
edit-agent-modern	Edit instructions, output format, model, conversation starters
add-tool	Guide for adding ConnectorTool/McpTool/WorkflowTool (UI connection + YAML edit)
add-knowledge-modern	Add WebsiteKnowledgeSource via YAML; guide for SharePoint/files/Dataverse
edit-skill	Edit InlineAgentSkill markdown content and description

Clone fix

manage-agent clone now accepts --cluster-category N for non-prod environments (was hardcoded to 5/prod, causing 403 on test environments).

Evals

5 eval scenarios covering modern agent authoring: create skill, edit skill, edit instructions, add knowledge, add conversation starters.

---

Known Issues: Push/Pull Tooling

Both the LSP (VS Code extension) and PAC CLI have issues with Modern Agents. These are platform bugs, not plugin bugs.

LSP (manage-agent.bundle.js) — current approach

Issue	Impact	Workaround
Push demotes existing DialogComponents to TranslationsComponents	Tools/skills added via the UI may disappear from the UI after a CLI push. The YAML file is preserved but Dataverse re-registers it as content-only (TranslationsComponent) instead of invocable (DialogComponent).	Only push when you've made changes. If a tool disappears, re-add it via the CPS UI. New components created by the push are registered correctly.
Stale row versions after rapid push cycles	PreconditionFailed / ConcurrencyVersionMismatch errors on push.	Always pull before push. If push still fails, re-clone the agent.
Clone hardcodes prod cluster	403 Forbidden when cloning from non-prod environments.	Use --cluster-category 1 for test environments (fixed in this PR).
Clone nests directories	Agent cloned into workspace/agent-name/agent-name/.	Scripts should detect and flatten the nesting after clone.

PAC CLI (pac copilot) — future approach

Issue	Impact	Workaround
pac copilot push crashes on $kind format	ArgumentOutOfRangeException in KindFromType when reading Modern Agent YAML. Cannot push Modern Agents at all.	Use LSP for push. PAC clone works fine.
Feature flag required	pac copilot clone/pull/push commands are hidden behind verbCopilotSync: "on" in featureflags.json.	Set flag in ~/.dotnet/tools/.store/microsoft.powerapps.cli.tool/<version>/.../featureflags.json.
Requires .NET 10	PAC CLI v2.7.4 needs .NET 10 runtime.	Install via Homebrew: brew install dotnet@10.

Recommendation

Use the LSP for all push/pull/clone/publish operations. Be aware of the DialogComponent demotion bug — avoid pushing if you haven't changed tool files. Switch to PAC CLI once the $kind crash is fixed.

---

Test plan

• Skill filtering: modern skill blocked on classic workspace with helpful message
• Skill filtering: classic skill works on classic workspace
• Clone: --cluster-category 1 enables clone on test environments
• Push: instructions, skills, knowledge sources round-trip via pull → edit → push
• Push: new skill in topics/ creates DialogComponent (visible in UI)
• Push: new knowledge source appears in UI
• CI: validates all skills have agent-types tag
• Evals: 22/25 content checks pass (3 skill tracing failures are eval harness limitation)
• Modern skills on modern workspace (manual testing — hook blocking confirmed working)

🤖 Generated with Claude Code