Add skill-runtime evals: execute an exported SKILL.md in a real runtime - #70

Open

Karim Mehalebi (karimad) wants to merge 6 commits into

microsoft:mainfrom

karimad:add-skill-runtime-evals

Commits on Aug 24, 2026

Add skill-runtime evals: execute an exported SKILL.md in a real runtime
Karim Mehalebi (karimad)
committed
153f5f0
Address review: exact-token matching, real filter simulation, cleanup, tool-scope
Karim Mehalebi (karimad)
committed
bbd3a69
Address security review: enforce allowed-tools, minimal env, fix mock gaps
Karim Mehalebi (karimad)
committed
91df18b
Document evals/skill-runtime/ in evals/README.md
Karim Mehalebi (karimad)
committed
a8ad66b

Commits on Aug 25, 2026

Fix allowed-tools prefix matching to reject shell-injection bypass
Karim Mehalebi
committed
466c7f2
Fix possibly-undefined reply in skill-runtime eval runner
Karim Mehalebi
committed
0a4c83b