Skip to content

Update level-5 fixture with real example#5

Merged
lingzhong merged 2 commits into
mainfrom
lingzhong/level-5
May 14, 2026
Merged

Update level-5 fixture with real example#5
lingzhong merged 2 commits into
mainfrom
lingzhong/level-5

Conversation

@lingzhong

@lingzhong lingzhong commented May 14, 2026

Copy link
Copy Markdown
Owner

Summary

Updates the Level 5 (Agent-Native) test fixture to use real example instead of the generic agent-native-example.com. This includes updated URLs, response bodies, metadata, and test results reflecting a set of actual agent-native capabilities including MCP server cards, A2A agent cards, WebMCP tools, and payment protocol support.

Test plan

  • tests/test.sh passes locally.
  • shellcheck scripts/check-readiness.sh tests/test.sh tests/mock-server.sh exits 0.
  • actionlint exits 0.

lingzhong and others added 2 commits May 14, 2026 01:00
The previous level-5 fixture was a synthetic capture from
agent-native-example.com, which does not resolve to a real site
(live scans of that domain return level: null). Replaced with a
live scan of finchip.ai, currently the only public site confirmed
at level 5.

Side benefits:
- First real-world coverage of the commerce.mpp check (added to
  the scanner API after v0.1.0)
- Populated evidence[] arrays match current scanner output shape

No script changes; tests/test.sh case "level-5-passes-at-min-5"
still passes (asserts level=5, passed=true, Agent-Native).

https://claude.ai/code/session_017MiTntmC1GAevg5K7aJzfZ
@lingzhong lingzhong changed the title Update level-5 fixture with FinChip.ai test data Update level-5 fixture with real example May 14, 2026
@lingzhong lingzhong merged commit 927aac5 into main May 14, 2026
4 checks passed
@lingzhong lingzhong deleted the lingzhong/level-5 branch May 14, 2026 08:11
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants