Repository navigation
corpus: rust-axum-no-auth + java-xxe + swift-keychain (toward #84) - #116
Merged
Merged
Conversation
Third batch of under-covered-language bench tasks. Bench 15 → 18 tasks. Three more matcher slugs exercised across the Phase-2/3 languages. ## rust-axum-no-auth Exercises `rust-axum-no-auth-extractor` — state-changing axum POST route without an auth extractor in the handler signature. The matcher is noise_tier=noisy because handler-auth analysis is context-dependent; the bench task pins the regex hook. `matcher_exclude = ["axum-handler", "auth-bypass"]` — the unrelated `axum-handler` and `auth-bypass` matchers fire on literally every axum route + a router file shape; they're noise on this slug-under-test. ## java-xxe Exercises `java-xxe` (and the bundled language-agnostic `xxe-xml-parser` sibling) — `DocumentBuilderFactory.newInstance()` without external-entity hardening. Single-method fixture; decoy is a non-XML method on the same class. ## swift-keychain-no-access Exercises `swift-keychain-no-access-control` — `SecItemAdd` without `kSecAttrAccessControl`, leaving the keychain item readable without auth prompt. Single-function fixture; decoy is a token-formatting helper that doesn't touch the keychain. ## Scoring Each task standalone: **recall 1.0**, **precision 1.0**, **0 decoy FPs**. Whole-bench: task_count 15 → 18 (+3) recall 0.9706 → 0.9730 (better) precision 1.0 → 1.0 (unchanged) decoy FP 0 0 ## Toward #84 18 of 30 target tasks. Halfway-plus. Now covering: - Java (3 fixtures, 7 slugs) - Rust (2 fixtures, 3 slugs) - C (1 fixture, 2 slugs) - Kotlin (1 fixture, 2 slugs) - Swift (2 fixtures, 2 slugs) - Ruby (1 fixture, 1 slug) - TS / Python / Go (the pre-existing corpus) Remaining under-covered: PHP and C# both at zero (would need matcher PRs first), more JVM Spring shapes, the WKWebView / intent-implicit Kotlin Android slugs, more Swift secure-trust flavors. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
13 of 15 tasks
noeljackson
added a commit
that referenced
this pull request
May 15, 2026
) Third batch of under-covered-language bench tasks. Bench 15 → 18 tasks. Three more matcher slugs exercised across the Phase-2/3 languages. ## rust-axum-no-auth Exercises `rust-axum-no-auth-extractor` — state-changing axum POST route without an auth extractor in the handler signature. The matcher is noise_tier=noisy because handler-auth analysis is context-dependent; the bench task pins the regex hook. `matcher_exclude = ["axum-handler", "auth-bypass"]` — the unrelated `axum-handler` and `auth-bypass` matchers fire on literally every axum route + a router file shape; they're noise on this slug-under-test. ## java-xxe Exercises `java-xxe` (and the bundled language-agnostic `xxe-xml-parser` sibling) — `DocumentBuilderFactory.newInstance()` without external-entity hardening. Single-method fixture; decoy is a non-XML method on the same class. ## swift-keychain-no-access Exercises `swift-keychain-no-access-control` — `SecItemAdd` without `kSecAttrAccessControl`, leaving the keychain item readable without auth prompt. Single-function fixture; decoy is a token-formatting helper that doesn't touch the keychain. ## Scoring Each task standalone: **recall 1.0**, **precision 1.0**, **0 decoy FPs**. Whole-bench: task_count 15 → 18 (+3) recall 0.9706 → 0.9730 (better) precision 1.0 → 1.0 (unchanged) decoy FP 0 0 ## Toward #84 18 of 30 target tasks. Halfway-plus. Now covering: - Java (3 fixtures, 7 slugs) - Rust (2 fixtures, 3 slugs) - C (1 fixture, 2 slugs) - Kotlin (1 fixture, 2 slugs) - Swift (2 fixtures, 2 slugs) - Ruby (1 fixture, 1 slug) - TS / Python / Go (the pre-existing corpus) Remaining under-covered: PHP and C# both at zero (would need matcher PRs first), more JVM Spring shapes, the WKWebView / intent-implicit Kotlin Android slugs, more Swift secure-trust flavors. Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
noeljackson
added a commit
that referenced
this pull request
May 18, 2026
) Third batch of under-covered-language bench tasks. Bench 15 → 18 tasks. Three more matcher slugs exercised across the Phase-2/3 languages. ## rust-axum-no-auth Exercises `rust-axum-no-auth-extractor` — state-changing axum POST route without an auth extractor in the handler signature. The matcher is noise_tier=noisy because handler-auth analysis is context-dependent; the bench task pins the regex hook. `matcher_exclude = ["axum-handler", "auth-bypass"]` — the unrelated `axum-handler` and `auth-bypass` matchers fire on literally every axum route + a router file shape; they're noise on this slug-under-test. ## java-xxe Exercises `java-xxe` (and the bundled language-agnostic `xxe-xml-parser` sibling) — `DocumentBuilderFactory.newInstance()` without external-entity hardening. Single-method fixture; decoy is a non-XML method on the same class. ## swift-keychain-no-access Exercises `swift-keychain-no-access-control` — `SecItemAdd` without `kSecAttrAccessControl`, leaving the keychain item readable without auth prompt. Single-function fixture; decoy is a token-formatting helper that doesn't touch the keychain. ## Scoring Each task standalone: **recall 1.0**, **precision 1.0**, **0 decoy FPs**. Whole-bench: task_count 15 → 18 (+3) recall 0.9706 → 0.9730 (better) precision 1.0 → 1.0 (unchanged) decoy FP 0 0 ## Toward #84 18 of 30 target tasks. Halfway-plus. Now covering: - Java (3 fixtures, 7 slugs) - Rust (2 fixtures, 3 slugs) - C (1 fixture, 2 slugs) - Kotlin (1 fixture, 2 slugs) - Swift (2 fixtures, 2 slugs) - Ruby (1 fixture, 1 slug) - TS / Python / Go (the pre-existing corpus) Remaining under-covered: PHP and C# both at zero (would need matcher PRs first), more JVM Spring shapes, the WKWebView / intent-implicit Kotlin Android slugs, more Swift secure-trust flavors.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Toward #84. Third batch in this session.
What
route with no auth extractor in the handler signature.
`matcher_exclude = ["axum-handler", "auth-bypass"]` keeps the
noise off this slug-under-test.
`xxe-xml-parser`) on
`DocumentBuilderFactory.newInstance()`. Decoy is a non-XML method
on the same class.
on `SecItemAdd` without `kSecAttrAccessControl`. Decoy is a
token-formatter helper.
Scoring
Each task standalone: recall 1.0, precision 1.0, 0 decoy FPs.
Whole-bench:
Toward #84
18 of 30 target. Halfway-plus. Coverage now:
Still zero coverage: PHP, C# (matcher pack would need to land
first). Bigger work, separate issue.
🤖 Generated with Claude Code