Skip to content

Retrain probe with product-CDN negatives, add product guard - #34

Merged
felirami merged 1 commit into
mainfrom
fable/product-cdn-negatives
Aug 16, 2026
Merged

felirami merged 1 commit into
mainfrom
fable/product-cdn-negatives

Conversation

@felirami

Copy link
Copy Markdown
Collaborator

Closes the remaining DINO-saturation class from the second live smoke (confirmed FPs were concentrated in IKEA and Amazon product imagery, all DINO-driven with CF near zero).

  • 198 IKEA and Amazon product-CDN images (grid and large variants) join the probe's training negatives; 100 held out as a fourth permanent guard
  • Labeling rationale: product marketing imagery, including classical CGI renders, counts as not generative AI for this detector (the judge's stated criterion protects IKEA catalog shots)
Guard Result Before
Bench 87.9 BA / 76.0 TPR / 99.8 TNR identical
Stress 3/240 3/240
Live guard (Unsplash CDN) 5/132 4/132
Product guard (new) 3/100 n/a
IKEA 12-image check 0/12 5/12

Zero bench cost, verified genuine (265 dino scores moved, no verdicts flipped). Suite 228 green. After merge: tag v1.3.1, then the third live smoke.

The DINO probe saturated on IKEA room renders and Amazon product
marketing imagery (all five flagged images on the 12-image IKEA check
were DINO-driven with CF at 0.004 to 0.11). 198 product-CDN images
from both retailers' live CDNs join the training negatives; 100 more
are held out as a fourth permanent guard. Product marketing imagery,
including classical CGI renders, counts as not generative AI for this
detector.

Verified: bench unchanged at 87.9 BA / 76.0 TPR / 99.8 TNR (scores
moved on 265 images, zero verdicts flipped), stress 3/240, live guard
5/132, product guard 3/100 (two of three CF-driven), IKEA 12-image
check 5/12 to 0/12. Suite 228 green. Version 1.3.1.
@felirami
felirami merged commit 7d894e4 into main Aug 16, 2026
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant