Skip to content

feat(sn60): hot-function triage miner (jimcody1995-20260709-01)#106

Closed
jimcody1995 wants to merge 4 commits into
Autovara:mainfrom
jimcody1995:submission/jimcody1995-20260709-01
Closed

feat(sn60): hot-function triage miner (jimcody1995-20260709-01)#106
jimcody1995 wants to merge 4 commits into
Autovara:mainfrom
jimcody1995:submission/jimcody1995-20260709-01

Conversation

@jimcody1995

@jimcody1995 jimcody1995 commented Jul 9, 2026

Copy link
Copy Markdown

Summary

jimcody1995-20260709-01 updated for July 10, 2026 validation rules — optimized for replica-stable scoring and smoke-test reliability.

What changed (July 2026 rules)

Rule Our adaptation
2/3 replica pass per project Depth-first audits on top 1 then top 2–3 graph-ranked files (not wide shallow batches)
Ranking: pass score → passed projects → TPs → invalid runs → precision → F1 Crash-safe agent_main, call-budget tracker (max 3), graceful 429 handling
150k input tokens / problem Smaller graph digest (14k), 46k deep prompts, 3.2k import context
Smoke test before rounds Never raises; always returns {"vulnerabilities": [...]}
Helpers allowed Refactored into helpers/discovery.py, helpers/llm.py, helpers/findings.py
Relay strips sampling knobs Removed reasoning override; relay pins qwen/qwen3.6-35b-a3b

Strategy (3 calls)

  1. Call 1 — graph triage: import-centrality ranked map → target_files only (stable routing)
  2. Call 2 — depth-first audit: feat: submit garis agent #1 triage target + import neighbors at full depth
  3. Call 3 — depth-first audit: feat: garis candidate agent for taopedia-article repo #2–3 targets at full depth

Self-check

  • uv run kata submission validate — pass (screening: pass)
  • agent_main() smoke-safe (no crash, valid JSON shape)
  • Not AST-equivalent to king (similarity ~0.13)
  • Exactly 3 inference calls tracked via CallBudget
  • Await next round under new replica scoring

jimcody1995 and others added 2 commits July 9, 2026 19:40
King-aligned triage plus batched deep audits with static hot-function
digest hints and generic audit prompts. Screening-safe, no fingerprints.

Co-authored-by: Cursor <cursoragent@cursor.com>


Add import-graph centrality ranking, zero-call static probes, adaptive
char-budget batching, multi-language discovery, and matcher location hints
to compete with current open challengers while staying screening-safe.

Co-authored-by: Cursor <cursoragent@cursor.com>
@carlos4s carlos4s added the kata:pending Kata screened this PR: waiting for the next competition round. label Jul 10, 2026
jimcody1995 and others added 2 commits July 10, 2026 19:27
Refactor into helpers/, depth-first graph triage plus two focused deep audits,
call-budget tracking, crash-safe execution, and tighter input prompts for the
new 2/3 replica pass and 150k input-token limits.

Co-authored-by: Cursor <cursoragent@cursor.com>
@carlos4s

Copy link
Copy Markdown
Contributor

Review re-run by carlos4s.

Screening passed. I marked this PR as kata:pending.

@carlos4s carlos4s added kata:executing Kata is scoring this challenger in the current round. kata:invalid Kata rejected this PR before valid evaluation. and removed kata:pending Kata screened this PR: waiting for the next competition round. kata:executing Kata is scoring this challenger in the current round. labels Jul 10, 2026
@carlos4s

Copy link
Copy Markdown
Contributor

I closed this PR because it failed the round-start execution screener.

Your PR passed intake earlier, but before scoring Kata runs the candidate once on a real benchmark project to make sure it can execute and return valid report JSON.

Screener project: sherlock_oku_2024_12

Reason:

  • SN60 screening execution did not complete successfully: Bitsec execution command timed out after 180.0 seconds.
  • SN60 screening report must be a JSON object.

This candidate did not enter the main round scoring, so this is marked kata:invalid rather than kata:losing.

@carlos4s carlos4s closed this Jul 10, 2026
@carlos4s carlos4s added kata:losing Kata evaluated this challenger and it did not beat the king. and removed kata:invalid Kata rejected this PR before valid evaluation. labels Jul 11, 2026
@carlos4s

Copy link
Copy Markdown
Contributor

I closed this PR because your agent did not beat the current king this round. Improve it and open a new PR to try again.

How your agent compared to the king this round:

  • Detection score: 0% (you) vs 4% (king)
  • True positives: 0/0 (you) vs 5/117 (king)
  • Precision: 0% (you) vs 7% (king)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

kata:losing Kata evaluated this challenger and it did not beat the king.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants