automation: issue-to-eval sync (#124 de-prefix, #142 added) + weekly summaries (weeks of 2026-07-10, 2026-07-17 & 2026-07-24) - #191
Open
elong0527 wants to merge 5 commits into
Open
Conversation
Benchmark eval sync (issue-to-eval) ran and found all 44 open benchmark issues already up to date — no eval changes this week. Weekly summary (Friday run) generated for the 2026-07-10 → 2026-07-17 window and posted to Slack channel C0AR7L8GR5Z. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01B9RbRxapXbVAHM78cTT46T
Re-synced all 47 benchmark-labeled GitHub issues through the skill's parse_issue_markdown / save_to_evals helpers. Because gh is unavailable here, issue bodies were fetched via the GitHub MCP API and passed through html.unescape before parsing (the API returns HTML-entity-encoded bodies where gh returns raw text), so no entity noise is introduced. One genuine change: - github-issue-124: target_skills de-prefixed admiral/admiral-adsl -> admiral-adsl, matching the upstream issue body and the bare-name convention already on main (root-level admiral-* symlinks make both forms resolve; PR #190 standardized on the bare form). Deliberately not changed: - github-issue-142 is a duplicate of #141 (identical prompt/skill) that was intentionally removed from main (PR #189); left excluded. - github-issue-108 skipped (unfilled template placeholder, empty Skills/Query). - All other parseable benchmark issues already up to date. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01KsktG6DExRxgyRNTDnyJHz
elong0527
force-pushed
the
claude/funny-planck-oVtNE
branch
from
July 20, 2026 13:11
fedf954 to
4ff7c53
Compare
elong0527
changed the title
elong0527
force-pushed
the
claude/funny-planck-oVtNE
branch
from
July 22, 2026 13:11
5ef5cb3 to
4ff7c53
Compare
Activity window 2026-07-17 → 2026-07-24 (lookback_days=7): - Commits: 0 new on main this week (PR #190 merge was a boundary commit already reported in the prior week's summary). - PRs: #192 clinical-ipd-sim opened for review; automation PR #191 still open. - Issues: 6 benchmark issues saw discussion; 0 opened/closed. issue-to-eval sync ran against all 44 open benchmark-labeled issues and found no semantic changes (all evals already up to date), so no eval files were modified this run. Summary posted to Slack channel C0AR7L8GR5Z. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01L7vLibSynppqeCgwPL6NLV
elong0527
changed the title
…S/ADSL) Adds github-issue-142.json — a new admiral-adsl benchmark (create ADVS BDS ADaM + derive ADSL baseline vitals from pharmaversesdtm). Synced via the issue-to-eval skill's parse_issue_markdown/save_to_evals helpers; the 44 other open benchmark issues were already up to date. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01DJ6vRGtixajEePwCmw7pie
elong0527
changed the title
Friday scheduled run (2026-07-31). issue-to-eval re-sync found no eval drift — all 46 syncable benchmark issues already up to date on this branch (#108 skipped: unfilled template). Adds the week-of-2026-07-24 summary, also posted to Slack channel C0AR7L8GR5Z. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01CW8xjLdgPpnFJbNtzn5apY
elong0527
changed the title
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Scheduled-routine automation runs on branch
claude/funny-planck-oVtNE. TheghCLI is unavailable in this environment, so GitHub data was fetched via the GitHub MCP API and fed through the skills' existing Python helpers. Issue bodies are passed throughhtml.unescapebefore parsing (the MCP API returns HTML-entity-encoded bodies whereghreturns raw text), so no entity noise is introduced.issue-to-evalRe-synced all open
benchmark-labeled issues throughparse_issue_markdown/save_to_evals, comparing semantic field values (parse-normalized, so→vs literal→and HTML entities don't create false diffs).Updated / added across runs:
target_skillsde-prefixedadmiral/admiral-adsl→admiral-adslThe bare skill name matches the upstream issue body and the bare-name convention on
main(PR #190).2026-07-24 run: all 44 open benchmark issues already up to date — no eval files modified.
2026-07-25 run: 47 open benchmark issues scanned; #142 added (new), 45 already up to date, #108 skipped (unfilled template placeholder — empty
## Skills/## Query).2026-07-31 run: 47 open benchmark issues scanned; no eval drift — 46 already up to date, #108 skipped (same unfilled template). No eval files modified this run.
weekly-summaryFriday summaries, archived under
_automation/weekly-summary/outputs/and posted to Slack channelC0AR7L8GR5Z.Week of 2026-07-10 (window 2026-07-10 → 2026-07-17):
main(PR automation: eval sync (2026-07-13) + weekly Slack update (week of 2026-07-03) #190).Week of 2026-07-17 (window 2026-07-17 → 2026-07-24):
main(the PR automation: eval sync (2026-07-13) + weekly Slack update (week of 2026-07-03) #190 merge was a boundary commit already reported the prior week).clinical-ipd-simopened for review (large external contribution, 81 files); automation PR automation: issue-to-eval sync (#124 de-prefix, #142 added) + weekly summaries (weeks of 2026-07-10, 2026-07-17 & 2026-07-24) #191 still open; 0 merged this week.Week of 2026-07-24 (window 2026-07-24 → 2026-07-31, run 2026-07-31):
main(last landed 2026-07-16).Files changed
_automation/evals/github-issue-124.json(updated —target_skillsde-prefixed)_automation/evals/github-issue-142.json(new — admiral-adsl ADVS/ADSL benchmark)_automation/weekly-summary/outputs/pharma-skills-weekly-summary-2026-07-17.md(week-of-2026-07-10 summary)_automation/weekly-summary/outputs/pharma-skills-weekly-summary-2026-07-24.md(week-of-2026-07-17 summary)_automation/weekly-summary/outputs/pharma-skills-weekly-summary-2026-07-31.md(week-of-2026-07-24 summary)🤖 Generated with Claude Code
https://claude.ai/code/session_01CW8xjLdgPpnFJbNtzn5apY