Skip to content

feat: public evaluation and optimization suite#13

Draft
jdehorty wants to merge 3 commits into
mainfrom
feat/eval-and-optimization
Draft

feat: public evaluation and optimization suite#13
jdehorty wants to merge 3 commits into
mainfrom
feat/eval-and-optimization

Conversation

@jdehorty

@jdehorty jdehorty commented Jun 2, 2026

Copy link
Copy Markdown
Contributor

Summary

Publishes the evaluation and optimization suite as a clean public branch built on current origin/main.

This replaces the older draft PR #6. The previous branch carried older tuning-layout history and commit messages that were not ideal for a public-facing publication branch. This PR is rebuilt as a single scrubbed commit with public-safe author metadata and without local run artifacts.

What changed

  • Adds the public evaluation/ framework, deterministic scorecards, visual quality review flow, and baseline-audit dashboard.
  • Adds the optimization/ framework, scorecard-guided proposer loop, public-safe optimization results, and dashboard artifacts.
  • Updates CesiumJS skills to the current public API baseline and moves public wiki/docs for the evaluation workflow into the repository.
  • Keeps local run traces, ignored .env, and untracked generated optimization artifacts out of the branch.
  • Adds pytest.ini so CI and local bare pytest invocations resolve the top-level evaluation and optimization packages consistently.

Validation

  • optimization/scripts/check-secrets.sh
  • python3 optimization/scripts/check-public-artifacts.py
  • gitleaks detect --redact --log-opts="origin/main..HEAD" --report-format json --report-path /tmp/gitleaks-feat-eval-public.json
  • python3 evaluation/scripts/validate-evaluation.py
  • python3 optimization/scripts/check-canonical-eval-surface.py
  • pytest -q optimization/tests evaluation/tests
  • Manual commit-message/content scans for personal paths, personal email, private-source markers, and token-shaped literals

Related to #5. Supersedes #6.

@jdehorty jdehorty force-pushed the feat/eval-and-optimization branch 5 times, most recently from 7f3f970 to b13aecb Compare June 3, 2026 17:19
@jdehorty jdehorty force-pushed the feat/eval-and-optimization branch from b13aecb to 74a3a5e Compare June 3, 2026 17:22
jdehorty added 2 commits June 4, 2026 10:59
…ation

# Conflicts:
#	docs/skills-catalog.md
#	skills/cesiumjs-entities/SKILL.md
#	skills/cesiumjs-primitives/SKILL.md
#	wiki/Domain-Mapping.md
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant