schema v1.7: aggregate conditioning + fidelity/units repairs#4
Merged
Conversation
Additive, backward-compatible schema update (v1.6 datasets remain valid), prepared to support the working-group review. New columns (water accounting): - aggregate_moisture_state, aggregate_absorption_pct, aggregate_moisture_content_pct (ASTM C127/C128, C566) -- recover effective (free) mix water when aggregates are batched off SSD; free moisture = total moisture - absorption (not a w/c, w/b duplicate). - aggregate_prewetted -- process flag for the common pre-wetting-to-damp practice. Tooling / fidelity repairs: - units.py: imperial-tonnage factors (lb_yd3, short_ton, long_ton, metric_ton); a bare "ton"/"t" is rejected as ambiguous (~12% short-vs-long spread). +5 tests. - fidelity.py: field_coverage no longer penalizes relational foreign keys/IDs (still preserved in the sidecar). - crosswalk: completed the test-method enum (four_point_bending -> ASTM_C78, ...). - Measured fidelity on a relational template: 78.7 -> 87.4 (B); UCI 96.7 (A) unchanged. Release hygiene: - v1.6 -> v1.7 across schema.md, sql, CHANGELOG [1.7.0], crosswalk, ingest tool (pyproject + __init__), landing, schema-reference, llms.txt, README, AGENTS, intake, examples, .well-known/mcp-manifest.json (was stale at v1.5), .zenodo.json (version added). - Term justification regenerated: 241 terms / 25 sections (coverage gate passes). - examples/ refreshed against v1.7 (UCI reproduce-and-diff byte-identical). - New scripts/check_version.py + version-consistency CI: one canonical version list that fails the build if any surface drifts (would have caught the stale v1.5 manifest). - check_examples.py / check_version.py made Windows-console safe. 18 ingest tests pass; examples, version, and term-coverage checks green. Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Open3DCP schema v1.7 — aggregate conditioning + fidelity/units repairs
Additive, backward-compatible update (v1.6 datasets remain valid). Prepared to support the working-group review and reduce committee deliberation.
New columns (water accounting)
aggregate_moisture_state,aggregate_absorption_pct,aggregate_moisture_content_pct(ASTM C127/C128, C566) — recover the effective (free) mix water when aggregates are batched off SSD; free moisture = total moisture − absorption (not a duplicate of w/c, w/b).aggregate_prewetted— process flag for the common pre-wetting-to-damp practice.Tooling / fidelity repairs
units.py: imperial-tonnage factors (lb_yd3,short_ton,long_ton,metric_ton); a bare "ton" is now rejected as ambiguous (~12% short↔long spread). +5 tests.fidelity.py:field_coverageno longer penalizes relational foreign keys / IDs (still preserved in the sidecar).four_point_bending→ASTM_C78, …).Release hygiene
[1.7.0], crosswalk, ingest tool, landing, schema-reference, llms.txt, README, AGENTS, intake, examples,.well-known/mcp-manifest.json(was stale at v1.5),.zenodo.json(version added).examples/refreshed against v1.7 (UCI reproduce-and-diff byte-identical).scripts/check_version.py+ version-consistency CI — one canonical version list; fails the build if any surface drifts (would have caught the v1.5 manifest). Maintainer scripts made Windows-console-safe.Checks
18 ingest tests pass; examples, version-consistency, and term-coverage checks green.
🤖 Generated with Claude Code