add Roadbed Pointer List

[damonmcc]

resolves #1839

all builds on this branch

dev vs prod

HTML map of a correct dev example attached to this github comment

row counts:

• 10 more rows in dev (29,181 vs 29,171)
• 29 rows in dev that aren't in prod
• 19 rows in prod that aren't in dev

row order within groups with the same generic_segmentid:

• 278 diffs in row ordering
• apparent causes (still reviewing):
  • wrong order in prod (e.g. L roadbed before R)
  • source records not having an R roadbed in their group

values:

• 3 diffs in values
• all related to to_/from_ nodeid_ values

new qa approach

added and using the dbt-audit-helper dbt package in the new qa rpl models

the models uses the compare_and_classify_query_results macro to generate a row-by-row comparison and summary stats of added, removed, identical and modified records

(in-progress description) to qa record ordering, I had to add a rpl_id to each table (query) to incorporate row order into the key for comparison. by default, there are max of 20 sample records per "status"

summary of results from qa__rpl_order:

dbt_audit_row_status	dbt_audit_num_rows_in_status
added	29
identical	28874
modified	278
removed	19

notes

Checking ordering within groups of 5 roadbed records surfaced a bug that is now resolved and those groups appear to have the right ordering now.

The bug in some of the large groups was caused by the logic assuming that an innermost segment would be closer to it's side's outermost segment than that of the other side. So if an innermost segment on the right side was so close to the central generic that the distance to the outermost left is less than the distance to the outermost right, then the ordering was incorrect because the logic presumed it was to the left of the central generic.

[codecov]

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 73.70%. Comparing base (fef4e7f) to head (1964f9d).

Additional details and impacted files

Files with missing lines	Coverage Δ
dcpy/__main__.py	0.00% <ø> (ø)

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.