Skip to content

Delete committed dataset orphans (Track X) - #58

Merged
mmcky merged 3 commits into
mainfrom
track-x-orphans
Sep 1, 2026
Merged

mmcky merged 3 commits into
mainfrom
track-x-orphans

Conversation

@mmcky

@mmcky mmcky commented Sep 1, 2026

Copy link
Copy Markdown
Contributor

Deletes the ten committed data files no lecture in this repo has ever read — nine inherited from lecture-python.myst's tree when the repo was set up, plus the shadowed lectures/graph.txt (separate commit) — and adds lectures/graph.txt to .gitignore.

path why it is an orphan
_static/lecture_specific/ols/maketable{1,2,4}.dta, mle/fp.dta inherited; no ols/mle lecture here; the consuming lectures live in lecture-python.myst and read data-lectures
_static/lecture_specific/pandas_panel/{countries,employ,realwage}.csv inherited; consuming lectures live in lecture-python-programming / lecture-python.myst and read data-lectures
_static/lecture_specific/match_transport/acs_data_summary.csv inherited; the consuming lecture lives in lecture-python-advanced.myst and reads data-lectures
_static/lecture_specific/finite_markov/web_graph_data.txt inherited; no finite_markov lecture here
graph.txt short_path regenerates it with %%file before reading it

Published surface and settle — note the host. This repo publishes at quantecon.github.io/lecture-dp/; dp.quantecon.org is the Dynamic Programming book site and 404s every lecture path, so a check against it passes vacuously. On the real host all nine _static files serve at 200 today (graph.txt does not). There is no _build/html prune here (QuantEcon/workspace-lectures#41), so they clear on the settle policy — next Monday clean rebuild, then the next publish-* tag. The last publish was publish-2026jul07, so that may be a while; nothing reads them meanwhile, and this repo has no forks.

Rows for QuantEcon/workspace-lectures#40 (published URL, measured today with a 200 page control and a 404 never-existed control on the same host; expect 404 after the settle):

path (under https://quantecon.github.io/lecture-dp) today
/_static/lecture_specific/ols/maketable1.dta 200, 14,466 B
/_static/lecture_specific/ols/maketable2.dta 200, 11,210 B
/_static/lecture_specific/ols/maketable4.dta 200, 12,024 B
/_static/lecture_specific/mle/fp.dta 200, 1,024,085 B
/_static/lecture_specific/pandas_panel/countries.csv 200, 49,605 B
/_static/lecture_specific/pandas_panel/employ.csv 200, 1,725,234 B
/_static/lecture_specific/pandas_panel/realwage.csv 200, 121,589 B
/_static/lecture_specific/match_transport/acs_data_summary.csv 200, 14,365 B
/_static/lecture_specific/finite_markov/web_graph_data.txt 200, 296 B

Deletion-time reader sweep (2026-09-01). Authenticated tarball-and-grep pass over 407 repositories: all 283 QuantEcon org repos (70 private, 26 archived; numfocus, quantecon-book-dp and test-cli are empty and unfetchable) plus 130 forks of the six holding repos (2 returned 404 and are recorded as not-swept rather than clean). Matched by basename, not URL, with each hit's three preceding lines folded in because URLs get split across source lines. Controls fired in the same pass: a never-existing basename returned 0 hits and 0 copies, and both known readers were found — the English python_advanced_features.md exercise link to test_table.csv, and devopseng99/project.lecture-wasm's runtime fetch of intro's graph.txt. Result: no repository reads any path this PR deletes. Every other co-occurrence of these basenames is a %%file embed, prose, a .gitignore line, or review text; the pre-MyST master/source/… reads in old course repos have been dead since the MyST migration and are unaffected.

Part of the Track X orphan sweep, QuantEcon/workspace-lectures#57 (one PR per holding repo, identical titles). Source list: https://quantecon.github.io/data-lectures/audit.json orphans, 2026-08-31 run.

🤖 Generated with Claude Code

mmcky and others added 3 commits September 1, 2026 10:04
These files are committed but read by nothing: the audit at https://quantecon.github.io/data-lectures/audit.json (2026-08-31 run) lists them under orphans, and an authenticated content sweep of 407 repositories (283 QuantEcon org repos plus the forks of the six holding repos, by basename, positive and negative controls in the same pass) on 2026-09-01 found no reader of these paths. Tracker: QuantEcon/workspace-lectures#57.

All nine were inherited from lecture-python.myst's tree when this repo was set up; no lecture here has ever read them, and the lectures that do consume these datasets (ols, mle, pandas_panel, finite_markov, match_transport) live in other repos and now read data-lectures.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
short_path regenerates graph.txt with %%file before reading it, so the committed bytes are never consumed. The 2026-09-01 organisation sweep found no reader of this repo's copy (this repo has no forks).

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
A local run of short_path.md writes lectures/graph.txt into the working tree; ignoring it prevents the deleted copy from being re-committed by a later git add -A.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Copilot AI lite review requested due to automatic review settings September 1, 2026 00:08

Copilot AI left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Removes committed “orphan” dataset/static files that are not used by any lecture in this repository and prevents reintroducing the autogenerated graph.txt by ignoring it.

Changes:

  • Delete unused committed data assets under lectures/_static/lecture_specific/**.
  • Delete the previously committed lectures/graph.txt (regenerated by short_path.md).
  • Add lectures/graph.txt to .gitignore to avoid recommitting the regenerated artifact.

Reviewed changes

Copilot reviewed 4 out of 11 changed files in this pull request and generated no comments.

Show a summary per file
File Description
lectures/_static/lecture_specific/ols/maketable1.dta Remove unused inherited dataset file.
lectures/_static/lecture_specific/ols/maketable2.dta Remove unused inherited dataset file.
lectures/_static/lecture_specific/ols/maketable4.dta Remove unused inherited dataset file.
lectures/_static/lecture_specific/mle/fp.dta Remove unused inherited dataset file.
lectures/_static/lecture_specific/pandas_panel/countries.csv Remove unused inherited dataset file.
lectures/_static/lecture_specific/pandas_panel/employ.csv Remove unused inherited dataset file.
lectures/_static/lecture_specific/pandas_panel/realwage.csv Remove unused inherited dataset file.
lectures/_static/lecture_specific/match_transport/acs_data_summary.csv Remove unused inherited dataset file.
lectures/_static/lecture_specific/finite_markov/web_graph_data.txt Remove unused inherited data file.
lectures/graph.txt Remove committed autogenerated artifact.
.gitignore Ignore lectures/graph.txt to prevent recommits.

💡 Add a code-review agent skill or configure MCP servers for context-aware, tailored reviews. Learn more in the docs.

@mmcky

mmcky commented Sep 1, 2026

Copy link
Copy Markdown
Contributor Author

Validation (2026-09-01): this repo has no preview step, so the channels are the build and the sources. Build Project [using jupyter-book] succeeded on the branch; its log (1,175 lines) has 0 warnings or errors mentioning any of the ten deleted basenames. No lecture in this repo references any of them: short_path.md writes graph.txt with %%file (line 272) and reads that; there is no ols, mle, pandas_panel, finite_markov or match_transport lecture here, and the consuming lectures in the other repos all read data-lectures. Live-site check for QuantEcon/workspace-lectures#40 after the settle: probe quantecon.github.io/lecture-dp/_static/lecture_specific/…, not dp.quantecon.org (the book site, which 404s every lecture path).

@mmcky
mmcky merged commit 65748e3 into main Sep 1, 2026
2 checks passed
@mmcky
mmcky deleted the track-x-orphans branch September 1, 2026 00:34
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants