Delete committed dataset orphans (Track X) - #58
Conversation
These files are committed but read by nothing: the audit at https://quantecon.github.io/data-lectures/audit.json (2026-08-31 run) lists them under orphans, and an authenticated content sweep of 407 repositories (283 QuantEcon org repos plus the forks of the six holding repos, by basename, positive and negative controls in the same pass) on 2026-09-01 found no reader of these paths. Tracker: QuantEcon/workspace-lectures#57. All nine were inherited from lecture-python.myst's tree when this repo was set up; no lecture here has ever read them, and the lectures that do consume these datasets (ols, mle, pandas_panel, finite_markov, match_transport) live in other repos and now read data-lectures. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
short_path regenerates graph.txt with %%file before reading it, so the committed bytes are never consumed. The 2026-09-01 organisation sweep found no reader of this repo's copy (this repo has no forks). Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
A local run of short_path.md writes lectures/graph.txt into the working tree; ignoring it prevents the deleted copy from being re-committed by a later git add -A. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
There was a problem hiding this comment.
Pull request overview
Removes committed “orphan” dataset/static files that are not used by any lecture in this repository and prevents reintroducing the autogenerated graph.txt by ignoring it.
Changes:
- Delete unused committed data assets under
lectures/_static/lecture_specific/**. - Delete the previously committed
lectures/graph.txt(regenerated byshort_path.md). - Add
lectures/graph.txtto.gitignoreto avoid recommitting the regenerated artifact.
Reviewed changes
Copilot reviewed 4 out of 11 changed files in this pull request and generated no comments.
Show a summary per file
| File | Description |
|---|---|
lectures/_static/lecture_specific/ols/maketable1.dta |
Remove unused inherited dataset file. |
lectures/_static/lecture_specific/ols/maketable2.dta |
Remove unused inherited dataset file. |
lectures/_static/lecture_specific/ols/maketable4.dta |
Remove unused inherited dataset file. |
lectures/_static/lecture_specific/mle/fp.dta |
Remove unused inherited dataset file. |
lectures/_static/lecture_specific/pandas_panel/countries.csv |
Remove unused inherited dataset file. |
lectures/_static/lecture_specific/pandas_panel/employ.csv |
Remove unused inherited dataset file. |
lectures/_static/lecture_specific/pandas_panel/realwage.csv |
Remove unused inherited dataset file. |
lectures/_static/lecture_specific/match_transport/acs_data_summary.csv |
Remove unused inherited dataset file. |
lectures/_static/lecture_specific/finite_markov/web_graph_data.txt |
Remove unused inherited data file. |
lectures/graph.txt |
Remove committed autogenerated artifact. |
.gitignore |
Ignore lectures/graph.txt to prevent recommits. |
💡 Add a code-review agent skill or configure MCP servers for context-aware, tailored reviews. Learn more in the docs.
|
Validation (2026-09-01): this repo has no preview step, so the channels are the build and the sources. |
Deletes the ten committed data files no lecture in this repo has ever read — nine inherited from
lecture-python.myst's tree when the repo was set up, plus the shadowedlectures/graph.txt(separate commit) — and addslectures/graph.txtto.gitignore._static/lecture_specific/ols/maketable{1,2,4}.dta,mle/fp.dtaols/mlelecture here; the consuming lectures live inlecture-python.mystand read data-lectures_static/lecture_specific/pandas_panel/{countries,employ,realwage}.csvlecture-python-programming/lecture-python.mystand read data-lectures_static/lecture_specific/match_transport/acs_data_summary.csvlecture-python-advanced.mystand reads data-lectures_static/lecture_specific/finite_markov/web_graph_data.txtfinite_markovlecture heregraph.txtshort_pathregenerates it with%%filebefore reading itPublished surface and settle — note the host. This repo publishes at
quantecon.github.io/lecture-dp/;dp.quantecon.orgis the Dynamic Programming book site and 404s every lecture path, so a check against it passes vacuously. On the real host all nine_staticfiles serve at 200 today (graph.txtdoes not). There is no_build/htmlprune here (QuantEcon/workspace-lectures#41), so they clear on the settle policy — next Monday clean rebuild, then the nextpublish-*tag. The last publish waspublish-2026jul07, so that may be a while; nothing reads them meanwhile, and this repo has no forks.Rows for QuantEcon/workspace-lectures#40 (published URL, measured today with a 200 page control and a 404 never-existed control on the same host; expect 404 after the settle):
https://quantecon.github.io/lecture-dp)/_static/lecture_specific/ols/maketable1.dta/_static/lecture_specific/ols/maketable2.dta/_static/lecture_specific/ols/maketable4.dta/_static/lecture_specific/mle/fp.dta/_static/lecture_specific/pandas_panel/countries.csv/_static/lecture_specific/pandas_panel/employ.csv/_static/lecture_specific/pandas_panel/realwage.csv/_static/lecture_specific/match_transport/acs_data_summary.csv/_static/lecture_specific/finite_markov/web_graph_data.txtDeletion-time reader sweep (2026-09-01). Authenticated tarball-and-grep pass over 407 repositories: all 283 QuantEcon org repos (70 private, 26 archived;
numfocus,quantecon-book-dpandtest-cliare empty and unfetchable) plus 130 forks of the six holding repos (2 returned 404 and are recorded as not-swept rather than clean). Matched by basename, not URL, with each hit's three preceding lines folded in because URLs get split across source lines. Controls fired in the same pass: a never-existing basename returned 0 hits and 0 copies, and both known readers were found — the Englishpython_advanced_features.mdexercise link totest_table.csv, anddevopseng99/project.lecture-wasm's runtime fetch of intro'sgraph.txt. Result: no repository reads any path this PR deletes. Every other co-occurrence of these basenames is a%%fileembed, prose, a.gitignoreline, or review text; the pre-MySTmaster/source/…reads in old course repos have been dead since the MyST migration and are unaffected.Part of the Track X orphan sweep, QuantEcon/workspace-lectures#57 (one PR per holding repo, identical titles). Source list: https://quantecon.github.io/data-lectures/audit.json
orphans, 2026-08-31 run.🤖 Generated with Claude Code