Skip to content

Read the six folded datasets from data-lectures, not high_dim_data - #53

Merged
mmcky merged 1 commit into
mainfrom
repoint/high-dim-data-fold
Aug 11, 2026
Merged

mmcky merged 1 commit into
mainfrom
repoint/high-dim-data-fold

Conversation

@mmcky

@mmcky mmcky commented Aug 11, 2026

Copy link
Copy Markdown
Contributor

Seven reads across four files. The six datasets moved into QuantEcon/data-lectures (QuantEcon/data-lectures#62), so every read here follows them — and the host changes too, not just the org and repo.

This repo is the quantecon/actions canary. It builds and publishes its own Pages site from a copy of intro's lectures, so its data reads are live reads by real readers, not fixtures.

Why the host has to change

media.githubusercontent.com is the LFS media endpoint and routes per path by LFS status. These six were LFS-tracked in high_dim_data and are plain git in data-lectures, so the media host 404s for every one of them — measured: 404 with 0 bytes, against 200 for the raw URL. A mechanical org/repo swap preserving the host would have broken every chart in these three lectures. Repoint rule 6.

All seven land on raw.githubusercontent.com, matching lecture-python-intro, lecture-wasm and lecture-intro.zh-cn exactly. qeld (QuantEcon/data-lectures#65) is intended to make the spelling an implementation detail later.

Nothing automated can see any of this

This repo is not in the data audit's SCAN_REPOS — it is not a Python-family repo and was never in scope — and it has no data-url-guard. So unlike intro and wasm, no check of any kind covers these seven reads. Verified by hand:

  • Both acceptance greps clean: no media-host data-lectures read, and no high_dim_data reference anywhere in lectures/
  • All 7 URLs return 200
  • Three-way byte identity on the four cross_section files — manifest sha256 = new URL = old high_dim_data URL

_static/lecture_specific/inequality/data.ipynb:37 is edited by hand — no audit scans _static/**, the build never executes it, and it is served with the URL in its body from this repo's own Pages site.

What this PR does NOT fix

This repo also holds 14 references to QuantEcon/lecture-python-intro — reads of intro's committed dataset copies, which intro deleted during repoint sets 1–3. Those are serving 404s today and are out of scope here; they are tracked in QuantEcon/workspace-lectures#28. This PR only clears the high_dim_data reads, which were the ones still working and about to stop.

No prose is touched

The lecture's claim that the Forbes billionaires data is a 2020 snapshot is contradicted by the bytes (282 timestamps spanning 2020-04-07 to 2023-04-15, and the chart plots realTimeWorth rather than the annual list). Split out to QuantEcon/workspace-lectures#35. The Global 2000 "2020" claim nearby is correct and is left alone.

Part of QuantEcon/workspace-lectures#23 (step 3, PR set C2). Companion PRs land in lecture-python-intro and lecture-wasm under the same title. Merged as three independent branches off main, never stacked.

🤖 Generated with Claude Code

Seven reads across four files. The six datasets moved into
QuantEcon/data-lectures (dl#62), so every read follows them -- and the
HOST changes too, not just the org and repo.

media.githubusercontent.com is the LFS *media* endpoint and routes per
path by LFS status. These six were LFS-tracked in high_dim_data and are
plain git in data-lectures, so the media host 404s for all of them.
Measured: the media URL for data-lectures returns 404 with 0 bytes, the
raw URL returns 200. A mechanical org/repo swap preserving the host
would have broken every chart in these three lectures.

All seven land on raw.githubusercontent.com, including any that used the
github.com/*/raw/ redirect form and would have survived a bare org swap.
One spelling across all four consuming repos is deliberate: the set 1/2
repoints broke lecture-wasm by "harmonising" its URLs onto the redirect
form, whose 302 carries an empty access-control-allow-origin and so is
rejected by the browser before it is followed (dl#46). If every repo
spells these lines the same way, that class of fix cannot recur.

_static/lecture_specific/inequality/data.ipynb is edited by hand. No
audit scans _static/**, the build never executes it, and the translation
sync is .md-only -- so nothing mechanical would ever carry this change.
It is also served: it returns 200 on the published site with the URL in
its body.

No prose is touched. The lecture's claim that the Forbes billionaires
data is a 2020 snapshot is contradicted by the bytes (282 timestamps
spanning 2020-04-07 to 2023-04-15, and the chart plots realTimeWorth
rather than the annual list), but that is content, not a repoint --
split out to QuantEcon/workspace-lectures#35. The Global 2000 "2020"
claim nearby IS correct and is deliberately left alone.

Verified: both acceptance greps clean (no media-host data-lectures read,
no high_dim_data reference anywhere in lectures/); all 7 URLs return 200;
three-way byte identity on the four cross_section files -- manifest
sha256 = new URL = old high_dim_data URL, so this changes the address and
not the data.

Part of QuantEcon/workspace-lectures#23. Data: QuantEcon/data-lectures#62

Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
Copilot AI lite review requested due to automatic review settings August 11, 2026 04:50

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Updates this repo’s lecture notebooks to read the six “folded” datasets from their new home in QuantEcon/data-lectures, using the correct raw.githubusercontent.com host so the data loads correctly now that the files are plain git (not LFS).

Changes:

  • Repoint SCF-derived CSV reads in mle.md and inequality.md from QuantEcon/high_dim_data to QuantEcon/data-lectures on raw.githubusercontent.com.
  • Repoint four cross_section CSV reads in heavy_tails.md from the LFS media endpoint to raw.githubusercontent.com/QuantEcon/data-lectures.
  • Update the matching URL embedded in the static inequality/data.ipynb notebook.

Reviewed changes

Copilot reviewed 4 out of 4 changed files in this pull request and generated no comments.

File Description
lectures/mle.md Updates SCF_plus CSV URL to QuantEcon/data-lectures via raw.githubusercontent.com.
lectures/inequality.md Updates SCF_plus CSV URL to QuantEcon/data-lectures via raw.githubusercontent.com.
lectures/heavy_tails.md Updates four CSV URLs (Forbes + city population) to QuantEcon/data-lectures via raw.githubusercontent.com.
lectures/_static/lecture_specific/inequality/data.ipynb Updates the embedded SCF_plus CSV URL to QuantEcon/data-lectures via raw.githubusercontent.com.

💡 Add a code-review agent skill or configure MCP servers for context-aware, tailored reviews. Learn more in the docs.

@github-actions

Copy link
Copy Markdown

📖 Netlify Preview Ready!

Preview URL: https://pr-53--jade-tarsier-d98a19.netlify.app

Commit: 7e4d1d1


Build Info

@mmcky
mmcky merged commit 744957f into main Aug 11, 2026
2 checks passed
@mmcky
mmcky deleted the repoint/high-dim-data-fold branch August 11, 2026 05:04
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants