docs(#601): record the sampling universe, exclusions and sub-samples in 38 country CONTENTS.org#658
Merged
Merged
Conversation
…in 38 country CONTENTS.org For each country, a new "Sampling universe, exclusions and sub-samples" section records *what the survey documentation claims the sample represents* -- verbatim, with a file/page or catalog-field citation for every quote, and with gaps recorded as gaps (naming what was searched) rather than filled by inference. This is EVIDENCE ONLY. No schema, YAML key, or code change is proposed here: GH #603 owns the representation decision. Nothing in these sections is inferred from the .dta files -- what a survey claims and what its microdata contain are kept strictly apart. Placement follows each file's existing structure: sections sit beside the country's existing "Sampling Design" / "Survey Program" material where that exists, and above the issue list otherwise. Malawi and Uganda are filed one level down as the last subsection of their existing "Sampling Design" section. Four countries had no _/CONTENTS.org and get one (Afghanistan, Armenia, Peru, Serbia and Montenegro). Where the new evidence contradicts text already in a file, both sides are quoted and the disagreement is flagged in place -- nothing existing was edited or deleted (Azerbaijan weights, CotedIvoire CILSS panel shape, Ethiopia ESS1 coverage, GhanaLSS GLSS1/2 rotating panel, Guinea-Bissau vague/grappe, Mali EHCVM-vs-EAC-I, Nepal panel, Nigeria wt_wave5, Uganda refresh cadence). Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01Su5JKX3wKChyfMAdXrdCTr
ligon
force-pushed
the
docs/601-universe-in-contents
branch
from
July 22, 2026 05:29
ed3b06a to
765f90e
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Records, in each country's
_/CONTENTS.org, what the survey documentation claims its sample represents — the declared universe, the exclusions, and the sub-samples/oversamples that live inside a wave.Refs #601, #603, #654.
What this is (and is not)
This is evidence, not representation.
CLAUDE.mdagainst unevidenced "no module here" claims. "None found" never means "none exists"..dtafiles. No microdata was opened. What a survey claims and what its data contain are two different facts and are kept apart deliberately.data_scheme.ymlchange, no code. design(#601): the population record — declaring what a sample represents [DECISION NEEDED] #603 owns the decision about how the library represents any of this; this PR only makes sure the evidence exists to decide from.Only
lsms_library/countries/*/_/CONTENTS.orgis touched — 38 files, all additions, no deletions.Countries
38 sections applied: Afghanistan, Albania, Armenia, Azerbaijan, Benin, Burkina Faso, Cambodia, China, Côte d'Ivoire, Ethiopia, EthiopiaRHS, GhanaLSS, GhanaSPS, Guatemala, Guinea-Bissau, Guyana, India, Iraq, Kazakhstan, Kosovo, Liberia, Malawi, Mali, Nepal, Niger, Nigeria, Pakistan, Panama, Peru, Senegal, Serbia, Serbia and Montenegro, South Africa, Tajikistan, Tanzania, Timor-Leste, Togo, Uganda.
Four had no
_/CONTENTS.orgat all and now have one: Afghanistan, Armenia, Peru, Serbia and Montenegro.How much is actually there
Counting a country as carrying the item if at least one of its waves has it stated in documentation (not inferred):
Two patterns recur across the corpus and are flagged wherever they appear:
Tensions with existing text — flagged, never overwritten
Nine countries' evidence disagrees with something already in the file. In every case both sides are quoted in place, the disagreement is named, and nothing existing was edited or deleted:
weightis exactly the intended three-group post-stratification factorWand "weighting factors must be applied"; the existing Data Quality note calls it a fallback and advises treating Azerbaijan as effectively unweighted. Resolving it needs a data check that was deliberately not run.panel_ids.weight.grappeis visited in exactly onevague. Settling it needs agrappe × vaguecrosstab.weight/panel_weight→wt_hhmapping. Also a catalog-id error in Data Acquisition Status (NLSS II = 74, not 1000).wt_wave5is the wave-4-to-5 longitudinal combined-sample weight, not a "general wave weight". The library's mappings are correct; only the annotation is wrong.Placement
Each section went where it belongs in that file's existing structure — beside the country's own
Sampling Design/Survey Programmaterial where that exists, above the issue list otherwise — cross-referencing rather than duplicating. Malawi and Uganda are filed one level down as the last subsection of their existing* Sampling Design, placed so that every "…above" reference in the new prose resolves correctly.Verified before commit: the inserted block is byte-identical to the drafted fragment in all 38 files (quotes untouched, no reflow); headings nest;
#+begin_/#+end_blocks and drawers balance; tables are non-ragged; no stray fragment markers. Two pre-existing org level-jumps (Guinea-Bissau, Togoplot_features) are untouched.🤖 Generated with Claude Code
https://claude.ai/code/session_01Su5JKX3wKChyfMAdXrdCTr