This workspace contains only the website-data work built from:
https://www.mtv-chilloutzone.com/- archive seed:
https://www.mtv-chilloutzone.com/playlistarchive.htm
- local mirror data in
mirror/www.mtv-chilloutzone.com/ - extracted playlist archive data in
data/ - serviceable broadcast-level records in
data/serviceable/ - the scripts used to build and regenerate those outputs
mirror/www.mtv-chilloutzone.com/- local mirror of the site data currently kept in scope
data/mtv_chilloutzone_archive.csv- song-level archive export
data/mtv_chilloutzone_book.md- readable year/date/edition export
data/mtv_chilloutzone_manifest.csv- fetched URL manifest
data/mtv_chilloutzone_summary.txt- archive summary
data/serviceable/broadcasts_serviceable.csv- one row per broadcast instance
data/serviceable/broadcasts_serviceable.jsonl- one JSON object per broadcast instance
data/serviceable/tracks_serviceable.csv- flat serviceable track rows
data/serviceable/serviceable.sqlite- SQLite database with
broadcastsandtracks
- SQLite database with
data/serviceable/serviceable_summary.txt- serviceable output summary
scripts/mtv_archive_pipeline.py- crawl, resume, extract, prune
scripts/make_records_serviceable.py- build serviceable records from the song-level archive CSV
Build or resume the archive mirror:
python3 scripts/mtv_archive_pipeline.py --resumeBuild or resume the broader same-host site mirror:
python3 scripts/mtv_archive_pipeline.py --resume --full-siteRebuild the archive CSV and book from the current mirror:
python3 scripts/mtv_archive_pipeline.py --extract-onlyPrune the local mirror back to the current policy:
python3 scripts/mtv_archive_pipeline.py --prune-mirror --full-siteBuild serviceable records:
python3 scripts/make_records_serviceable.pyShow service-builder help:
python3 scripts/make_records_serviceable.py --help- full-site mirroring excludes video/screenshots material by default
- excluded branch:
watchthevideos.htmscreenshots.htmintros.htmintros-promos-vids.htmss-*.htmand their descendant assets
- the website is the canonical source
- the archive CSV preserves the original raw song line
- same-date same-edition duplicate playlist instances are preserved as separate broadcast instances
- for the serviceable layer, see
SERVICEABLE_RECORDS_GUIDE.md