Repository navigation
Remove donor-site leftovers - #8
Merged
Merged
Conversation
…o/IDR, auctions) - --help: scraper_api_client "auction scraper" description and /p/<cat> URL help; diff_runs --price-tolerance-pct "quotes IDR"; playwright --pages "infinitely scrolling search". - playwright --concurrency warning: "refuses a headless browser ... by answering NOTHING at all" -> refuses exits outside the UAE. - Engines, captcha_solver, output_writer: Akamai 394-byte headless refusal, --mode product/shop, unaddressable search, /p/<slug> hub prose replaced with this repo's measured Imperva/UAE facts or deleted; contradictory "HEADFUL by default" comments removed; unused shop_facts field removed. - diff_runs: euro/18 locales/auction prose -> AED, two languages, Car of the Week lifecycle; farfetch-style example filenames -> cars. - CONTRIBUTING: site-change section rewritten for __NEXT_DATA__ / JSON-LD join / DOM fallback; datacentre note corrected; pyppeteer crash attributed to the sibling it happened in. - Issue templates: donor options (reserve price, favorite_count, suggested lots, 100 cap, headless refused) and orphan lines removed; bug report example prefix/count fixed. - .gitignore/.dockerignore: dubizzle_listings.* -> dubizzle_products.*. - smoke_test: CATAWIKI_* env names -> DUBIZZLE_*; EUR comment -> AED. - README: last badge "runs without an account" -> "needs a UAE exit". - CHANGELOG: new [Unreleased] section. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
- SECURITY.md said the project has no releases or version tags; it has both (gh release list). Supported versions now names the latest release and main, in the wording bbb-scraper and foodpanda-scraper already use. - captcha_solver.py's docstring pointed at a "No DataDome solver" section this repo does not have; the line came with the copied core. Removed. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
jehrr
force-pushed
the
fix/donor-leftovers
branch
from
September 28, 2026 19:49
bf8e618 to
75cd2b1
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Removes text and data inherited from the repos this one was bootstrapped from, which described another site as if it were dubizzle.
Fixed
scraper_api_client.pydescription ("auction scraper", scrolling grid,/p/<cat>URL help);diff_runs.py --price-tolerance-pct("quotes IDR"); Playwright--pageshelp (infinitely scrolling search); Playwright--concurrencywarning ("refuses a headless browser ... answering NOTHING at all").--mode product/--mode shop, unaddressable search and/p/<slug>hub comments in all three engines,captcha_solver.pyandoutput_writer.py— replaced with the Imperva / UAE-exit facts from this repo's README andpage_flow.py, or deleted. Contradictory "HEADFUL by default" comments removed (the default is headless, as the code and suite already say). Unusedshop_factsdataclass field removed from the engines.__NEXT_DATA__, the JSON-LD path join and the DOM fallback; the datacentre "no response at all" note corrected; the pyppeteer first-fetch crash attributed to the sibling (tokopedia-scraper).--out grills/ "96 products".dubizzle_listings.*->dubizzle_products.*(the engines' real--outdefault;_*.*coversdubizzle_products_scraperapi).CATAWIKI_CDP_ENDPOINT/CATAWIKI_PROXY->DUBIZZLE_*(same assertions); EUR comment -> AED.[Unreleased]entry; no version bump.Kept deliberately
captcha_solver.py, the craigslist.env*note in.gitignore: explicit sibling provenance.output_writer.py: family schema statement.smoke_test.py: a guard, phrased as sibling.<captcha-widgets>/_Incapsula_Resourcenotes inproduct_parser.pyand CONTRIBUTING: stated as measured on this site's own 17 captures.Suite:
smoke_test: OKbefore and after (engine groups skipped, no engine installed);ci_checks.py --secret-checkand--help-check --sample-checkgreen.🤖 Generated with Claude Code