Harvest Source Error: commerce json

[FuhuXia]

Harvest Source Info

Source Name: commerce-non-spatial-data-json-harvest-source
Source Type: datajson
Harvest Frequency: Daily
Last Successful Harvest: 2025-11-04
Last Update:
Source URL: https://www.commerce.gov/sites/default/files/data.json
About Page: https://catalog.data.gov/harvest/about/commerce-non-spatial-data-json-harvest-source

Error Info

Getting this error since 2025-11-05.

HTTPError getting json source: 403 Client Error: Forbidden for url:
https://www.commerce.gov/sites/default/files/data.json.

Our harvesting agent is blocked by their server, but not by the user agent level.

Debugging

Run the following command on your local and/or cloud.gov to tell if the source server side blocks our agent (HarvesterBot) or cloud.gov IPs (52.222.122.97 and 52.222.123.172)

curl -I -L -A "HarvesterBot/0.0 (https://data.gov;datagovhelp@gsa.gov) Data.gov/2.0" [source_url]