Instead of blocking scraping, can't we just put a limit on it?

[fiatjaf]

The allow_scrape_if_limited_to requires a limit to be specified, but we'll never get clients to adhere to such requirements.

Instead why not have an option to impose a hard limit on scraping queries (or on all queries even) So if someone requests all our events we can just return the last 50 or something.

[mikedilger]

Interesting. I'm torn though.

I don't want to return results that I know are incorrect (incomplete), I'd rather return an error saying we can't fulfill the request.

[mikedilger]

Maybe we could have a config that specifies a max age, and then allow scrapes (backwards in time) up to the max age.