For use in CI systems, a flag to immediately fail on cache-miss would be useful

[aaronwhite]

The use case:

We deploy a cache bundle to CI for taking screenshots. However, if a query produced by the test runner is fundamentally new (and unservable from the cache), we'd want the tests to halt and make this error clear, so we can go update/augment the cache bundle.