Skip to content

Dedicated Environment-Preparation Script for Conformance Tests

Choose a tag to compare

View all tags
@tjazerzen tjazerzen released this 05 Dec 11:14
· 173 commits to main since this release
v0.1.16.0
002fcf4
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

Overview

Conformance tests often spend a lot of their runtime on environment setup rather than actual execution. Previously, each functional requirement ran its conformance test in a fully isolated environment, requiring the setup process to repeat for every test.

What's new

This release introduces support for an optional environment-preparation script that runs once before all conformance tests. The prepared environment is then reused across tests, dramatically reducing redundant setup work and lowering overall test time—while still keeping each conformance test fully end-to-end.

Example use cases

  • Compiling the project only when sources have changed (for compiled languages)
  • Rebuilding Docker images only when necessary (for Docker-based workflows)

If no preparation script is provided, existing behavior remains unchanged.

Assets 2
Loading