Skip to content

Make repository test output concise by default - #1004

Merged
jormundur00 merged 2 commits into
masterfrom
rhei-implement/issue-982
Aug 4, 2026
Merged

Make repository test output concise by default#1004
jormundur00 merged 2 commits into
masterfrom
rhei-implement/issue-982

Conversation

@jormundur00

Copy link
Copy Markdown
Member

What changed

Ordinary JVM test runs now keep Gradle's compact task and build summaries instead of printing every passed or skipped test and routine test output. Failures still identify the failing test and source location, while detailed results and captured streams remain available in Gradle's generated reports and diagnostic output.

Why

Repository test runs had become difficult to scan because shared build configuration forced successful test events and standard output into normal lifecycle logs. Removing that override makes useful failures easier to spot without changing test execution or the Native Image launcher’s dedicated native-test reporting.

Example

For the same plain-console rerun of the affected utility and JUnit modules, output dropped from 380 lines to 128 lines. The previous run contained 115 per-test status lines and 11 incidental stream lines; the updated run contained none. A controlled failing test still reported:

FileUtilsTest > issue982FailureProbe() FAILED
    AssertionFailedError at FileUtilsTest.java:78

The generated XML and HTML reports retained the full assertion message and captured output.

Implementation summary

  • Restored Gradle's verbosity-specific test logging defaults in the shared Java convention and removed the duplicate JUnit-native override.
  • Removed incidental debug and fixture output without changing assertions, discovery scenarios, or native-launcher behavior.
  • Documented the concise ordinary-test-output contract and grounded the changed executable fixtures in their most-specific end-to-end specification.

Validation

Passed:

  • /home/jovan/.local/bin/grund check
  • ./gradlew :utils:checkstyleMain :utils:checkstyleTest :utils:test :junit-platform-native:checkstyleMain :junit-platform-native:checkstyleTest :junit-platform-native:test --rerun-tasks --console=plain
  • GRAALVM_HOME=/home/jovan/.sdkman/candidates/java/current ./gradlew :junit-platform-native:nativeTest --rerun-tasks --console=plain
  • ./gradlew :native-gradle-plugin:test :native-gradle-plugin:inspections --rerun-tasks --console=plain
  • Controlled expected-failure probe confirming concise normal failure output and retained XML/HTML diagnostics, followed by a passing ./gradlew :utils:test --rerun-tasks --console=plain
  • git diff --check

Not run: full ./gradlew check, the full build, documentation rendering, or the complete CI matrix, including the CI-only native Gradle plugin functional and configuration-cache matrices. The issue's reported 704-line baseline could not be reproduced exactly because its invocation, cache state, and console configuration were not provided. Existing Gradle native-access, deprecation, and problems-report notices did not fail the focused gates.

Fixes #982

AI workflow

Generated by Rhei’s github-issue-fix workflow using 15 completed AI-assisted steps, 2 resolved models, and 2 focused review cycles.

View AI workflow details

Approved proposal: edfa2ec23468fcf7

1. Issue intake

Model: openai:gpt-5.6-sol · Agent: codex · Reasoning effort: medium

Inspected issue 982, repository policy, specifications, and the isolated worktree, then routed the compatible request.

Tokens: 594174 total · 585068 input (515072 cached) · 9106 output

2. Implement fix

Model: openai:gpt-5.6-sol · Agent: codex · Reasoning effort: medium

Implemented concise default JVM test logging, removed incidental fixture output, and updated the internal specification.

Tokens: 2117913 total · 2107441 input (2000896 cached) · 10472 output

3. Validation — cycle 1

Model: openai:gpt-5.6-sol · Agent: codex · Reasoning effort: medium

Ran the initial grounding, focused test, native-test, product-plugin, diagnostic, and output-comparison validation.

Tokens: 2298828 total · 2283251 input (2184192 cached) · 15577 output

4. Requirements review — cycle 1

Model: openai:gpt-5.6-terra · Agent: codex · Reasoning effort: medium

Checked the implementation against the issue acceptance criteria, repository rules, and approved scope.

Tokens: 93904 total · 92208 input (68608 cached) · 1696 output

5. Spec review — cycle 1

Model: openai:gpt-5.6-terra · Agent: codex · Reasoning effort: medium

Reviewed specification ownership, citations, and the behavior contract for fit and completeness.

Tokens: 194903 total · 191145 input (151552 cached) · 3758 output

6. Implementation review — cycle 1

Model: openai:gpt-5.6-terra · Agent: codex · Reasoning effort: medium

Reviewed the seven-file diff for correctness, scope, repository conventions, and test preservation.

Tokens: 181629 total · 178297 input (130048 cached) · 3332 output

7. Validation review — cycle 1

Model: openai:gpt-5.6-terra · Agent: codex · Reasoning effort: medium

Checked the recorded validation evidence and identified the citation and PR-description repairs needed before publication.

Tokens: 125977 total · 123261 input (94720 cached) · 2716 output

8. Aggregate review — cycle 1

Model: openai:gpt-5.6-sol · Agent: codex · Reasoning effort: medium

Aggregated the specialist reviews and routed the task to address the concrete findings.

Tokens: 194214 total · 190983 input (153600 cached) · 3231 output

9. Address review findings — cycle 1

Model: openai:gpt-5.6-sol · Agent: codex · Reasoning effort: medium

Added the most-specific executable-fixture citations and supplied the maintainer-facing PR description.

Tokens: 704366 total · 693961 input (615424 cached) · 10405 output

10. Validation — cycle 2

Model: openai:gpt-5.6-sol · Agent: codex · Reasoning effort: medium

Revalidated the repair with grounding, JUnit-native JVM and native tests, exact removal checks, and diff hygiene.

Tokens: 1089201 total · 1077680 input (995840 cached) · 11521 output

11. Requirements review — cycle 2

Model: openai:gpt-5.6-terra · Agent: codex · Reasoning effort: medium

Rechecked issue requirements and scope after the review repair.

Tokens: 169652 total · 166373 input (148992 cached) · 3279 output

12. Spec review — cycle 2

Model: openai:gpt-5.6-terra · Agent: codex · Reasoning effort: medium

Rechecked the repaired citations and specification alignment.

Tokens: 158558 total · 155814 input (125440 cached) · 2744 output

13. Implementation review — cycle 2

Model: openai:gpt-5.6-terra · Agent: codex · Reasoning effort: medium

Rechecked the final implementation diff and confirmed the repair stayed within approved scope.

Tokens: 320569 total · 315187 input (284672 cached) · 5382 output

14. Validation review — cycle 2

Model: openai:gpt-5.6-terra · Agent: codex · Reasoning effort: medium

Confirmed there were no blocking validation failures and recorded the remaining broader-check disclosures.

Tokens: 116337 total · 114028 input (88064 cached) · 2309 output

15. Aggregate review — cycle 2

Model: openai:gpt-5.6-sol · Agent: codex · Reasoning effort: medium

Confirmed the fix was ready to publish after the second focused review cycle.

Tokens: 142517 total · 139518 input (112640 cached) · 2999 output

16. Publish draft PR

Model: openai:gpt-5.6-luna · Agent: codex · Reasoning effort: medium

Committed the reviewed fix, pushed the configured branch to origin, and created this draft pull request with the rhei label.

Tokens: not finalized at PR creation

Aggregate token usage: 8502742 total · 8414215 input (7669760 cached) · 88527 output

The aggregate excludes the current unfinalized publication step. Two focused review cycles completed, with one review-repair cycle. Accounting covers all 15 completed AI-assisted steps; the publication step is not yet finalized. There were no superseded invocation records and no unmeasured completed attempts. Input cache writes, output cache writes, and output cached reads are unsupported; cached-read tokens are included within input and total.

@oracle-contributor-agreement oracle-contributor-agreement Bot added the OCA Verified All contributors have signed the Oracle Contributor Agreement. label Jul 24, 2026
@jormundur00
jormundur00 marked this pull request as ready for review July 27, 2026 06:33
@vjovanov

vjovanov commented Aug 4, 2026

Copy link
Copy Markdown
Member

How do token counts change?

@jormundur00

Copy link
Copy Markdown
Member Author

How do token counts change?

We don't really have a way to test this in a unified way, as the rhei generation template is still not merged, and we don't really have a benchmark for our repo generation.

Token usage should drop either way, as with over 50% line drop in output, the agents should consume less unnecessary bloat text.

@jormundur00
jormundur00 merged commit 4d15113 into master Aug 4, 2026
52 checks passed
@jormundur00
jormundur00 deleted the rhei-implement/issue-982 branch August 4, 2026 13:44
mergify Bot added a commit to ArcadeData/arcadedb that referenced this pull request Aug 16, 2026
….8 to 1.1.9 [skip ci]

Bumps [org.graalvm.buildtools:native-maven-plugin](https://github.com/graalvm/native-build-tools) from 1.1.8 to 1.1.9.
Release notes

*Sourced from [org.graalvm.buildtools:native-maven-plugin's releases](https://github.com/graalvm/native-build-tools/releases).*

> 1.1.9
> -----
>
> What's Changed
> --------------
>
> * Make repository test output concise by default by [`@​jormundur00`](https://github.com/jormundur00) in [graalvm/native-build-tools#1004](https://redirect.github.com/graalvm/native-build-tools/pull/1004)
> * Decouple Maven plugin unit tests from remote bootstrap tasks by [`@​jormundur00`](https://github.com/jormundur00) in [graalvm/native-build-tools#1007](https://redirect.github.com/graalvm/native-build-tools/pull/1007)
> * Clarify build prerequisites and add a core build mode by [`@​jormundur00`](https://github.com/jormundur00) in [graalvm/native-build-tools#1012](https://redirect.github.com/graalvm/native-build-tools/pull/1012)
> * Release 1.1.8 by [`@​graalvmbot`](https://github.com/graalvmbot) in [graalvm/native-build-tools#1015](https://redirect.github.com/graalvm/native-build-tools/pull/1015)
> * Bump version to 1.1.9-SNAPSHOT by [`@​graalvmbot`](https://github.com/graalvmbot) in [graalvm/native-build-tools#1016](https://redirect.github.com/graalvm/native-build-tools/pull/1016)
> * Uplift the Native Image layer configuration model by [`@​jormundur00`](https://github.com/jormundur00) in [graalvm/native-build-tools#1011](https://redirect.github.com/graalvm/native-build-tools/pull/1011)
> * Update reachability metadata to 1.0.10 by [`@​graalvmbot`](https://github.com/graalvmbot) in [graalvm/native-build-tools#1021](https://redirect.github.com/graalvm/native-build-tools/pull/1021)
>
> **Full Changelog**: <graalvm/native-build-tools@1.1.8...1.1.9>


Commits

* [`70a22ad`](graalvm/native-build-tools@70a22ad) Release 1.1.9
* [`226c2f2`](graalvm/native-build-tools@226c2f2) Merge pull request [#1021](https://redirect.github.com/graalvm/native-build-tools/issues/1021) from graalvm/update-metadata-to-1.0.10
* [`750e24d`](graalvm/native-build-tools@750e24d) Update reachability metadata to 1.0.10
* [`f9d090c`](graalvm/native-build-tools@f9d090c) Clarify layer selector and test suite support
* [`8a62507`](graalvm/native-build-tools@8a62507) Skip later Gradle layer consumers on GraalVM 25.0
* [`fa9cb64`](graalvm/native-build-tools@fa9cb64) Narrow GraalVM 25.0 layer test skips
* [`a7f0ca4`](graalvm/native-build-tools@a7f0ca4) Skip Gradle layer consumers on GraalVM 25.0
* [`cf67f05`](graalvm/native-build-tools@cf67f05) Skip Maven shared layer test on GraalVM 25.0
* [`60da37c`](graalvm/native-build-tools@60da37c) Skip Maven all-selector layer test on GraalVM 25.0
* [`0498739`](graalvm/native-build-tools@0498739) Fix layered image runtime distribution
* Additional commits viewable in [compare view](graalvm/native-build-tools@1.1.8...1.1.9)
  
[![Dependabot compatibility score](https://dependabot-badges.githubapp.com/badges/compatibility\_score?dependency-name=org.graalvm.buildtools:native-maven-plugin&package-manager=maven&previous-version=1.1.8&new-version=1.1.9)](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores)
Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting `@dependabot rebase`.
[//]: # (dependabot-automerge-start)
[//]: # (dependabot-automerge-end)
---
Dependabot commands and options
  
You can trigger Dependabot actions by commenting on this PR:
- `@dependabot rebase` will rebase this PR
- `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it
- `@dependabot show  ignore conditions` will show all of the ignore conditions of the specified dependency
- `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
- `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
- `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
mergify Bot added a commit to robfrank/linklift that referenced this pull request Aug 20, 2026
….6 to 1.1.9 [skip ci]

Bumps [org.graalvm.buildtools:native-maven-plugin](https://github.com/graalvm/native-build-tools) from 1.1.6 to 1.1.9.
Release notes

*Sourced from [org.graalvm.buildtools:native-maven-plugin's releases](https://github.com/graalvm/native-build-tools/releases).*

> 1.1.9
> -----
>
> What's Changed
> --------------
>
> * Make repository test output concise by default by [`@​jormundur00`](https://github.com/jormundur00) in [graalvm/native-build-tools#1004](https://redirect.github.com/graalvm/native-build-tools/pull/1004)
> * Decouple Maven plugin unit tests from remote bootstrap tasks by [`@​jormundur00`](https://github.com/jormundur00) in [graalvm/native-build-tools#1007](https://redirect.github.com/graalvm/native-build-tools/pull/1007)
> * Clarify build prerequisites and add a core build mode by [`@​jormundur00`](https://github.com/jormundur00) in [graalvm/native-build-tools#1012](https://redirect.github.com/graalvm/native-build-tools/pull/1012)
> * Release 1.1.8 by [`@​graalvmbot`](https://github.com/graalvmbot) in [graalvm/native-build-tools#1015](https://redirect.github.com/graalvm/native-build-tools/pull/1015)
> * Bump version to 1.1.9-SNAPSHOT by [`@​graalvmbot`](https://github.com/graalvmbot) in [graalvm/native-build-tools#1016](https://redirect.github.com/graalvm/native-build-tools/pull/1016)
> * Uplift the Native Image layer configuration model by [`@​jormundur00`](https://github.com/jormundur00) in [graalvm/native-build-tools#1011](https://redirect.github.com/graalvm/native-build-tools/pull/1011)
> * Update reachability metadata to 1.0.10 by [`@​graalvmbot`](https://github.com/graalvmbot) in [graalvm/native-build-tools#1021](https://redirect.github.com/graalvm/native-build-tools/pull/1021)
>
> **Full Changelog**: <graalvm/native-build-tools@1.1.8...1.1.9>
>
> 1.1.8
> -----
>
> What's Changed
> --------------
>
> * Release 1.1.7 by [`@​graalvmbot`](https://github.com/graalvmbot) in [graalvm/native-build-tools#1009](https://redirect.github.com/graalvm/native-build-tools/pull/1009)
> * Bump version to 1.1.8-SNAPSHOT by [`@​graalvmbot`](https://github.com/graalvmbot) in [graalvm/native-build-tools#1010](https://redirect.github.com/graalvm/native-build-tools/pull/1010)
> * Deprecate fallback plugin options by [`@​jormundur00`](https://github.com/jormundur00) in [graalvm/native-build-tools#997](https://redirect.github.com/graalvm/native-build-tools/pull/997)
> * Update reachability metadata to 1.0.9 by [`@​graalvmbot`](https://github.com/graalvmbot) in [graalvm/native-build-tools#1014](https://redirect.github.com/graalvm/native-build-tools/pull/1014)
>
> **Full Changelog**: <graalvm/native-build-tools@1.1.7...1.1.8>
>
> 1.1.7
> -----
>
> What's Changed
> --------------
>
> * Release 1.1.6 by [`@​graalvmbot`](https://github.com/graalvmbot) in [graalvm/native-build-tools#996](https://redirect.github.com/graalvm/native-build-tools/pull/996)
> * Suppress missing Javadoc diagnostics across convention tasks by [`@​jormundur00`](https://github.com/jormundur00) in [graalvm/native-build-tools#994](https://redirect.github.com/graalvm/native-build-tools/pull/994)
> * Replace deprecated Kotlin DSL delegated accessors by [`@​jormundur00`](https://github.com/jormundur00) in [graalvm/native-build-tools#998](https://redirect.github.com/graalvm/native-build-tools/pull/998)
> * Fix Maven plugin unit-test mock maker and SLF4J setup by [`@​jormundur00`](https://github.com/jormundur00) in [graalvm/native-build-tools#999](https://redirect.github.com/graalvm/native-build-tools/pull/999)
> * Bump version to 1.1.7-SNAPSHOT by [`@​graalvmbot`](https://github.com/graalvmbot) in [graalvm/native-build-tools#1001](https://redirect.github.com/graalvm/native-build-tools/pull/1001)
> * Bump io.netty:netty-codec-http from 4.1.135.Final to 4.1.136.Final in /samples/metadata-repo-integration by [`@​dependabot`](https://github.com/dependabot)[bot] in [graalvm/native-build-tools#1002](https://redirect.github.com/graalvm/native-build-tools/pull/1002)
> * Avoid Maven internal API for console colors by [`@​jormundur00`](https://github.com/jormundur00) in [graalvm/native-build-tools#1003](https://redirect.github.com/graalvm/native-build-tools/pull/1003)
> * Update reachability metadata to 1.0.8 by [`@​graalvmbot`](https://github.com/graalvmbot) in [graalvm/native-build-tools#1008](https://redirect.github.com/graalvm/native-build-tools/pull/1008)
>
> **Full Changelog**: <graalvm/native-build-tools@1.1.6...1.1.7>


Commits

* [`70a22ad`](graalvm/native-build-tools@70a22ad) Release 1.1.9
* [`226c2f2`](graalvm/native-build-tools@226c2f2) Merge pull request [#1021](https://redirect.github.com/graalvm/native-build-tools/issues/1021) from graalvm/update-metadata-to-1.0.10
* [`750e24d`](graalvm/native-build-tools@750e24d) Update reachability metadata to 1.0.10
* [`f9d090c`](graalvm/native-build-tools@f9d090c) Clarify layer selector and test suite support
* [`8a62507`](graalvm/native-build-tools@8a62507) Skip later Gradle layer consumers on GraalVM 25.0
* [`fa9cb64`](graalvm/native-build-tools@fa9cb64) Narrow GraalVM 25.0 layer test skips
* [`a7f0ca4`](graalvm/native-build-tools@a7f0ca4) Skip Gradle layer consumers on GraalVM 25.0
* [`cf67f05`](graalvm/native-build-tools@cf67f05) Skip Maven shared layer test on GraalVM 25.0
* [`60da37c`](graalvm/native-build-tools@60da37c) Skip Maven all-selector layer test on GraalVM 25.0
* [`0498739`](graalvm/native-build-tools@0498739) Fix layered image runtime distribution
* Additional commits viewable in [compare view](graalvm/native-build-tools@1.1.6...1.1.9)
  
[![Dependabot compatibility score](https://dependabot-badges.githubapp.com/badges/compatibility\_score?dependency-name=org.graalvm.buildtools:native-maven-plugin&package-manager=maven&previous-version=1.1.6&new-version=1.1.9)](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores)
Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting `@dependabot rebase`.
[//]: # (dependabot-automerge-start)
[//]: # (dependabot-automerge-end)
---
Dependabot commands and options
  
You can trigger Dependabot actions by commenting on this PR:
- `@dependabot rebase` will rebase this PR
- `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it
- `@dependabot show  ignore conditions` will show all of the ignore conditions of the specified dependency
- `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
- `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
- `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

OCA Verified All contributors have signed the Oracle Contributor Agreement. rhei

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Make repository test output concise by default

2 participants