Skip to content

QVAC-23075 chore: DO NOT MERGE, overlay-validate the 7 fabric consumers against the VisionPsy fabric branch - #3814

Closed
yingying0906 wants to merge 5 commits into
mainfrom
QVAC-23075/rollout-phase-a
Closed

QVAC-23075 chore: DO NOT MERGE, overlay-validate the 7 fabric consumers against the VisionPsy fabric branch#3814
yingying0906 wants to merge 5 commits into
mainfrom
QVAC-23075/rollout-phase-a

Conversation

@yingying0906

@yingying0906 yingying0906 commented Aug 13, 2026

Copy link
Copy Markdown
Contributor

DO NOT MERGE

Validation branch for QVAC-23075 rollout Phase A. It carries a temporary vcpkg overlay that pins qvac-fabric to a branch SHA, a812964c93ce692e70fc190857614ef462c43850 on feat/QVAC-23075-visionpsy, because the tag does not exist yet. Merging this would point every consumer at an unpublished commit. The overlay dies at the registry publish in Phase B, which replaces it with the real tag.

🎯 What problem does this PR solve?

  • The 7 fabric consumers have to be validated against the VisionPsy fabric branch before it is tagged and published.
  • The consumer CI is driven by PR labels, not by a dispatch per package, so the validation needs an open PR to hang the labels on.

📝 How does it solve it?

🧪 How was it tested?

  • merge-guard is expected to fail here, since this branch is never merged.
  • Mobile legs are expected to fail at setup on the qvac-test-addon-mobile clone, which is a PAT_TOKEN problem raised with devops and not a code issue.

@yingying0906
yingying0906 requested review from a team as code owners August 13, 2026 05:28
@github-actions

Copy link
Copy Markdown
Contributor

Review Status

Current Status: ❌ PENDING
Approvals so far: none

Pending reviews: Needs 1 Management or Team Lead, and 1 more from Management, Team Lead, or Member.

@github-actions

github-actions Bot commented Aug 13, 2026

Copy link
Copy Markdown
Contributor

License compliance — clean

No new dependency license findings in this PR.

Warn-only (shadow) mode — this check does not block merges yet.

Updated automatically by the canonical license compliance workflow.

NOTICE presence (advisory)

Missing NOTICE (advisory, does not block):

  • ./.github/actions/release-merge-guard
  • ./docs/website
  • ./packages/ggml-coload-smoke
  • ./packages/fabric/test/integration
  • ./packages/inference-addon-cpp/mobile
  • ./packages/sdk/e2e
  • ./packages/llm-llamacpp/benchmarks/performance
  • ./packages/llm-llamacpp/benchmarks/server
  • ./packages/vla-ggml/sim/server
  • ./packages/embed-llamacpp/benchmarks/performance
  • ./packages/embed-llamacpp/benchmarks/server
  • ./packages/asr-ggml/benchmarks/server

@yingying0906 yingying0906 added prebuilds CI: run only prebuild/cache stage (requires verified) run-cpp-addon-tests CI: run C++ addon tests (requires verified) run-desktop-addon-tests CI: run desktop integration tests (requires verified) run-mobile-addon-tests CI: run mobile integration tests (requires verified) run-coload-tests CI: run multi-addon co-load smoke (requires verified) labels Aug 13, 2026
@github-actions

Copy link
Copy Markdown
Contributor

🧪 C++ Test Coverage Report

Coverage:

📊 Detailed Coverage
Filename                         Regions    Missed Regions     Cover   Functions  Missed Functions  Executed       Lines      Missed Lines     Cover    Branches   Missed Branches     Cover
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
NmtLazyInitializeBackend.cpp          99                20    79.80%          11                 1    90.91%         157                36    77.07%          66                21    68.18%
NmtLazyInitializeBackend.hpp           2                 0   100.00%           1                 0   100.00%           1                 0   100.00%           0                 0         -
TranslationModel.cpp                 296               168    43.24%          28                 8    71.43%         506               213    57.91%         181               122    32.60%
TranslationModel.hpp                   1                 0   100.00%           1                 0   100.00%           1                 0   100.00%           0                 0         -
nmt.cpp                               72                22    69.44%           9                 1    88.89%         137                28    79.56%          44                16    63.64%
nmt.hpp                               51                 4    92.16%          11                 2    81.82%          53                 4    92.45%          28                 0   100.00%
nmt_beam_search.cpp                  116                25    78.45%          10                 3    70.00%         254                32    87.40%          76                19    75.00%
nmt_graph_decoder.cpp                164                78    52.44%          15                 7    53.33%         540               161    70.19%         112                69    38.39%
nmt_graph_encoder.cpp                 54                13    75.93%           3                 0   100.00%         268                33    87.69%          37                16    56.76%
nmt_loader.cpp                       270                67    75.19%          14                 0   100.00%         774                97    87.47%         161                67    58.39%
nmt_state_backend.cpp                253                94    62.85%          21                 0   100.00%         489               128    73.82%         165                87    47.27%
nmt_tokenization.cpp                  88                21    76.14%           8                 0   100.00%         135                36    73.33%          61                26    57.38%
nmt_utils.cpp                        120                89    25.83%           8                 3    62.50%         180               134    25.56%          78                63    19.23%
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
TOTAL                               1586               601    62.11%         140                25    82.14%        3495               902    74.19%        1009               506    49.85%

…inst VisionPsy

Rollout Phase A for the VisionPsy fabric change. Adds the shared qvac-fabric overlay
port and points every consumer at it, so all 7 build against the fabric branch head
before the tag exists and before anything is published to the registry.

The port is copied from qvac-registry-vcpkg origin/main, which is two files now;
android-vulkan-version.cmake is gone from the registry and is deliberately not
reinstated here. REF is a branch SHA rather than v${VERSION} because the tag does not
exist yet, and the whole overlay dies at the registry publish.

Consumer version>= pins stay at 10069.0.0. The overlay bypasses version resolution
entirely, so only the overlay port's own version matters here; bumping the pins is
Phase B. default-registry.baseline is untouched in all 7, which is the one thing a
rollout PR must never move.

Roster re-derived rather than assumed:
git grep -l "qvac-fabric" origin/main -- "packages/*/vcpkg.json"
classification-ggml is absent because it consumes the published @qvac/fabric npm
package rather than the vcpkg port.

DO NOT MERGE. Validation only.
… fabric head

The branch pinned 7a6425a3a, which predates the review round. Fabric is now 8be2131e2, ten
commits on, including the OpenCL view readback fix and the preprocessing changes the consumers
should be validated against. SHA512 recomputed from the archive of the full SHA, with the method
checked by reproducing the old pin's hash exactly.
The fabric branch gained three commits from the second review pass: the zero image_size
rejection extended to idefics3, the libmtmd rebuild note in mtmd.h, and the prompt-sequence
assertions in tests.sh. Phase A has to validate the consumers against what will actually be
tagged, so the overlay follows the head.

SHA512 is the sha512 of the GitHub archive tarball for that commit. Method checked by
reproducing the previous pin's hash from the same command before replacing it.
@github-actions

Copy link
Copy Markdown
Contributor

🧪 C++ Test Coverage Report

Coverage:

📊 Detailed Coverage
Filename                         Regions    Missed Regions     Cover   Functions  Missed Functions  Executed       Lines      Missed Lines     Cover    Branches   Missed Branches     Cover
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
NmtLazyInitializeBackend.cpp          99                20    79.80%          11                 1    90.91%         157                36    77.07%          66                21    68.18%
NmtLazyInitializeBackend.hpp           2                 0   100.00%           1                 0   100.00%           1                 0   100.00%           0                 0         -
TranslationModel.cpp                 296               168    43.24%          28                 8    71.43%         506               213    57.91%         181               122    32.60%
TranslationModel.hpp                   1                 0   100.00%           1                 0   100.00%           1                 0   100.00%           0                 0         -
nmt.cpp                               72                22    69.44%           9                 1    88.89%         137                28    79.56%          44                16    63.64%
nmt.hpp                               51                 4    92.16%          11                 2    81.82%          53                 4    92.45%          28                 0   100.00%
nmt_beam_search.cpp                  116                25    78.45%          10                 3    70.00%         254                32    87.40%          76                19    75.00%
nmt_graph_decoder.cpp                164                78    52.44%          15                 7    53.33%         540               161    70.19%         112                69    38.39%
nmt_graph_encoder.cpp                 54                13    75.93%           3                 0   100.00%         268                33    87.69%          37                16    56.76%
nmt_loader.cpp                       270                67    75.19%          14                 0   100.00%         774                97    87.47%         161                67    58.39%
nmt_state_backend.cpp                253                94    62.85%          21                 0   100.00%         489               128    73.82%         165                87    47.27%
nmt_tokenization.cpp                  88                21    76.14%           8                 0   100.00%         135                36    73.33%          61                26    57.38%
nmt_utils.cpp                        120                89    25.83%           8                 3    62.50%         180               134    25.56%          78                63    19.23%
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
TOTAL                               1586               601    62.11%         140                25    82.14%        3495               902    74.19%        1009               506    49.85%

Was 295226e2d, which predates four fabric commits, two of which change what the consumers
build: d85b1f367 formats string_format into the result rather than a vector, and a812964c9
takes the idefics3 overview from the original again. The other two do not affect the
library, 4bccd82aa is test-only and aff60f874 touches build-opencl.yml.

Phase A validation against the old pin no longer describes the branch, so no run on it
counts as evidence.

SHA512 recomputed from the archive for the full 40-char ref.
@github-actions

Copy link
Copy Markdown
Contributor

🧪 C++ Test Coverage Report

Coverage:

📊 Detailed Coverage
Filename                         Regions    Missed Regions     Cover   Functions  Missed Functions  Executed       Lines      Missed Lines     Cover    Branches   Missed Branches     Cover
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
NmtLazyInitializeBackend.cpp          99                20    79.80%          11                 1    90.91%         157                36    77.07%          66                21    68.18%
NmtLazyInitializeBackend.hpp           2                 0   100.00%           1                 0   100.00%           1                 0   100.00%           0                 0         -
TranslationModel.cpp                 296               168    43.24%          28                 8    71.43%         506               213    57.91%         181               122    32.60%
TranslationModel.hpp                   1                 0   100.00%           1                 0   100.00%           1                 0   100.00%           0                 0         -
nmt.cpp                               72                22    69.44%           9                 1    88.89%         137                28    79.56%          44                16    63.64%
nmt.hpp                               51                 4    92.16%          11                 2    81.82%          53                 4    92.45%          28                 0   100.00%
nmt_beam_search.cpp                  116                25    78.45%          10                 3    70.00%         254                32    87.40%          76                19    75.00%
nmt_graph_decoder.cpp                164                78    52.44%          15                 7    53.33%         540               161    70.19%         112                69    38.39%
nmt_graph_encoder.cpp                 54                13    75.93%           3                 0   100.00%         268                33    87.69%          37                16    56.76%
nmt_loader.cpp                       270                67    75.19%          14                 0   100.00%         774                97    87.47%         161                67    58.39%
nmt_state_backend.cpp                253                94    62.85%          21                 0   100.00%         489               128    73.82%         165                87    47.27%
nmt_tokenization.cpp                  88                21    76.14%           8                 0   100.00%         135                36    73.33%          61                26    57.38%
nmt_utils.cpp                        120                89    25.83%           8                 3    62.50%         180               134    25.56%          78                63    19.23%
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
TOTAL                               1586               601    62.11%         140                25    82.14%        3495               902    74.19%        1009               506    49.85%

@github-actions

github-actions Bot commented Aug 13, 2026

Copy link
Copy Markdown
Contributor

Mobile integration tests — @qvac/ocr-ggml (Android)

Result: passed

metric value
Devices passed 9
Devices failed 0
Test cases total 27
Test cases passed 27
Test cases failed 0
Test cases skipped 0

View workflow run

@github-actions

github-actions Bot commented Aug 13, 2026

Copy link
Copy Markdown
Contributor

Mobile integration tests — @qvac/ocr-ggml (iOS)

Result: passed

metric value
Devices passed 6
Devices failed 0
Test cases total 18
Test cases passed 18
Test cases failed 0
Test cases skipped 0

View workflow run

@github-actions

github-actions Bot commented Aug 14, 2026

Copy link
Copy Markdown
Contributor

Mobile integration tests — @qvac/model-fit (Android)

Result: passed

metric value
Devices passed 3
Devices failed 0
Test cases total 9
Test cases passed 9
Test cases failed 0
Test cases skipped 0

View workflow run

@github-actions

github-actions Bot commented Aug 14, 2026

Copy link
Copy Markdown
Contributor

Mobile integration tests — @qvac/embed-llamacpp (Android)

Result: passed

metric value
Devices passed 6
Devices failed 0
Test cases total 18
Test cases passed 18
Test cases failed 0
Test cases skipped 0

View workflow run

@github-actions

github-actions Bot commented Aug 14, 2026

Copy link
Copy Markdown
Contributor

Mobile integration tests — @qvac/model-fit (iOS)

Result: passed

metric value
Devices passed 2
Devices failed 0
Test cases total 6
Test cases passed 6
Test cases failed 0
Test cases skipped 0

View workflow run

@github-actions

github-actions Bot commented Aug 14, 2026

Copy link
Copy Markdown
Contributor

Mobile integration tests — @qvac/translation-nmtcpp (Android)

Result: passed

metric value
Devices passed 2
Devices failed 0
Test cases total 6
Test cases passed 6
Test cases failed 0
Test cases skipped 0

View workflow run

@github-actions

github-actions Bot commented Aug 14, 2026

Copy link
Copy Markdown
Contributor

Mobile integration tests — @qvac/translation-nmtcpp (iOS)

Result: passed

metric value
Devices passed 3
Devices failed 0
Test cases total 9
Test cases passed 9
Test cases failed 0
Test cases skipped 0

View workflow run

@github-actions

github-actions Bot commented Aug 14, 2026

Copy link
Copy Markdown
Contributor

Mobile integration tests — @qvac/embed-llamacpp (iOS)

Result: passed

metric value
Devices passed 4
Devices failed 0
Test cases total 12
Test cases passed 12
Test cases failed 0
Test cases skipped 0

View workflow run

@github-actions

Copy link
Copy Markdown
Contributor

🧪 C++ Test Coverage Report

Coverage:

📊 Detailed Coverage
Filename                         Regions    Missed Regions     Cover   Functions  Missed Functions  Executed       Lines      Missed Lines     Cover    Branches   Missed Branches     Cover
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
NmtLazyInitializeBackend.cpp          99                20    79.80%          11                 1    90.91%         157                36    77.07%          66                21    68.18%
NmtLazyInitializeBackend.hpp           2                 0   100.00%           1                 0   100.00%           1                 0   100.00%           0                 0         -
TranslationModel.cpp                 296               168    43.24%          28                 8    71.43%         506               213    57.91%         181               122    32.60%
TranslationModel.hpp                   1                 0   100.00%           1                 0   100.00%           1                 0   100.00%           0                 0         -
nmt.cpp                               72                22    69.44%           9                 1    88.89%         137                28    79.56%          44                16    63.64%
nmt.hpp                               51                 4    92.16%          11                 2    81.82%          53                 4    92.45%          28                 0   100.00%
nmt_beam_search.cpp                  116                25    78.45%          10                 3    70.00%         254                32    87.40%          76                19    75.00%
nmt_graph_decoder.cpp                164                78    52.44%          15                 7    53.33%         540               161    70.19%         112                69    38.39%
nmt_graph_encoder.cpp                 54                13    75.93%           3                 0   100.00%         268                33    87.69%          37                16    56.76%
nmt_loader.cpp                       270                67    75.19%          14                 0   100.00%         774                97    87.47%         161                67    58.39%
nmt_state_backend.cpp                253                94    62.85%          21                 0   100.00%         489               128    73.82%         165                87    47.27%
nmt_tokenization.cpp                  88                21    76.14%           8                 0   100.00%         135                36    73.33%          61                26    57.38%
nmt_utils.cpp                        120                89    25.83%           8                 3    62.50%         180               134    25.56%          78                63    19.23%
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
TOTAL                               1586               601    62.11%         140                25    82.14%        3495               902    74.19%        1009               506    49.85%

@github-actions

github-actions Bot commented Aug 14, 2026

Copy link
Copy Markdown
Contributor

Mobile integration tests — @qvac/vla-ggml (iOS)

Result: passed

metric value
Devices passed 6
Devices failed 0
Test cases total 18
Test cases passed 18
Test cases failed 0
Test cases skipped 0

View workflow run

@github-actions

github-actions Bot commented Aug 14, 2026

Copy link
Copy Markdown
Contributor

Mobile integration tests — @qvac/vla-ggml (Android)

Result: passed

metric value
Devices passed 9
Devices failed 0
Test cases total 27
Test cases passed 27
Test cases failed 0
Test cases skipped 0

View workflow run

Fabric head moved with the load-time bounds on the idefics3-style preprocessing
metadata, so the 7 consumers need re-validating against it. SHA512 recomputed
from the tarball for the new REF.

Also drops the em-dashes from the portfile comments and message() strings.
@github-actions

Copy link
Copy Markdown
Contributor

🧪 C++ Test Coverage Report

Coverage:

📊 Detailed Coverage
Filename                         Regions    Missed Regions     Cover   Functions  Missed Functions  Executed       Lines      Missed Lines     Cover    Branches   Missed Branches     Cover
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
NmtLazyInitializeBackend.cpp          99                99     0.00%          11                11     0.00%         157               157     0.00%          66                66     0.00%
NmtLazyInitializeBackend.hpp           2                 2     0.00%           1                 1     0.00%           1                 1     0.00%           0                 0         -
TranslationModel.cpp                 296               296     0.00%          28                28     0.00%         506               506     0.00%         181               181     0.00%
TranslationModel.hpp                   1                 1     0.00%           1                 1     0.00%           1                 1     0.00%           0                 0         -
nmt.cpp                               72                72     0.00%           9                 9     0.00%         137               137     0.00%          44                44     0.00%
nmt.hpp                               51                51     0.00%          11                11     0.00%          53                53     0.00%          28                28     0.00%
nmt_beam_search.cpp                  116               116     0.00%          10                10     0.00%         254               254     0.00%          76                76     0.00%
nmt_graph_decoder.cpp                164               164     0.00%          15                15     0.00%         540               540     0.00%         112               112     0.00%
nmt_graph_encoder.cpp                 54                54     0.00%           3                 3     0.00%         268               268     0.00%          37                37     0.00%
nmt_loader.cpp                       270               270     0.00%          14                14     0.00%         774               774     0.00%         161               161     0.00%
nmt_state_backend.cpp                253               253     0.00%          21                21     0.00%         489               489     0.00%         165               165     0.00%
nmt_tokenization.cpp                  88                88     0.00%           8                 8     0.00%         135               135     0.00%          61                61     0.00%
nmt_utils.cpp                        120               120     0.00%           8                 8     0.00%         180               180     0.00%          78                78     0.00%
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
TOTAL                               1586              1586     0.00%         140               140     0.00%        3495              3495     0.00%        1009              1009     0.00%

@github-actions

Copy link
Copy Markdown
Contributor

Mobile integration tests — @qvac/llm-llamacpp (iOS)

Result: failed

metric value
Devices passed 25
Devices failed 1
Test cases total 78
Test cases passed 77
Test cases failed 1
Test cases skipped 0

View workflow run

@github-actions

Copy link
Copy Markdown
Contributor

Mobile integration tests — @qvac/llm-llamacpp (Android)

Result: passed

metric value
Devices passed 21
Devices failed 0
Test cases total 63
Test cases passed 63
Test cases failed 0
Test cases skipped 0

View workflow run

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

prebuilds CI: run only prebuild/cache stage (requires verified) run-coload-tests CI: run multi-addon co-load smoke (requires verified) run-cpp-addon-tests CI: run C++ addon tests (requires verified) run-desktop-addon-tests CI: run desktop integration tests (requires verified) run-mobile-addon-tests CI: run mobile integration tests (requires verified)

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant