Skip to content

compile/action: start with a build using setscene only - #2004

Closed
Jose Quaresma (quaresmajose) wants to merge 1 commit into
qualcomm-linux:masterfrom
quaresmajose:setscene-only
Closed

Jose Quaresma (quaresmajose) wants to merge 1 commit into
qualcomm-linux:masterfrom
quaresmajose:setscene-only

Conversation

@quaresmajose

Copy link
Copy Markdown
Member

Since the sstate-cache used in CI is hosted on a NFS server, this change will allow measuring its latency.

Performing an initial build at each subbuild step using only the bitbake setscene tasks, will allow us to measure the time of that task. Which basically consists of executing all the task that can be accelerated using the stored sstate-cache. These tasks make exhaustive use of the NFS filesystem to acquire the sstate-cache artifacts.

With this change, it will be easy to distinguish between the time required to acquire and unpack the sstate-cache artifacts and the time spent on the build itself.

@quaresmajose

Copy link
Copy Markdown
Member Author

Initial tests suggest that the NFS latency is negligible:

- nodistro: 1m 
- qcom-distro: 1m30s
  • build-pr / glymur-crd/nodistro
world: setscene
2026-04-20 14:43:47 - INFO     - Initialising tasks...Sstate summary: Wanted 6207 Local 6123 Mirrors 0 Missed 84 Current 0 (98% match, 0% complete)
2026-04-20 14:44:49 - INFO     - NOTE: Tasks Summary: Attempted 0 tasks of which 0 didn't need to be rerun and all succeeded.

world: 
2026-04-20 14:46:20 - INFO     - Initialising tasks...Sstate summary: Wanted 2721 Local 2637 Mirrors 0 Missed 84 Current 3486 (96% match, 98% complete)
2026-04-20 14:48:07 - INFO     - NOTE: Tasks Summary: Attempted 11284 tasks of which 10848 didn't need to be rerun and all succeeded.

distro: setscene
2026-04-20 14:48:55 - INFO     - Initialising tasks...Sstate summary: Wanted 1702 Local 1698 Mirrors 0 Missed 4 Current 1980 (99% match, 99% complete)
2026-04-20 14:48:58 - INFO     - NOTE: Tasks Summary: Attempted 0 tasks of which 0 didn't need to be rerun and all succeeded.

distro:
2026-04-20 14:49:17 - INFO     - Initialising tasks...Sstate summary: Wanted 1671 Local 1667 Mirrors 0 Missed 4 Current 2011 (99% match, 99% complete)
2026-04-20 14:50:08 - INFO     - NOTE: Tasks Summary: Attempted 6751 tasks of which 6739 didn't need to be rerun and all succeeded.
  • build-pr / glymur-crd/qcom-distro
world: setscene
2026-04-20 14:44:49 - INFO     - Initialising tasks...Sstate summary: Wanted 7628 Local 7546 Mirrors 0 Missed 82 Current 0 (98% match, 0% complete)
2026-04-20 14:46:20 - INFO     - NOTE: Tasks Summary: Attempted 0 tasks of which 0 didn't need to be rerun and all succeeded.

world: 
2026-04-20 14:48:55 - INFO     - Initialising tasks...Sstate summary: Wanted 3385 Local 3303 Mirrors 0 Missed 82 Current 4243 (97% match, 98% complete)
2026-04-20 14:51:18 - INFO     - NOTE: Tasks Summary: Attempted 13981 tasks of which 13537 didn't need to be rerun and all succeeded.

distro: setscene
2026-04-20 14:53:00 - INFO     - Initialising tasks...Sstate summary: Wanted 4752 Local 4742 Mirrors 0 Missed 10 Current 3069 (99% match, 99% complete)
2026-04-20 14:53:25 - INFO     - NOTE: Tasks Summary: Attempted 0 tasks of which 0 didn't need to be rerun and all succeeded.

distro:
2026-04-20 14:54:40 - INFO     - Initialising tasks...Sstate summary: Wanted 3418 Local 3408 Mirrors 0 Missed 10 Current 4403 (99% match, 99% complete)
2026-04-20 15:01:11 - INFO     - NOTE: Tasks Summary: Attempted 13908 tasks of which 13869 didn't need to be rerun and all succeeded.

@github-actions

Copy link
Copy Markdown

This pull request has been marked as stale due to 30 days of inactivity. To prevent automatic closure in 5 days, remove the stale label or add a comment. You can reopen a closed pull request at any time.

@github-actions github-actions Bot added the Stale label May 21, 2026
@quaresmajose

Copy link
Copy Markdown
Member Author

Revisit after #2195

@github-actions

Copy link
Copy Markdown

Test run workflow

Test jobs for commit d909a2f

nodistro
Pass: 9 | Fail: 0 | Total: 9
qcom-distro_linux-qcom-6.18
Pass: 198 | Fail: 0 | Total: 235
qcom-distro
Pass: 236 | Fail: 0 | Total: 282

@test-reporting-app

test-reporting-app Bot commented Jun 15, 2026

Copy link
Copy Markdown

Test Results

  117 files  ± 0    698 suites  ±0   7h 47m 1s ⏱️ + 1h 22m 44s
  162 tests + 2    125 ✅  - 21   0 💤 ±0  37 ❌ +23 
4 479 runs   - 15  4 368 ✅  - 46  63 💤 +3  48 ❌ +28 

For more details on these failures, see this check.

Results for commit e77e100. ± Comparison against base commit 19cc1e1.

This pull request removes 1 and adds 3 tests. Note that renamed tests count towards both.
lava ‑ 3_[
lava ‑ 2_weston-si[
lava ‑ lava-test-retry
lava ‑ lava-test-shell

♻️ This comment has been updated with latest results.

@quaresmajose
Jose Quaresma (quaresmajose) force-pushed the setscene-only branch 5 times, most recently from 3428102 to 71578f2 Compare July 6, 2026 15:22
@github-actions

github-actions Bot commented Jul 6, 2026

Copy link
Copy Markdown

Test run workflow

Test jobs for commit 71578f2

nodistro
Pass: 9 | Fail: 0 | Total: 9
qcom-distro_linux-qcom-6.18
Pass: 7 | Fail: 0 | Total: 7
qcom-distro
Pass: 9 | Fail: 0 | Total: 9

@github-actions

github-actions Bot commented Aug 9, 2026

Copy link
Copy Markdown

This pull request has been marked as stale due to 30 days of inactivity. To prevent automatic closure in 5 days, remove the stale label or add a comment. You can reopen a closed pull request at any time.

@github-actions github-actions Bot added the Stale label Aug 9, 2026
Since the sstate-cache used in CI is hosted on a NFS server,
this change will allow measuring its latency.

Performing an initial build at each subbuild step using only the bitbake
setscene tasks, will allow us to measure the time of that task. Which
basically consists of executing all the task that can be accelerated
using the stored sstate-cache. These tasks make exhaustive use of
the NFS filesystem to acquire the sstate-cache artifacts.

With this change, it will be easy to distinguish between the time
required to acquire and unpack the sstate-cache artifacts and the
time spent on the build itself.

Signed-off-by: Jose Quaresma <jose.quaresma@oss.qualcomm.com>
@github-actions

Copy link
Copy Markdown

Test run workflow

Test jobs for commit e77e100

nodistro
Pass: 10 | Fail: 0 | Total: 10
qcom-distro
Pass: 302 | Fail: 1 | Total: 342
qcom-distro_linux-qcom-6.18
Pass: 207 | Fail: 28 | Total: 259

@qcomlnxci

Copy link
Copy Markdown

Test Coral run workflow

Test jobs for commit e77e100

  • qcomdistro: multimedia image
    Pass: 9 | Fail: 0 | Total: 9
  • qcomdistro: multimedia image-prop
    Pass: 51 | Fail: 1 | Total: 52

@github-actions

Copy link
Copy Markdown

This pull request has been marked as stale due to 30 days of inactivity. To prevent automatic closure in 5 days, remove the stale label or add a comment. You can reopen a closed pull request at any time.

@github-actions github-actions Bot added the Stale label Sep 12, 2026
@quaresmajose

Copy link
Copy Markdown
Member Author

There is no latency introduced by the NFS.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants