Skip to content

πŸ”§ Flaky perf test β€” relax hardcoded <50ms bound on shared runnersΒ #3950

Description

@PierreBrisorgueil

Problem

A performance integration test (billing.extraBalance.listLedger.perf.integration.tests.js) asserts listLedgerPage fetches page 1 of a 1000-entry ledger in < 50ms, a hardcoded wall-clock bound. On shared CI runners (ARC on a busy K8s node) it flakes under load β€” observed 86ms on a green, correct build, failing an unrelated PR.

Fix (pick one)

  • Gate on a percentile / relative bound instead of an absolute 50ms wall-clock.
  • Bump the ceiling to a load-tolerant value, or
  • Mark it perf-flaky: retry-once, or skip when the runner is under contention.

The query itself isn't slow β€” the assertion is environment-sensitive. Perf regressions are better caught by a dedicated benchmark job than an inline < 50ms in the integration suite on shared runners.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions