Skip to content

[bot] Merge master/d0c7e6ba into rel/dev - #1968

Merged
yenkins-admin merged 4 commits into
rel/devfrom
snapshot-master-d0c7e6ba-to-rel/dev
Nov 18, 2026
Merged

yenkins-admin merged 4 commits into
rel/devfrom
snapshot-master-d0c7e6ba-to-rel/dev

Conversation

@yenkins-admin

Copy link
Copy Markdown
Contributor

🚀 Automated PR to perform merge from master into rel/dev with changes up to d0c7e6b (created by https://github.com/gooddata/gooddata-python-sdk/actions/runs/44324671205).

myduong243 and others added 4 commits November 18, 2026 14:01
Add the single-shot kind catalog_metadata for the Analytics Catalog
generateTitle / generateDescription endpoints.

- catalog_input on dataset items: object type, object id, output
- client asks again once on a 200 answer with no usable text and
  records unusable_retries
- evaluator: format checks (generated, no note, word / sentence
  limits, no markup, no ids) plus judge criteria graded like
  dashboard_summary; expect_note items pass on no text + a note
- violation judge decides presence only: the item question carries
  the object's real metadata, which made the judge grade correctness
  and score a stated wrong fact as absent
- evaluate_catalog_metadata: K-run, gate and Langfuse entry point
  for the Tavern shim
- make calibrate-catalog-metadata with a calibration fixture
- the takeaway and catalog clients share the retry predicate and
  is_transient in core/_retry.py

jira: QA-30180
risk: low
- blank text and blank note count as no answer, so they are asked
  again and never pass as a decline
- no_markup also catches single emphasis (*x*, _x_)
- format overrides must be a positive integer (limits) or true,
  false or null; checked before any request
- calibration counts an ungraded judge run as a mismatch

jira: QA-30180
risk: low
- no_markup: a leading "# of" is a metric name, not a heading
- word and sentence counts move to _text_utils; each evaluator
  passes its own abbreviation list, so catalog keeps "Avg.",
  "Est.", "U.K." in one sentence and takeaway verdicts stay as
  they are

jira: QA-30180
risk: low
feat(gooddata-eval): evaluate Analytics Catalog title/description
@yenkins-admin
yenkins-admin merged commit a460700 into rel/dev Nov 18, 2026
1 check passed
@yenkins-admin
yenkins-admin deleted the snapshot-master-d0c7e6ba-to-rel/dev branch November 18, 2026 14:29
@coderabbitai

coderabbitai Bot commented Nov 18, 2026

Copy link
Copy Markdown

Important

Review skipped

Auto reviews are disabled on base/target branches other than the default branch.

Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

Run configuration

  • Source mode: Auto
  • Repository: Unavailable
  • Branch: Unavailable
  • File: No configuration file from this repository applied
  • Commit: Unavailable
  • Layers: Organization UI
  • Review profile: CHILL
  • Plan: Advanced
  • Run ID: 7a9e5f0d-90cd-4392-a041-a16e0ddb5b82

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

Use the checkbox below for a quick retry:

  • Trigger review
  • Autofix · Keep fixing CodeRabbit findings and required CI, and resolving merge conflicts

@codecov

codecov Bot commented Nov 18, 2026

Copy link
Copy Markdown

Codecov Report

❌ Patch coverage is 99.00000% with 3 lines in your changes missing coverage. Please review.
✅ Project coverage is 87.07%. Comparing base (b6f2959) to head (d0c7e6b).
⚠️ Report is 661 commits behind head on rel/dev.

Files with missing lines Patch % Lines
...ta-eval/src/gooddata_eval/core/catalog/evaluate.py 98.30% 2 Missing ⚠️
.../gooddata_eval/core/evaluators/catalog_metadata.py 98.75% 1 Missing ⚠️
Additional details and impacted files
@@             Coverage Diff             @@
##           rel/dev    #1968      +/-   ##
===========================================
+ Coverage    86.96%   87.07%   +0.11%     
===========================================
  Files          352      355       +3     
  Lines        27781    28052     +271     
===========================================
+ Hits         24159    24427     +268     
- Misses        3622     3625       +3     

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants