Add pull_request event trigger to ATF tests pipeline by adrisala · Pull Request #16632 · ansible/awx

adrisala · 2026-09-01T08:11:30Z

SUMMARY

ATF tests pipeline previously only triggered on /run-atf-tests PR comment.
Added on-event and on-target-branch annotations so pipeline also triggers
automatically on pull_request events targeting devel, aligning with the
jewel repo's pipeline configuration.

ISSUE TYPE

Bug, Docs Fix or other nominal change

COMPONENT NAME

Other

STEPS TO REPRODUCE AND EXTRA INFO

N/A - CI pipeline configuration change only.

Summary by CodeRabbit

Tests
- Automated AWX acceptance tests now run for pull requests targeting the devel branch.
- Gateway tests are excluded from this pull-request validation run.
- This provides earlier feedback on proposed changes before they are merged.

coderabbitai · 2026-09-01T08:11:57Z

Note

Reviews paused

It looks like this branch is under active development. To avoid overwhelming you with review comments due to an influx of new commits, CodeRabbit has automatically paused this review. You can configure this behavior by changing the reviews.auto_review.auto_pause_after_reviewed_commits setting.

Use the following commands to manage reviews:

@coderabbitai resume to resume automatic reviews.
@coderabbitai review to trigger a single review.

Use the checkboxes below for quick actions:

▶️ Resume reviews
🔍 Trigger review

No actionable comments were generated in the recent review. 🎉

ℹ️ Recent review info

⚙️ Run configuration

Configuration used: Organization UI

Review profile: CHILL

Plan: Team

Run ID: 2aff2317-7506-4ec2-a034-bcf12e791616

📥 Commits

Reviewing files that changed from the base of the PR and between 6bfc205 and ba411ea.

📒 Files selected for processing (1)

.tekton/run-atf-tests-pull-request.yaml

Included review availability: Your plan provides up to 10 included reviews per hour; 9 remain after this review.

📝 Walkthrough

Walkthrough

The Tekton PipelineRun now triggers ATF tests for pull requests targeting devel and excludes tests matching Gateway.

Changes

ATF pipeline configuration

Layer / File(s)	Summary
Configure pull-request execution `.tekton/run-atf-tests-pull-request.yaml`	Adds Pipelines as Code annotations for pull requests targeting `devel` and sets `pytest-expression` to `not Gateway`.

Estimated code review effort: 1 (Trivial) | ~2 minutes

Suggested reviewers: ryankwilliams

Merge Risk: ⚪ Minimal · up to ba411

This change enables ATF runs for pull requests targeting devel while retaining comment-triggered runs and excluding Gateway tests. No concrete merge-blocking risk is identified.

🚥 Pre-merge checks | ✅ 5

✅ Passed checks (5 passed)

Check name	Status	Explanation
Description Check	✅ Passed	Check skipped - CodeRabbit’s high-level summary is enabled.
Title check	✅ Passed	The title clearly and concisely describes the addition of a pull request event trigger to the ATF tests pipeline.
Docstring Coverage	✅ Passed	No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check. Docstring coverage is scoped to functions touched by this diff. Analyzed 0 functions across 0…
Linked Issues check	✅ Passed	Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check	✅ Passed	Check skipped because no linked issues were found for this pull request.

✨ Finishing Touches

🧪 Generate unit tests (beta)

Create PR with unit tests
Commit unit tests in branch tekton-atf-pr-trigger

_{Comment @coderabbitai help to get the list of available commands.}

aap-pde-ci-bot · 2026-09-01T10:24:24Z

❌ Test Results - FAILED

Summary

Metric	Count
Total Tests	1368
✅ Passed	1255
❌ Failed	13
⚠️ Errors	40
⏭️ Skipped	60
⏱️ Duration	3344.55s

Pass Rate: 91.7%

❌ Failed Tests

Test	Class
`test_user_can_delete_inventories_with_role[Inventory Admin-202-Controller]`	`opt.test-suite.tests.rbac.test_inventories.TestControllerRBACInventories`
`test_user_can_delete_inventories_with_role[Organization Admin-202-Gateway]`	`opt.test-suite.tests.rbac.test_inventories.TestControllerRBACInventories`
`test_user_can_delete_inventories_with_role[Organization Admin-202-Controller]`	`opt.test-suite.tests.rbac.test_inventories.TestControllerRBACInventories`
`test_user_can_delete_inventories_with_role[Organization Inventory Admin-202-Gateway]`	`opt.test-suite.tests.rbac.test_inventories.TestControllerRBACInventories`
`test_user_can_delete_inventories_with_role[Organization Inventory Admin-202-Controller]`	`opt.test-suite.tests.rbac.test_inventories.TestControllerRBACInventories`
`test_team_can_delete_inventories_with_role[Inventory Admin-202-Gateway]`	`opt.test-suite.tests.rbac.test_inventories.TestControllerRBACInventories`
`test_user_can_delete_inventories_with_role[Inventory Admin-202-Gateway]`	`opt.test-suite.tests.rbac.test_inventories.TestControllerRBACInventories`
`test_team_can_delete_inventories_with_role[Inventory Admin-202-Controller]`	`opt.test-suite.tests.rbac.test_inventories.TestControllerRBACInventories`
`test_delete_inventory_and_associated_rbac_assignment[Gateway]`	`opt.test-suite.tests.rbac.test_inventories.TestControllerRBACInventories`
`test_team_can_delete_inventories_with_role[Organization Inventory Admin-202-Gateway]`	`opt.test-suite.tests.rbac.test_inventories.TestControllerRBACInventories`
`test_team_can_delete_inventories_with_role[Organization Inventory Admin-202-Controller]`	`opt.test-suite.tests.rbac.test_inventories.TestControllerRBACInventories`
`test_delete_inventory_and_associated_rbac_assignment[Controller]`	`opt.test-suite.tests.rbac.test_inventories.TestControllerRBACInventories`
`test_user_can_view_job_templates_with_role[Platform Auditor-200-Gateway]`	`opt.test-suite.tests.rbac.test_job_templates.TestControllerRBACJobTemplates`
`test_user_can_change_job_templates_with_role[Platform Auditor-403-Gateway]`	`opt.test-suite.tests.rbac.test_job_templates.TestControllerRBACJobTemplates`
`test_user_can_delete_job_templates_with_role[Platform Auditor-403-Gateway]`	`opt.test-suite.tests.rbac.test_job_templates.TestControllerRBACJobTemplates`
`test_job_template_change_request_without_usage_role_returns_code_403[Platform Auditor-403-Gateway]`	`opt.test-suite.tests.rbac.test_job_templates.TestControllerRBACJobTemplates`
`test_user_can_relaunch_job_with_role[JobTemplate Execute-201-Controller]`	`opt.test-suite.tests.rbac.test_jobs.TestControllerRBACJobTemplates`
`test_team_can_create_credentials_with_role[Organization Credential Admin-201-Gateway]`	`opt.test-suite.tests.rbac.test_credentials.TestControllerRBACCredentials`
`test_user_can_schedule_job_with_role[Organization Audit-403-Gateway]`	`opt.test-suite.tests.rbac.test_jobs.TestControllerRBACJobTemplates`
`test_user_can_delete_projects_with_role[Organization Audit-403-Controller]`	`opt.test-suite.tests.rbac.test_projects.TestControllerProjectsRBAC`
`test_team_can_relaunch_with_ask_inventory_with_role[Organization JobTemplate Admin-201-Controller]`	`opt.test-suite.tests.rbac.test_jobs.TestControllerRBACJobTemplates`
`test_team_can_delete_projects_with_role[Project Update-403-Controller]`	`opt.test-suite.tests.rbac.test_projects.TestControllerProjectsRBAC`
`test_team_can_schedule_job_with_role[Organization JobTemplate Admin-201-Controller]`	`opt.test-suite.tests.rbac.test_jobs.TestControllerRBACJobTemplates`
`test_user_can_view_jobs_with_role[Organization Admin-200-Gateway]`	`opt.test-suite.tests.rbac.test_jobs.TestControllerRBACJobTemplates`
`test_user_can_cancel_and_delete_ad_hoc_command_with_role[Inventory Update-403-403-Controller]`	`opt.test-suite.tests.rbac.test_inventories.TestControllerRBACInventories`
`test_user_can_relaunch_job_with_role[Organization Admin-201-Gateway]`	`opt.test-suite.tests.rbac.test_jobs.TestControllerRBACJobTemplates`
`test_user_can_cancel_job_with_role[Organization Admin-202-Gateway]`	`opt.test-suite.tests.rbac.test_jobs.TestControllerRBACJobTemplates`
`test_user_can_relaunch_with_ask_inventory_with_role[Organization Admin-201-Gateway]`	`opt.test-suite.tests.rbac.test_jobs.TestControllerRBACJobTemplates`
`test_user_can_schedule_job_with_role[Organization Admin-201-Gateway]`	`opt.test-suite.tests.rbac.test_jobs.TestControllerRBACJobTemplates`
`test_user_can_test_notification_templates_with_role[Organization NotificationTemplate Admin-202-Gateway]`	`opt.test-suite.tests.rbac.test_rbac_notification_templates.TestControllerRBACNotificationTemplates`
`test_user_can_delete_projects_with_role[Project Update-403-Controller]`	`opt.test-suite.tests.rbac.test_projects.TestControllerProjectsRBAC`
`test_user_can_delete_notification_templates_with_role[Organization Admin-204-Controller]`	`opt.test-suite.tests.rbac.test_rbac_notification_templates.TestControllerRBACNotificationTemplates`
`test_user_can_delete_projects_with_role[Project Update-403-Controller]`	`opt.test-suite.tests.rbac.test_projects.TestControllerProjectsRBAC`
`test_user_can_test_notification_templates_with_role[Organization NotificationTemplate Admin-202-Controller]`	`opt.test-suite.tests.rbac.test_rbac_notification_templates.TestControllerRBACNotificationTemplates`
`test_user_can_delete_projects_with_role[Project Admin-204-Controller]`	`opt.test-suite.tests.rbac.test_projects.TestControllerProjectsRBAC`
`test_user_can_delete_schedules_with_role[Organization Member-403-Controller]`	`opt.test-suite.tests.rbac.test_schedules_rbac.TestControllerRBACJobSchedules`
`test_user_can_test_notification_templates_with_role[NotificationTemplate Admin-202-Gateway]`	`opt.test-suite.tests.rbac.test_rbac_notification_templates.TestControllerRBACNotificationTemplates`
`test_user_can_test_notification_templates_with_role[NotificationTemplate Admin-202-Controller]`	`opt.test-suite.tests.rbac.test_rbac_notification_templates.TestControllerRBACNotificationTemplates`
`test_team_can_test_notification_templates_with_role[NotificationTemplate Admin-202-Gateway]`	`opt.test-suite.tests.rbac.test_rbac_notification_templates.TestControllerRBACNotificationTemplates`
`test_user_can_test_notification_templates_with_role[Organization Admin-202-Gateway]`	`opt.test-suite.tests.rbac.test_rbac_notification_templates.TestControllerRBACNotificationTemplates`
`test_team_can_test_notification_templates_with_role[NotificationTemplate Admin-202-Controller]`	`opt.test-suite.tests.rbac.test_rbac_notification_templates.TestControllerRBACNotificationTemplates`
`test_team_can_manage_project_update_with_role[Project Admin-202-Gateway]`	`opt.test-suite.tests.rbac.test_projects.TestControllerProjectsRBAC`
`test_user_can_test_notification_templates_with_role[Organization Admin-202-Controller]`	`opt.test-suite.tests.rbac.test_rbac_notification_templates.TestControllerRBACNotificationTemplates`
`test_team_can_test_notification_templates_with_role[Organization NotificationTemplate Admin-202-Gateway]`	`opt.test-suite.tests.rbac.test_rbac_notification_templates.TestControllerRBACNotificationTemplates`
`test_team_can_test_notification_templates_with_role[Organization NotificationTemplate Admin-202-Controller]`	`opt.test-suite.tests.rbac.test_rbac_notification_templates.TestControllerRBACNotificationTemplates`
`test_deleted_uj_logged_as_deleted_user[project_update]`	`opt.test-suite.tests.test_activity_stream.TestActivityStream`
`test_deleted_uj_logged_as_deleted_user[system_job]`	`opt.test-suite.tests.test_activity_stream.TestActivityStream`
`test_deleted_uj_logged_as_deleted_user[inventory_update]`	`opt.test-suite.tests.test_activity_stream.TestActivityStream`
`test_analytics_ship_oidc_when_no_cert`	`opt.test-suite.tests.test_candlepin_integration.TestCandlepinAnalyticsShipping`
`test_analytics_ship_with_candlepin_cert`	`opt.test-suite.tests.test_candlepin_integration.TestCandlepinAnalyticsShipping`
`test_analytics_ship_renews_invalid_cert`	`opt.test-suite.tests.test_candlepin_integration.TestCandlepinAnalyticsShipping`
`test_analytics_ship_with_existing_valid_cert`	`opt.test-suite.tests.test_candlepin_integration.TestCandlepinAnalyticsShipping`
`test_analytics_ship_oidc_fallback_cert_failure`	`opt.test-suite.tests.test_candlepin_integration.TestCandlepinAnalyticsShipping`

aap-pde-ci-bot · 2026-09-02T10:22:14Z

❌ Test Results - FAILED

Summary

Metric	Count
Total Tests	1369
✅ Passed	1277
❌ Failed	5
⚠️ Errors	27
⏭️ Skipped	60
⏱️ Duration	4328.56s

Pass Rate: 93.3%

❌ Failed Tests

Test	Class
`test_user_can_delete_inventories_with_role[Inventory Admin-202-Gateway]`	`opt.test-suite.tests.rbac.test_inventories.TestControllerRBACInventories`
`test_user_can_delete_inventories_with_role[Inventory Admin-202-Controller]`	`opt.test-suite.tests.rbac.test_inventories.TestControllerRBACInventories`
`test_user_can_delete_inventories_with_role[Organization Admin-202-Gateway]`	`opt.test-suite.tests.rbac.test_inventories.TestControllerRBACInventories`
`test_user_can_delete_inventories_with_role[Organization Admin-202-Controller]`	`opt.test-suite.tests.rbac.test_inventories.TestControllerRBACInventories`
`test_user_can_delete_inventories_with_role[Organization Inventory Admin-202-Gateway]`	`opt.test-suite.tests.rbac.test_inventories.TestControllerRBACInventories`
`test_user_can_delete_inventories_with_role[Organization Inventory Admin-202-Controller]`	`opt.test-suite.tests.rbac.test_inventories.TestControllerRBACInventories`
`test_team_can_delete_inventories_with_role[Inventory Admin-202-Gateway]`	`opt.test-suite.tests.rbac.test_inventories.TestControllerRBACInventories`
`test_team_can_delete_inventories_with_role[Inventory Admin-202-Controller]`	`opt.test-suite.tests.rbac.test_inventories.TestControllerRBACInventories`
`test_team_can_delete_inventories_with_role[Organization Inventory Admin-202-Gateway]`	`opt.test-suite.tests.rbac.test_inventories.TestControllerRBACInventories`
`test_team_can_delete_inventories_with_role[Organization Inventory Admin-202-Controller]`	`opt.test-suite.tests.rbac.test_inventories.TestControllerRBACInventories`
`test_delete_inventory_and_associated_rbac_assignment[Gateway]`	`opt.test-suite.tests.rbac.test_inventories.TestControllerRBACInventories`
`test_delete_inventory_and_associated_rbac_assignment[Controller]`	`opt.test-suite.tests.rbac.test_inventories.TestControllerRBACInventories`
`test_team_can_change_job_templates_with_role[Organization JobTemplate Admin-200-Controller]`	`opt.test-suite.tests.rbac.test_job_templates.TestControllerRBACJobTemplates`
`test_user_can_view_job_templates_with_role[Organization Admin-200-Controller]`	`opt.test-suite.tests.rbac.test_job_templates.TestControllerRBACJobTemplates`
`test_user_can_test_notification_templates_with_role[NotificationTemplate Admin-202-Gateway]`	`opt.test-suite.tests.rbac.test_rbac_notification_templates.TestControllerRBACNotificationTemplates`
`test_user_can_test_notification_templates_with_role[NotificationTemplate Admin-202-Controller]`	`opt.test-suite.tests.rbac.test_rbac_notification_templates.TestControllerRBACNotificationTemplates`
`test_user_can_test_notification_templates_with_role[Organization Admin-202-Gateway]`	`opt.test-suite.tests.rbac.test_rbac_notification_templates.TestControllerRBACNotificationTemplates`
`test_user_can_delete_projects_with_role[Project Use-403-Gateway]`	`opt.test-suite.tests.rbac.test_projects.TestControllerProjectsRBAC`
`test_user_can_create_notification_templates_with_role[Organization NotificationTemplate Admin-201-Gateway]`	`opt.test-suite.tests.rbac.test_rbac_notification_templates.TestControllerRBACNotificationTemplates`
`test_user_can_delete_projects_with_role[Project Use-403-Gateway]`	`opt.test-suite.tests.rbac.test_projects.TestControllerProjectsRBAC`
`test_user_can_test_notification_templates_with_role[Organization Admin-202-Controller]`	`opt.test-suite.tests.rbac.test_rbac_notification_templates.TestControllerRBACNotificationTemplates`
`test_user_can_test_notification_templates_with_role[Organization NotificationTemplate Admin-202-Gateway]`	`opt.test-suite.tests.rbac.test_rbac_notification_templates.TestControllerRBACNotificationTemplates`
`test_team_can_test_notification_templates_with_role[Organization NotificationTemplate Admin-202-Controller]`	`opt.test-suite.tests.rbac.test_rbac_notification_templates.TestControllerRBACNotificationTemplates`
`test_user_can_test_notification_templates_with_role[Organization NotificationTemplate Admin-202-Controller]`	`opt.test-suite.tests.rbac.test_rbac_notification_templates.TestControllerRBACNotificationTemplates`
`test_team_can_test_notification_templates_with_role[NotificationTemplate Admin-202-Gateway]`	`opt.test-suite.tests.rbac.test_rbac_notification_templates.TestControllerRBACNotificationTemplates`
`test_team_can_test_notification_templates_with_role[NotificationTemplate Admin-202-Controller]`	`opt.test-suite.tests.rbac.test_rbac_notification_templates.TestControllerRBACNotificationTemplates`
`test_team_can_test_notification_templates_with_role[Organization NotificationTemplate Admin-202-Gateway]`	`opt.test-suite.tests.rbac.test_rbac_notification_templates.TestControllerRBACNotificationTemplates`
`test_analytics_ship_with_candlepin_cert`	`opt.test-suite.tests.test_candlepin_integration.TestCandlepinAnalyticsShipping`
`test_analytics_ship_with_existing_valid_cert`	`opt.test-suite.tests.test_candlepin_integration.TestCandlepinAnalyticsShipping`
`test_analytics_ship_oidc_when_no_cert`	`opt.test-suite.tests.test_candlepin_integration.TestCandlepinAnalyticsShipping`
`test_analytics_ship_renews_invalid_cert`	`opt.test-suite.tests.test_candlepin_integration.TestCandlepinAnalyticsShipping`
`test_analytics_ship_oidc_fallback_cert_failure`	`opt.test-suite.tests.test_candlepin_integration.TestCandlepinAnalyticsShipping`

aap-pde-ci-bot · 2026-09-03T10:12:21Z

❌ Test Results - FAILED

Summary

Metric	Count
Total Tests	1243
✅ Passed	1166
❌ Failed	2
⚠️ Errors	20
⏭️ Skipped	55
⏱️ Duration	2568.06s

Pass Rate: 93.8%

❌ Failed Tests

Test	Class
`test_all_group_variables_overwrite`	`opt.test-suite.tests.inventories.test_constructed.TestConstructedInventory`
`test_all_group_variables_overwrite`	`opt.test-suite.tests.inventories.test_constructed.TestConstructedInventory`
`test_user_can_view_instance_groups_with_role[InstanceGroup Use-200-Controller]`	`opt.test-suite.tests.rbac.test_instance_group_rbac.TestControllerInstanceGroupRBAC`
`test_team_can_view_instance_groups_with_role[InstanceGroup Use-200-Controller]`	`opt.test-suite.tests.rbac.test_instance_group_rbac.TestControllerInstanceGroupRBAC`
`test_user_can_create_instance_groups_with_role[InstanceGroup Use-403-Controller]`	`opt.test-suite.tests.rbac.test_instance_group_rbac.TestControllerInstanceGroupRBAC`
`test_team_can_create_instance_groups_with_role[InstanceGroup Use-403-Controller]`	`opt.test-suite.tests.rbac.test_instance_group_rbac.TestControllerInstanceGroupRBAC`
`test_user_can_change_instance_groups_with_role[InstanceGroup Use-403-Controller]`	`opt.test-suite.tests.rbac.test_instance_group_rbac.TestControllerInstanceGroupRBAC`
`test_team_can_change_instance_groups_with_role[InstanceGroup Use-403-Controller]`	`opt.test-suite.tests.rbac.test_instance_group_rbac.TestControllerInstanceGroupRBAC`
`test_user_can_delete_instance_groups_with_role[InstanceGroup Use-403-Controller]`	`opt.test-suite.tests.rbac.test_instance_group_rbac.TestControllerInstanceGroupRBAC`
`test_team_can_delete_instance_groups_with_role[InstanceGroup Use-403-Controller]`	`opt.test-suite.tests.rbac.test_instance_group_rbac.TestControllerInstanceGroupRBAC`
`test_user_can_assign_instance_group_to_inventory[InstanceGroup Use-204-Controller]`	`opt.test-suite.tests.rbac.test_instance_group_rbac.TestControllerInstanceGroupRBAC`
`test_user_can_assign_instance_group_to_inventory[InstanceGroup Use-204-Controller]`	`opt.test-suite.tests.rbac.test_instance_group_rbac.TestControllerInstanceGroupRBAC`
`test_job_template_change_request_without_usage_role_returns_code_403[JobTemplate Admin-200-Controller]`	`opt.test-suite.tests.rbac.test_job_templates.TestControllerRBACJobTemplates`
`test_user_can_delete_job_templates_with_role[Platform Auditor-403-Gateway]`	`opt.test-suite.tests.rbac.test_job_templates.TestControllerRBACJobTemplates`
`test_job_template_change_request_without_usage_role_returns_code_403[Platform Auditor-403-Gateway]`	`opt.test-suite.tests.rbac.test_job_templates.TestControllerRBACJobTemplates`
`test_user_can_change_job_templates_with_role[Platform Auditor-403-Gateway]`	`opt.test-suite.tests.rbac.test_job_templates.TestControllerRBACJobTemplates`
`test_analytics_ship_with_existing_valid_cert`	`opt.test-suite.tests.test_candlepin_integration.TestCandlepinAnalyticsShipping`
`test_analytics_ship_with_candlepin_cert`	`opt.test-suite.tests.test_candlepin_integration.TestCandlepinAnalyticsShipping`
`test_analytics_ship_renews_invalid_cert`	`opt.test-suite.tests.test_candlepin_integration.TestCandlepinAnalyticsShipping`
`test_analytics_ship_oidc_when_no_cert`	`opt.test-suite.tests.test_candlepin_integration.TestCandlepinAnalyticsShipping`
`test_project_sync_with_galaxy_disabled`	`opt.test-suite.tests.test_projects.TestProjectGalaxyInstall`
`test_analytics_ship_oidc_fallback_cert_failure`	`opt.test-suite.tests.test_candlepin_integration.TestCandlepinAnalyticsShipping`

adrisala · 2026-09-03T13:48:49Z

/run-atf-tests

adrisala · 2026-09-03T13:52:07Z

/run-atf-tests

adrisala · 2026-09-03T14:01:48Z

/run-atf-tests

adrisala · 2026-09-07T08:09:13Z

/run-atf-tests

adrisala · 2026-09-07T10:00:15Z

/run-atf-tests

aap-pde-ci-bot · 2026-09-07T11:44:20Z

⚠️ Test Results - NO TESTS

Summary

Metric	Count
Total Tests	0
✅ Passed	0
❌ Failed	0
⚠️ Errors	0
⏭️ Skipped	0
⏱️ Duration	9.96s

adrisala · 2026-09-08T09:31:56Z

/run-atf-tests

aap-pde-ci-bot · 2026-09-08T10:28:53Z

❌ Test Results - FAILED

Summary

Metric	Count
Total Tests	650
✅ Passed	523
❌ Failed	2
⚠️ Errors	76
⏭️ Skipped	49
⏱️ Duration	1442.45s

Pass Rate: 80.5%

❌ Failed Tests

Test	Class
`test_all_group_variables_overwrite`	`opt.test-suite.tests.inventories.test_constructed.TestConstructedInventory`
`test_all_group_variables_overwrite`	`opt.test-suite.tests.inventories.test_constructed.TestConstructedInventory`
`test_user_can_delete_instance_groups_with_role[InstanceGroup Use-403-Controller]`	`opt.test-suite.tests.rbac.test_instance_group_rbac.TestControllerInstanceGroupRBAC`
`test_team_can_delete_instance_groups_with_role[InstanceGroup Use-403-Controller]`	`opt.test-suite.tests.rbac.test_instance_group_rbac.TestControllerInstanceGroupRBAC`
`test_user_can_assign_instance_group_to_inventory[InstanceGroup Use-204-Controller]`	`opt.test-suite.tests.rbac.test_instance_group_rbac.TestControllerInstanceGroupRBAC`
`test_user_can_assign_instance_group_to_job_template[InstanceGroup Use-204-Controller]`	`opt.test-suite.tests.rbac.test_instance_group_rbac.TestControllerInstanceGroupRBAC`
`test_user_can_view_instance_groups_with_role[InstanceGroup Admin-200-Controller]`	`opt.test-suite.tests.rbac.test_instance_group_rbac.TestControllerInstanceGroupRBAC`
`test_team_can_view_instance_groups_with_role[InstanceGroup Admin-200-Controller]`	`opt.test-suite.tests.rbac.test_instance_group_rbac.TestControllerInstanceGroupRBAC`
`test_user_can_create_instance_groups_with_role[InstanceGroup Admin-403-Controller]`	`opt.test-suite.tests.rbac.test_instance_group_rbac.TestControllerInstanceGroupRBAC`
`test_team_can_create_instance_groups_with_role[InstanceGroup Admin-403-Controller]`	`opt.test-suite.tests.rbac.test_instance_group_rbac.TestControllerInstanceGroupRBAC`
`test_user_can_change_instance_groups_with_role[InstanceGroup Admin-200-Controller]`	`opt.test-suite.tests.rbac.test_instance_group_rbac.TestControllerInstanceGroupRBAC`
`test_team_can_change_instance_groups_with_role[InstanceGroup Admin-200-Controller]`	`opt.test-suite.tests.rbac.test_instance_group_rbac.TestControllerInstanceGroupRBAC`
`test_user_can_delete_instance_groups_with_role[InstanceGroup Admin-204-Controller]`	`opt.test-suite.tests.rbac.test_instance_group_rbac.TestControllerInstanceGroupRBAC`
`test_team_can_delete_instance_groups_with_role[InstanceGroup Admin-204-Controller]`	`opt.test-suite.tests.rbac.test_instance_group_rbac.TestControllerInstanceGroupRBAC`
`test_user_can_assign_instance_group_to_inventory[InstanceGroup Admin-204-Controller]`	`opt.test-suite.tests.rbac.test_instance_group_rbac.TestControllerInstanceGroupRBAC`
`test_user_can_assign_instance_group_to_job_template[InstanceGroup Admin-204-Controller]`	`opt.test-suite.tests.rbac.test_instance_group_rbac.TestControllerInstanceGroupRBAC`
`test_user_can_view_instance_groups_with_role[Organization Member-403-Controller]`	`opt.test-suite.tests.rbac.test_instance_group_rbac.TestControllerInstanceGroupRBAC`
`test_user_can_create_instance_groups_with_role[Organization Member-403-Controller]`	`opt.test-suite.tests.rbac.test_instance_group_rbac.TestControllerInstanceGroupRBAC`
`test_user_can_change_instance_groups_with_role[Organization Member-403-Controller]`	`opt.test-suite.tests.rbac.test_instance_group_rbac.TestControllerInstanceGroupRBAC`
`test_user_can_delete_instance_groups_with_role[Organization Member-403-Controller]`	`opt.test-suite.tests.rbac.test_instance_group_rbac.TestControllerInstanceGroupRBAC`
`test_user_can_view_instance_groups_with_role[Organization Admin-403-Controller]`	`opt.test-suite.tests.rbac.test_instance_group_rbac.TestControllerInstanceGroupRBAC`
`test_user_can_create_instance_groups_with_role[Organization Admin-403-Controller]`	`opt.test-suite.tests.rbac.test_instance_group_rbac.TestControllerInstanceGroupRBAC`
`test_user_can_change_instance_groups_with_role[Organization Admin-403-Controller]`	`opt.test-suite.tests.rbac.test_instance_group_rbac.TestControllerInstanceGroupRBAC`
`test_user_can_delete_instance_groups_with_role[Organization Admin-403-Controller]`	`opt.test-suite.tests.rbac.test_instance_group_rbac.TestControllerInstanceGroupRBAC`
`test_user_can_view_instance_groups_with_role[Organization Audit-403-Controller]`	`opt.test-suite.tests.rbac.test_instance_group_rbac.TestControllerInstanceGroupRBAC`
`test_user_can_view_instance_groups_with_role[Organization Audit-403-Controller]`	`opt.test-suite.tests.rbac.test_instance_group_rbac.TestControllerInstanceGroupRBAC`
`test_team_can_relaunch_job_with_role[JobTemplate Execute-201-Controller]`	`opt.test-suite.tests.rbac.test_jobs.TestControllerRBACJobTemplates`
`test_user_can_cancel_job_with_role[JobTemplate Execute-403-Controller]`	`opt.test-suite.tests.rbac.test_jobs.TestControllerRBACJobTemplates`
`test_team_can_cancel_job_with_role[JobTemplate Execute-403-Controller]`	`opt.test-suite.tests.rbac.test_jobs.TestControllerRBACJobTemplates`
`test_user_can_relaunch_with_ask_inventory_with_role[JobTemplate Execute-201-Controller]`	`opt.test-suite.tests.rbac.test_jobs.TestControllerRBACJobTemplates`
`test_team_can_relaunch_with_ask_inventory_with_role[JobTemplate Execute-201-Controller]`	`opt.test-suite.tests.rbac.test_jobs.TestControllerRBACJobTemplates`
`test_user_can_schedule_job_with_role[JobTemplate Execute-201-Controller]`	`opt.test-suite.tests.rbac.test_jobs.TestControllerRBACJobTemplates`
`test_team_can_schedule_job_with_role[JobTemplate Execute-201-Controller]`	`opt.test-suite.tests.rbac.test_jobs.TestControllerRBACJobTemplates`
`test_user_can_view_jobs_with_role[JobTemplate Admin-200-Controller]`	`opt.test-suite.tests.rbac.test_jobs.TestControllerRBACJobTemplates`
`test_team_can_view_jobs_with_role[JobTemplate Admin-200-Controller]`	`opt.test-suite.tests.rbac.test_jobs.TestControllerRBACJobTemplates`
`test_team_can_launch_job_with_role[JobTemplate Admin-201-Controller]`	`opt.test-suite.tests.rbac.test_jobs.TestControllerRBACJobTemplates`
`test_user_can_relaunch_job_with_role[JobTemplate Admin-201-Controller]`	`opt.test-suite.tests.rbac.test_jobs.TestControllerRBACJobTemplates`
`test_team_can_relaunch_job_with_role[JobTemplate Admin-201-Controller]`	`opt.test-suite.tests.rbac.test_jobs.TestControllerRBACJobTemplates`
`test_user_can_cancel_job_with_role[JobTemplate Admin-202-Controller]`	`opt.test-suite.tests.rbac.test_jobs.TestControllerRBACJobTemplates`
`test_team_can_cancel_job_with_role[JobTemplate Admin-202-Controller]`	`opt.test-suite.tests.rbac.test_jobs.TestControllerRBACJobTemplates`
`test_user_can_relaunch_with_ask_inventory_with_role[JobTemplate Admin-201-Controller]`	`opt.test-suite.tests.rbac.test_jobs.TestControllerRBACJobTemplates`
`test_team_can_relaunch_with_ask_inventory_with_role[JobTemplate Admin-201-Controller]`	`opt.test-suite.tests.rbac.test_jobs.TestControllerRBACJobTemplates`
`test_user_can_schedule_job_with_role[JobTemplate Admin-201-Controller]`	`opt.test-suite.tests.rbac.test_jobs.TestControllerRBACJobTemplates`
`test_team_can_schedule_job_with_role[JobTemplate Admin-201-Controller]`	`opt.test-suite.tests.rbac.test_jobs.TestControllerRBACJobTemplates`
`test_user_can_view_jobs_with_role[Organization Member-403-Controller]`	`opt.test-suite.tests.rbac.test_jobs.TestControllerRBACJobTemplates`
`test_team_can_view_jobs_with_role[Organization JobTemplate Admin-200-Controller]`	`opt.test-suite.tests.rbac.test_jobs.TestControllerRBACJobTemplates`
`test_team_can_launch_job_with_role[Organization JobTemplate Admin-201-Controller]`	`opt.test-suite.tests.rbac.test_jobs.TestControllerRBACJobTemplates`
`test_user_can_relaunch_job_with_role[Organization Member-403-Controller]`	`opt.test-suite.tests.rbac.test_jobs.TestControllerRBACJobTemplates`
`test_team_can_relaunch_job_with_role[Organization JobTemplate Admin-201-Controller]`	`opt.test-suite.tests.rbac.test_jobs.TestControllerRBACJobTemplates`
`test_user_can_cancel_job_with_role[Organization Member-403-Controller]`	`opt.test-suite.tests.rbac.test_jobs.TestControllerRBACJobTemplates`
`test_team_can_cancel_job_with_role[Organization JobTemplate Admin-202-Controller]`	`opt.test-suite.tests.rbac.test_jobs.TestControllerRBACJobTemplates`
`test_user_can_relaunch_with_ask_inventory_with_role[Organization Member-403-Controller]`	`opt.test-suite.tests.rbac.test_jobs.TestControllerRBACJobTemplates`
`test_team_can_relaunch_with_ask_inventory_with_role[Organization JobTemplate Admin-201-Controller]`	`opt.test-suite.tests.rbac.test_jobs.TestControllerRBACJobTemplates`
`test_user_can_schedule_job_with_role[Organization Member-403-Controller]`	`opt.test-suite.tests.rbac.test_jobs.TestControllerRBACJobTemplates`
`test_team_can_schedule_job_with_role[Organization JobTemplate Admin-201-Controller]`	`opt.test-suite.tests.rbac.test_jobs.TestControllerRBACJobTemplates`
`test_user_can_view_jobs_with_role[Organization Admin-200-Controller]`	`opt.test-suite.tests.rbac.test_jobs.TestControllerRBACJobTemplates`
`test_user_can_relaunch_job_with_role[Organization Admin-201-Controller]`	`opt.test-suite.tests.rbac.test_jobs.TestControllerRBACJobTemplates`
`test_user_can_cancel_job_with_role[Organization Admin-202-Controller]`	`opt.test-suite.tests.rbac.test_jobs.TestControllerRBACJobTemplates`
`test_user_can_relaunch_with_ask_inventory_with_role[Organization Admin-201-Controller]`	`opt.test-suite.tests.rbac.test_jobs.TestControllerRBACJobTemplates`
`test_user_can_schedule_job_with_role[Organization Admin-201-Controller]`	`opt.test-suite.tests.rbac.test_jobs.TestControllerRBACJobTemplates`
`test_user_can_view_jobs_with_role[Organization JobTemplate Admin-200-Controller]`	`opt.test-suite.tests.rbac.test_jobs.TestControllerRBACJobTemplates`
`test_user_can_relaunch_job_with_role[Organization JobTemplate Admin-201-Controller]`	`opt.test-suite.tests.rbac.test_jobs.TestControllerRBACJobTemplates`
`test_user_can_cancel_job_with_role[Organization JobTemplate Admin-202-Controller]`	`opt.test-suite.tests.rbac.test_jobs.TestControllerRBACJobTemplates`
`test_user_can_relaunch_with_ask_inventory_with_role[Organization JobTemplate Admin-201-Controller]`	`opt.test-suite.tests.rbac.test_jobs.TestControllerRBACJobTemplates`
`test_user_can_schedule_job_with_role[Organization JobTemplate Admin-201-Controller]`	`opt.test-suite.tests.rbac.test_jobs.TestControllerRBACJobTemplates`
`test_user_can_view_jobs_with_role[Organization Audit-200-Controller]`	`opt.test-suite.tests.rbac.test_jobs.TestControllerRBACJobTemplates`
`test_user_can_relaunch_job_with_role[Organization Audit-403-Controller]`	`opt.test-suite.tests.rbac.test_jobs.TestControllerRBACJobTemplates`
`test_user_can_cancel_job_with_role[Organization Audit-403-Controller]`	`opt.test-suite.tests.rbac.test_jobs.TestControllerRBACJobTemplates`
`test_user_can_relaunch_with_ask_inventory_with_role[Organization Audit-403-Controller]`	`opt.test-suite.tests.rbac.test_jobs.TestControllerRBACJobTemplates`
`test_user_can_schedule_job_with_role[Organization Audit-403-Controller]`	`opt.test-suite.tests.rbac.test_jobs.TestControllerRBACJobTemplates`
`test_user_can_view_jobs_with_role[Platform Auditor-200-Controller]`	`opt.test-suite.tests.rbac.test_jobs.TestControllerRBACJobTemplates`
`test_user_can_relaunch_job_with_role[Platform Auditor-403-Controller]`	`opt.test-suite.tests.rbac.test_jobs.TestControllerRBACJobTemplates`
`test_user_can_cancel_job_with_role[Platform Auditor-403-Controller]`	`opt.test-suite.tests.rbac.test_jobs.TestControllerRBACJobTemplates`
`test_user_can_schedule_job_with_role[Platform Auditor-403-Controller]`	`opt.test-suite.tests.rbac.test_jobs.TestControllerRBACJobTemplates`
`test_user_can_view_jobs_with_role[JobTemplate Execute-200-Controller]`	`opt.test-suite.tests.rbac.test_jobs.TestControllerRBACJobTemplates`
`test_user_can_relaunch_job_with_role[JobTemplate Execute-201-Controller]`	`opt.test-suite.tests.rbac.test_jobs.TestControllerRBACJobTemplates`
`test_launching_template_with_labels_should_not_create_activity_stream_entries_for_each_label[job_template]`	`opt.test-suite.tests.test_activity_stream.TestActivityStream`
`test_launching_template_with_labels_should_not_create_activity_stream_entries_for_each_label[job_template]`	`opt.test-suite.tests.test_activity_stream.TestActivityStream`

adrisala · 2026-09-08T10:40:20Z

/run-atf-tests

aap-pde-ci-bot · 2026-09-08T11:27:26Z

❌ Test Results - FAILED

Summary

Metric	Count
Total Tests	651
✅ Passed	563
❌ Failed	4
⚠️ Errors	35
⏭️ Skipped	49
⏱️ Duration	1472.58s

Pass Rate: 86.5%

❌ Failed Tests

Test	Class
`test_user_can_create_instance_groups_with_role[Organization Audit-403-Controller]`	`opt.test-suite.tests.rbac.test_instance_group_rbac.TestControllerInstanceGroupRBAC`
`test_user_can_change_instance_groups_with_role[Organization Audit-403-Controller]`	`opt.test-suite.tests.rbac.test_instance_group_rbac.TestControllerInstanceGroupRBAC`
`test_user_can_delete_instance_groups_with_role[Organization Audit-403-Controller]`	`opt.test-suite.tests.rbac.test_instance_group_rbac.TestControllerInstanceGroupRBAC`
`test_user_can_delete_instance_groups_with_role[Platform Auditor-403-Controller]`	`opt.test-suite.tests.rbac.test_instance_group_rbac.TestControllerInstanceGroupRBAC`
`test_try_create_jt_using_ee_from_other_organization[Organization Member-403-Controller]`	`opt.test-suite.tests.rbac.test_job_templates.TestControllerRBACJobTemplates`
`test_user_can_view_job_templates_with_role[Organization Member-403-Controller]`	`opt.test-suite.tests.rbac.test_job_templates.TestControllerRBACJobTemplates`
`test_team_can_view_job_templates_with_role[Organization JobTemplate Admin-200-Controller]`	`opt.test-suite.tests.rbac.test_job_templates.TestControllerRBACJobTemplates`
`test_team_can_create_job_templates_with_role[Organization JobTemplate Admin-403-Controller]`	`opt.test-suite.tests.rbac.test_job_templates.TestControllerRBACJobTemplates`
`test_user_can_change_job_templates_with_role[Organization Member-403-Controller]`	`opt.test-suite.tests.rbac.test_job_templates.TestControllerRBACJobTemplates`
`test_team_can_change_job_templates_with_role[Organization JobTemplate Admin-200-Controller]`	`opt.test-suite.tests.rbac.test_job_templates.TestControllerRBACJobTemplates`
`test_user_can_delete_job_templates_with_role[Organization Member-403-Controller]`	`opt.test-suite.tests.rbac.test_job_templates.TestControllerRBACJobTemplates`
`test_team_can_delete_job_templates_with_role[Organization JobTemplate Admin-204-Controller]`	`opt.test-suite.tests.rbac.test_job_templates.TestControllerRBACJobTemplates`
`test_job_template_change_request_without_usage_role_returns_code_403[Organization Member-403-Controller]`	`opt.test-suite.tests.rbac.test_job_templates.TestControllerRBACJobTemplates`
`test_try_create_jt_using_ee_from_other_organization[Organization Admin-403-Controller]`	`opt.test-suite.tests.rbac.test_job_templates.TestControllerRBACJobTemplates`
`test_user_can_view_job_templates_with_role[Organization Admin-200-Controller]`	`opt.test-suite.tests.rbac.test_job_templates.TestControllerRBACJobTemplates`
`test_user_can_change_job_templates_with_role[Organization Admin-200-Controller]`	`opt.test-suite.tests.rbac.test_job_templates.TestControllerRBACJobTemplates`
`test_user_can_delete_job_templates_with_role[Organization Admin-204-Controller]`	`opt.test-suite.tests.rbac.test_job_templates.TestControllerRBACJobTemplates`
`test_job_template_change_request_without_usage_role_returns_code_403[Organization Admin-200-Controller]`	`opt.test-suite.tests.rbac.test_job_templates.TestControllerRBACJobTemplates`
`test_try_create_jt_using_ee_from_other_organization[Organization JobTemplate Admin-403-Controller]`	`opt.test-suite.tests.rbac.test_job_templates.TestControllerRBACJobTemplates`
`test_user_can_view_job_templates_with_role[Organization JobTemplate Admin-200-Controller]`	`opt.test-suite.tests.rbac.test_job_templates.TestControllerRBACJobTemplates`
`test_user_can_change_job_templates_with_role[Organization JobTemplate Admin-200-Controller]`	`opt.test-suite.tests.rbac.test_job_templates.TestControllerRBACJobTemplates`
`test_user_can_delete_job_templates_with_role[Organization JobTemplate Admin-204-Controller]`	`opt.test-suite.tests.rbac.test_job_templates.TestControllerRBACJobTemplates`
`test_job_template_change_request_without_usage_role_returns_code_403[Organization JobTemplate Admin-200-Controller]`	`opt.test-suite.tests.rbac.test_job_templates.TestControllerRBACJobTemplates`
`test_try_create_jt_using_ee_from_other_organization[Organization Audit-403-Controller]`	`opt.test-suite.tests.rbac.test_job_templates.TestControllerRBACJobTemplates`
`test_user_can_view_job_templates_with_role[Organization Audit-200-Controller]`	`opt.test-suite.tests.rbac.test_job_templates.TestControllerRBACJobTemplates`
`test_user_can_change_job_templates_with_role[Organization Audit-403-Controller]`	`opt.test-suite.tests.rbac.test_job_templates.TestControllerRBACJobTemplates`
`test_user_can_delete_job_templates_with_role[Organization Audit-403-Controller]`	`opt.test-suite.tests.rbac.test_job_templates.TestControllerRBACJobTemplates`
`test_job_template_change_request_without_usage_role_returns_code_403[Organization Audit-403-Controller]`	`opt.test-suite.tests.rbac.test_job_templates.TestControllerRBACJobTemplates`
`test_user_can_view_job_templates_with_role[Platform Auditor-200-Controller]`	`opt.test-suite.tests.rbac.test_job_templates.TestControllerRBACJobTemplates`
`test_user_can_change_job_templates_with_role[Platform Auditor-403-Controller]`	`opt.test-suite.tests.rbac.test_job_templates.TestControllerRBACJobTemplates`
`test_user_can_delete_job_templates_with_role[Platform Auditor-403-Controller]`	`opt.test-suite.tests.rbac.test_job_templates.TestControllerRBACJobTemplates`
`test_job_template_change_request_without_usage_role_returns_code_403[Platform Auditor-403-Controller]`	`opt.test-suite.tests.rbac.test_job_templates.TestControllerRBACJobTemplates`
`test_team_can_cancel_and_delete_ad_hoc_command_with_role[Inventory Update-403-403-Controller]`	`opt.test-suite.tests.rbac.test_inventories.TestControllerRBACInventories`
`test_team_can_cancel_and_delete_ad_hoc_command_with_role[Inventory Update-403-403-Controller]`	`opt.test-suite.tests.rbac.test_inventories.TestControllerRBACInventories`
`test_user_can_delete_projects_with_role[Organization Project Admin-204-Controller]`	`opt.test-suite.tests.rbac.test_projects.TestControllerProjectsRBAC`
`test_user_can_delete_projects_with_role[Organization Project Admin-204-Controller]`	`opt.test-suite.tests.rbac.test_projects.TestControllerProjectsRBAC`
`test_launching_template_with_labels_should_not_create_activity_stream_entries_for_each_label[job_template]`	`opt.test-suite.tests.test_activity_stream.TestActivityStream`
`test_project_gpg_signature_verification_valid`	`opt.test-suite.tests.test_projects.TestProjectGpgSignatureVerification`
`test_launching_template_with_labels_should_not_create_activity_stream_entries_for_each_label[job_template]`	`opt.test-suite.tests.test_activity_stream.TestActivityStream`

aap-pde-ci-bot · 2026-09-08T12:39:45Z

❌ Test Results - FAILED

Summary

Metric	Count
Total Tests	650
✅ Passed	594
❌ Failed	2
⚠️ Errors	2
⏭️ Skipped	52
⏱️ Duration	2382.56s

Pass Rate: 91.4%

❌ Failed Tests

Test	Class
`test_constructed_inventory_duplicate_hosts`	`opt.test-suite.tests.inventories.test_constructed_control_plane.TestConstructedInventoryControlPlane`
`test_constructed_inventory_duplicate_hosts`	`opt.test-suite.tests.inventories.test_constructed_control_plane.TestConstructedInventoryControlPlane`
`test_team_can_cancel_and_delete_ad_hoc_command_with_role[None-403-403-Controller]`	`opt.test-suite.tests.rbac.test_inventories.TestControllerRBACInventories`
`test_team_can_cancel_and_delete_ad_hoc_command_with_role[None-403-403-Controller]`	`opt.test-suite.tests.rbac.test_inventories.TestControllerRBACInventories`

adrisala · 2026-09-08T14:01:31Z

/run-atf-tests

aap-pde-ci-bot · 2026-09-08T15:40:44Z

❌ Test Results - FAILED

Summary

Metric	Count
Total Tests	649
✅ Passed	594
❌ Failed	1
⚠️ Errors	2
⏭️ Skipped	52
⏱️ Duration	3199.76s

Pass Rate: 91.5%

❌ Failed Tests

Test	Class
`test_user_can_launch_ad_hoc_command_with_role[Inventory Adhoc-201-Controller]`	`opt.test-suite.tests.rbac.test_inventories.TestControllerRBACInventories`
`test_jt_does_not_allow_to_set_timeout_when_prompt_is_not_enabled`	`opt.test-suite.tests.prompts.test_prompts_timeout.TestPromptTimeout`
`test_jt_does_not_allow_to_set_timeout_when_prompt_is_not_enabled`	`opt.test-suite.tests.prompts.test_prompts_timeout.TestPromptTimeout`

adrisala · 2026-09-09T07:38:57Z

/run-atf-tests

aap-pde-ci-bot · 2026-09-09T08:42:16Z

❌ Test Results - FAILED

Summary

Metric	Count
Total Tests	649
✅ Passed	593
❌ Failed	3
⚠️ Errors	1
⏭️ Skipped	52
⏱️ Duration	2352.53s

Pass Rate: 91.4%

❌ Failed Tests

Test	Class
`test_all_group_variables_overwrite`	`opt.test-suite.tests.inventories.test_constructed.TestConstructedInventory`
`test_all_group_variables_overwrite`	`opt.test-suite.tests.inventories.test_constructed.TestConstructedInventory`
`test_job_listing_after_delete_does_not_500`	`opt.test-suite.tests.job_templates.test_job_template_concurrency.TestJobTemplateConcurrency`
`test_launching_template_with_labels_should_not_create_activity_stream_entries_for_each_label[job_template]`	`opt.test-suite.tests.test_activity_stream.TestActivityStream`

adrisala · 2026-09-09T10:11:48Z

/run-atf-tests

aap-pde-ci-bot · 2026-09-09T11:42:29Z

❌ Test Results - FAILED

Summary

Metric	Count
Total Tests	650
✅ Passed	594
❌ Failed	2
⚠️ Errors	2
⏭️ Skipped	52
⏱️ Duration	3236.60s

Pass Rate: 91.4%

❌ Failed Tests

Test	Class
`test_all_group_variables_overwrite`	`opt.test-suite.tests.inventories.test_constructed.TestConstructedInventory`
`test_all_group_variables_overwrite`	`opt.test-suite.tests.inventories.test_constructed.TestConstructedInventory`
`test_cancel_workflow_cancels_always_chain_jobs`	`opt.test-suite.tests.jobs.test_workflow_cancel.TestWorkflowCancelPendingJobs`
`test_cancel_workflow_cancels_always_chain_jobs`	`opt.test-suite.tests.jobs.test_workflow_cancel.TestWorkflowCancelPendingJobs`

aap-pde-ci-bot · 2026-09-09T14:08:32Z

❌ Test Results - FAILED

Summary

Metric	Count
Total Tests	649
✅ Passed	593
❌ Failed	3
⚠️ Errors	1
⏭️ Skipped	52
⏱️ Duration	2298.98s

Pass Rate: 91.4%

❌ Failed Tests

Test	Class
`test_all_group_variables_overwrite`	`opt.test-suite.tests.inventories.test_constructed.TestConstructedInventory`
`test_all_group_variables_overwrite`	`opt.test-suite.tests.inventories.test_constructed.TestConstructedInventory`
`test_job_listing_after_delete_does_not_500`	`opt.test-suite.tests.job_templates.test_job_template_concurrency.TestJobTemplateConcurrency`
`test_launching_template_with_labels_should_not_create_activity_stream_entries_for_each_label[job_template]`	`opt.test-suite.tests.test_activity_stream.TestActivityStream`

adrisala · 2026-09-09T14:27:09Z

/run-atf-tests

adrisala · 2026-09-09T18:46:34Z

/run-atf-tests

adrisala · 2026-09-10T08:04:23Z

/run-atf-tests

aap-pde-ci-bot · 2026-09-10T09:10:22Z

❌ Test Results - FAILED

Summary

Metric	Count
Total Tests	635
✅ Passed	565
❌ Failed	1
⚠️ Errors	18
⏭️ Skipped	51
⏱️ Duration	2401.56s

Pass Rate: 89.0%

❌ Failed Tests

Test	Class
`test_user_can_view_instance_groups_with_role[None-403-Controller]`	`opt.test-suite.tests.rbac.test_instance_group_rbac.TestControllerInstanceGroupRBAC`
`test_team_can_view_instance_groups_with_role[None-403-Controller]`	`opt.test-suite.tests.rbac.test_instance_group_rbac.TestControllerInstanceGroupRBAC`
`test_user_can_create_instance_groups_with_role[None-403-Controller]`	`opt.test-suite.tests.rbac.test_instance_group_rbac.TestControllerInstanceGroupRBAC`
`test_team_can_create_instance_groups_with_role[None-403-Controller]`	`opt.test-suite.tests.rbac.test_instance_group_rbac.TestControllerInstanceGroupRBAC`
`test_user_can_change_instance_groups_with_role[None-403-Controller]`	`opt.test-suite.tests.rbac.test_instance_group_rbac.TestControllerInstanceGroupRBAC`
`test_team_can_change_instance_groups_with_role[None-403-Controller]`	`opt.test-suite.tests.rbac.test_instance_group_rbac.TestControllerInstanceGroupRBAC`
`test_user_can_delete_instance_groups_with_role[None-403-Controller]`	`opt.test-suite.tests.rbac.test_instance_group_rbac.TestControllerInstanceGroupRBAC`
`test_team_can_delete_instance_groups_with_role[None-403-Controller]`	`opt.test-suite.tests.rbac.test_instance_group_rbac.TestControllerInstanceGroupRBAC`
`test_user_can_assign_instance_group_to_inventory[None-403-Controller]`	`opt.test-suite.tests.rbac.test_instance_group_rbac.TestControllerInstanceGroupRBAC`
`test_user_can_assign_instance_group_to_job_template[None-403-Controller]`	`opt.test-suite.tests.rbac.test_instance_group_rbac.TestControllerInstanceGroupRBAC`
`test_execution_nodes_access_for_admin[Controller]`	`opt.test-suite.tests.rbac.test_instance_group_rbac.TestControllerInstanceGroupRBAC`
`test_user_can_view_instance_groups_with_role[InstanceGroup Use-200-Controller]`	`opt.test-suite.tests.rbac.test_instance_group_rbac.TestControllerInstanceGroupRBAC`
`test_team_can_view_instance_groups_with_role[InstanceGroup Use-200-Controller]`	`opt.test-suite.tests.rbac.test_instance_group_rbac.TestControllerInstanceGroupRBAC`
`test_user_can_create_instance_groups_with_role[InstanceGroup Use-403-Controller]`	`opt.test-suite.tests.rbac.test_instance_group_rbac.TestControllerInstanceGroupRBAC`
`test_team_can_create_instance_groups_with_role[InstanceGroup Use-403-Controller]`	`opt.test-suite.tests.rbac.test_instance_group_rbac.TestControllerInstanceGroupRBAC`
`test_user_can_change_instance_groups_with_role[InstanceGroup Use-403-Controller]`	`opt.test-suite.tests.rbac.test_instance_group_rbac.TestControllerInstanceGroupRBAC`
`test_user_can_change_instance_groups_with_role[InstanceGroup Use-403-Controller]`	`opt.test-suite.tests.rbac.test_instance_group_rbac.TestControllerInstanceGroupRBAC`
`test_user_can_launch_ad_hoc_command_with_role[Inventory Adhoc-201-Controller]`	`opt.test-suite.tests.rbac.test_inventories.TestControllerRBACInventories`
`test_project_resync[archive-zip]`	`opt.test-suite.tests.test_projects.TestProjectResync`

adrisala · 2026-09-10T09:11:20Z

/run-atf-tests

adrisala · 2026-09-14T08:49:15Z

/run-atf-tests

aap-pde-ci-bot · 2026-09-14T09:48:20Z

❌ Test Results - FAILED

Summary

Metric	Count
Total Tests	636
✅ Passed	580
❌ Failed	1
⚠️ Errors	3
⏭️ Skipped	52
⏱️ Duration	2096.45s

Pass Rate: 91.2%

❌ Failed Tests

Test	Class
`test_delete_var_between_two_updates_from_same_source[True]`	`opt.test-suite.tests.inventories.test_inventory_variables.TestInventoryVariables`
`test_delete_var_between_two_updates_from_same_source[True]`	`opt.test-suite.tests.inventories.test_inventory_variables.TestInventoryVariables`
`test_user_can_launch_ad_hoc_command_with_role[Inventory Adhoc-201-Controller]`	`opt.test-suite.tests.rbac.test_inventories.TestControllerRBACInventories`
`test_team_can_create_projects_with_role[Organization Project Admin-201-Controller]`	`opt.test-suite.tests.rbac.test_projects.TestControllerProjectsRBAC`

Previously the ATF tests pipeline only ran on `/run-atf-tests` comment. Add on-event and on-target-branch annotations so it also triggers automatically on pull_request events targeting devel, matching the jewel repo configuration. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com> Signed-off-by: Adrià Sala <22398818+adrisala@users.noreply.github.com>

sonarqubecloud · 2026-09-15T08:54:11Z

Quality Gate passed

Issues
0 New issues
0 Accepted issues

Measures
0 Security Hotspots
0.0% Coverage on New Code
0.0% Duplication on New Code

See analysis details on SonarQube Cloud

aap-pde-ci-bot · 2026-09-15T09:49:37Z

❌ Test Results - FAILED

Summary

Metric	Count
Total Tests	635
✅ Passed	582
❌ Failed	0
⚠️ Errors	1
⏭️ Skipped	52
⏱️ Duration	3262.95s

Pass Rate: 91.7%

❌ Failed Tests

Test	Class
`test_user_can_launch_ad_hoc_command_with_role[Inventory Adhoc-201-Controller]`	`opt.test-suite.tests.rbac.test_inventories.TestControllerRBACInventories`

github-actions Bot added the community label Sep 1, 2026

adrisala force-pushed the tekton-atf-pr-trigger branch 3 times, most recently from 9927dbb to ba9470e Compare September 1, 2026 09:02

adrisala force-pushed the tekton-atf-pr-trigger branch from ba9470e to ca9ce10 Compare September 2, 2026 08:46

adrisala force-pushed the tekton-atf-pr-trigger branch 2 times, most recently from 6bfc205 to 67473d8 Compare September 3, 2026 09:07

adrisala force-pushed the tekton-atf-pr-trigger branch from 67473d8 to ba411ea Compare September 7, 2026 11:12

adrisala force-pushed the tekton-atf-pr-trigger branch from ba411ea to f0e8123 Compare September 8, 2026 08:48

adrisala force-pushed the tekton-atf-pr-trigger branch from f0e8123 to 2cedcbe Compare September 8, 2026 09:39

adrisala force-pushed the tekton-atf-pr-trigger branch from 2cedcbe to 6049f34 Compare September 8, 2026 11:35

adrisala force-pushed the tekton-atf-pr-trigger branch 3 times, most recently from 1fe31c3 to 25bc39b Compare September 9, 2026 13:06

adrisala force-pushed the tekton-atf-pr-trigger branch 2 times, most recently from 56ee79a to ee9b18c Compare September 9, 2026 14:28

adrisala force-pushed the tekton-atf-pr-trigger branch 2 times, most recently from 155c91e to 6e16716 Compare September 14, 2026 08:51

adrisala force-pushed the tekton-atf-pr-trigger branch 3 times, most recently from 9adbf54 to 8329ff7 Compare September 15, 2026 08:28

adrisala force-pushed the tekton-atf-pr-trigger branch from 8329ff7 to 04cc979 Compare September 15, 2026 08:29

lallen92 approved these changes Sep 15, 2026

View reviewed changes

adrisala merged commit fb4c3ab into devel Sep 15, 2026
20 of 21 checks passed

adrisala deleted the tekton-atf-pr-trigger branch September 15, 2026 10:38

Uh oh!

Conversation

adrisala commented Sep 1, 2026 • edited by coderabbitai Bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

SUMMARY

ISSUE TYPE

COMPONENT NAME

STEPS TO REPRODUCE AND EXTRA INFO

Summary by CodeRabbit

Uh oh!

coderabbitai Bot commented Sep 1, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Reviews paused

Walkthrough

Changes

Uh oh!

aap-pde-ci-bot commented Sep 1, 2026

❌ Test Results - FAILED

Summary

❌ Failed Tests

Uh oh!

aap-pde-ci-bot commented Sep 2, 2026

❌ Test Results - FAILED

Summary

❌ Failed Tests

Uh oh!

aap-pde-ci-bot commented Sep 3, 2026

❌ Test Results - FAILED

Summary

❌ Failed Tests

Uh oh!

adrisala commented Sep 3, 2026

Uh oh!

adrisala commented Sep 3, 2026

Uh oh!

adrisala commented Sep 3, 2026

Uh oh!

adrisala commented Sep 7, 2026

Uh oh!

adrisala commented Sep 7, 2026

Uh oh!

aap-pde-ci-bot commented Sep 7, 2026

⚠️ Test Results - NO TESTS

Summary

Uh oh!

adrisala commented Sep 8, 2026

Uh oh!

aap-pde-ci-bot commented Sep 8, 2026

❌ Test Results - FAILED

Summary

❌ Failed Tests

Uh oh!

adrisala commented Sep 8, 2026

Uh oh!

aap-pde-ci-bot commented Sep 8, 2026

❌ Test Results - FAILED

Summary

❌ Failed Tests

Uh oh!

aap-pde-ci-bot commented Sep 8, 2026

❌ Test Results - FAILED

Summary

❌ Failed Tests

Uh oh!

adrisala commented Sep 8, 2026

Uh oh!

aap-pde-ci-bot commented Sep 8, 2026

❌ Test Results - FAILED

Summary

❌ Failed Tests

Uh oh!

adrisala commented Sep 9, 2026

Uh oh!

aap-pde-ci-bot commented Sep 9, 2026

❌ Test Results - FAILED

Summary

❌ Failed Tests

Uh oh!

adrisala commented Sep 9, 2026

Uh oh!

adrisala commented Sep 1, 2026 •

edited by coderabbitai Bot

Loading

coderabbitai Bot commented Sep 1, 2026 •

edited

Loading