Skip to content

Commit 6351916

Browse files
committed
Update req attribute and workflow for test coverage
This is triggered by the meeting minutes and discussion with the testing community. See here for details: https://github.com/orgs/eclipse-score/discussions/2234?sort=new#discussioncomment-16050359 Signed-off-by: Philipp Ahmann <philipp.ahmann@de.bosch.com>
1 parent 4c3a16f commit 6351916

3 files changed

Lines changed: 27 additions & 3 deletions

File tree

process/process_areas/requirements_engineering/guidance/requirements_process_reqs.rst

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -245,14 +245,14 @@ Process Requirement Linkage
245245

246246
It shall be possible to link requirements to tests and automatically include a link to the test case in the attribute testlink.
247247

248-
.. gd_req:: Requirement attribute: test covered
248+
.. gd_req:: Requirement attribute: complete test coverage
249249
:id: gd_req__req_attr_test_covered
250250
:status: valid
251251
:tags: manual_prio_1, attribute
252252
:satisfies: wf__req_feat_req, wf__req_comp_req
253253
:complies: std_req__iso26262__support_6433, std_req__iso26262__software_944, std_req__aspice_40__iic-13-51
254254

255-
It shall be possible to specify if requirements are completely covered by the linked test cases.
255+
It shall be possible to specify if a requirement is completely satisfied by the linked test case(s).
256256

257257
* Yes
258258
* No
@@ -279,7 +279,7 @@ Process Requirements Checks
279279
:complies: std_req__iso26262__support_6425, std_req__iso26262__support_6434, std_req__aspice_40__iic-13-51
280280

281281
Based on the requirement versioning it shall be checked if a parent requirement was updated but not the linked child requirements (or tests).
282-
In case an update was detected, the attribute requirement (or test) covered shall be set to "No"
282+
In case an update was detected, the attribute `requirement covered` (or `complete test coverage`) shall be set to "No"
283283

284284
Note: This refers to :need:`gd_req__req_attr_req_cov` and :need:`gd_req__req_attr_test_covered`
285285

process/process_areas/verification/guidance/verification_guideline.rst

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -84,6 +84,8 @@ For multiple test cases having a "partial coverage" a review has to be conducted
8484
that a requirement is fully covered. The pull request description should indicate which requirements
8585
are fully covered by the PR commits and which test cases are needed to fully cover the test case.
8686
This is important, as multiple PRs may be needed to fully verify a single requirement.
87+
This information is later on used to set the requirement attribute to `yes` as mentioned by :need:`gd_req__req_attr_test_covered`
88+
which shows that the set of partially covering test cases in sum fully satisfy the requirement.
8789

8890

8991
Test case execution

process/process_areas/verification/verification_workflows.rst

Lines changed: 22 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -150,6 +150,28 @@ For a detailed explanation of workflows and their role within the process model,
150150
Note that during the initial creation of the verification plan in :need:`wf__verification_plan`
151151
not every input down to component level may be available.
152152

153+
.. workflow:: Set Requirement Test Coverage
154+
:id: wf__verification_req_test_coverage
155+
:status: valid
156+
:tags: verification
157+
:responsible: rl__committer, rl__testing_community
158+
:approved_by: rl__project_lead
159+
:supported_by: rl__safety_manager, rl__infrastructure_tooling_community
160+
:input: wp__requirements_stkh, wp__requirements_feat, wp__requirements_feat_aou,
161+
wp__requirements_comp, wp__requirements_comp_aou,
162+
wp__verification_plan, wp__verification_sw_unit_test,
163+
wp__verification_comp_int_test, wp__verification_feat_int_test, wp__verification_platform_int_test
164+
:output: wp__requirements_stkh, wp__requirements_feat, wp__requirements_feat_aou,
165+
wp__requirements_comp, wp__requirements_comp_aou
166+
:contains: gd_req__req_attr_test_covered, gd_req__req_suspicious, gd_guidl__verification_guide
167+
:has: doc_concept__verification_process, doc_getstrt__verification_process
168+
169+
The requirement attribute `complete test coverage` is set to `yes` by a :need:`rl__committer` when it is verified
170+
that the requirement is fully covered by test cases. This means the linked test cases in sum fully satisfy the requirement.
171+
172+
A fully covered requirement will be set to `no` automatically via the implementation of the check described in :need:`gd_req__req_suspicious`.
173+
A recheck is needed in this case to get the status back to `yes`.
174+
153175
.. workflow:: Create Module Verification Report
154176
:id: wf__verification_mod_ver_report
155177
:status: valid

0 commit comments

Comments
 (0)