Skip to content

Cucumber WDIO reporter - Scenario Outline results merged in 1 single execution result in testomat #350

@Automata3D

Description

@Automata3D

Describe the bug
When running "Scenario Outline" examples with Cucumber+WebdriverIO (Appium service), the test run in testomat seems to just upload the latest example result.

To Reproduce
Steps to reproduce the behavior:

  1. Create a "Scenario Outline" with several examples using Cucumber+WebdriverIO framework.
  2. Run the test adding the needed config in order to create the test run report in testomat
    "npx start-test-run -c 'dotenv -e .env -- npx wdio config/local/ios.conf.js --parallel=true' --env-file .env"
  3. Note we are using wdio-cucumber-parallel-execution, which creates 1 webdriverio session per Cucumber example
  4. Once the run is finished, in testomat we just get the latest example execution as the feature result

Expected behavior
Ideally, we should have a result per each scenario outline example, meaning that probably scenario outlines should be treated as test suites containing different tests.

Screenshots
If applicable, add screenshots to help explain your problem.

Desktop (please complete the following information):

  • OS: [e.g. iOS] - macOS Sonoma

Smartphone (please complete the following information):

  • Device: [e.g. iPhone6] - iPhone 15
  • OS: [e.g. iOS8.1] - 17.2

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't workingcucumberusersusers need help with the issue

    Type

    No fields configured for Bug.

    Projects

    No projects

    Milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions