Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Wrong step order in allure-report #587

Closed
1 of 3 tasks
IlgizVafin opened this issue Aug 31, 2017 · 12 comments
Closed
1 of 3 tasks

Wrong step order in allure-report #587

IlgizVafin opened this issue Aug 31, 2017 · 12 comments
Assignees
Labels
type:bug Something isn't working

Comments

@IlgizVafin
Copy link

I'm submitting a ...

  • bug report
  • feature request
  • support request => Please do not submit support request here, see note at the top of this template.

What is the current behavior?

Wrong step order in allure-report.

Steps to reproduce:

  1. create demo project for UI-testing based on framework webdriverio with Cucumber.
    You can use:
  1. write some test scenario by Gherkin:
Feature: Broken feature

    @Broken
    Scenario: Go to github.com and press non-existent button
        When I go to https://github.com
        And I press button "Non-existent button"
        Then I expect page title "Join GitHub · GitHub"

Feature: Passed feature

    @Passed
    Scenario: Go to github.com and press signup button
        When I go to https://github.com
        And I press button "Sign up for GitHub"
        Then I expect page title "Join GitHub · GitHub"
  1. run test - wdio wdio.conf.js (for example)
  2. generate report - allure generate ./allure-results (for example)
  3. open report and look at the step order
    image
  4. step order isn't correct.

What is the expected behavior?

Step order should be equal to order in *.feature scenarious.

My environment:

Allure version 2.3.4
Test framework webdriver.io + cucumber@~2.2.0
Generate report using [email protected]

Other information

@slipwalker
Copy link

I faced the same issue. Tests execution order is different from that Allure report shows (looks like tests order in Allure report has some random nature). Even, when for every test explicitly set priority on a test level (in case using TestNG framework for instance). I have simple test class with test methods and they have different order in Allure that they were actually executed.

@eliranshani
Copy link

Can you share when this fix will be released ?

@lrocheWB
Copy link

lrocheWB commented Sep 5, 2017

+1

@baev baev added type:bug Something isn't working work:backlog labels Sep 5, 2017
@baev baev self-assigned this Sep 5, 2017
@baev baev closed this as completed in 3d6e863 Sep 6, 2017
@baev baev removed the work:review label Sep 6, 2017
@maciejkamela
Copy link

Have the same issue. Moreover when I run eg. 8 scenarios they are mismatched and just 5 was presented but in wrong order. I would expect the test outcome to be grouped by feature.

@lrocheWB
Copy link

@baev thanks ! https://github.com/allure-framework/allure2/releases/tag/2.3.5

It works for me.

@ravxz
Copy link
Contributor

ravxz commented Jan 19, 2018

Have similar issue with TestNG DataProvider tests. The test cases under test class in report are ordered backward like: #3, #2, #1. Meanwhile, default shown order is by "name" forward.

@reedchan7
Copy link

I have the same issue in allure-java 2.13.7.. Test order is different in the allure report. Isn't this fixed?

@sarvesh371
Copy link

I am facing the same issue with pytest framework

@VanillicRipple
Copy link

+1, I have the same in allure

@poengen
Copy link

poengen commented Feb 28, 2022

+1, Same issure here with kotest framework

@FFFFFF
Copy link

FFFFFF commented Jul 20, 2023

+1, Same issue with jest-junit and allure.

@SivasubramanianV
Copy link

I still see this issue in mocha wdio, the steps are back and forth

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
type:bug Something isn't working
Projects
None yet
Development

No branches or pull requests