Preserve execution order alphabetically by test title

[SimonBaeumer]

Fixes #

Checklist

• Added unit / integration tests for windows, macOS and Linux?
• Added a changelog entry in CHANGELOG.md?
• Updated the documentation (README.md, docs)?
• Does your change work on Linux, Windows and macOS?

[dylanhitt]

I know it's not ready for review, but I found sometime. Is the plan to make the alphabetical ordering the default order or flag enabled?

[SimonBaeumer]

I know it's not ready for review, but I found sometime. Is the plan to make the alphabetical ordering the default order or flag enabled?

The idea is to enable it by default because currently there is no order guaranteed.

[SimonBaeumer]

@dylanhitt review? 👍

[dylanhitt]

Sure, I'll look at it Sunday 👍

[dylanhitt]

Reviewing Monday, current get to my computer today. Sorry about that.

[SimonBaeumer]

Reviewing Monday, current get to my computer today. Sorry about that.

No problem, do it when you have time 👍

[dylanhitt]

👍

[dylanhitt]

The only thing I really have to add is where do we mention "Commander test will execute tests in alphabetical order by default". I was thinking it should go in the commander test cli help text, and maybe a little bit of text under executing.

Hmm maybe a little example showing sequential execution. Something like you mentioned in #128.

001 - it should print hello world:
  order: 1
  command: echo hello world
  stdout: hello world
  exit-code: 0

003 - it should validate exit code:
  order: 2
  command: exit 1
  exit-code: 1

002 - another test:
  order: 2
  command: exit 1
  exit-code: 1

Maybe a full suite example in examples/ could go a long way. Your thoughts?

[SimonBaeumer]

The only thing I really have to add is where do we mention "Commander test will execute tests in alphabetical order by default". I was thinking it should go in the commander test cli help text, and maybe a little bit of text under executing.

Hmm maybe a little example showing sequential execution. Something like you mentioned in #128.

001 - it should print hello world:
  order: 1
  command: echo hello world
  stdout: hello world
  exit-code: 0

003 - it should validate exit code:
  order: 2
  command: exit 1
  exit-code: 1

002 - another test:
  order: 2
  command: exit 1
  exit-code: 1

Maybe a full suite example in examples/ could go a long way. Your thoughts?

Good idea! I will add it to the help and extend the examples.
Anyway I have extending the help command on my list as well.

[codeclimate]

Code Climate has analyzed commit ba142f2 and detected 0 issues on this pull request.

The test coverage on the diff in this pull request is 100.0% (50% is the threshold).

This pull request will bring the total coverage in the repository to 92.4% (0.0% change).

View more on Code Climate.