Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Release 4.6.0 - Beta 1 - Wazuh UI regression testing #5937

Closed
1 of 2 tasks
Tracked by #5863
damarisg opened this issue Sep 26, 2023 · 3 comments
Closed
1 of 2 tasks
Tracked by #5863

Release 4.6.0 - Beta 1 - Wazuh UI regression testing #5937

damarisg opened this issue Sep 26, 2023 · 3 comments
Assignees
Labels
level/task Task issue type/test Test issue

Comments

@damarisg
Copy link
Member

damarisg commented Sep 26, 2023

The following issue aims to run manual tests for the current release candidate, report the results, and open new issues for any encountered errors.

Wazuh UI tests information

Main release candidate issue wazuh/wazuh#19166
Version 4.6.0
Release candidate # Beta1
Tag v4.6.0-beta1
Previous UI regression tests issue #5862

Test report procedure

TL;DR

  1. The specified tests will be executed in every platform and version mentioned in this issue.
  2. Include evidence of each test performed.
  3. Report any problem or bug. Open a new issue for each of them and link them here.
  4. Justify skipped tests.

All test results must have one the following statuses:

The test hasn't started yet.
🟢 All checks passed.
🔴 There is at least one failed check.
🟡 There is at least one expected fail or skipped test and no failures.

Any failing test must be properly addressed with a new issue, detailing the error and the possible cause.
It must be included in the Problems section of the current release candidate issue.

Any expected fail or skipped test must be justified with a reason.
All auditors must validate the justification for an expected fail or skipped test.

An extended report of the test results must be attached as a zip, txt or images.
This report can be used by the auditors to dig deeper into any possible failures and details.

Test template

Test Chrome Firefox Safari
-

Test plan

  1. Verify the app package installs and operates as expected.
  2. New search bar component #4312
  3. Redesign of add agent page #4205
  4. Review the analysis of Wazuh API usage #5233
  5. Cleanup embedded components #5040
  6. Improve error management #4145
  7. Move settings checks to alerts index check on health check page #5310
  8. Add ignore and restrict options to localfile configuration #4628
  9. Fix the GitHub and Office 365 module visibility configuration were not kept when changing the plugin #5376
  10. Cannot read properties of null error in the Settings section #4772
  11. Fix the request body suggestions are not working in API console #5520

Previously failed checks in Alpha 1

  1. The ServerAdress documentation link points to an incorrect section #5865
  2. Screenshots of the wizard in the documentation are outdated #5866
  3. The documentation link for WQL is not working #5867
  4. Error parsing manager configuration to XML #5868
  5. The API console reports syntax errors #5880
  6. Outdated link to OpenSearch's documentation #5883

Conclusions

Status Platform
🟢 Wazuh dashboards 4.6.0-beta1

Auditors validation

The definition of done for this one is the validation of the conclusions and the test results from all auditors.

All checks from below must be accepted in order to close this issue.

@damarisg damarisg added type/test Test issue level/task Task issue labels Sep 26, 2023
@wazuhci wazuhci moved this to Backlog in Release 4.6.0 Sep 26, 2023
@wazuhci wazuhci moved this from Backlog to In progress in Release 4.6.0 Sep 27, 2023
@asteriscos
Copy link
Member

asteriscos commented Sep 27, 2023

Test results

Legend:
⚫: none
🟢: pass
🟡: warning
🔴: fail
⚪: not applicable

UI

Test Chrome Firefox Safari
New search bar component 🟢 🟢
Add agent wizard redesign 🟢 🟢
Wazuh API usage 🟢 🟢
Cleanup embedded components 🟢 🟢
Improve error management 🟢 🟢
Re-organize alerts index checks 🟢 🟢
Add ignore and restrict options to localfile configuration 🟢 🟢
Fix GitHub and Office365 modules visibility 🟢 🟢
Fix error in the Settings section 🟢 🟢
Fix suggestions for the request's body in the API console 🟢 🟢
The ServerAdress documentation link points to an incorrect section 🟢 🟢
Screenshots of the wizard in the documentation are outdated 🟢 🟢
The documentation link for WQL is not working 🟢 🟢
Error parsing manager configuration to XML 🟢 🟢
The API console reports syntax errors 🟢 🟢
Outdated link to OpenSearch's documentation 🟢 🟢

Details

New search bar component

🟢 New search bar component: general use

Chrome
image

Firefox
image

Add agent wizard redesign

🟢 Add agent wizard redesign: general use

An agent has been installed and enrolled successfully using the wizard.

image

🟢 Add agent wizard redesign: enrollment password

If password authentication for agent enrollment is enabled, the UI shows the password in the command, and its visibility can be toggled properly.

Chrome
image

Firefox
image

🟢 Add agent wizard redesign: all supported systems are listed

Chrome
image

Firefox
image

🟢 Add agent wizard redesign: all created groups are listed

Existing groups are listed in the dropdown. Selecting a group modifies the enrollment command accordingly.

Chrome
image

Firefox
image

🟢 Add agent wizard redesign: UDP connection

If the protocol is UDP, an additional variable shows in the command.

Chrome
image

Firefox
image

Wazuh API usage

🟢 Wazuh API usage: general use

When adding a new group there are no duplicated requests.
image

The refresh button doesn't duplicate the requests.
image

The agent view works as expected and no request to /groups is made.
image

image

image

Cleanup embedded components

🟢 Cleanup embedded components: general use

No errors were found related to the removal of the embedded jQuery library.

Improve error management

🟢 Improve error management: general use

Navigating through the app, no errors were found. The app works as expected.

Re-organize alerts index checks

🟢 Re-organize alerts index checks

The timeFilter, metaFields, maxBuckets checks are now inside the alerts index check category of the Healthcheck.

image

Add ignore and restrict options to localfile configuration

🟢 Add ignore and restrict options to localfile configuration

Without values
image

With values
image

Fix GitHub and Office365 modules visibility

🟢 Fix GitHub and Office365 modules visibility

By default Github and Office 365 are not enabled and don't appear in the modules menu.

image

Chrome
image

Firefox
image

Fix error in the Settings section

🟢 Fix error in the Settings section

The bug has been fixed. I could not reproduce the error anymore.

Chrome
Peek 2023-09-27 19-13

Firefox
Peek 2023-09-27 19-14

Fix suggestions for the request's body in the API console

🟢 Fix suggestions for the request's body in the API console

Suggestions work, but I have to double-click on the property name to apply it.

Chrome
Peek 2023-09-27 19-06

Firefox
Peek 2023-09-27 19-09

The ServerAdress documentation link points to an incorrect section

🟢 The ServerAdress documentation link points to an incorrect section

Chrome
image

Firefox
image

Screenshots of the wizard in the documentation are outdated

🟢 Screenshots of the wizard in the documentation are outdated

Chrome
image

Firefox
image

The documentation link for WQL is not working

🟢 The documentation link for WQL is not working

Chrome
image

Firefox
image

Error parsing manager configuration to XML

🟢 Error parsing manager configuration to XML

Chrome
image

Firefox
image

The API console reports syntax errors

🟢 The API console reports syntax errors

Chrome
image

Firefox
image

Outdated link to OpenSearch's documentation

🟢 Outdated link to OpenSearch's documentation

The OpenSearch's documentation link uses the 2.8 version

Chrome

image

Firefox
image

@Machi3mfl
Copy link
Member

LGTM! ✅

@wazuhci wazuhci moved this from In progress to Pending review in Release 4.6.0 Sep 28, 2023
@wazuhci wazuhci moved this from Pending review to Pending final review in Release 4.6.0 Sep 28, 2023
@wazuhci wazuhci moved this from Pending final review to In final review in Release 4.6.0 Sep 29, 2023
@juliamagan
Copy link
Member

LGTM

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
level/task Task issue type/test Test issue
Projects
No open projects
Status: Done
Development

No branches or pull requests

4 participants