Deployability testing tier 2

[fcaffieri]

• This issue is a draft
• Objective needs to be transferred

Description

In this objective, as tier 2, we intend to include improvements that were found during the development of DTT1. In addition, upgrade tests, deployment tests by repositories and service tests will be included. Finally, the existing testing will also be expanded to the operating systems considered as tier 2.

Functional requirements

• As tier 2, it must incorporate the improvements found during the development of tier 1.
• Upgrade tests must be added for all components.
• Deployment tests for repositories should be added.
• Service tests should be added
• Existing testing should be extended to tier 2 operating systems.
• ARM macOS should be added to existing testing. (https://github.com/wazuh/wazuh-qa-automation/issues/265)
• ARM manager tests should be added.

Non-functional requirements

Implementation restrictions

Plan

Improvements

These improvements should be checked after CI overhaul, as there will be some that will need to be made on that objective in order to advance.

• DTT2 - General - Python best practice and clean code #5116
  • DTT2 - Provision Module - Findings and recommendations #5176
• DTT2 - Bugs - Provision module - Same Os in agent and manager generates instability in the agent supply #5193
• DTT2 - Validate provision playbook execution and error report #5278
• DTT2 - Iteration 3 - Unit test - Unit tests for each module #4993
  • DTT2 - Unit test - Unit tests for the Test module #4995
• DTT2 - The testing module does not generate an exception when SSH login fails #5238
• DTT2 - Testing Module. Redesign/refactor WazuhAgent class in agent.py #5293
• DTT2 - Testing Module. Replace the use of assert statements with explicit exceptions in the helper function. #5294
• DTT2 - General - Debugging support. #5114
• DTT2 - Logging - Improve log file naming and location #5204
• DTT2 - Unclassified debug log is present in the logs: [DEBUG] SPNEGO._GSS #5277
• DTT2 - Define support for different host systems #5335
• DTT2 - Testing module. Convert the track.yaml file into an object when the module starts #5296
• DTT2 - Testing Module. Enhance the test assertions #5297

New developments

• TBD