Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Integrate regression testing into release pipelines #931

Closed
troughc opened this issue Jan 30, 2024 · 18 comments · Fixed by #1295, #1296, #1360, #1369 or #1370
Closed

Integrate regression testing into release pipelines #931

troughc opened this issue Jan 30, 2024 · 18 comments · Fixed by #1295, #1296, #1360, #1369 or #1370
Assignees
Labels
bug Something isn't working
Milestone

Comments

@troughc
Copy link
Contributor

troughc commented Jan 30, 2024

For reference: https://docs.google.com/document/d/1xw_jwnMMgg93DuPYcA5GPAyvnQ70AoFE9EUeWLBrhvI/edit

@sahalali is working with Kim on this one.

@troughc troughc added this to the February Release milestone Jan 30, 2024
@sahalali
Copy link
Contributor

@troughc We can wait until Kim Prepares the runnable Regression test script.

@sahalali sahalali assigned troughc and unassigned sahalali Feb 13, 2024
@sahalali sahalali assigned sahalali and unassigned troughc Feb 20, 2024
@sahalali
Copy link
Contributor

Waiting for @kmdvs to complete the regression test scripts.

@troughc
Copy link
Contributor Author

troughc commented Mar 27, 2024

Regression test status update:

  • Keeping the versions up-to-date on his testing platform
  • Kim is working on updating the scripts now (for general tests to be in sync with latest version)
  • Will work on script for Github to launch Cypress (so that it can be used on Docker and so that it is more flexible in terms of test options)
  • Notes that he needs to stay in sync with the latest version - not sure exactly how to make sure the synchronization occurs (how to track the release schedule so he can release his regression test just after, maybe the next day)
  • To be decided: how to inform Kim IN ADVANCE to update the regression test so that it can be ready ASAP - is there a release schedule he could follow? How to communicate emergency releases?

cc @kmdvs @sahalali

@saumier
Copy link
Member

saumier commented Jun 12, 2024

@sahalali What is the status on this issue? Is this an old issue that should be closed or still active?

@sahalali
Copy link
Contributor

@saumier We are waiting for Kim to come back with the final script. Once that is ready, we can integrate the regression tests with our development process.

@sahalali
Copy link
Contributor

sahalali commented Aug 5, 2024

@dev-aravind

  1. Please add a workflow in the footlight-calendar-api repo to manually run the regression test with sufficient input options.
  2. Try to create a reusable action for the regression test, so that we should be able to reuse the action to run different regression tests

@sahalali
Copy link
Contributor

sahalali commented Aug 28, 2024

Please use this workflow diagram to implement the CICD pipeline.

@AbhishekPAnil Please also look into the process workflow in this Figma

https://www.figma.com/board/5cKuhr1s0kHWthxh3wZRYZ/Workflow-(Copy)?node-id=0-1&t=asEwBTitca1zIXcF-0

@dev-aravind
Copy link
Contributor

@AbhishekPAnil Please make the changes that Kim requested and assign this back to me. Thanks

@AbhishekPAnil AbhishekPAnil removed their assignment Nov 5, 2024
@dev-aravind
Copy link
Contributor

@AbhishekPAnil Please merge this PR for the tests.

@troughc troughc modified the milestones: March Release, CC 2024.1 Nov 18, 2024
@dev-aravind
Copy link
Contributor

Assigning this to @kmdvs as he is working to fix the current errors in the regression tests regarding modification of entities.

@dev-aravind dev-aravind assigned kmdvs and unassigned AbhishekPAnil Nov 20, 2024
@kmdvs
Copy link
Collaborator

kmdvs commented Nov 22, 2024

Fixed as test 1 and test 2 passed 100%

@kmdvs kmdvs assigned dev-aravind and unassigned kmdvs Nov 22, 2024
@troughc troughc added the bug Something isn't working label Nov 25, 2024
@dev-aravind
Copy link
Contributor

@sahalali Please review this PR to add the regression test into our CI/CD pipelines. Let me know if you need any changes.

@dev-aravind dev-aravind assigned sahalali and unassigned dev-aravind Nov 26, 2024
@kmdvs
Copy link
Collaborator

kmdvs commented Nov 28, 2024

This can be closed now, since #1464?

@troughc
Copy link
Contributor Author

troughc commented Nov 29, 2024

Thanks @kmdvs i am closing this even though we are still having issues with regression testing. cc @dev-aravind @sahalali

@troughc
Copy link
Contributor Author

troughc commented Nov 29, 2024

cc @AbhishekPAnil

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment