Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

test: retry failed cypress tests twice #2584

Merged
merged 4 commits into from
Jun 30, 2022

Conversation

max-nextcloud
Copy link
Collaborator

This will hopefully make the CI more stable
while allowing us to also see which tests are flaky
in the cypress ui.

Some tests may not be retryable yet.
So they will always fail on a second attempt because of remains of a first attempt.
We can tackle that on a test by test basis later.

Signed-off-by: Max max@nextcloud.com

  • Target version: master

@max-nextcloud
Copy link
Collaborator Author

https://dashboard.cypress.io/projects/hx9gqy/runs/4319/test-results/b476bae3-44e3-4184-9d68-81c968f8875a image test retry failing because on the second and third run it has a file conflict.

@max-nextcloud max-nextcloud force-pushed the test/retry-failed-cypress-tests branch from 785adfa to 440c75d Compare June 20, 2022 07:33
@max-nextcloud
Copy link
Collaborator Author

https://dashboard.cypress.io/projects/hx9gqy/runs/4319/test-results/b476bae3-44e3-4184-9d68-81c968f8875a with the file conflict gone it now fails because the file name counter continues to go up even if the images were removed from the file content itself. This makes sense as the editor was not closed in between.

@max-nextcloud max-nextcloud force-pushed the test/retry-failed-cypress-tests branch from 440c75d to cde6965 Compare June 20, 2022 09:35
@vinicius73
Copy link
Member

/rebase

@nextcloud-command nextcloud-command force-pushed the test/retry-failed-cypress-tests branch from cde6965 to bd1de5b Compare June 30, 2022 15:11
@vinicius73
Copy link
Member

/rebase

This will hopefully make the CI more stable
while allowing us to also see which tests are flaky
in the cypress ui.

Some tests may not be retryable yet.
So they will always fail on a second attempt because of remains of a first attempt.
We can tackle that on a test by test basis later.

Signed-off-by: Max <max@nextcloud.com>
Use a unique filename so retries work on different files.

Uploading the existing file again would cause a conflict
resulting in retries failing.

Signed-off-by: Max <max@nextcloud.com>
@vinicius73 vinicius73 force-pushed the test/retry-failed-cypress-tests branch from bd1de5b to 9956041 Compare June 30, 2022 17:36
@vinicius73 vinicius73 added enhancement New feature or request tests If you write them we ♥ you 3. to review labels Jun 30, 2022
Signed-off-by: Vinicius Reis <vinicius.reis@nextcloud.com>
vinicius73 pushed a commit that referenced this pull request Jun 30, 2022
Signed-off-by: Vinicius Reis <vinicius.reis@nextcloud.com>
@vinicius73
Copy link
Member

/compile amend

Signed-off-by: Vinicius Reis <vinicius.reis@nextcloud.com>
Signed-off-by: nextcloud-command <nextcloud-command@users.noreply.github.com>
@nextcloud-command nextcloud-command force-pushed the test/retry-failed-cypress-tests branch from 19dc1a2 to 62bb1fe Compare June 30, 2022 18:10
@vinicius73 vinicius73 merged commit fa0c72e into master Jun 30, 2022
@delete-merged-branch delete-merged-branch bot deleted the test/retry-failed-cypress-tests branch June 30, 2022 18:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
3. to review enhancement New feature or request tests If you write them we ♥ you
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants