Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Autotests: if one of the jobs fail, consider cancelling all other parallel jobs #6542

Open
rdimaio opened this issue Mar 8, 2024 · 1 comment
Assignees
Labels

Comments

@rdimaio
Copy link
Contributor

rdimaio commented Mar 8, 2024

Follow-up from a conversation with Martin. Currently, we run multiple tests in parallel (example). When one of them fails, the others keep running.

To save up on GH workers usage, when one of the parallel tests fail, we could fail all the other tests. However, this might cause annoying problems if there are flaky tests (e.g. #6506)

@rdimaio rdimaio added the Testing label Mar 8, 2024
@voetberg
Copy link
Contributor

voetberg commented Mar 8, 2024

Would it also make sense to stop tests on their first fail (adding the -x) option for each runner? This would also free runners faster (not as fast as cancelling the whole suite), and would let the other parallel tests keep running in case of a single flaky test.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants