Add repeat option to run untill tests fail #456
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
locker
reviewed
Jul 7, 2025
Totktonada
approved these changes
Jul 8, 2025
Add the `--repeat` command line option so each test should succeed `--repeat` times to pass. One may think of the option as a `--retries` analog, but instead of assuring that each test passes at least once, we require each test to pass every time. Combining both non-trivial `--retries` and `--repeat` options values require each test to pass at least once in `--retries` runs `--repeat` times in a row. Needed for tarantool/tarantool#6646
LevKats
force-pushed
the
gh-tarantool-6646-workflow-catching-flaky-tests
branch
from
1f22c8f to
56deae6
Compare
locker
approved these changes
Jul 9, 2025
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Add the
--repeatcommand line option so each test should succeed--repeattimes to pass. One may think of the option as a--retriesanalog, but instead of assuring that each test passes at least once, we require each test to pass every time. Combining both non-trivial--retiresand--repeatoptions values require each test to pass at least once in--retiresruns--repeattimes in a row.Needed for tarantool/tarantool#6646