Add baseline comparison option for Relative Constraint #190
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
The Performance Publisher's "Expert Mode" currently has two options for "Relative Constraints":
However, there is no option to compare with a specific build number (which even the "Standard Mode" can do).
Since the addition of the baseline build setting in #178 for calculating report tables, it would make sense to use the same baseline build for "Relative Constraint" evaluations.
The challenge is not to break existing Jobs and Pipelines, which this PR addresses by leaving existing configuration fields and their existing values unchanged, but changing them to a String field with the same representation, namely in
PreviousResultsBlock:This way existing Freestyle config.xml and Pipeline DSL calls keep working by unmarshalling the former Boolean values into Strings.