Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

New possibility "Ignore differences lower than" #603

Open
basia-wulnikowska opened this issue Nov 27, 2020 · 0 comments
Open

New possibility "Ignore differences lower than" #603

basia-wulnikowska opened this issue Nov 27, 2020 · 0 comments
Labels
discussion New enhancement proposition, awaits broader discussion or design session. size large Issues requiring substantial effort, possibly across whole stack

Comments

@basia-wulnikowska
Copy link
Contributor

Is your feature request related to a problem? Please describe.
It often happens in the project, that some image url on page changes but the image itself doesn't or similar small differences are detected. In such case, people responsible for accepting have to spend a lot of time accepting screenshots with no visible difference.

Describe the solution you'd like
I think we may implement a new feature that will be taken and described on wiki as something to use only on User (project team) responsibility. This function can be implemented in code and allow user to choose percentage of difference that will be a bottom line to show green status. It means that if you'll put there 1%, then all screenshots that differ 0.1, or 0.5, 0.8% will be ignored and still shown as green (however the difference still may be shown if you open the specific case from the list, but your tests status will be marked as passed). Allow users to choose any percentage number.
To decide whether this should be available for all test suite as global setting or can be specified for chosen url (maybe both options available?).

Describe alternatives you've considered
Additional flag on test report - ignore differences for this page, and specify difference here. Additionally how long should it be ignored with time specification.

@basia-wulnikowska basia-wulnikowska added discussion New enhancement proposition, awaits broader discussion or design session. size large Issues requiring substantial effort, possibly across whole stack labels Nov 27, 2020
@basia-wulnikowska basia-wulnikowska added this to To do in AET Summer 2020 via automation Nov 27, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
discussion New enhancement proposition, awaits broader discussion or design session. size large Issues requiring substantial effort, possibly across whole stack
Projects
Development

No branches or pull requests

1 participant