You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
When reporting new problems in #7455 I found that is quite hard to track if reported problems were fixed, because sometimes even unrelated and MR fixes them.
So in my fuzzer I collected files that causes from all my issues and named them like W292_W101_D100__7473.py where 3 first items are rule codes and at the end there is issue id.
Next, in CI I check every file if still causes problem via ruff check W292_W101_D100__7473,py --rules W292,W101,D100 --fix --unsafe-fixes
I see results in such format:
File XYZ__252.py still cause problems
File XYYS_FFSR__5524.py still causes problems
[NO_PROBLEM] File PORR__525.py is fixed
This is quite easy to check for autofix errors and crashes, but rest(like formatter) may be a little problematic.
So with such CI, it is possible to automatically find fixed issues and close them without needing to manually check if are really fixed.
Maybe this is not real problem now, because there is only ~500 opened issues and most of them cannot be really automatically tested if are still valid, but it may help in future reduce number of issues.
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
-
When reporting new problems in #7455 I found that is quite hard to track if reported problems were fixed, because sometimes even unrelated and MR fixes them.
So in my fuzzer I collected files that causes from all my issues and named them like
W292_W101_D100__7473.py
where 3 first items are rule codes and at the end there is issue id.Next, in CI I check every file if still causes problem via
ruff check W292_W101_D100__7473,py --rules W292,W101,D100 --fix --unsafe-fixes
I see results in such format:
This is quite easy to check for autofix errors and crashes, but rest(like formatter) may be a little problematic.
So with such CI, it is possible to automatically find fixed issues and close them without needing to manually check if are really fixed.
Maybe this is not real problem now, because there is only ~500 opened issues and most of them cannot be really automatically tested if are still valid, but it may help in future reduce number of issues.
Beta Was this translation helpful? Give feedback.
All reactions