Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Image test idiff.py acceptance not working as intended #5098

Closed
trexfeathers opened this issue Dec 7, 2022 · 1 comment · Fixed by #5482
Closed

Image test idiff.py acceptance not working as intended #5098

trexfeathers opened this issue Dec 7, 2022 · 1 comment · Fixed by #5482

Comments

@trexfeathers
Copy link
Contributor

trexfeathers commented Dec 7, 2022

🐛 Bug Report

Thanks @rcomer for spotting this 🙂

Have looked with @bjlittle and we expect this is a hangover from the old idiff, where the duplicate check was for URI's. It's now for file names, and duplicates are expected during the acceptance process.

How To Reproduce

Steps to reproduce the behaviour:

  1. Change any graphics test (anything that is a subclass of tests.GraphicsTest) to produce a different image from what's expected.
  2. Follow the Adding or Updating Graphics Tests steps, clicking Accept in the idiff window when it appears.
  3. You should get a message like this: DUPLICATE: result-gallery_tests.test_plot_COP_maps.0.png -> gallery_tests.test_plot_COP_maps.0.png (ignored)

Expected behaviour

Should instead get a ACCEPTED: ... message instead, with the image_repo.json file getting updated and the PNG file being renamed.

Screenshots

Environment

  • OS & Version: [e.g., Ubuntu 20.04 LTS]
  • Iris Version: [e.g., From the command line run python -c "import iris; print(iris.__version__)"]

Iris releases since v3.3.

Additional context

Click to expand this section...
Please add additional verbose information in this section e.g., code, output, tracebacks, screenshots etc
@rcomer
Copy link
Member

rcomer commented Jul 18, 2023

I just ran the Iris tests against Matplotlib and Cartopy main branches and saw a lot of image comparison failures. Both packages are likely to release fairly soon so it might be worth bumping this issue up the priority list.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants