Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update weights and re-evaluate models #274

Merged
merged 3 commits into from
Apr 25, 2021

Conversation

ckkelvinchan
Copy link
Member

When channel_order is not used correctly, BasicVSR and IconVSR output BGR image hence the evaluation result is not correct (since the function bgr2gray is used when evaluating in Y-channel). This PR re-computes the results in the datasets and updates the links for the pre-trained weights.

@codecov
Copy link

codecov bot commented Apr 24, 2021

Codecov Report

Merging #274 (9d30c03) into master (ce4ad1f) will not change coverage.
The diff coverage is n/a.

❗ Current head 9d30c03 differs from pull request most recent head 3c1612e. Consider uploading reports for the commit 3c1612e to get more accurate results
Impacted file tree graph

@@           Coverage Diff           @@
##           master     #274   +/-   ##
=======================================
  Coverage   79.94%   79.94%           
=======================================
  Files         159      159           
  Lines        7942     7942           
  Branches     1177     1177           
=======================================
  Hits         6349     6349           
  Misses       1449     1449           
  Partials      144      144           
Flag Coverage Δ
unittests 79.94% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.


Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update ce4ad1f...3c1612e. Read the comment docs.

@@ -16,7 +16,7 @@
pixel_loss=dict(type='CharbonnierLoss', loss_weight=1.0, reduction='mean'))
# model training and testing settings
train_cfg = dict(fix_iter=5000)
test_cfg = dict(metrics=['PSNR', 'SSIM'], crop_border=0, convert_to='y')
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is removing 'SSIM' intended?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes, as it would slow down the training. Therefore I put only PSNR here.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Users may remove 'SSIM', or together with 'PSNR' themselves if they want to speed up training. It's better to leave it here since our result page contains both SSIM and PSNR.

@ckkelvinchan
Copy link
Member Author

Invalid link, will update

@innerlee innerlee merged commit 4c20a4a into open-mmlab:master Apr 25, 2021
@ckkelvinchan ckkelvinchan deleted the channel_order branch April 26, 2021 08:08
Yshuo-Li pushed a commit to Yshuo-Li/mmediting that referenced this pull request Jul 15, 2022
* Update weights and re-evaluate models

* Update links to weights

* Add back SSIM to configuration
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants