Skip to content

Commit

Permalink
Merge 19761e7 into 912fad1
Browse files Browse the repository at this point in the history
  • Loading branch information
@ckkelvinchan
ckkelvinchan authored Jul 7, 2021
2 parents 912fad1 + 19761e7 commit 5b67b10
Show file tree
Hide file tree
Showing 24 changed files with 382 additions and 0 deletions.
14 changes: 14 additions & 0 deletions configs/inpainting/deepfillv1/README_zh-CN.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -16,3 +16,17 @@
```

</details>

<br/>

**Places365-Challenge**

| Method | Mask Type | Resolution | Train Iters | Test Set | l1 error | PSNR | SSIM | Download |
| :--------------------------------------------------------------------------: | :---------: | :--------: | :---------: | :-----------: | :------: | :----: | :---: | :-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------: |
| [DeepFillv1](/configs/inpainting/deepfillv1/deepfillv1_256x256_8x2_places.py) | square bbox | 256x256 | 3500k | Places365-val | 11.019 | 23.429 | 0.862 | [model](https://download.openmmlab.com/mmediting/inpainting/deepfillv1/deepfillv1_256x256_8x2_places_20200619-c00a0e21.pth) \| [log](https://download.openmmlab.com/mmediting/inpainting/deepfillv1/deepfillv1_256x256_8x2_places_20200619-c00a0e21.log.json) |

**CelebA-HQ**

| Method | Mask Type | Resolution | Train Iters | Test Set | l1 error | PSNR | SSIM | Download |
| :--------------------------------------------------------------------------: | :---------: | :--------: | :---------: | :--------: | :------: | :----: | :---: | :-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------: |
| [DeepFillv1](/configs/inpainting/deepfillv1/deepfillv1_256x256_4x4_celeba.py) | square bbox | 256x256 | 1500k | CelebA-val | 6.677 | 26.878 | 0.911 | [model](https://download.openmmlab.com/mmediting/inpainting/deepfillv1/deepfillv1_256x256_4x4_celeba_20200619-dd51a855.pth) \| [log](https://download.openmmlab.com/mmediting/inpainting/deepfillv1/deepfillv1_256x256_4x4_celeba_20200619-dd51a855.log.json) |
14 changes: 14 additions & 0 deletions configs/inpainting/deepfillv2/README_zh-CN.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -15,3 +15,17 @@
```

</details>

<br/>

**Places365-Challenge**

| Method | Mask Type | Resolution | Train Iters | Test Set | l1 error | PSNR | SSIM | Download |
| :--------------------------------------------------------------------------: | :-------: | :--------: | :---------: | :-----------: | :------: | :----: | :---: | :-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------: |
| [DeepFillv2](/configs/inpainting/deepfillv2/deepfillv2_256x256_8x2_places.py) | free-form | 256x256 | 100k | Places365-val | 8.635 | 22.398 | 0.815 | [model](https://download.openmmlab.com/mmediting/inpainting/deepfillv2/deepfillv2_256x256_8x2_places_20200619-10d15793.pth) \| [log](https://download.openmmlab.com/mmediting/inpainting/deepfillv2/deepfillv2_256x256_8x2_places_20200619-10d15793.log.json) |

**CelebA-HQ**

| Method | Mask Type | Resolution | Train Iters | Test Set | l1 error | PSNR | SSIM | Download |
| :--------------------------------------------------------------------------: | :-------: | :--------: | :---------: | :--------: | :------: | :----: | :---: | :-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------: |
| [DeepFillv2](/configs/inpainting/deepfillv2/deepfillv2_256x256_8x2_celeba.py) | free-form | 256x256 | 20k | CelebA-val | 5.411 | 25.721 | 0.871 | [model](https://download.openmmlab.com/mmediting/inpainting/deepfillv2/deepfillv2_256x256_8x2_celeba_20200619-c96e5f12.pth) \| [log](https://download.openmmlab.com/mmediting/inpainting/deepfillv2/deepfillv2_256x256_8x2_celeba_20200619-c96e5f12.log.json) |
16 changes: 16 additions & 0 deletions configs/inpainting/global_local/README_zh-CN.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -18,3 +18,19 @@
```

</details>

<br/>

*Note that we do not apply the post-processing module in Global&Local for a fair comparison with current deep inpainting methods.*

**Places365-Challenge**

| Method | Mask Type | Resolution | Train Iters | Test Set | l1 error | PSNR | SSIM | Download |
| :-----------------------------------------------------------------------: | :---------: | :--------: | :---------: | :-----------: | :------: | :----: | :---: | :-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------: |
| [Global&Local](/configs/inpainting/global_local/gl_256x256_8x12_places.py) | square bbox | 256x256 | 500k | Places365-val | 11.164 | 23.152 | 0.862 | [model](https://download.openmmlab.com/mmediting/inpainting/global_local/gl_256x256_8x12_places_20200619-52a040a8.pth) \| [log](https://download.openmmlab.com/mmediting/inpainting/global_local/gl_256x256_8x12_places_20200619-52a040a8.log.json) |

**CelebA-HQ**

| Method | Mask Type | Resolution | Train Iters | Test Set | l1 error | PSNR | SSIM | Download |
| :-----------------------------------------------------------------------: | :---------: | :--------: | :---------: | :--------: | :------: | :----: | :---: | :-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------: |
| [Global&Local](/configs/inpainting/global_local/gl_256x256_8x12_celeba.py) | square bbox | 256x256 | 500k | CelebA-val | 6.678 | 26.780 | 0.904 | [model](https://download.openmmlab.com/mmediting/inpainting/global_local/gl_256x256_8x12_celeba_20200619-5af0493f.pth) \| [log](https://download.openmmlab.com/mmediting/inpainting/global_local/gl_256x256_8x12_celeba_20200619-5af0493f.log.json) |
14 changes: 14 additions & 0 deletions configs/inpainting/partial_conv/README_zh-CN.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -16,3 +16,17 @@
```

</details>

<br/>

**Places365-Challenge**

| Method | Mask Type | Resolution | Train Iters | Test Set | l1 error | PSNR | SSIM | Download |
| :-------------------------------------------------------------------------: | :-------: | :--------: | :---------: | :-----------: | :------: | :----: | :---: | :-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------: |
| [PConv](/configs/inpainting/partial_conv/pconv_256x256_stage2_4x2_places.py) | free-form | 256x256 | 500k | Places365-val | 8.776 | 22.762 | 0.801 | [model](https://download.openmmlab.com/mmediting/inpainting/pconv/pconv_256x256_stage2_4x2_places_20200619-1ffed0e8.pth) \| [log](https://download.openmmlab.com/mmediting/inpainting/pconv/pconv_256x256_stage2_4x2_places_20200619-1ffed0e8.log.json) |

**CelebA-HQ**

| Method | Mask Type | Resolution | Train Iters | Test Set | l1 error | PSNR | SSIM | Download |
| :-------------------------------------------------------------------------: | :-------: | :--------: | :---------: | :--------: | :------: | :----: | :---: | :-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------: |
| [PConv](/configs/inpainting/partial_conv/pconv_256x256_stage2_4x2_celeba.py) | free-form | 256x256 | 500k | CelebA-val | 5.990 | 25.404 | 0.853 | [model](https://download.openmmlab.com/mmediting/inpainting/pconv/pconv_256x256_stage2_4x2_celeba_20200619-860f8b95.pth) \| [log](https://download.openmmlab.com/mmediting/inpainting/pconv/pconv_256x256_stage2_4x2_celeba_20200619-860f8b95.log.json) |
20 changes: 20 additions & 0 deletions configs/mattors/dim/README_zh-CN.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -15,3 +15,23 @@
```

</details>

<br/>

| Method | SAD | MSE | GRAD | CONN | Download |
| :------------------------------------------------------------------------: | :------: | :-------: | :------: | :------: | :-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------: |
| stage1 (paper) | 54.6 | 0.017 | 36.7 | 55.3 | - |
| stage3 (paper) | **50.4** | **0.014** | 31.0 | 50.8 | - |
| [stage1 (our)](/configs/mattors/dim/dim_stage1_v16_1x1_1000k_comp1k.py) | 53.8 | 0.017 | 32.7 | 54.5 | [model](https://download.openmmlab.com/mmediting/mattors/dim/dim_stage1_v16_1x1_1000k_comp1k_SAD-53.8_20200605_140257-979a420f.pth) \| [log](https://download.openmmlab.com/mmediting/mattors/dim/dim_stage1_v16_1x1_1000k_comp1k_20200605_140257.log.json) |
| [stage2 (our)](/configs/mattors/dim/dim_stage2_v16_pln_1x1_1000k_comp1k.py) | 52.3 | 0.016 | 29.4 | 52.4 | [model](https://download.openmmlab.com/mmediting/mattors/dim/dim_stage2_v16_pln_1x1_1000k_comp1k_SAD-52.3_20200607_171909-d83c4775.pth) \| [log](https://download.openmmlab.com/mmediting/mattors/dim/dim_stage2_v16_pln_1x1_1000k_comp1k_20200607_171909.log.json) |
| [stage3 (our)](/configs/mattors/dim/dim_stage3_v16_pln_1x1_1000k_comp1k.py) | 50.6 | 0.015 | **29.0** | **50.7** | [model](https://download.openmmlab.com/mmediting/mattors/dim/dim_stage3_v16_pln_1x1_1000k_comp1k_SAD-50.6_20200609_111851-647f24b6.pth) \| [log](https://download.openmmlab.com/mmediting/mattors/dim/dim_stage3_v16_pln_1x1_1000k_comp1k_20200609_111851.log.json) |

**NOTE**

* stage1: train the encoder-decoder part without the refinement part. \
* stage2: fix the encoder-decoder part and train the refinement part. \
* stage3: fine-tune the whole network.

> The performance of the model is not stable during the training. Thus, the reported performance is not from the last checkpoint. Instead, it is the best performance of all validations during training.
> The performance of training (best performance) with different random seeds diverges in a large range. You may need to run several experiments for each setting to obtain the above performance.
16 changes: 16 additions & 0 deletions configs/mattors/gca/README_zh-CN.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -14,3 +14,19 @@
```

</details>

<br/>

| Method | SAD | MSE | GRAD | CONN | Download |
| :--------------------------------------------------------------------: | :-------: | :--------: | :-------: | :-------: | :------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------: |
| baseline (paper) | 40.62 | 0.0106 | 21.53 | 38.43 | - |
| GCA (paper) | 35.28 | 0.0091 | 16.92 | 32.53 | - |
| [baseline (our)](/configs/mattors/gca/baseline_r34_4x10_200k_comp1k.py) | 36.50 | 0.0090 | 17.40 | 34.33 | [model](https://download.openmmlab.com/mmediting/mattors/gca/baseline_r34_4x10_200k_comp1k_SAD-36.50_20200614_105701-95be1750.pth) \| [log](https://download.openmmlab.com/mmediting/mattors/gca/baseline_r34_4x10_200k_comp1k_20200614_105701.log.json) |
| [GCA (our)](/configs/mattors/gca/gca_r34_4x10_200k_comp1k.py) | **34.77** | **0.0080** | **16.33** | **32.20** | [model](https://download.openmmlab.com/mmediting/mattors/gca/gca_r34_4x10_200k_comp1k_SAD-34.77_20200604_213848-4369bea0.pth) \| [log](https://download.openmmlab.com/mmediting/mattors/gca/gca_r34_4x10_200k_comp1k_20200604_213848.log.json) |

**More results**

| Method | SAD | MSE | GRAD | CONN | Download |
| :-----------------------------------------------------------------------------------------: | :---: | :----: | :---: | :---: | :--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------: |
| [baseline (with DIM pipeline)](/configs/mattors/gca/baseline_dimaug_r34_4x10_200k_comp1k.py) | 49.95 | 0.0144 | 30.21 | 49.67 | [model](https://download.openmmlab.com/mmediting/mattors/gca/baseline_dimaug_r34_4x10_200k_comp1k_SAD-49.95_20200626_231612-535c9a11.pth) \| [log](https://download.openmmlab.com/mmediting/mattors/gca/baseline_dimaug_r34_4x10_200k_comp1k_20200626_231612.log.json) |
| [GCA (with DIM pipeline)](/configs/mattors/gca/gca_dimaug_r34_4x10_200k_comp1k.py) | 49.42 | 0.0129 | 28.07 | 49.47 | [model](https://download.openmmlab.com/mmediting/mattors/gca/gca_dimaug_r34_4x10_200k_comp1k_SAD-49.42_20200626_231422-8e9cc127.pth) \| [log](https://download.openmmlab.com/mmediting/mattors/gca/gca_dimaug_r34_4x10_200k_comp1k_20200626_231422.log.json) |
Loading

0 comments on commit 5b67b10

Please sign in to comment.