Bump timm from 0.6.7 to 0.6.11

[dependabot]

Bumps timm from 0.6.7 to 0.6.11.

Release notes

Sourced from timm's releases.

v0.6.11 Release

Changes Since 0.6.7

Sept 23, 2022

• CLIP LAION-2B pretrained B/32, L/14, H/14, and g/14 image tower weights as vit models (for fine-tune)

Sept 7, 2022

• Hugging Face timm docs home now exists, look for more here in the future
• Add BEiT-v2 weights for base and large 224x224 models from https://github.com/microsoft/unilm/tree/master/beit2
• Add more weights in maxxvit series incl a pico (7.5M params, 1.9 GMACs), two tiny variants:
  • maxvit_rmlp_pico_rw_256 - 80.5 @ 256, 81.3 @ 320 (T)
  • maxvit_tiny_rw_224 - 83.5 @ 224 (G)
  • maxvit_rmlp_tiny_rw_256 - 84.2 @ 256, 84.8 @ 320 (T)

Aug 29, 2022

• MaxVit window size scales with img_size by default. Add new RelPosMlp MaxViT weight that leverages this:
  • maxvit_rmlp_nano_rw_256 - 83.0 @ 256, 83.6 @ 320 (T)

Aug 26, 2022

• CoAtNet (https://arxiv.org/abs/2106.04803) and MaxVit (https://arxiv.org/abs/2204.01697) timm original models
  • both found in maxxvit.py model def, contains numerous experiments outside scope of original papers
  • an unfinished Tensorflow version from MaxVit authors can be found https://github.com/google-research/maxvit
• Initial CoAtNet and MaxVit timm pretrained weights (working on more):
  • coatnet_nano_rw_224 - 81.7 @ 224 (T)
  • coatnet_rmlp_nano_rw_224 - 82.0 @ 224, 82.8 @ 320 (T)
  • coatnet_0_rw_224 - 82.4 (T) -- NOTE timm '0' coatnets have 2 more 3rd stage blocks
  • coatnet_bn_0_rw_224 - 82.4 (T)
  • maxvit_nano_rw_256 - 82.9 @ 256 (T)
  • coatnet_rmlp_1_rw_224 - 83.4 @ 224, 84 @ 320 (T)
  • coatnet_1_rw_224 - 83.6 @ 224 (G)
  • (T) = TPU trained with bits_and_tpu branch training code, (G) = GPU trained
• GCVit (weights adapted from https://github.com/NVlabs/GCVit, code 100% timm re-write for license purposes)
• MViT-V2 (multi-scale vit, adapted from https://github.com/facebookresearch/mvit)
• EfficientFormer (adapted from https://github.com/snap-research/EfficientFormer)
• PyramidVisionTransformer-V2 (adapted from https://github.com/whai362/PVT)
• 'Fast Norm' support for LayerNorm and GroupNorm that avoids float32 upcast w/ AMP (uses APEX LN if available for further boost)

Aug 15, 2022

• ConvNeXt atto weights added
  • convnext_atto - 75.7 @ 224, 77.0 @ 288
  • convnext_atto_ols - 75.9 @ 224, 77.2 @ 288

Aug 5, 2022

• More custom ConvNeXt smaller model defs with weights
  • convnext_femto - 77.5 @ 224, 78.7 @ 288
  • convnext_femto_ols - 77.9 @ 224, 78.9 @ 288
  • convnext_pico - 79.5 @ 224, 80.4 @ 288
  • convnext_pico_ols - 79.5 @ 224, 80.5 @ 288

... (truncated)

Changelog

Sourced from timm's changelog.

Recent Changes

July 27, 2022

• All runtime benchmark and validation result csv files are up-to-date!
• A few more weights & model defs added:
  • darknetaa53 - 79.8 @ 256, 80.5 @ 288
  • convnext_nano - 80.8 @ 224, 81.5 @ 288
  • cs3sedarknet_l - 81.2 @ 256, 81.8 @ 288
  • cs3darknet_x - 81.8 @ 256, 82.2 @ 288
  • cs3sedarknet_x - 82.2 @ 256, 82.7 @ 288
  • cs3edgenet_x - 82.2 @ 256, 82.7 @ 288
  • cs3se_edgenet_x - 82.8 @ 256, 83.5 @ 320
• cs3* weights above all trained on TPU w/ bits_and_tpu branch. Thanks to TRC program!
• Add output_stride=8 and 16 support to ConvNeXt (dilation)
• deit3 models not being able to resize pos_emb fixed

Commits

• d4ea5c7 Merge pull request #1476 from Afafard/class_dict
• 7327792 update to support pickle based dictionaries
• 1199c5a clip_laion2b models need 1e-5 eps for LayerNorm
• 5dc4343 version 0.6.11
• a383ef9 Make huggingface_hub necessary if it's the only source for a pretrained weight
• d199f66 Merge pull request #1467 from rwightman/clip_laion2b
• 33e30f8 Remove layer-decay print
• e069249 Add hf hub entries for laion2b clip models, add huggingface_hub dependency, u...
• 9d65557 Fix errant import
• 9709dba Adding support for fine-tune CLIP LAION-2B image tower weights for B/32, L/14...
• Additional commits viewable in compare view

You can trigger a rebase of this PR by commenting @dependabot rebase.

---

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

• @dependabot rebase will rebase this PR
• @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
• @dependabot merge will merge this PR after your CI passes on it
• @dependabot squash and merge will squash and merge this PR after your CI passes on it
• @dependabot cancel merge will cancel a previously requested merge and block automerging
• @dependabot reopen will reopen this PR if it is closed
• @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
• @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

> **Note** > Automatic rebases have been disabled on this pull request as it has been open for over 30 days.

[dependabot]

Dependabot tried to update this pull request, but something went wrong. We're looking into it, but in the meantime you can retry the update by commenting @dependabot rebase.

[dependabot]

Dependabot tried to update this pull request, but something went wrong. We're looking into it, but in the meantime you can retry the update by commenting @dependabot rebase.

[dependabot]

Dependabot tried to update this pull request, but something went wrong. We're looking into it, but in the meantime you can retry the update by commenting @dependabot rebase.

[dependabot]

Dependabot tried to update this pull request, but something went wrong. We're looking into it, but in the meantime you can retry the update by commenting @dependabot rebase.