Code

Fix Norm Layers, Again#1509

Code

Closed

DhairyaLGandhi wants to merge 49 commits intomasterFluxML/Flux.jl:masterfrom dg/instance2FluxML/Flux.jl:dg/instance2Copy head branch name to clipboard

+277-247

Commits

Commits on Feb 16, 2021

• clean up the history

  

  Dhairya Gandhi

  committed
  2cd59b4

  Copy full SHA for 2cd59b4

• bn on cudnn

  

  Dhairya Gandhi

  committed
  0ef033e

  Copy full SHA for 0ef033e

• rm extra utils

  

  Dhairya Gandhi

  committed
  1e67700

  Copy full SHA for 1e67700

• use simpler test suite first

  

  Dhairya Gandhi

  committed
  0dbeb39

  Copy full SHA for 0dbeb39

• git fixes

  

  Dhairya Gandhi

  committed
  04ca0a8

  Copy full SHA for 04ca0a8

Commits on Feb 18, 2021

• refactor norm_forward

  

  Dhairya Gandhi

  committed
  31f7000

  Copy full SHA for 31f7000

Commits on Feb 20, 2021

• simplify tests

  

  Dhairya Gandhi

  committed
  262112a

  Copy full SHA for 262112a

• typose

  

  Dhairya Gandhi

  committed
  c61457c

  Copy full SHA for c61457c

• check reduce for batch

  

  Dhairya Gandhi

  committed
  0432b82

  Copy full SHA for 0432b82

Commits on Feb 21, 2021

• use normconfig

  

  Dhairya Gandhi

  committed
  77a8e87

  Copy full SHA for 77a8e87

• use normconfig for other layers

  

  Dhairya Gandhi

  committed
  d0961a7

  Copy full SHA for d0961a7

• typo

  

  Dhairya Gandhi

  committed
  b091a80

  Copy full SHA for b091a80

• backwards

  

  Dhairya Gandhi

  committed
  680e64f

  Copy full SHA for 680e64f

Commits on Mar 1, 2021

• first pass

  

  Dhairya Gandhi

  committed
  4a26559

  Copy full SHA for 4a26559

Commits on Mar 7, 2021

• Update src/layers/normalise.jl

  Show description for 1c38029
  

  DhairyaLGandhi

  and

  CarloLucibello

  authored
  1c38029

  Copy full SHA for 1c38029

Commits on Mar 8, 2021

• don't use single instance in bn

  

  Dhairya Gandhi

  committed
  137acf9

  Copy full SHA for 137acf9

• use prev stats to track

  

  Dhairya Gandhi

  committed
  db559c5

  Copy full SHA for db559c5

• Merge branch 'dg/instance2' of https://github.com/FluxML/Flux.jl into dg/instance2

  

  Dhairya Gandhi

  committed
  f5c3641

  Copy full SHA for f5c3641

• track stats tests

  

  Dhairya Gandhi

  committed
  fcea841

  Copy full SHA for fcea841

Commits on Mar 9, 2021

• fix BN(3)

  

  Dhairya Gandhi

  committed
  647dcd9

  Copy full SHA for 647dcd9

Commits on Mar 10, 2021

• check instance norm tests

  

  Dhairya Gandhi

  committed
  561c94f

  Copy full SHA for 561c94f

Commits on Mar 12, 2021

• clean up instance norm

  

  Dhairya Gandhi

  committed
  332b13b

  Copy full SHA for 332b13b

• dont reshape eagerly

  

  Dhairya Gandhi

  committed
  30d6542

  Copy full SHA for 30d6542

Commits on Mar 15, 2021

• use mean instead of channel

  

  Dhairya Gandhi

  committed
  1d99fd6

  Copy full SHA for 1d99fd6

• unbreak a couple tests

  

  Dhairya Gandhi

  committed
  e3ae11d

  Copy full SHA for e3ae11d

Commits on Mar 16, 2021

• use non corrected variance

  

  Dhairya Gandhi

  committed
  c66202e

  Copy full SHA for c66202e

• typo

  

  Dhairya Gandhi

  committed
  d6fac56

  Copy full SHA for d6fac56

• use train time eval

  

  Dhairya Gandhi

  committed
  16d0b96

  Copy full SHA for 16d0b96

• check for dims in getaffine

  

  Dhairya Gandhi

  committed
  e7fe00b

  Copy full SHA for e7fe00b

Commits on Mar 22, 2021

• use correct group dims

  

  Dhairya Gandhi

  committed
  9c01dd2

  Copy full SHA for 9c01dd2

• typo

  

  Dhairya Gandhi

  committed
  9abfe0c

  Copy full SHA for 9abfe0c

• use trainmode groupnorm test

  

  Dhairya Gandhi

  committed
  a621ef6

  Copy full SHA for a621ef6

Commits on Mar 24, 2021

• cleanup

  

  Dhairya Gandhi

  committed
  e174605

  Copy full SHA for e174605

• use bias and gamma for trainable

  

  Dhairya Gandhi

  committed
  99901a7

  Copy full SHA for 99901a7

• trainable

  

  Dhairya Gandhi

  committed
  9f481e4

  Copy full SHA for 9f481e4

Commits on Mar 26, 2021

• test fixes

  

  Dhairya Gandhi

  committed
  e9d89ab

  Copy full SHA for e9d89ab

Commits on Apr 19, 2021

• new constructor

  DhairyaLGandhi

  committed
  8f3844c

  Copy full SHA for 8f3844c

• test conflicts

  DhairyaLGandhi

  committed
  bf34b73

  Copy full SHA for bf34b73

• conflicts

  DhairyaLGandhi

  committed
  14a6372

  Copy full SHA for 14a6372

• conflicts

  DhairyaLGandhi

  committed
  d82c3d3

  Copy full SHA for d82c3d3

Commits on Jun 23, 2021

• rebase

  DhairyaLGandhi

  committed
  8aadf1e

  Copy full SHA for 8aadf1e

• rebase

  DhairyaLGandhi

  committed
  28521c1

  Copy full SHA for 28521c1

Commits on Jun 24, 2021

• size fix

  DhairyaLGandhi

  committed
  19b91b2

  Copy full SHA for 19b91b2

• space cleanups + show

  DhairyaLGandhi

  committed
  0d4605d

  Copy full SHA for 0d4605d

• add layer norm show methods

  DhairyaLGandhi

  committed
  36084e5

  Copy full SHA for 36084e5

• whitespace

  DhairyaLGandhi

  committed
  3c6f1ce

  Copy full SHA for 3c6f1ce

Commits on Jun 25, 2021

• change some tests

  DhairyaLGandhi

  committed
  8f6de19

  Copy full SHA for 8f6de19

Commits on Jun 29, 2021

• use affine as function

  DhairyaLGandhi

  committed
  c525d4f

  Copy full SHA for c525d4f

Commits on Aug 6, 2021

• rebase

  DhairyaLGandhi

  committed
  aa39039

  Copy full SHA for aa39039