Code

update#26

Code

Merged

AnnaTrainingG merged 140 commits intoAnnaTrainingG:developAnnaTrainingG/Paddle:developfrom PaddlePaddle:developPaddlePaddle/Paddle:developCopy head branch name to clipboardSep 1, 2021

+25,566-3,850

Commits

Commits on Aug 23, 2021

• add fill_constant_batch_size_like npu op (#34563)

  pangyoki

  authored
  7d86737

  Copy full SHA for 7d86737

• add beam_search_decode npu op (#34967)

  pangyoki

  authored
  4ce272e

  Copy full SHA for 4ce272e

• Revert "use spin lock in auto growth allocator (#34910)" (#35069)

  Show description for 97fef01
  wanghuancoder

  authored
  97fef01

  Copy full SHA for 97fef01

• Support gettiem by Bool index (#35026)

  Show description for b6dc16c
  zyfncg

  authored
  b6dc16c

  Copy full SHA for b6dc16c

• [hybrid performance] optim the grad fuse for pipeline mode by sorting the grad by dtype (#35070)

  FeixLiu

  authored
  fad4b3b

  Copy full SHA for fad4b3b

• Refactor the organization of layer_norm cuda impl. (#34883)

  Show description for 7f5eb53
  limin2021

  authored
  7f5eb53

  Copy full SHA for 7f5eb53

• support infer_ut on windows nightly build (#35049)

  Show description for 4f86aae
  OliverLPH

  authored
  4f86aae

  Copy full SHA for 4f86aae

• upgrade oneDNN to v2.3.2 (#35040)

  lidanqing-intel

  authored
  a047c13

  Copy full SHA for a047c13

• [oneDNN] disable caching for interpolate and batch Norm (#35030)

  Show description for 673bf71
  jczaja

  authored
  673bf71

  Copy full SHA for 673bf71

• remove old data check (#35077)

  b3602sss

  authored
  5b814fd

  Copy full SHA for 5b814fd

• fix model-benchmark build error (#35081)

  tianshuo78520a

  authored
  a95db6a

  Copy full SHA for a95db6a

• trt convert ut add dynamic_shape and int8, etc. (#35061)

  jiweibo

  authored
  17188e8

  Copy full SHA for 17188e8

• [CPU] Enable barrier op upon gloo (#34671)

  bliu3650

  authored
  e8f146a

  Copy full SHA for e8f146a

Commits on Aug 24, 2021

• Add auto completion module for auto parallel (#34813)

  Show description for 93d862b
  

  aoyulong

  and

  sandyhouse

  authored
  93d862b

  Copy full SHA for 93d862b

• Fix a bug of transpose op, about accessing memory out of bounds of the perm param (#35079)

  TeslaZhao

  authored
  1056379

  Copy full SHA for 1056379

• [NPU] add pool2 op and tests (#34770)

  Show description for da26173
  ronny1996

  authored
  da26173

  Copy full SHA for da26173

• [NPU] add conv_op_npu and test (#34055)

  Show description for 00a269d
  ronny1996

  authored
  00a269d

  Copy full SHA for 00a269d

• add scope guard (#35103)

  sneaxiy

  authored
  b0a1d12

  Copy full SHA for b0a1d12

• add the extra and quantization for op def, test=develop (#35076)

  winter-wang

  authored
  cb28753

  Copy full SHA for cb28753

• cache runtime ctx for executor, test=develop (#35108)

  wanghuancoder

  authored
  3b0d8a7

  Copy full SHA for 3b0d8a7

• [oneDNN] Concat refactoring and disabling caching (#35002)

  Show description for d9c0f09
  jczaja

  authored
  d9c0f09

  Copy full SHA for d9c0f09

• Update LearningRate for test fit a line BF16 (#34653)

  Show description for 36f7e75
  arogowie-intel

  authored
  36f7e75

  Copy full SHA for 36f7e75

• fix bmm bug (#35098)

  Show description for de64515
  firestonelib

  authored
  de64515

  Copy full SHA for de64515

• [NPU] fix NPU ci scripts, test=develop (#35095)

  qili93

  authored
  a332352

  Copy full SHA for a332352

• Add no_sync in data parallel for dynamic graph (#34740)

  Show description for b09f4d7
  haohongxiang

  authored
  b09f4d7

  Copy full SHA for b09f4d7

• add fetch, test=develop (#35019)

  Show description for a5060b5
  wanghuancoder

  authored
  a5060b5

  Copy full SHA for a5060b5

• fix convert ut framework problem (#35112)

  jiweibo

  authored
  a8dee3b

  Copy full SHA for a8dee3b

• Add flags to control whether to check Nan value of hccl_allreduce_sum. (#35093)

  gongweibao

  authored
  5b73783

  Copy full SHA for 5b73783

• add checker, test=develop (#35109)

  

  lilong12

  authored
  881e55e

  Copy full SHA for 881e55e

Commits on Aug 25, 2021

• update elementwise api in kunlun (#35021)

  taixiurong

  authored
  ff96a7d

  Copy full SHA for ff96a7d

• high-performance SingleThreadedWorkQueue (#35086)

  liutiexing

  authored
  751a794

  Copy full SHA for 751a794

• [NPU] add npu_one_hot_v2 (#34937)

  ronny1996

  authored
  d710c3a

  Copy full SHA for d710c3a

• [hybrid performance] optim npu coalesce set constant (#35105)

  FeixLiu

  authored
  4bfd044

  Copy full SHA for 4bfd044

• fix potential tensor leak in tensor.__setitem__ (#35013)

  Show description for 763b6d9
  zhiqiu

  authored
  763b6d9

  Copy full SHA for 763b6d9

• [NPU] Fix the performance problem when 'axis' is not specified (#35116)

  ronny1996

  authored
  91ba86b

  Copy full SHA for 91ba86b

• fix cpu adamw problem for np.float64 (#35124)

  zhaoyinglia

  authored
  700205e

  Copy full SHA for 700205e

• [hybrid npu] fix npu found_finite in hybrid (#35134)

  wangxicoding

  authored
  f609ca3

  Copy full SHA for f609ca3

• strip inference.so and make link to mkldnn.so (#34895)

  jiweibo

  authored
  086540c

  Copy full SHA for 086540c

• SGD BF16 functional test. (#34648)

  Show description for d618de2
  arogowie-intel

  authored
  d618de2

  Copy full SHA for d618de2

• Fix for expand_v2 op (#35101)

  Show description for 1f34f7e
  jakpiase

  authored
  1f34f7e

  Copy full SHA for 1f34f7e

• Modify ci time count & fix resnet50_quant multi_thread tests (#35141)

  Show description for 9e54209
  OliverLPH

  authored
  9e54209

  Copy full SHA for 9e54209

• fix cmaklist for new executor (#35137)

  Show description for 03cb313
  wanghuancoder

  authored
  03cb313

  Copy full SHA for 03cb313

• disable test_resnet50_quant (#35149)

  OliverLPH

  authored
  b3ef9a6

  Copy full SHA for b3ef9a6

Commits on Aug 26, 2021

• use spinlock in auto growth (#35139)

  Show description for 0efda9d
  wanghuancoder

  authored
  0efda9d

  Copy full SHA for 0efda9d

• fix the bug of channel-wise quantization for ernie (#34948)

  XGZhang11

  authored
  c71025e

  Copy full SHA for c71025e

• fix cast op (#35156)

  firestonelib

  authored
  412877e

  Copy full SHA for 412877e

• add temporary MultiThreadedWorkQueue (#35158)

  liutiexing

  authored
  e4a8815

  Copy full SHA for e4a8815

• [Inference] Replace unordered_map with map to support subgraph stability (#35147)

  jiweibo

  authored
  a1aae04

  Copy full SHA for a1aae04

• add paddle.sum example and doc (#35051)

  GuoxiaWang

  authored
  537cee9

  Copy full SHA for 537cee9

• Add roi align op npu (#34973)

  Show description for 289e181
  shiyutang

  authored
  289e181

  Copy full SHA for 289e181

• fix iscan python bug (#35148)

  zhwesky2010

  authored
  223c01f

  Copy full SHA for 223c01f

• Add copy from tensor (#34406)

  Show description for ac33c0c
  shangzhizhou

  authored
  ac33c0c

  Copy full SHA for ac33c0c

• [NPU] Support npu kernel for StridedSlice op without grad (#34601)

  bliu3650

  authored
  fa6c59a

  Copy full SHA for fa6c59a

• Add feed_forward for fused attention op. (#34945)

  Show description for d1a33bc
  limin2021

  authored
  d1a33bc

  Copy full SHA for d1a33bc

• Support Multi-Stream, Single-Thread in New Executor (#35024)

  Show description for 678a259
  Aurelius84

  authored
  678a259

  Copy full SHA for 678a259

• support tensor index. (#34824)

  Show description for e7df47e
  hbwx24

  authored
  e7df47e

  Copy full SHA for e7df47e

• Support dropout backward in eval mode (#35122)

  Show description for f1275fb
  smallv0221

  authored
  f1275fb

  Copy full SHA for f1275fb

• gc for newexecutor (#35085)

  Show description for f147203
  wanghuancoder

  authored
  f147203

  Copy full SHA for f147203

• fix assign bug support fp16 uint8 (#35153)

  Show description for 270efb9
  firestonelib

  authored
  270efb9

  Copy full SHA for 270efb9

• Add paddle.utils.dlpack APIs (#35067)

  Show description for 8dc050d
  DesmonDay

  authored
  8dc050d

  Copy full SHA for 8dc050d

• [oneDNN] disable caching oneDNN primitives in matmul v2, Reduce grad and elementwise_add grad, expand_v2 (#35132)

  Show description for 31f0221
  jczaja

  authored
  31f0221

  Copy full SHA for 31f0221

Commits on Aug 27, 2021

• Revert "Add copy from tensor (#34406)" (#35173)

  Show description for 32c1ec4
  lelelelelez

  authored
  32c1ec4

  Copy full SHA for 32c1ec4

• Polish the error message of paddle.slice. (#35179)

  Show description for 669853f
  hbwx24

  authored
  669853f

  Copy full SHA for 669853f

• [hybrid][npu] fix npu clear float status in pipeline (#35165)

  wangxicoding

  authored
  7332126

  Copy full SHA for 7332126

• add elementwise max grad op for npu (#34862)

  Show description for 5310cea
  baoachun

  authored
  5310cea

  Copy full SHA for 5310cea

• Fix model_benchmark_ci (#35183)

  Show description for 50836e1
  tianshuo78520a

  authored
  50836e1

  Copy full SHA for 50836e1

• Support the output of nn.Layer is dict type when in quantization training (#35180)

  yghstill

  authored
  1506d26

  Copy full SHA for 1506d26

• fix weighted CE loss's bug

  

  HydrogenSulfate

  authored and

  chajchaj

  committed
  12bcd02

  Copy full SHA for 12bcd02

• Update loss.py

  

  HydrogenSulfate

  authored and

  chajchaj

  committed
  f3d315a

  Copy full SHA for f3d315a

• Update loss.py

  

  HydrogenSulfate

  authored and

  chajchaj

  committed
  8751311

  Copy full SHA for 8751311

• Update loss.py

  

  HydrogenSulfate

  authored and

  chajchaj

  committed
  a232737

  Copy full SHA for a232737

• Update loss.py

  

  HydrogenSulfate

  authored and

  chajchaj

  committed
  05eaa9b

  Copy full SHA for 05eaa9b

• Update loss.py

  

  HydrogenSulfate

  authored and

  chajchaj

  committed
  61b3a94

  Copy full SHA for 61b3a94

• Update loss.py

  

  HydrogenSulfate

  authored and

  chajchaj

  committed
  4b96ae6

  Copy full SHA for 4b96ae6

• Update loss.py

  

  HydrogenSulfate

  authored and

  chajchaj

  committed
  39e8153

  Copy full SHA for 39e8153

• Update loss.py

  

  HydrogenSulfate

  authored and

  chajchaj

  committed
  fa4805b

  Copy full SHA for fa4805b

• Update loss.py

  

  HydrogenSulfate

  authored and

  chajchaj

  committed
  b4a3f21

  Copy full SHA for b4a3f21

• Update test_cross_entropy_loss.py

  

  HydrogenSulfate

  authored and

  chajchaj

  committed
  c61027e

  Copy full SHA for c61027e

• Update loss.py

  

  HydrogenSulfate

  authored and

  chajchaj

  committed
  de972c5

  Copy full SHA for de972c5

• Update loss.py

  

  HydrogenSulfate

  authored and

  chajchaj

  committed
  b9f665d

  Copy full SHA for b9f665d

• Update loss.py

  

  HydrogenSulfate

  authored and

  chajchaj

  committed
  3ca813e

  Copy full SHA for 3ca813e

• Update loss.py

  

  HydrogenSulfate

  authored and

  chajchaj

  committed
  dd0140b

  Copy full SHA for dd0140b

• Update test_cross_entropy_loss.py

  

  HydrogenSulfate

  authored and

  chajchaj

  committed
  d1a1105

  Copy full SHA for d1a1105

• Update test_cross_entropy_loss.py

  

  HydrogenSulfate

  authored and

  chajchaj

  committed
  23cc214

  Copy full SHA for 23cc214

• Update test_cross_entropy_loss.py

  

  HydrogenSulfate

  authored and

  chajchaj

  committed
  0bf3248

  Copy full SHA for 0bf3248

• Update loss.py

  

  HydrogenSulfate

  authored and

  chajchaj

  committed
  f2df33e

  Copy full SHA for f2df33e

• Update test_cross_entropy_loss.py

  

  HydrogenSulfate

  authored and

  chajchaj

  committed
  f6dc4b6

  Copy full SHA for f6dc4b6

• Update test_cross_entropy_loss.py

  

  HydrogenSulfate

  authored and

  chajchaj

  committed
  7afd7f3

  Copy full SHA for 7afd7f3

• Update test_cross_entropy_loss.py

  

  HydrogenSulfate

  authored and

  chajchaj

  committed
  ee070fb

  Copy full SHA for ee070fb

• Update loss.py

  

  HydrogenSulfate

  authored and

  chajchaj

  committed
  0046768

  Copy full SHA for 0046768

• Update loss.py

  

  HydrogenSulfate

  authored and

  chajchaj

  committed
  52804cd

  Copy full SHA for 52804cd

• Update loss.py

  

  HydrogenSulfate

  authored and

  chajchaj

  committed
  0c2d6bc

  Copy full SHA for 0c2d6bc

• Update loss.py

  

  HydrogenSulfate

  authored and

  chajchaj

  committed
  11e9d4e

  Copy full SHA for 11e9d4e

• Update loss.py

  

  HydrogenSulfate

  authored and

  chajchaj

  committed
  cf6e543

  Copy full SHA for cf6e543

• Update test_cross_entropy_loss.py

  

  HydrogenSulfate

  authored and

  chajchaj

  committed
  e838cac

  Copy full SHA for e838cac

• fix the crash when input variable is bool type, test=develop (#35176)

  winter-wang

  authored
  ad52248

  Copy full SHA for ad52248

• gelu/logsigmoid add AsExtra (#35198)

  zhupengyang

  authored
  2006fbc

  Copy full SHA for 2006fbc

• fix count_api_without_core_ops (#35170)

  Show description for 7272526
  wanghuancoder

  authored
  7272526

  Copy full SHA for 7272526

• Polish DeviceEvent interface and Remove #ifdef in InterpreterCore (#35196)

  Show description for 48bf7cb
  Aurelius84

  authored
  48bf7cb

  Copy full SHA for 48bf7cb

• Add fusion_gru and multi_gru to PTQ (Post-Training Quantization) (#33749)

  Show description for 7debae3
  wozna

  authored
  7debae3

  Copy full SHA for 7debae3

• [hybrid] Fix row parallel linear bias (#35186)

  wangxicoding

  authored
  1533d7e

  Copy full SHA for 1533d7e

• sparse_momentum_op is used to save w@GRAD memory for gather_op (#34942)

  Show description for 234ce93
  GuoxiaWang

  authored
  234ce93

  Copy full SHA for 234ce93

• Add unpool2d op & Expose max_unpool2d API (#35056)

  Show description for ceee71a
  tink2123

  authored
  ceee71a

  Copy full SHA for ceee71a

• add more models for model_benchmark_ci,test=document_fix (#35178)

  xiegegege

  authored
  5a72cf4

  Copy full SHA for 5a72cf4

• add uniform_ op and UT (#33934)

  zoooo0820

  authored
  be29b8e

  Copy full SHA for be29b8e

• test=document_fix (#35222)

  GuoxiaWang

  authored
  5dcff7c

  Copy full SHA for 5dcff7c

Commits on Aug 29, 2021

• test=document_fix (#35221)

  GuoxiaWang

  authored
  31cd106

  Copy full SHA for 31cd106

Commits on Aug 30, 2021

• Abstract GenerateDeviceEventFlag to shield platforms (#35219)

  Show description for 20cfa8b
  Aurelius84

  authored
  20cfa8b

  Copy full SHA for 20cfa8b

• Add cpu/gpu for PR-CI-CPU-Py2 (#35174)

  Show description for 8f94d34
  tianshuo78520a

  authored
  8f94d34

  Copy full SHA for 8f94d34

• Set value (#34886)

  Show description for 37d281c
  2742195759

  authored
  37d281c

  Copy full SHA for 37d281c

• del message;test=document_fix (#35248)

  tianshuo78520a

  authored
  c0bdef5

  Copy full SHA for c0bdef5

• [paddle-TRT]support matmul set to int8 in multihead (#34917)

  Show description for 0043fa8
  ceci3

  authored
  0043fa8

  Copy full SHA for 0043fa8

• [Op Def] Add extra def of linear_interp & linear_interp_v2 & addmm (#35233)

  Show description for 6ff179a
  Ray2020BD

  authored
  6ff179a

  Copy full SHA for 6ff179a

• - candidate fix (#35231)

  jczaja

  authored
  ca4d2fc

  Copy full SHA for ca4d2fc

• fix using boost::none as the init value when using paddle::optional (#35215)

  MingMingShangTian

  authored
  e864667

  Copy full SHA for e864667

• [NPU] Add log_loss op (#35010)

  Show description for b94d7ff
  Ray2020BD

  authored
  b94d7ff

  Copy full SHA for b94d7ff

• [Paddle Inference-TRT]Adding six op unittest codes of TRT INT8 (#35130)

  Show description for 3956514
  xiaoxiaohehe001

  authored
  3956514

  Copy full SHA for 3956514

Commits on Aug 31, 2021

• change exit code and polish infer_ut summary style (#35254)

  Show description for 531a890
  OliverLPH

  authored
  531a890

  Copy full SHA for 531a890

• NPU add fill_zeros_like kernel (#35246)

  Aganlengzi

  authored
  aaaa996

  Copy full SHA for aaaa996

• NPU add elementwise_mod (#35245)

  Aganlengzi

  authored
  561841d

  Copy full SHA for 561841d

• support fuse layers for ptq (#35015)

  XGZhang11

  authored
  ef53625

  Copy full SHA for ef53625

• fix the pass compat check position error, test=develop (#35272)

  winter-wang

  authored
  54f0701

  Copy full SHA for 54f0701

• fix windows batch file error:The system cannot find the batch label specified (#35288)

  zhwesky2010

  authored
  2c0d667

  Copy full SHA for 2c0d667

• Add AsExtra() for conditional_block_op.h (#35268)

  Show description for 2100816
  zhhsplendid

  authored
  2100816

  Copy full SHA for 2100816

• fix CI skip cc test error (#35264)

  Show description for 3d76d00
  Avin0323

  authored
  3d76d00

  Copy full SHA for 3d76d00

• add trt error information. (#35277)

  Show description for a2afcac
  b3602sss

  authored
  a2afcac

  Copy full SHA for a2afcac

• update infer trt ut. (#35261)

  jiweibo

  authored
  96e7d90

  Copy full SHA for 96e7d90

• Put code style check on gpu_ci (#35309)

  Show description for d9f59fd
  tianshuo78520a

  authored
  d9f59fd

  Copy full SHA for d9f59fd

• New whl release strategy with pruned nv_fatbin (#35239)

  Show description for 2f3b393
  jim19930609

  authored
  2f3b393

  Copy full SHA for 2f3b393

• fix bug that cmake find python (#35304)

  zhwesky2010

  authored
  00c9aeb

  Copy full SHA for 00c9aeb

• Revert "Revert "Add copy from tensor (#34406)" (#35173)" (#35256)

  Show description for 6116f9a
  shangzhizhou

  authored
  6116f9a

  Copy full SHA for 6116f9a

• [NPU] fix cmake for ascend ci, test=develop (#35255)

  Show description for f6004ab
  qili93

  authored
  f6004ab

  Copy full SHA for f6004ab

• [Dy2Stat]Add model ResNet50 for Dy2stat AMP training (#35276)

  Show description for 079c585
  Aurelius84

  authored
  079c585

  Copy full SHA for 079c585

• transformer opt python files (#35206)

  Show description for e299155
  xingfeng01

  authored
  e299155

  Copy full SHA for e299155

• Support CostInfo and MemProfiler in InterpreterCore (#34981)

  Show description for 572bad8
  Aurelius84

  authored
  572bad8

  Copy full SHA for 572bad8

Commits on Sep 1, 2021

• reverse xpu adamw to the combination of ops version. (#35286)

  zhaoyinglia

  authored
  884011a

  Copy full SHA for 884011a

• Support settiem by Bool index (#35133)

  Show description for d387820
  zyfncg

  authored
  d387820

  Copy full SHA for d387820

• [Dy2Stat]Support append method and initialized value for List in ControlFlow (#35212)

  Show description for 3b52f68
  Aurelius84

  authored
  3b52f68

  Copy full SHA for 3b52f68

• label prelu op (#35315)

  juncaipeng

  authored
  d9afa83

  Copy full SHA for d9afa83

• add ElementwiseTernary, Reduce, ReadDataStride (#35075)

  Show description for 12df57f
  AnnaTrainingG

  authored
  12df57f

  Copy full SHA for 12df57f