Code

fix nccl sync#205

Code

Merged

qingshui merged 128 commits intoxuewujiao:gpugraphxuewujiao/Paddle:gpugraphfrom qingshui:gpugraphqingshui/Paddle:gpugraphCopy head branch name to clipboardFeb 2, 2023

+25-4

Commits

Commits on May 19, 2022

• Merge pull request #39 from PaddlePaddle/develop

  Show description for 09dac41
  qingshui

  authored
  09dac41

Commits on Jun 13, 2022

• Merge pull request #41 from xuewujiao/gpugraph

  Show description for 6468546
  qingshui

  authored
  6468546

Commits on Jun 15, 2022

• Merge pull request #42 from xuewujiao/gpugraph

  Show description for 4cc6ef9
  qingshui

  authored
  4cc6ef9

Commits on Jun 22, 2022

• Merge pull request #43 from xuewujiao/gpugraph

  Show description for 01ebde5
  qingshui

  authored
  01ebde5

• Merge pull request #44 from xuewujiao/gpugraph

  Show description for fd0a0fd
  qingshui

  authored
  fd0a0fd

Commits on Jun 24, 2022

• Merge pull request #45 from xuewujiao/gpugraph

  Show description for c36e14b
  qingshui

  authored
  c36e14b

Commits on Jun 29, 2022

• Merge pull request #46 from xuewujiao/gpugraph

  Show description for a43ca88
  qingshui

  authored
  a43ca88

Commits on Jul 5, 2022

• Optimize graph loading and sample loading performance

  

  humingqing

  authored and

  humingqing

  committed
  de1e8bf

• Optimize graph loading and sample loading performance

  

  humingqing

  authored and

  humingqing

  committed
  5946f70

• fix

  

  humingqing

  authored and

  humingqing

  committed
  a5b4aaa

• fix function name

  

  humingqing

  authored and

  humingqing

  committed
  f5bfadb

• Merge pull request #47 from xuewujiao/gpugraph

  Show description for 8c50898
  qingshui

  authored
  8c50898

Commits on Jul 6, 2022

• Optimization chart CPU processing

  

  humingqing

  authored and

  humingqing

  committed
  5fcc277

• Optimization chart CPU processing

  

  humingqing

  authored and

  humingqing

  committed
  57c5821

Commits on Jul 11, 2022

• pull push dedup, use pull feature value clip size

  

  humingqing

  authored and

  humingqing

  committed
  4a059af

Commits on Jul 12, 2022

• pull push dedup, use pull feature value clip size

  

  humingqing

  authored and

  humingqing

  committed
  ee41abb

• remove same not used kernel

  

  humingqing

  authored and

  humingqing

  committed
  0a7044e

• merge master fix confilt

  

  humingqing

  authored and

  humingqing

  committed
  be891d3

• fix merge

  

  humingqing

  authored and

  humingqing

  committed
  56adf43

• add fix restore idx auto fit mode according to repettition ratio

  

  humingqing

  authored and

  humingqing

  committed
  5b90815

• filter zero

  

  humingqing

  authored and

  humingqing

  committed
  43c8bc6

• fix load node bug

  

  humingqing

  authored and

  humingqing

  committed
  fc822cf

• fix

  

  humingqing

  authored and

  humingqing

  committed
  4bb4f18

• fix mf dim bug

  

  humingqing

  authored and

  humingqing

  committed
  ec7df9a

• fix mf dim bug

  

  humingqing

  authored and

  humingqing

  committed
  db0415f

• fix mif size bug

  

  humingqing

  authored and

  humingqing

  committed
  c41a460

• fix mif size bug

  

  humingqing

  authored and

  humingqing

  committed
  7813d5f

Commits on Jul 13, 2022

• Merge pull request #50 from xuewujiao/gpugraph

  Show description for 3f00d46
  qingshui

  authored
  3f00d46

• format ps_gpu_wrapper.cc

  

  humingqing

  authored and

  humingqing

  committed
  c67a0c7

Commits on Oct 11, 2022

• merge master

  

  humingqing

  authored and

  humingqing

  committed
  2b3bcc9

Commits on Oct 26, 2022

• add all2all

  

  humingqing

  authored and

  humingqing

  committed
  5439c1b

• add all2all

  

  humingqing

  authored and

  humingqing

  committed
  d227a21

Commits on Oct 27, 2022

• fix trans enable

  

  humingqing

  authored and

  humingqing

  committed
  8d30c7d

Commits on Oct 31, 2022

• fix dualbox

  

  humingqing

  authored and

  humingqing

  committed
  2d6e683

• fix dualbox

  

  humingqing

  authored and

  humingqing

  committed
  16ecdb9

• fix dualbox

  

  humingqing

  authored and

  humingqing

  committed
  2924ca7

• fix dualbox

  

  humingqing

  authored and

  humingqing

  committed
  72d3534

• fix dualbox

  

  humingqing

  authored and

  humingqing

  committed
  99550b1

• fix dualbox

  

  humingqing

  authored and

  humingqing

  committed
  1764a2a

Commits on Nov 1, 2022

• fix alloc

  

  humingqing

  authored and

  humingqing

  committed
  ee73d21

• fix alloc

  

  humingqing

  authored and

  humingqing

  committed
  782e413

• fix alloc

  

  humingqing

  authored and

  humingqing

  committed
  99ed9dd

• fix comm init bug

  

  humingqing

  authored and

  humingqing

  committed
  55c8232

• add auto detect flags

  

  humingqing

  authored and

  humingqing

  committed
  5b2f614

• add auto detect flags

  

  humingqing

  authored and

  humingqing

  committed
  d146326

• fix update one table

  

  humingqing

  authored and

  humingqing

  committed
  67b12ec

• add log

  

  humingqing

  authored and

  humingqing

  committed
  5f33ecd

• add log

  

  humingqing

  authored and

  humingqing

  committed
  e479b78

• fix trans

  

  humingqing

  authored and

  humingqing

  committed
  9a0f381

• fix trans

  

  humingqing

  authored and

  humingqing

  committed
  b71d2ff

• fix trans

  

  humingqing

  authored and

  humingqing

  committed
  ee30e93

• debug

  

  humingqing

  authored and

  humingqing

  committed
  a1cc217

• fix merge keys

  

  humingqing

  authored and

  humingqing

  committed
  e9bece9

Commits on Nov 2, 2022

• fix all2ll push

  

  humingqing

  authored and

  humingqing

  committed
  de2f9ad

• fix barrier

  

  humingqing

  authored and

  humingqing

  committed
  ec3d008

• add debug

  

  humingqing

  authored and

  humingqing

  committed
  ce75785

• fix merge grad

  

  humingqing

  authored and

  humingqing

  committed
  6f8ec08

• fix merge grad

  

  humingqing

  authored and

  humingqing

  committed
  f4a09ee

• fix merge grad

  

  humingqing

  authored and

  humingqing

  committed
  9cbddf8

• fix check

  

  humingqing

  authored and

  humingqing

  committed
  a14d17c

• fix check

  

  humingqing

  authored and

  humingqing

  committed
  5ea075e

• fix check

  

  humingqing

  authored and

  humingqing

  committed
  dbcf2f7

• fix check

  

  humingqing

  authored and

  humingqing

  committed
  95fd124

• fix check

  

  humingqing

  authored and

  humingqing

  committed
  bb2ad3f

• fix check

  

  humingqing

  authored and

  humingqing

  committed
  ec40bbd

• add check

  

  humingqing

  authored and

  humingqing

  committed
  1e957bd

• add check

  

  humingqing

  authored and

  humingqing

  committed
  12aaf5e

• add check

  

  humingqing

  authored and

  humingqing

  committed
  20d2a9e

• add check

  

  humingqing

  authored and

  humingqing

  committed
  e807b15

• add check

  

  humingqing

  authored and

  humingqing

  committed
  0b1abd5

Commits on Nov 3, 2022

• add debug

  

  humingqing

  authored and

  humingqing

  committed
  84497b8

• add debug

  

  humingqing

  authored and

  humingqing

  committed
  a104d52

• add debug info

  

  humingqing

  authored and

  humingqing

  committed
  64cc988

• add debug info

  

  humingqing

  authored and

  humingqing

  committed
  5152bf5

• fix check

  

  humingqing

  authored and

  humingqing

  committed
  3cac362

• fix check

  

  humingqing

  authored and

  humingqing

  committed
  d063d1a

• add debug

  

  humingqing

  authored and

  humingqing

  committed
  ccd79e6

• debug

  

  humingqing

  authored and

  humingqing

  committed
  bad1e91

• fix alloc

  

  humingqing

  authored and

  humingqing

  committed
  c90849e

Commits on Nov 4, 2022

• add debug

  

  humingqing

  authored and

  humingqing

  committed
  58ca1f9

• fix merge grad

  

  humingqing

  authored and

  humingqing

  committed
  4881fe8

• add debug

  

  humingqing

  authored and

  humingqing

  committed
  a56601a

• add debug

  

  humingqing

  authored and

  humingqing

  committed
  485cb2f

• fix dual div show

  

  humingqing

  authored and

  humingqing

  committed
  1ffb67f

• fix dual div show

  

  humingqing

  authored and

  humingqing

  committed
  36bc396

• fix dual div show

  

  humingqing

  authored and

  humingqing

  committed
  fa630b2

• fix dual div show

  

  humingqing

  authored and

  humingqing

  committed
  cc181d8

• fix dual div show

  

  humingqing

  authored and

  humingqing

  committed
  0a8d6fd

• fix all2all nan inf

  

  humingqing

  authored and

  humingqing

  committed
  43e9ead

Commits on Nov 14, 2022

• add hashtable collisions stats, train time 1183sec->942.81sec, close gflags 942.81sec->897.78sec

  

  humingqing

  authored and

  humingqing

  committed
  f1938c7

• add multi node stream flow optimization

  

  humingqing

  authored and

  humingqing

  committed
  2b45e4d

• add gflags

  

  humingqing

  authored and

  humingqing

  committed
  513bd60

• merge master from gpugraph branch

  

  humingqing

  authored and

  humingqing

  committed
  ebab0bc

• fix hashtable localcount add

  

  humingqing

  authored and

  humingqing

  committed
  586f0cb

Commits on Nov 15, 2022

• add debug gflags, adjust log levels, optimize heter_comm create and reset

  

  humingqing

  authored and

  humingqing

  committed
  4258850

• infer not need dump

  

  humingqing

  authored and

  humingqing

  committed
  101f1c5

Commits on Nov 17, 2022

• train need check miss key

  

  humingqing

  authored and

  humingqing

  committed
  97ffe49

• merge gpugraph

  

  humingqing

  authored and

  humingqing

  committed
  eadcb52

Commits on Nov 22, 2022

• fix allreduce no param scale, add fuse allreduce support

  

  humingqing

  authored and

  humingqing

  committed
  0ea5e16

• fix allreduce no param scale, add fuse allreduce support

  

  humingqing

  authored and

  humingqing

  committed
  35f4749

• fix conflicts

  

  humingqing

  authored and

  humingqing

  committed
  d182a95

• fix conflicts

  

  humingqing

  authored and

  humingqing

  committed
  3f6eb14

Commits on Nov 24, 2022

• add PADDLE_LOSS_SCALE env, add PADDLE_FUSE_ALLREDUCE env

  

  humingqing

  authored and

  humingqing

  committed
  4e0343a

• add PADDLE_LOSS_SCALE env, add PADDLE_FUSE_ALLREDUCE env

  

  humingqing

  authored and

  humingqing

  committed
  195cf64

• fix conflicts

  

  humingqing

  authored and

  humingqing

  committed
  4e95133

Commits on Nov 25, 2022

• Merge pull request #63 from xuewujiao/gpugraph

  Show description for 0655495
  qingshui

  authored
  0655495

Commits on Nov 29, 2022

• Merge pull request #64 from xuewujiao/gpugraph

  Show description for 77dc33a
  qingshui

  authored
  77dc33a

• fix full hbm infer mode assert error

  

  humingqing

  authored and

  humingqing

  committed
  d702bde

Commits on Dec 5, 2022

• add all2all cpu rpc server and pull ssd

  

  humingqing

  authored and

  humingqing

  committed
  f4a2ced

• add all2all cpu rpc server and pull ssd

  

  humingqing

  authored and

  humingqing

  committed
  0a95836

• fix CONFLICT

  

  humingqing

  authored and

  humingqing

  committed
  ede278a

Commits on Dec 7, 2022

• add multi node fix gpu block

  

  humingqing

  authored and

  humingqing

  committed
  f35330d

Commits on Dec 12, 2022

• add multi node equal batch num

  

  humingqing

  authored and

  humingqing

  committed
  666e700

Commits on Dec 13, 2022

• merge master

  

  humingqing

  authored and

  humingqing

  committed
  7eb447f

Commits on Dec 23, 2022

• fix dualbox core, adjust ps_gpu_wrapper thread

  

  humingqing

  authored and

  humingqing

  committed
  9cb5891

Commits on Dec 26, 2022

• fix dual trainer

  

  humingqing

  authored and

  humingqing

  committed
  764ea57

Commits on Dec 30, 2022

• sync gpugraph

  

  humingqing

  authored and

  humingqing

  committed
  1ee6af3

• fix merge

  

  humingqing

  authored and

  humingqing

  committed
  8d0ab4f

Commits on Jan 20, 2023

• remove default stream, add nccl sync stream dual allocator not block

  

  humingqing

  authored and

  humingqing

  committed
  0e566df

Commits on Jan 29, 2023

• fix dual merge sparse bug, thrust used paddle memory pool, thrust remove default stream used

  

  humingqing

  authored and

  humingqing

  committed
  6bf3100

• merge gpugraph

  

  humingqing

  authored and

  humingqing

  committed
  b2f2d93

• fix complier

  

  humingqing

  authored and

  humingqing

  committed
  c4adc5e

Commits on Jan 31, 2023

• fix set constant, remove default stream, add c_allreduce_xsum op

  

  humingqing

  authored and

  humingqing

  committed
  967b9a5

Commits on Feb 1, 2023

• fix nccl block, fix dual merge sparse bug, thrust used memory pool and remote default stream used, remove sample used default stream (PaddlePaddle#202) (#72)

  qingshui

  authored
  1354f4a

Commits on Feb 2, 2023

• fix hpi

  

  humingqing

  authored and

  humingqing

  committed
  cb4508a

• fix hpi

  

  humingqing

  authored and

  humingqing

  committed
  d5e59b0

• fix hpi (PaddlePaddle#204) (#74)

  qingshui

  authored
  e370086

• fix nccl sync

  

  humingqing

  authored and

  humingqing

  committed
  89f76da