Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Make lars cpp code flexible #36450

Closed
wants to merge 14 commits into from
Closed

Make lars cpp code flexible #36450

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
14 commits
Select commit Hold shift + click to select a range
4e1fc95
first commit
JamesLim-sy Oct 14, 2021
2ffbbba
revert change about argmuent of l2_norm
JamesLim-sy Oct 14, 2021
3da1b1f
get param addr from param_out tensor
JamesLim-sy Oct 14, 2021
fb89aef
shrink the struct size
JamesLim-sy Oct 14, 2021
eec1fc6
add test file
JamesLim-sy Oct 15, 2021
dc103de
refine cpp codes
JamesLim-sy Oct 16, 2021
7be6434
fix python codes error
JamesLim-sy Oct 17, 2021
57b952a
change the type form of lars_weight_decay
JamesLim-sy Oct 17, 2021
c310c8d
Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into…
JamesLim-sy Oct 17, 2021
3f62752
add test file of merged lars
JamesLim-sy Oct 17, 2021
c6ef005
fix code according to comments.
JamesLim-sy Oct 18, 2021
47ba53b
change the format of lars_weight_decay from scalar into vector
JamesLim-sy Oct 19, 2021
82dd12a
change the format of lars_weight_decay from scalar into vector
JamesLim-sy Oct 19, 2021
c5d06e0
fix lars_weight_decay from a scalar into a vector.
JamesLim-sy Oct 20, 2021
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
9 changes: 0 additions & 9 deletions paddle/fluid/operators/optimizers/lars_momentum_op.cc
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -44,8 +44,6 @@ class LarsMomentumOp : public framework::OperatorWithKernel {
auto grad_dim = ctx->GetInputsDim("Grad");
auto param_dim = ctx->GetInputsDim("Param");
auto velocity_dim = ctx->GetInputsDim("Velocity");
auto lars_weight_decays =
ctx->Attrs().Get<std::vector<float>>("lars_weight_decay");
auto multi_precision = ctx->Attrs().Get<bool>("multi_precision");

PADDLE_ENFORCE_EQ(
Expand All @@ -61,13 +59,6 @@ class LarsMomentumOp : public framework::OperatorWithKernel {
"have same quantity. But number of Param is [%d] and Velocity "
"is [%d].",
param_dim.size(), velocity_dim.size()));
PADDLE_ENFORCE_EQ(
lars_weight_decays.size(), grad_dim.size(),
platform::errors::InvalidArgument(
"Attr(Lars_weight_decay) and "
"Input(Grad) of LarsMomentumOp should have same quantity. "
"But number of Lars_weight_decay is [%d] and Grad is [%d].",
lars_weight_decays.size(), grad_dim.size()));

if (multi_precision) {
OP_INOUT_CHECK(ctx->HasInputs("MasterParam"), "Input", "MasterParam",
Expand Down
Loading