From dee69d4d74cbe9c366815f231ac11c6c69388167 Mon Sep 17 00:00:00 2001 From: YibinLiu666 <2632839426@qq.com> Date: Wed, 6 Mar 2024 12:47:28 +0800 Subject: [PATCH 1/5] add first weekly report --- .../[WeeklyReports] 2024.02.25~2024.03.08.md | 36 +++++++++++++++++++ 1 file changed, 36 insertions(+) create mode 100644 WeeklyReports/Hackathon_6th/09_YibinLiu666/[WeeklyReports] 2024.02.25~2024.03.08.md diff --git a/WeeklyReports/Hackathon_6th/09_YibinLiu666/[WeeklyReports] 2024.02.25~2024.03.08.md b/WeeklyReports/Hackathon_6th/09_YibinLiu666/[WeeklyReports] 2024.02.25~2024.03.08.md new file mode 100644 index 00000000..48231075 --- /dev/null +++ b/WeeklyReports/Hackathon_6th/09_YibinLiu666/[WeeklyReports] 2024.02.25~2024.03.08.md @@ -0,0 +1,36 @@ +### 姓名 +YibinLiu666 + +### 实习项目 +高阶微分的性能分析和优化 + +### 本周工作 + +1. **paddle高阶微分性能分析** + + * 测试paddle现有高阶微分算子组合实现与大算子实现的性能。 + * 性能分析，定位到大算子性能较差的高阶微分算子，分析原因 + + +2. **高阶微分算子组合实现添加** + + * 添加部分高阶微分算子的组合实现: + 1. abs_double_grad : https://github.com/PaddlePaddle/Paddle/pull/62335 + 2. pow_grad : https://github.com/PaddlePaddle/Paddle/pull/62336 + 3. pow_double_grad : https://github.com/PaddlePaddle/Paddle/pull/62338 + 4. sin_double_grad : https://github.com/PaddlePaddle/Paddle/pull/62341 + 5. cos_double_grad : https://github.com/PaddlePaddle/Paddle/pull/62340 + 6. minimum_double_grad : https://github.com/PaddlePaddle/Paddle/pull/62342 + 7. maximum_double_grad : https://github.com/PaddlePaddle/Paddle/pull/62343 + +3. **问题疑惑与解答** +无 + +### 下周工作 + +1. 添加上述pr中实现算子的单测 +2. 优化部分微分大算子的性能 +3. 实现log_triple_grad和prod_double_grad的组合实现 + +### 导师点评 +请联系导师填写 From 53e3abe8ee170f63f8564cd060580431f0292f3c Mon Sep 17 00:00:00 2001 From: HydrogenSulfate <490868991@qq.com> Date: Wed, 6 Mar 2024 13:42:38 +0800 Subject: [PATCH 2/5] Update WeeklyReports/Hackathon_6th/09_YibinLiu666/[WeeklyReports] 2024.02.25~2024.03.08.md --- .../[WeeklyReports] 2024.02.25~2024.03.08.md | 40 +++++++++++-------- 1 file changed, 23 insertions(+), 17 deletions(-) diff --git a/WeeklyReports/Hackathon_6th/09_YibinLiu666/[WeeklyReports] 2024.02.25~2024.03.08.md b/WeeklyReports/Hackathon_6th/09_YibinLiu666/[WeeklyReports] 2024.02.25~2024.03.08.md index 48231075..bcd7e00c 100644 --- a/WeeklyReports/Hackathon_6th/09_YibinLiu666/[WeeklyReports] 2024.02.25~2024.03.08.md +++ b/WeeklyReports/Hackathon_6th/09_YibinLiu666/[WeeklyReports] 2024.02.25~2024.03.08.md @@ -1,20 +1,20 @@ -### 姓名 +### 濮撳悕 YibinLiu666 -### 实习项目 -高阶微分的性能分析和优化 +### 瀹炰範椤圭洰 +楂橀樁寰垎鐨勬ц兘鍒嗘瀽鍜屼紭鍖 -### 本周工作 +### 鏈懆宸ヤ綔 -1. **paddle高阶微分性能分析** +1. **paddle楂橀樁寰垎鎬ц兘鍒嗘瀽** - * 测试paddle现有高阶微分算子组合实现与大算子实现的性能。 - * 性能分析，定位到大算子性能较差的高阶微分算子，分析原因 + * 娴嬭瘯paddle鐜版湁楂橀樁寰垎绠楀瓙缁勫悎瀹炵幇涓庡ぇ绠楀瓙瀹炵幇鐨勬ц兘銆 + * 鎬ц兘鍒嗘瀽锛屽畾浣嶅埌澶х畻瀛愭ц兘杈冨樊鐨勯珮闃跺井鍒嗙畻瀛愶紝鍒嗘瀽鍘熷洜 -2. **高阶微分算子组合实现添加** +2. **楂橀樁寰垎绠楀瓙缁勫悎瀹炵幇娣诲姞** - * 添加部分高阶微分算子的组合实现: + * 娣诲姞閮ㄥ垎楂橀樁寰垎绠楀瓙鐨勭粍鍚堝疄鐜: 1. abs_double_grad : https://github.com/PaddlePaddle/Paddle/pull/62335 2. pow_grad : https://github.com/PaddlePaddle/Paddle/pull/62336 3. pow_double_grad : https://github.com/PaddlePaddle/Paddle/pull/62338 @@ -23,14 +23,20 @@ YibinLiu666 6. minimum_double_grad : https://github.com/PaddlePaddle/Paddle/pull/62342 7. maximum_double_grad : https://github.com/PaddlePaddle/Paddle/pull/62343 -3. **问题疑惑与解答** -无 +3. **闂鐤戞儜涓庤В绛** +鏃 -### 下周工作 +### 涓嬪懆宸ヤ綔 -1. 添加上述pr中实现算子的单测 -2. 优化部分微分大算子的性能 -3. 实现log_triple_grad和prod_double_grad的组合实现 +1. 娣诲姞涓婅堪pr涓疄鐜扮畻瀛愮殑鍗曟祴 +2. 浼樺寲閮ㄥ垎寰垎澶х畻瀛愮殑鎬ц兘 +3. 瀹炵幇log_triple_grad鍜宲rod_double_grad鐨勭粍鍚堝疄鐜 -### 导师点评 -请联系导师填写 +### 瀵煎笀鐐硅瘎 + +鑳藉緢蹇悊瑙ｅ苟涓婃墜楂橀樁寰垎缁勫悎绠楀瓙鐩稿叧宸ヤ綔锛屽苟瀵逛唬鐮佸疄鐜拌繘琛屽垎鏋愩佷紭鍖栥 + +1. 浼樺寲寰垎澶х畻瀛愪换鍔★紝鍙互鎸夌収浼樺厛绾т粠楂樺埌浣庤繘琛屼紭鍖栵細`AddGradImpl`, `DivideDoubleGradImpl`, `AddDoubleGradImpl`銆 +浼樺寲瀹屾瘯涔嬪悗鍙互鍦ㄥ姩鎬佸浘閲屾祴璇曚竴涓嬩紭鍖栧墠鍚庣殑鎬ц兘宸窛锛 +2. `log_triple_grad`鍜宍prod_double_grad`缁勫悎绠楀瓙瀹炵幇瀹屾瘯涔嬪悗锛屽彲浠ユ祴璇曚竴涓媗og涓夐樁寰垎鍦╨og涓闃剁粍鍚堝拰涓夐樁缁勫悎涓嬬殑鎬ц兘鍙樺寲锛宲rod鍚岀悊娴嬭瘯浜岄樁寰垎鍦ㄤ竴闃剁粍鍚堝拰浜岄樁缁勫悎涓嬬殑鎬ц兘鍙樺寲銆 +3. 鍙互浜嗚В涓涓媝ytorch鐨刧radchecker鏈哄埗锛屽寘鎷琯radcheck鍜 From 4b8f0603d62b667330dc6d145624498a8e091655 Mon Sep 17 00:00:00 2001 From: YibinLiu666 <2632839426@qq.com> Date: Fri, 22 Mar 2024 00:08:45 +0800 Subject: [PATCH 3/5] second week --- .../[WeeklyReports]2024.03.09~2024.03.22.md | 30 +++++++++++++++++++ 1 file changed, 30 insertions(+) create mode 100644 WeeklyReports/Hackathon_6th/09_YibinLiu666/[WeeklyReports]2024.03.09~2024.03.22.md diff --git a/WeeklyReports/Hackathon_6th/09_YibinLiu666/[WeeklyReports]2024.03.09~2024.03.22.md b/WeeklyReports/Hackathon_6th/09_YibinLiu666/[WeeklyReports]2024.03.09~2024.03.22.md new file mode 100644 index 00000000..45df7ea7 --- /dev/null +++ b/WeeklyReports/Hackathon_6th/09_YibinLiu666/[WeeklyReports]2024.03.09~2024.03.22.md @@ -0,0 +1,30 @@ +### 姓名 +YibinLiu666 + +### 实习项目 +高阶微分的性能分析和优化 + +### 本周工作 + +1. **高阶微分大算子性能优化** + + * 优化add_double_grad大算子性能：https://github.com/PaddlePaddle/Paddle/pull/62474 + * 优化divide_double_grad大算子性能 (一直在给这个优化debug，问题有点小多)：https://github.com/PaddlePaddle/Paddle/pull/62533 + + +2. **高阶微分算子组合单测添加** + + * 添加高阶微分算子的组合实现的单测 + + +3. **问题疑惑与解答** +无 + +### 下周工作 + +1. merge现在提交的pr，补全单测 +2. 进一步优化divide_double_grad +3. 阅读fft算子的相关文档，理解原理后尝试优化FFTC2RGradKernel + +### 导师点评 +请联系导师填写 From f96502f85054ee5fc1af3eb3cce86c09456a4cf2 Mon Sep 17 00:00:00 2001 From: YibinLiu666 <2632839426@qq.com> Date: Fri, 22 Mar 2024 00:13:34 +0800 Subject: [PATCH 4/5] update --- .../[WeeklyReports] 2024.02.25~2024.03.08.md | 42 ------------------- 1 file changed, 42 deletions(-) delete mode 100644 WeeklyReports/Hackathon_6th/09_YibinLiu666/[WeeklyReports] 2024.02.25~2024.03.08.md diff --git a/WeeklyReports/Hackathon_6th/09_YibinLiu666/[WeeklyReports] 2024.02.25~2024.03.08.md b/WeeklyReports/Hackathon_6th/09_YibinLiu666/[WeeklyReports] 2024.02.25~2024.03.08.md deleted file mode 100644 index bcd7e00c..00000000 --- a/WeeklyReports/Hackathon_6th/09_YibinLiu666/[WeeklyReports] 2024.02.25~2024.03.08.md +++ /dev/null @@ -1,42 +0,0 @@ -### 濮撳悕 -YibinLiu666 - -### 瀹炰範椤圭洰 -楂橀樁寰垎鐨勬ц兘鍒嗘瀽鍜屼紭鍖 - -### 鏈懆宸ヤ綔 - -1. **paddle楂橀樁寰垎鎬ц兘鍒嗘瀽** - - * 娴嬭瘯paddle鐜版湁楂橀樁寰垎绠楀瓙缁勫悎瀹炵幇涓庡ぇ绠楀瓙瀹炵幇鐨勬ц兘銆 - * 鎬ц兘鍒嗘瀽锛屽畾浣嶅埌澶х畻瀛愭ц兘杈冨樊鐨勯珮闃跺井鍒嗙畻瀛愶紝鍒嗘瀽鍘熷洜 - - -2. **楂橀樁寰垎绠楀瓙缁勫悎瀹炵幇娣诲姞** - - * 娣诲姞閮ㄥ垎楂橀樁寰垎绠楀瓙鐨勭粍鍚堝疄鐜: - 1. abs_double_grad : https://github.com/PaddlePaddle/Paddle/pull/62335 - 2. pow_grad : https://github.com/PaddlePaddle/Paddle/pull/62336 - 3. pow_double_grad : https://github.com/PaddlePaddle/Paddle/pull/62338 - 4. sin_double_grad : https://github.com/PaddlePaddle/Paddle/pull/62341 - 5. cos_double_grad : https://github.com/PaddlePaddle/Paddle/pull/62340 - 6. minimum_double_grad : https://github.com/PaddlePaddle/Paddle/pull/62342 - 7. maximum_double_grad : https://github.com/PaddlePaddle/Paddle/pull/62343 - -3. **闂鐤戞儜涓庤В绛** -鏃 - -### 涓嬪懆宸ヤ綔 - -1. 娣诲姞涓婅堪pr涓疄鐜扮畻瀛愮殑鍗曟祴 -2. 浼樺寲閮ㄥ垎寰垎澶х畻瀛愮殑鎬ц兘 -3. 瀹炵幇log_triple_grad鍜宲rod_double_grad鐨勭粍鍚堝疄鐜 - -### 瀵煎笀鐐硅瘎 - -鑳藉緢蹇悊瑙ｅ苟涓婃墜楂橀樁寰垎缁勫悎绠楀瓙鐩稿叧宸ヤ綔锛屽苟瀵逛唬鐮佸疄鐜拌繘琛屽垎鏋愩佷紭鍖栥 - -1. 浼樺寲寰垎澶х畻瀛愪换鍔★紝鍙互鎸夌収浼樺厛绾т粠楂樺埌浣庤繘琛屼紭鍖栵細`AddGradImpl`, `DivideDoubleGradImpl`, `AddDoubleGradImpl`銆 -浼樺寲瀹屾瘯涔嬪悗鍙互鍦ㄥ姩鎬佸浘閲屾祴璇曚竴涓嬩紭鍖栧墠鍚庣殑鎬ц兘宸窛锛 -2. `log_triple_grad`鍜宍prod_double_grad`缁勫悎绠楀瓙瀹炵幇瀹屾瘯涔嬪悗锛屽彲浠ユ祴璇曚竴涓媗og涓夐樁寰垎鍦╨og涓闃剁粍鍚堝拰涓夐樁缁勫悎涓嬬殑鎬ц兘鍙樺寲锛宲rod鍚岀悊娴嬭瘯浜岄樁寰垎鍦ㄤ竴闃剁粍鍚堝拰浜岄樁缁勫悎涓嬬殑鎬ц兘鍙樺寲銆 -3. 鍙互浜嗚В涓涓媝ytorch鐨刧radchecker鏈哄埗锛屽寘鎷琯radcheck鍜 From 88b3f8088d247657be5eaa21d8854885a4f8ff1b Mon Sep 17 00:00:00 2001 From: HydrogenSulfate <490868991@qq.com> Date: Fri, 29 Mar 2024 11:09:55 +0800 Subject: [PATCH 5/5] Update WeeklyReports/Hackathon_6th/09_YibinLiu666/[WeeklyReports]2024.03.09~2024.03.22.md --- .../[WeeklyReports]2024.03.09~2024.03.22.md | 34 +++++++++---------- 1 file changed, 17 insertions(+), 17 deletions(-) diff --git a/WeeklyReports/Hackathon_6th/09_YibinLiu666/[WeeklyReports]2024.03.09~2024.03.22.md b/WeeklyReports/Hackathon_6th/09_YibinLiu666/[WeeklyReports]2024.03.09~2024.03.22.md index 45df7ea7..86c3e005 100644 --- a/WeeklyReports/Hackathon_6th/09_YibinLiu666/[WeeklyReports]2024.03.09~2024.03.22.md +++ b/WeeklyReports/Hackathon_6th/09_YibinLiu666/[WeeklyReports]2024.03.09~2024.03.22.md @@ -1,30 +1,30 @@ -### 姓名 +### 濮撳悕 YibinLiu666 -### 实习项目 -高阶微分的性能分析和优化 +### 瀹炰範椤圭洰 +楂橀樁寰垎鐨勬ц兘鍒嗘瀽鍜屼紭鍖 -### 本周工作 +### 鏈懆宸ヤ綔 -1. **高阶微分大算子性能优化** +1. **楂橀樁寰垎澶х畻瀛愭ц兘浼樺寲** - * 优化add_double_grad大算子性能：https://github.com/PaddlePaddle/Paddle/pull/62474 - * 优化divide_double_grad大算子性能 (一直在给这个优化debug，问题有点小多)：https://github.com/PaddlePaddle/Paddle/pull/62533 + * 浼樺寲add_double_grad澶х畻瀛愭ц兘锛歨ttps://github.com/PaddlePaddle/Paddle/pull/62474 + * 浼樺寲divide_double_grad澶х畻瀛愭ц兘 (涓鐩村湪缁欒繖涓紭鍖杁ebug锛岄棶棰樻湁鐐瑰皬澶)锛歨ttps://github.com/PaddlePaddle/Paddle/pull/62533 -2. **高阶微分算子组合单测添加** +2. **楂橀樁寰垎绠楀瓙缁勫悎鍗曟祴娣诲姞** - * 添加高阶微分算子的组合实现的单测 + * 娣诲姞楂橀樁寰垎绠楀瓙鐨勭粍鍚堝疄鐜扮殑鍗曟祴 -3. **问题疑惑与解答** -无 +3. **闂鐤戞儜涓庤В绛** +鏃 -### 下周工作 +### 涓嬪懆宸ヤ綔 -1. merge现在提交的pr，补全单测 -2. 进一步优化divide_double_grad -3. 阅读fft算子的相关文档，理解原理后尝试优化FFTC2RGradKernel +1. merge鐜板湪鎻愪氦鐨刾r锛岃ˉ鍏ㄥ崟娴 +2. 杩涗竴姝ヤ紭鍖杁ivide_double_grad +3. 闃呰fft绠楀瓙鐨勭浉鍏虫枃妗ｏ紝鐞嗚В鍘熺悊鍚庡皾璇曚紭鍖朏FTC2RGradKernel -### 导师点评 -请联系导师填写 +### 瀵煎笀鐐硅瘎 +DivideDoubleGrad绠楀瓙闇瑕佽冭檻寮犻噺骞挎挱浠ュ強鍙橀噺澶嶇敤鐨勬儏鍐碉紝杈冧负澶嶆潅锛岀泭鏂岃鐪熻В鍐充簡鍘熸湁鐨凚UG骞朵紭鍖栦簡閫熷害 馃憤 銆