Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[AutoParallel] BF16-o1/FP16-o1 PASS support training and generation #51147

Merged
merged 29 commits into from
Mar 22, 2023
Merged

[AutoParallel] BF16-o1/FP16-o1 PASS support training and generation #51147

merged 29 commits into from
Mar 22, 2023

Commits on Mar 3, 2023

  1. [AutoParallel] support bloom

    zhaoyingli committed Mar 3, 2023
    Configuration menu
    Copy the full SHA
    2eefda6 View commit details
    Browse the repository at this point in the history

  2. fix import

    zhaoyingli committed Mar 3, 2023
    Configuration menu
    Copy the full SHA
    ec72f96 View commit details
    Browse the repository at this point in the history

  3. align amp and bf16

    zhaoyingli committed Mar 3, 2023
    Configuration menu
    Copy the full SHA
    27f8dd3 View commit details
    Browse the repository at this point in the history

  4. update func name

    zhaoyingli committed Mar 3, 2023
    Configuration menu
    Copy the full SHA
    2969f77 View commit details
    Browse the repository at this point in the history

  5. clipbyglobalnorm and add_n support bf16

    zhaoyingli committed Mar 3, 2023
    Configuration menu
    Copy the full SHA
    8edf118 View commit details
    Browse the repository at this point in the history

Commits on Mar 6, 2023

  1. upgrade amp strategy api

    zhaoyingli committed Mar 6, 2023
    Configuration menu
    Copy the full SHA
    2531aab View commit details
    Browse the repository at this point in the history

  2. update bf16 unittest

    zhaoyingli committed Mar 6, 2023
    Configuration menu
    Copy the full SHA
    6225632 View commit details
    Browse the repository at this point in the history

  3. fix static clip

    zhaoyingli committed Mar 6, 2023
    Configuration menu
    Copy the full SHA
    483115a View commit details
    Browse the repository at this point in the history

Commits on Mar 7, 2023

  1. merge fp16-o1 & bf16-o1

    zhaoyingli committed Mar 7, 2023
    Configuration menu
    Copy the full SHA
    d276420 View commit details
    Browse the repository at this point in the history

Commits on Mar 8, 2023

  1. add bf16 o2

    @JZ-LIANG
    JZ-LIANG committed Mar 8, 2023
    Configuration menu
    Copy the full SHA
    ef4cc88 View commit details
    Browse the repository at this point in the history

  2. Merge pull request #4 from JZ-LIANG/AutoParallel/support-blomm 

    add bf16 o2
    @zhaoyinglia
    zhaoyinglia authored Mar 8, 2023
    Configuration menu
    Copy the full SHA
    48fd4a9 View commit details
    Browse the repository at this point in the history

Commits on Mar 9, 2023

  1. regist bf16 dtype for uniform_random

    zhaoyingli committed Mar 9, 2023
    Configuration menu
    Copy the full SHA
    9df25a9 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into… 

    … AutoParallel/bloom
    zhaoyingli committed Mar 9, 2023
    Configuration menu
    Copy the full SHA
    b0d198f View commit details
    Browse the repository at this point in the history

  3. rm nccl ver

    zhaoyingli committed Mar 9, 2023
    Configuration menu
    Copy the full SHA
    84e86e0 View commit details
    Browse the repository at this point in the history

  4. add BF16 O1

    zhaoyingli committed Mar 9, 2023
    Configuration menu
    Copy the full SHA
    df78c3b View commit details
    Browse the repository at this point in the history

Commits on Mar 10, 2023

  1. Fix ProxyLayer @to_static not take effect problem

    @Aurelius84
    Aurelius84 committed Mar 10, 2023
    Configuration menu
    Copy the full SHA
    d369d27 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'fix_d2s' of https://github.com/Aurelius84/Paddle into A… 

    …utoParallel/bloom
    zhaoyingli committed Mar 10, 2023
    Configuration menu
    Copy the full SHA
    b06d5a9 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into… 

    … AutoParallel/bloom
    zhaoyingli committed Mar 10, 2023
    Configuration menu
    Copy the full SHA
    944bc72 View commit details
    Browse the repository at this point in the history

Commits on Mar 13, 2023

  1. revert uniform_random_op.cu

    zhaoyingli committed Mar 13, 2023
    Configuration menu
    Copy the full SHA
    658bc05 View commit details
    Browse the repository at this point in the history

  2. rm auto_parallel_bf16.py

    zhaoyingli committed Mar 13, 2023
    Configuration menu
    Copy the full SHA
    bd92327 View commit details
    Browse the repository at this point in the history

Commits on Mar 14, 2023

  1. fix unittest&is_parameter_related

    zhaoyingli committed Mar 14, 2023
    Configuration menu
    Copy the full SHA
    ef6f200 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into… 

    … AutoParallel/bloom
    zhaoyingli committed Mar 14, 2023
    Configuration menu
    Copy the full SHA
    962e17c View commit details
    Browse the repository at this point in the history

Commits on Mar 15, 2023

  1. fix test_strategy

    zhaoyingli committed Mar 15, 2023
    Configuration menu
    Copy the full SHA
    4633e62 View commit details
    Browse the repository at this point in the history

  2. fix test amp pass

    zhaoyingli committed Mar 15, 2023
    Configuration menu
    Copy the full SHA
    04a8669 View commit details
    Browse the repository at this point in the history

  3. rm annotation

    zhaoyingli committed Mar 15, 2023
    Configuration menu
    Copy the full SHA
    e1fe56d View commit details
    Browse the repository at this point in the history

Commits on Mar 16, 2023

  1. Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into… 

    … AutoParallel/bloom
    zhaoyingli committed Mar 16, 2023
    Configuration menu
    Copy the full SHA
    0fbd839 View commit details
    Browse the repository at this point in the history

Commits on Mar 21, 2023

  1. Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into… 

    … AutoParallel/bloom
    zhaoyingli committed Mar 21, 2023
    Configuration menu
    Copy the full SHA
    517d782 View commit details
    Browse the repository at this point in the history

  2. add save load unittest

    zhaoyingli committed Mar 21, 2023
    Configuration menu
    Copy the full SHA
    ecbf738 View commit details
    Browse the repository at this point in the history

  3. fix test_strategy

    zhaoyingli committed Mar 21, 2023
    Configuration menu
    Copy the full SHA
    502410b View commit details
    Browse the repository at this point in the history