Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[CUDA] CUDA Quantized Training (fixes #5606) #5933

Merged
merged 52 commits into from
Oct 8, 2023
Merged

[CUDA] CUDA Quantized Training (fixes #5606) #5933

merged 52 commits into from
Oct 8, 2023

Commits on Dec 22, 2022

  1. add quantized training (first stage)

    @shiyu1994
    shiyu1994 committed Dec 22, 2022
    Configuration menu
    Copy the full SHA
    8187759 View commit details
    Browse the repository at this point in the history

Commits on Mar 23, 2023

  1. Merge remote-tracking branch 'origin/master' into quantized-training

    @shiyu1994
    shiyu1994 committed Mar 23, 2023
    Configuration menu
    Copy the full SHA
    8480873 View commit details
    Browse the repository at this point in the history

  2. add histogram construction functions for integer gradients

    @shiyu1994
    shiyu1994 committed Mar 23, 2023
    Configuration menu
    Copy the full SHA
    9e5d46b View commit details
    Browse the repository at this point in the history

  3. add stochastic rounding

    @shiyu1994
    shiyu1994 committed Mar 23, 2023
    Configuration menu
    Copy the full SHA
    dd2a3b4 View commit details
    Browse the repository at this point in the history

  4. update docs

    @shiyu1994
    shiyu1994 committed Mar 23, 2023
    Configuration menu
    Copy the full SHA
    41c6c79 View commit details
    Browse the repository at this point in the history

  5. fix compilation errors by adding template instantiations

    @shiyu1994
    shiyu1994 committed Mar 23, 2023
    Configuration menu
    Copy the full SHA
    dfb5bc4 View commit details
    Browse the repository at this point in the history

  6. update files for compilation

    @shiyu1994
    shiyu1994 committed Mar 23, 2023
    Configuration menu
    Copy the full SHA
    d830128 View commit details
    Browse the repository at this point in the history

  7. fix compilation of gpu version

    @shiyu1994
    shiyu1994 committed Mar 23, 2023
    Configuration menu
    Copy the full SHA
    e82675b View commit details
    Browse the repository at this point in the history

Commits on Mar 30, 2023

  1. initialize gradient discretizer before share states

    @shiyu1994
    shiyu1994 committed Mar 30, 2023
    Configuration menu
    Copy the full SHA
    1d68e97 View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'origin/master' into quantized-training

    @shiyu1994
    shiyu1994 committed Mar 30, 2023
    Configuration menu
    Copy the full SHA
    4ccdf34 View commit details
    Browse the repository at this point in the history

Commits on Apr 5, 2023

  1. add a test case for quantized training

    @shiyu1994
    shiyu1994 committed Apr 5, 2023
    Configuration menu
    Copy the full SHA
    27dbf8c View commit details
    Browse the repository at this point in the history

  2. add quantized training for data distributed training

    @shiyu1994
    shiyu1994 committed Apr 5, 2023
    Configuration menu
    Copy the full SHA
    5c8aac1 View commit details
    Browse the repository at this point in the history

Commits on Apr 6, 2023

  1. Delete origin.pred

    @shiyu1994
    shiyu1994 authored Apr 6, 2023
    Configuration menu
    Copy the full SHA
    1fd115a View commit details
    Browse the repository at this point in the history

  2. Delete ifelse.pred

    @shiyu1994
    shiyu1994 authored Apr 6, 2023
    Configuration menu
    Copy the full SHA
    197b394 View commit details
    Browse the repository at this point in the history

  3. Delete LightGBM_model.txt

    @shiyu1994
    shiyu1994 authored Apr 6, 2023
    Configuration menu
    Copy the full SHA
    7140bb8 View commit details
    Browse the repository at this point in the history

  4. remove useless changes

    @shiyu1994
    shiyu1994 authored Apr 6, 2023
    Configuration menu
    Copy the full SHA
    1f142d5 View commit details
    Browse the repository at this point in the history

Commits on Apr 19, 2023

  1. Merge remote-tracking branch 'origin/master' into quantized-training

    @shiyu1994
    shiyu1994 committed Apr 19, 2023
    Configuration menu
    Copy the full SHA
    22a98b7 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'quantized-training' of https://github.com/Microsoft/Lig… 

    …htGBM into quantized-training
    @shiyu1994
    shiyu1994 committed Apr 19, 2023
    Configuration menu
    Copy the full SHA
    bc848a0 View commit details
    Browse the repository at this point in the history

  3. fix lint error

    @shiyu1994
    shiyu1994 committed Apr 19, 2023
    Configuration menu
    Copy the full SHA
    d5fc93d View commit details
    Browse the repository at this point in the history

  4. remove debug loggings

    @shiyu1994
    shiyu1994 committed Apr 19, 2023
    Configuration menu
    Copy the full SHA
    ed066d0 View commit details
    Browse the repository at this point in the history

Commits on Apr 24, 2023

  1. fix mismatch of vector and allocator types

    @shiyu1994
    shiyu1994 committed Apr 24, 2023
    Configuration menu
    Copy the full SHA
    06826f0 View commit details
    Browse the repository at this point in the history

Commits on Apr 25, 2023

  1. remove changes in main.cpp

    @shiyu1994
    shiyu1994 committed Apr 25, 2023
    Configuration menu
    Copy the full SHA
    025ad39 View commit details
    Browse the repository at this point in the history

  2. fix bugs with uninitialized gradient discretizer

    @shiyu1994
    shiyu1994 committed Apr 25, 2023
    Configuration menu
    Copy the full SHA
    baef468 View commit details
    Browse the repository at this point in the history

  3. initialize ordered gradients in gradient discretizer

    @shiyu1994
    shiyu1994 committed Apr 25, 2023
    Configuration menu
    Copy the full SHA
    ce93015 View commit details
    Browse the repository at this point in the history

  4. disable quantized training with gpu and cuda 

    fix msvc compilation errors and warnings
    @shiyu1994
    shiyu1994 committed Apr 25, 2023
    Configuration menu
    Copy the full SHA
    2b1118c View commit details
    Browse the repository at this point in the history

Commits on Apr 26, 2023

  1. fix bug in data parallel tree learner

    @shiyu1994
    shiyu1994 committed Apr 26, 2023
    Configuration menu
    Copy the full SHA
    487f2c4 View commit details
    Browse the repository at this point in the history

  2. make quantized training test deterministic

    @shiyu1994
    shiyu1994 committed Apr 26, 2023
    Configuration menu
    Copy the full SHA
    8c0e67b View commit details
    Browse the repository at this point in the history

  3. make quantized training in test case more accurate

    @shiyu1994
    shiyu1994 committed Apr 26, 2023
    Configuration menu
    Copy the full SHA
    6a76fde View commit details
    Browse the repository at this point in the history

  4. refactor test_quantized_training

    @shiyu1994
    shiyu1994 committed Apr 26, 2023
    Configuration menu
    Copy the full SHA
    0812403 View commit details
    Browse the repository at this point in the history

Commits on May 4, 2023

  1. fix leaf splits initialization with quantized training

    @shiyu1994
    shiyu1994 committed May 4, 2023
    Configuration menu
    Copy the full SHA
    9c8894b View commit details
    Browse the repository at this point in the history

Commits on May 5, 2023

  1. check distributed quantized training result

    @shiyu1994
    shiyu1994 committed May 5, 2023
    Configuration menu
    Copy the full SHA
    788e1aa View commit details
    Browse the repository at this point in the history

Commits on Jun 16, 2023

  1. add cuda gradient discretizer

    @shiyu1994
    shiyu1994 committed Jun 16, 2023
    Configuration menu
    Copy the full SHA
    bf759a9 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into cuda-quantized-training

    @shiyu1994
    shiyu1994 committed Jun 16, 2023
    Configuration menu
    Copy the full SHA
    ba20a6d View commit details
    Browse the repository at this point in the history

Commits on Jun 27, 2023

  1. Merge remote-tracking branch 'origin/master' into cuda-quantized-trai… 

    …ning
    @shiyu1994
    shiyu1994 committed Jun 27, 2023
    Configuration menu
    Copy the full SHA
    3593b2c View commit details
    Browse the repository at this point in the history

Commits on Jun 28, 2023

  1. add quantized training for CUDA version in tree learner

    @shiyu1994
    shiyu1994 committed Jun 28, 2023
    Configuration menu
    Copy the full SHA
    d7298a7 View commit details
    Browse the repository at this point in the history

Commits on Jul 17, 2023

  1. remove cuda computability 6.1 and 6.2

    @shiyu1994
    shiyu1994 committed Jul 17, 2023
    Configuration menu
    Copy the full SHA
    3ee27f2 View commit details
    Browse the repository at this point in the history

Commits on Jul 18, 2023

  1. Merge branch 'master' into cuda-quantized-training

    @shiyu1994
    shiyu1994 committed Jul 18, 2023
    Configuration menu
    Copy the full SHA
    deace6c View commit details
    Browse the repository at this point in the history

Commits on Jul 20, 2023

  1. fix parts of gpu quantized training errors and warnings

    @shiyu1994
    shiyu1994 committed Jul 20, 2023
    Configuration menu
    Copy the full SHA
    48df866 View commit details
    Browse the repository at this point in the history

Commits on Aug 8, 2023

  1. fix build-python.sh to install locally built version

    @shiyu1994
    shiyu1994 committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    1d4b02e View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into cuda-quantized-training

    @shiyu1994
    shiyu1994 committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    a8ebc93 View commit details
    Browse the repository at this point in the history

Commits on Aug 9, 2023

  1. fix memory access bugs

    @shiyu1994
    shiyu1994 committed Aug 9, 2023
    Configuration menu
    Copy the full SHA
    3eaa652 View commit details
    Browse the repository at this point in the history

  2. fix lint errors

    @shiyu1994
    shiyu1994 committed Aug 9, 2023
    Configuration menu
    Copy the full SHA
    cf12051 View commit details
    Browse the repository at this point in the history

  3. mark cuda quantized training on cuda with categorical features as uns… 

    …upported
    @shiyu1994
    shiyu1994 committed Aug 9, 2023
    Configuration menu
    Copy the full SHA
    043fbcb View commit details
    Browse the repository at this point in the history

  4. rename cuda_utils.h to cuda_utils.hu

    @shiyu1994
    shiyu1994 committed Aug 9, 2023
    Configuration menu
    Copy the full SHA
    89357e5 View commit details
    Browse the repository at this point in the history

  5. enable quantized training with cuda

    @shiyu1994
    shiyu1994 committed Aug 9, 2023
    Configuration menu
    Copy the full SHA
    c7c5d57 View commit details
    Browse the repository at this point in the history

Commits on Sep 12, 2023

  1. Merge branch 'master' into cuda-quantized-training

    @shiyu1994
    shiyu1994 committed Sep 12, 2023
    Configuration menu
    Copy the full SHA
    6e3a271 View commit details
    Browse the repository at this point in the history

  2. fix cuda quantized training with sparse row data

    @shiyu1994
    shiyu1994 committed Sep 12, 2023
    Configuration menu
    Copy the full SHA
    800a378 View commit details
    Browse the repository at this point in the history

  3. allow using global memory buffer in histogram construction with cuda … 

    …quantized training
    @shiyu1994
    shiyu1994 committed Sep 12, 2023
    Configuration menu
    Copy the full SHA
    6b687b0 View commit details
    Browse the repository at this point in the history

Commits on Sep 30, 2023

  1. Merge branch 'master' into cuda-quantized-training

    @shiyu1994
    shiyu1994 authored Sep 30, 2023
    Configuration menu
    Copy the full SHA
    bd5935d View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into cuda-quantized-training

    @shiyu1994
    shiyu1994 authored Sep 30, 2023
    Configuration menu
    Copy the full SHA
    811e729 View commit details
    Browse the repository at this point in the history

Commits on Oct 1, 2023

  1. recover build-python.sh 

    enlarge allowed package size to 100M
    @shiyu1994
    shiyu1994 committed Oct 1, 2023
    Configuration menu
    Copy the full SHA
    2cb1abb View commit details
    Browse the repository at this point in the history

Commits on Oct 3, 2023

  1. Merge branch 'master' into cuda-quantized-training

    @shiyu1994
    shiyu1994 authored Oct 3, 2023
    Configuration menu
    Copy the full SHA
    b71fc86 View commit details
    Browse the repository at this point in the history