Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Speed up build: unnecessary invalidation in the incremental recompile mode [databricks] #9698

Merged
merged 30 commits into from
Nov 17, 2023
Merged

Speed up build: unnecessary invalidation in the incremental recompile mode [databricks] #9698

merged 30 commits into from
Nov 17, 2023

Commits on Nov 10, 2023

  1. Consolidate delta-lake poms 

    Signed-off-by: Gera Shegalov <[email protected]>
    @gerashegalov
    gerashegalov committed Nov 10, 2023
    Configuration menu
    Copy the full SHA
    7f7d4cb View commit details
    Browse the repository at this point in the history

Commits on Nov 11, 2023

  1. skip build-info if revision unchanged

    @gerashegalov
    gerashegalov committed Nov 11, 2023
    Configuration menu
    Copy the full SHA
    91e718a View commit details
    Browse the repository at this point in the history

  2. scala2.13 

    Signed-off-by: Gera Shegalov <[email protected]>
    @gerashegalov
    gerashegalov committed Nov 11, 2023
    Configuration menu
    Copy the full SHA
    afb81b2 View commit details
    Browse the repository at this point in the history

  3. compile output as dependency 

    Signed-off-by: Gera Shegalov <[email protected]>
    @gerashegalov
    gerashegalov committed Nov 11, 2023
    Configuration menu
    Copy the full SHA
    da86cda View commit details
    Browse the repository at this point in the history

  4. scala2.13 common 

    Signed-off-by: Gera Shegalov <[email protected]>
    @gerashegalov
    gerashegalov committed Nov 11, 2023
    Configuration menu
    Copy the full SHA
    9684214 View commit details
    Browse the repository at this point in the history

  5. revert to 4.3.0 

    Signed-off-by: Gera Shegalov <[email protected]>
    @gerashegalov
    gerashegalov committed Nov 11, 2023
    Configuration menu
    Copy the full SHA
    f6dd0e5 View commit details
    Browse the repository at this point in the history

  6. scala2.13 

    Signed-off-by: Gera Shegalov <[email protected]>
    @gerashegalov
    gerashegalov committed Nov 11, 2023
    Configuration menu
    Copy the full SHA
    3d0fe74 View commit details
    Browse the repository at this point in the history

Commits on Nov 12, 2023

  1. downgrade scala-maven-plugin 

    Signed-off-by: Gera Shegalov <[email protected]>
    @gerashegalov
    gerashegalov committed Nov 12, 2023
    Configuration menu
    Copy the full SHA
    fd8bbd9 View commit details
    Browse the repository at this point in the history

  2. incremental compile 

    Signed-off-by: Gera Shegalov <[email protected]>
    @gerashegalov
    gerashegalov committed Nov 12, 2023
    Configuration menu
    Copy the full SHA
    f79d88b View commit details
    Browse the repository at this point in the history

Commits on Nov 13, 2023

  1. incremental end-to-end 

    Signed-off-by: Gera Shegalov <[email protected]>
    @gerashegalov
    gerashegalov committed Nov 13, 2023
    Configuration menu
    Copy the full SHA
    868e36b View commit details
    Browse the repository at this point in the history

  2. may achieve with a single aggregate module 

    Signed-off-by: Gera Shegalov <[email protected]>
    @gerashegalov
    gerashegalov committed Nov 13, 2023
    Configuration menu
    Copy the full SHA
    ca299c8 View commit details
    Browse the repository at this point in the history

Commits on Nov 14, 2023

  1. remove aggrgator-tmp

    @gerashegalov
    gerashegalov committed Nov 14, 2023
    Configuration menu
    Copy the full SHA
    2a35697 View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'origin/branch-23.12' into speedupBuildInfo

    @gerashegalov
    gerashegalov committed Nov 14, 2023
    Configuration menu
    Copy the full SHA
    74da55a View commit details
    Browse the repository at this point in the history

  3. delete diff

    @gerashegalov
    gerashegalov committed Nov 14, 2023
    Configuration menu
    Copy the full SHA
    8ea3f76 View commit details
    Browse the repository at this point in the history

  4. Revert delta-lake changes

    @gerashegalov
    gerashegalov committed Nov 14, 2023
    Configuration menu
    Copy the full SHA
    6157a5b View commit details
    Browse the repository at this point in the history

  5. scala2.13 

    Signed-off-by: Gera Shegalov <[email protected]>
    @gerashegalov
    gerashegalov committed Nov 14, 2023
    Configuration menu
    Copy the full SHA
    baff166 View commit details
    Browse the repository at this point in the history

  6. revert unneeded changes 

    Signed-off-by: Gera Shegalov <[email protected]>
    @gerashegalov
    gerashegalov committed Nov 14, 2023
    Configuration menu
    Copy the full SHA
    56f6ecd View commit details
    Browse the repository at this point in the history

  7. change execution id 

    Signed-off-by: Gera Shegalov <[email protected]>
    @gerashegalov
    gerashegalov committed Nov 14, 2023
    Configuration menu
    Copy the full SHA
    9cc11f2 View commit details
    Browse the repository at this point in the history

  8. Replace skip with maven.scaladoc.skip 

    Follow up to NVIDIA#9615

Signed-off-by: Gera Shegalov <[email protected]>
    @gerashegalov
    gerashegalov committed Nov 14, 2023
    Configuration menu
    Copy the full SHA
    7ea535a View commit details
    Browse the repository at this point in the history

  9. robuster jar swapping logic 

    Signed-off-by: Gera Shegalov <[email protected]>
    @gerashegalov
    gerashegalov committed Nov 14, 2023
    Configuration menu
    Copy the full SHA
    c3d9740 View commit details
    Browse the repository at this point in the history

  10. scala2.13 sync 

    Signed-off-by: Gera Shegalov <[email protected]>
    @gerashegalov
    gerashegalov committed Nov 14, 2023
    Configuration menu
    Copy the full SHA
    b4ec26e View commit details
    Browse the repository at this point in the history

  11. Merge remote-tracking branch 'origin/branch-23.12' into speedupBuildInfo

    @gerashegalov
    gerashegalov committed Nov 14, 2023
    Configuration menu
    Copy the full SHA
    5e4764a View commit details
    Browse the repository at this point in the history

Commits on Nov 15, 2023

  1. Initialize dirs 

    check shim service file befor overwriting

Signed-off-by: Gera Shegalov <[email protected]>
    @gerashegalov
    gerashegalov committed Nov 15, 2023
    Configuration menu
    Copy the full SHA
    d92fc17 View commit details
    Browse the repository at this point in the history

  2. Fix equals check, regen scala2.13 

    Signed-off-by: Gera Shegalov <[email protected]>
    @gerashegalov
    gerashegalov committed Nov 15, 2023
    Configuration menu
    Copy the full SHA
    3f144ad View commit details
    Browse the repository at this point in the history

  3. use copy instead of move 

    Signed-off-by: Gera Shegalov <[email protected]>
    @gerashegalov
    gerashegalov committed Nov 15, 2023
    Configuration menu
    Copy the full SHA
    6af04b5 View commit details
    Browse the repository at this point in the history

  4. undo compiler plugin change 

    Signed-off-by: Gera Shegalov <[email protected]>
    @gerashegalov
    gerashegalov committed Nov 15, 2023
    Configuration menu
    Copy the full SHA
    db14701 View commit details
    Browse the repository at this point in the history

  5. rapids.jni.unpack.skip 

    Signed-off-by: Gera Shegalov <[email protected]>
    @gerashegalov
    gerashegalov committed Nov 15, 2023
    Configuration menu
    Copy the full SHA
    f2051e3 View commit details
    Browse the repository at this point in the history

  6. Apply suggestions from code review 

    Co-authored-by: Jason Lowe <[email protected]>
    @gerashegalov @jlowe
    gerashegalov and jlowe authored Nov 15, 2023
    Configuration menu
    Copy the full SHA
    e5aecbc View commit details
    Browse the repository at this point in the history

  7. reviews 

    Signed-off-by: Gera Shegalov <[email protected]>
    @gerashegalov
    gerashegalov committed Nov 15, 2023
    Configuration menu
    Copy the full SHA
    5efd1c2 View commit details
    Browse the repository at this point in the history

Commits on Nov 16, 2023

  1. Fixes 

    - binary-dedupe should not look outside paralle-world directory
- when unpack is skipped we should restore jni from a staged dir

Signed-off-by: Gera Shegalov <[email protected]>
    @gerashegalov
    gerashegalov committed Nov 16, 2023
    Configuration menu
    Copy the full SHA
    24ca3c7 View commit details
    Browse the repository at this point in the history