Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Reduce peak memory requirement in graph creation (part 1/2) #2070

Merged
merged 13 commits into from
Feb 22, 2022
Merged

Reduce peak memory requirement in graph creation (part 1/2) #2070

merged 13 commits into from
Feb 22, 2022

Commits on Feb 12, 2022

  1. reduce temporary memory requirement in R-mat edge list generation

    @seunghwak
    seunghwak committed Feb 12, 2022
    Configuration menu
    Copy the full SHA
    eefe729 View commit details
    Browse the repository at this point in the history

  2. input parameter renaming for clarity

    @seunghwak
    seunghwak committed Feb 12, 2022
    Configuration menu
    Copy the full SHA
    167b5ab View commit details
    Browse the repository at this point in the history

Commits on Feb 13, 2022

  1. add a heuristic to cut peak memory footprint

    @seunghwak
    seunghwak committed Feb 13, 2022
    Configuration menu
    Copy the full SHA
    f06f32b View commit details
    Browse the repository at this point in the history

  2. improve inconsistencies in naming

    @seunghwak
    seunghwak committed Feb 13, 2022
    Configuration menu
    Copy the full SHA
    6dceeab View commit details
    Browse the repository at this point in the history

Commits on Feb 15, 2022

  1. split groupby_and_shuffle_edgelist to groupby_and_count and shuffle_e… 

    …dgelist to pass mem_frugal=true to limit the maximum allocation chunk size to avoid malloc failure due to fragmentation with the pool allocator
    @seunghwak
    seunghwak committed Feb 15, 2022
    Configuration menu
    Copy the full SHA
    febd72d View commit details
    Browse the repository at this point in the history

Commits on Feb 16, 2022

  1. use temporary host buffer to concatenate edge list in edge generation

    @seunghwak
    seunghwak committed Feb 16, 2022
    Configuration menu
    Copy the full SHA
    48fa255 View commit details
    Browse the repository at this point in the history

  2. update groupby to take mem_frugal_threshold instead of bool mem_frugal

    @seunghwak
    seunghwak committed Feb 16, 2022
    Configuration menu
    Copy the full SHA
    234a119 View commit details
    Browse the repository at this point in the history

  3. move counting unique local edge majors/mionrs inside the graph constr… 

    …uctor to limit peak memory usage
    @seunghwak
    seunghwak committed Feb 16, 2022
    Configuration menu
    Copy the full SHA
    95f2295 View commit details
    Browse the repository at this point in the history

  4. clang-format

    @seunghwak
    seunghwak committed Feb 16, 2022
    Configuration menu
    Copy the full SHA
    15aeb4c View commit details
    Browse the repository at this point in the history

  5. copyright year

    @seunghwak
    seunghwak committed Feb 16, 2022
    Configuration menu
    Copy the full SHA
    e7102e0 View commit details
    Browse the repository at this point in the history

  6. Merge branch 'branch-22.04' of github.com:rapidsai/cugraph into enh_m… 

    …em_footprint
    @seunghwak
    seunghwak committed Feb 16, 2022
    Configuration menu
    Copy the full SHA
    d8c5178 View commit details
    Browse the repository at this point in the history

  7. clang-format

    @seunghwak
    seunghwak committed Feb 16, 2022
    Configuration menu
    Copy the full SHA
    7b544a6 View commit details
    Browse the repository at this point in the history

Commits on Feb 19, 2022

  1. bug fix

    @seunghwak
    seunghwak committed Feb 19, 2022
    Configuration menu
    Copy the full SHA
    edd7cdd View commit details
    Browse the repository at this point in the history