Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[REVIEW]Add remote storage support #2859

Merged
merged 49 commits into from
Nov 9, 2022
Merged

[REVIEW]Add remote storage support #2859

merged 49 commits into from
Nov 9, 2022

Commits on Oct 26, 2022

  1. Added the ability to load/call/unload general extensions in addition … 

    …to graph creation extensions, changed how unloading extensions work to unload by unique module name, make numpy and cupy optional modules in the client, updated Value and ValueWrapper to handle doubles and lists (recursive), added tests for new extension changes.
    @rlratzel
    rlratzel committed Oct 26, 2022
    Configuration menu
    Copy the full SHA
    3542708 View commit details
    Browse the repository at this point in the history

  2. Fixed tests broken by refactorings, removed dead code.

    @rlratzel
    rlratzel committed Oct 26, 2022
    Configuration menu
    Copy the full SHA
    2572ed0 View commit details
    Browse the repository at this point in the history

  3. Remove remove_pg_dependency_from_cugraph_store.py

    @VibhuJawa
    VibhuJawa committed Oct 26, 2022
    Configuration menu
    Copy the full SHA
    203da90 View commit details
    Browse the repository at this point in the history

  4. Added tests for extension modules that access the server and return N… 

    …one, added test for extension modules returning results to client GPUs (code not done yet).
    @rlratzel
    rlratzel committed Oct 26, 2022
    Configuration menu
    Copy the full SHA
    b19fab1 View commit details
    Browse the repository at this point in the history

  5. Merge remote-tracking branch 'upstream/branch-22.12' into branch-22.1… 

    …2-cugraph_service_extension_enhancements
    @rlratzel
    rlratzel committed Oct 26, 2022
    Configuration menu
    Copy the full SHA
    e897caf View commit details
    Browse the repository at this point in the history

  6. Remove remove_pg_dependency_from_cugraph_store.py

    @VibhuJawa
    VibhuJawa committed Oct 26, 2022
    Configuration menu
    Copy the full SHA
    51fb38f View commit details
    Browse the repository at this point in the history

  7. Move code to helper functions to make them callable from extensions

    @VibhuJawa
    VibhuJawa committed Oct 26, 2022
    Configuration menu
    Copy the full SHA
    d528c0c View commit details
    Browse the repository at this point in the history

  8. Fix typos

    @VibhuJawa
    VibhuJawa committed Oct 26, 2022
    Configuration menu
    Copy the full SHA
    a18becd View commit details
    Browse the repository at this point in the history

  9. Added copyrights

    @VibhuJawa
    VibhuJawa committed Oct 26, 2022
    Configuration menu
    Copy the full SHA
    3b6ef59 View commit details
    Browse the repository at this point in the history

Commits on Oct 27, 2022

  1. Moved common stuff to RemoteStorage

    @VibhuJawa
    VibhuJawa committed Oct 27, 2022
    Configuration menu
    Copy the full SHA
    4cfa293 View commit details
    Browse the repository at this point in the history

  2. Address Reviews

    @VibhuJawa
    VibhuJawa committed Oct 27, 2022
    Configuration menu
    Copy the full SHA
    f1a3318 View commit details
    Browse the repository at this point in the history

  3. Added ucx-py infra for support result_device param for call_extension… 

    …(), updated tests, added test for upcoming ability to load extensions via import paths.
    @rlratzel
    rlratzel committed Oct 27, 2022
    Configuration menu
    Copy the full SHA
    067c4e9 View commit details
    Browse the repository at this point in the history

  4. Added code to support loading extensions using a python module or pac… 

    …kage path (eg. import foo.bar.baz), updated test.
    @rlratzel
    rlratzel committed Oct 27, 2022
    Configuration menu
    Copy the full SHA
    ac59971 View commit details
    Browse the repository at this point in the history

  5. Updated docstring for load_extensions()

    @rlratzel
    rlratzel committed Oct 27, 2022
    Configuration menu
    Copy the full SHA
    b4b489e View commit details
    Browse the repository at this point in the history

  6. Added Remote Storage Support

    @VibhuJawa
    VibhuJawa committed Oct 27, 2022
    Configuration menu
    Copy the full SHA
    943034f View commit details
    Browse the repository at this point in the history

  7. Added better error handling for APIs when using device transfer optio… 

    …ns, added tests for error conditions, added benchmark for call_extension test.
    @rlratzel
    rlratzel committed Oct 27, 2022
    Configuration menu
    Copy the full SHA
    82871c3 View commit details
    Browse the repository at this point in the history

  8. Merge remote-tracking branch 'upstream/branch-22.12' into branch-22.1… 

    …2-cugraph_service_extension_enhancements
    @rlratzel
    rlratzel committed Oct 27, 2022
    Configuration menu
    Copy the full SHA
    42256e9 View commit details
    Browse the repository at this point in the history

  9. Remove remove_pg_dependency_from_cugraph_store.py

    @VibhuJawa
    VibhuJawa committed Oct 27, 2022
    Configuration menu
    Copy the full SHA
    b0ffa45 View commit details
    Browse the repository at this point in the history

  10. Remove remove_pg_dependency_from_cugraph_store.py

    @VibhuJawa
    VibhuJawa committed Oct 27, 2022
    Configuration menu
    Copy the full SHA
    4df76f0 View commit details
    Browse the repository at this point in the history

  11. Move code to helper functions to make them callable from extensions

    @VibhuJawa
    VibhuJawa committed Oct 27, 2022
    Configuration menu
    Copy the full SHA
    a941a8a View commit details
    Browse the repository at this point in the history

  12. Fix typos

    @VibhuJawa
    VibhuJawa committed Oct 27, 2022
    Configuration menu
    Copy the full SHA
    696fbc7 View commit details
    Browse the repository at this point in the history

  13. Added copyrights

    @VibhuJawa
    VibhuJawa committed Oct 27, 2022
    Configuration menu
    Copy the full SHA
    8f9cfab View commit details
    Browse the repository at this point in the history

  14. Moved common stuff to RemoteStorage

    @VibhuJawa
    VibhuJawa committed Oct 27, 2022
    Configuration menu
    Copy the full SHA
    d73bef4 View commit details
    Browse the repository at this point in the history

  15. Address Reviews

    @VibhuJawa
    VibhuJawa committed Oct 27, 2022
    Configuration menu
    Copy the full SHA
    e899c89 View commit details
    Browse the repository at this point in the history

  16. Added Remote Storage Support

    @VibhuJawa
    VibhuJawa committed Oct 27, 2022
    Configuration menu
    Copy the full SHA
    206e0be View commit details
    Browse the repository at this point in the history

  17. Add cugraph_service_store

    @VibhuJawa
    VibhuJawa committed Oct 27, 2022
    Configuration menu
    Copy the full SHA
    0afbb9b View commit details
    Browse the repository at this point in the history

  18. fix merge conflicts

    @VibhuJawa
    VibhuJawa committed Oct 27, 2022
    Configuration menu
    Copy the full SHA
    508f87a View commit details
    Browse the repository at this point in the history

  19. Add RemotePropertyGraph and RemoteMGPropertyGraph

    @VibhuJawa
    VibhuJawa committed Oct 27, 2022
    Configuration menu
    Copy the full SHA
    8426656 View commit details
    Browse the repository at this point in the history

  20. Merge commit 'refs/pull/2850/head' of https://github.com/rapidsai/cug… 

    …raph into add_remore_storage_support
    @VibhuJawa
    VibhuJawa committed Oct 27, 2022
    Configuration menu
    Copy the full SHA
    bca4154 View commit details
    Browse the repository at this point in the history

Commits on Oct 28, 2022

  1. Added working feature storage and add parquet data

    @VibhuJawa
    VibhuJawa committed Oct 28, 2022
    Configuration menu
    Copy the full SHA
    5e902e8 View commit details
    Browse the repository at this point in the history

  2. Add nvidia copyright

    @VibhuJawa
    VibhuJawa committed Oct 28, 2022
    Configuration menu
    Copy the full SHA
    00289a6 View commit details
    Browse the repository at this point in the history

  3. Added copyright information

    @VibhuJawa
    VibhuJawa committed Oct 28, 2022
    Configuration menu
    Copy the full SHA
    5354648 View commit details
    Browse the repository at this point in the history

  4. Added add_graph() to server facade so extensions can also create and … 

    …register graphs, added support for returning int8 so graph IDs can be returned easier.
    @rlratzel
    rlratzel committed Oct 28, 2022
    Configuration menu
    Copy the full SHA
    5cdd07b View commit details
    Browse the repository at this point in the history

  5. Merge commit 'refs/pull/2850/head' of https://github.com/rapidsai/cug… 

    …raph into add_remore_storage_support
    @VibhuJawa
    VibhuJawa committed Oct 28, 2022
    Configuration menu
    Copy the full SHA
    57fe0ea View commit details
    Browse the repository at this point in the history

  6. add_remore_storage_support

    @VibhuJawa
    VibhuJawa committed Oct 28, 2022
    Configuration menu
    Copy the full SHA
    133c0d0 View commit details
    Browse the repository at this point in the history

Commits on Oct 31, 2022

  1. Add LocalStore

    @VibhuJawa
    VibhuJawa committed Oct 31, 2022
    Configuration menu
    Copy the full SHA
    e91dc1f View commit details
    Browse the repository at this point in the history

  2. Added working graph service

    @VibhuJawa
    VibhuJawa committed Oct 31, 2022
    Configuration menu
    Copy the full SHA
    c0fab52 View commit details
    Browse the repository at this point in the history

Commits on Nov 4, 2022

  1. Merge branch 'branch-22.12' into add_remore_storage_support

    @VibhuJawa
    VibhuJawa authored Nov 4, 2022
    Configuration menu
    Copy the full SHA
    e55be6d View commit details
    Browse the repository at this point in the history

  2. Style Fixes

    @VibhuJawa
    VibhuJawa committed Nov 4, 2022
    Configuration menu
    Copy the full SHA
    ce470bb View commit details
    Browse the repository at this point in the history

  3. Skipped pytest for now

    @VibhuJawa
    VibhuJawa committed Nov 4, 2022
    Configuration menu
    Copy the full SHA
    be2d7ca View commit details
    Browse the repository at this point in the history

Commits on Nov 7, 2022

  1. Update python/cugraph/cugraph/gnn/dgl_extensions/cugraph_service_stor… 

    …e.py

Co-authored-by: Rick Ratzel <[email protected]>
    @VibhuJawa @rlratzel
    VibhuJawa and rlratzel authored Nov 7, 2022
    Configuration menu
    Copy the full SHA
    55ff270 View commit details
    Browse the repository at this point in the history

  2. Address Reviews

    @VibhuJawa
    VibhuJawa committed Nov 7, 2022
    Configuration menu
    Copy the full SHA
    56a4350 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'add_remore_storage_support' of https://github.com/Vibhu… 

    …Jawa/cugraph into add_remore_storage_support
    @VibhuJawa
    VibhuJawa committed Nov 7, 2022
    Configuration menu
    Copy the full SHA
    5b36168 View commit details
    Browse the repository at this point in the history

  4. Addresed using ntype and etype

    @VibhuJawa
    VibhuJawa committed Nov 7, 2022
    Configuration menu
    Copy the full SHA
    d24ab52 View commit details
    Browse the repository at this point in the history

  5. fix typing issue

    @VibhuJawa
    VibhuJawa committed Nov 7, 2022
    Configuration menu
    Copy the full SHA
    d7f4ace View commit details
    Browse the repository at this point in the history

Commits on Nov 8, 2022

  1. Update python/cugraph/cugraph/tests/test_dgl_extension_remote_wrapper… 

    …s.py

Co-authored-by: Alex Barghi <[email protected]>
    @VibhuJawa @alexbarghi-nv
    VibhuJawa and alexbarghi-nv authored Nov 8, 2022
    Configuration menu
    Copy the full SHA
    00795b4 View commit details
    Browse the repository at this point in the history

  2. remove relative imports

    @VibhuJawa
    VibhuJawa committed Nov 8, 2022
    Configuration menu
    Copy the full SHA
    fdd39d3 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'add_remore_storage_support' of https://github.com/Vibhu… 

    …Jawa/cugraph into add_remore_storage_support
    @VibhuJawa
    VibhuJawa committed Nov 8, 2022
    Configuration menu
    Copy the full SHA
    35872e6 View commit details
    Browse the repository at this point in the history

  4. link cugraph/issues/2863

    @VibhuJawa
    VibhuJawa committed Nov 8, 2022
    Configuration menu
    Copy the full SHA
    bf49417 View commit details
    Browse the repository at this point in the history