Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Move GaaS sources, tests, docs, scripts from the rapidsai/GaaS repo to the cugraph repo #2661

Merged
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
82 commits
Select commit Hold shift + click to select a range
41ed4ca
first commit
rlratzel Apr 21, 2022
70abd33
Initial version of GaaS which includes a client and server with APIs …
rlratzel Apr 21, 2022
68b86f3
Cleaned up and added documentation, fixed mechanism to find datasets …
rlratzel Apr 22, 2022
52b793b
Added more info to README.md
rlratzel Apr 22, 2022
b32b286
Merge pull request #1 from rlratzel/main
rlratzel Apr 22, 2022
b586718
Initial passing test for support for server-side extensions.
rlratzel May 15, 2022
873ea8b
Added ability to unload extensions, added load/unload/call graph crea…
rlratzel May 16, 2022
00a7535
Added proper CLI parsing, added CLI option to read a graph creation e…
rlratzel May 17, 2022
8256c10
Updated client tests with fixture to auto start and stop a server sub…
rlratzel May 17, 2022
b3eec7d
Added uptime() function (mainly to use as a ping function) and change…
rlratzel May 18, 2022
cfc86fe
Renamed test_client.py to test_e2e.py to better reflect that it is an…
rlratzel May 18, 2022
6a98c80
docstring formatting updates.
rlratzel May 18, 2022
6386b5c
Docstring updates.
rlratzel May 18, 2022
6972b2b
Minor tweak to docstring.
rlratzel May 18, 2022
b8a923e
Fixed imports to use absolute names, raising GaasError instead of all…
rlratzel May 18, 2022
79cba4f
Added option to set client connection timeout when making APIs calls …
rlratzel May 18, 2022
6cb91e7
Initial version of get_graph_vertex_dataframe_rows() working, still n…
rlratzel May 22, 2022
761b337
Removed custom Thrift type not needed, added assertions to tests and …
rlratzel May 22, 2022
d03d70d
Refactor in preparation for get_graph_edge_dataframe_rows(), added su…
rlratzel May 22, 2022
1ecf61a
Merge pull request #8 from rlratzel/branch-22.06-updates_for_dgl_1
rlratzel May 22, 2022
e668087
Merge branch 'branch-22.06-updates_for_dgl_1' into branch-22.06-updat…
rlratzel May 22, 2022
a6d8f04
Refactorings to reuse code easier, added shape API and edges APIs and…
rlratzel May 22, 2022
ba3b2de
Updated tests to not be sensitive to the PG internal dataframe row or…
rlratzel May 23, 2022
a45740c
Added batched_ego_graphs() API and test.
rlratzel May 23, 2022
384460c
Added API and test for retrieving edge IDs for a list of edges.
rlratzel May 24, 2022
3c03460
Changed method to get data from device to host and also sending numpy…
rlratzel May 24, 2022
b8f13ad
Changed binary fields in return struct to lists but only convert from…
rlratzel May 24, 2022
4a2e40b
some updates for pyg
alexbarghi-nv May 27, 2022
5400e40
remove useless files
alexbarghi-nv May 27, 2022
c00bb10
merge rick's changes
alexbarghi-nv May 27, 2022
3197825
gaas changes for support of property access in PyG
alexbarghi-nv Jun 3, 2022
be5f73d
remove useless file
alexbarghi-nv Jun 3, 2022
10f3302
remove useless files
alexbarghi-nv Jun 3, 2022
a40bb43
remove cufile
alexbarghi-nv Jun 3, 2022
80a72b9
Merge pull request #10 from alexbarghi-nv/updates_for_pyg_abarghi_01
rlratzel Jun 8, 2022
5e4e39a
Updates to make server single-threaded. Also added some crude test sc…
rlratzel Jun 8, 2022
7c5c997
Removed unused import.
rlratzel Jun 8, 2022
9cbdb62
updates for pyg
alexbarghi-nv Jun 13, 2022
8159078
remove uselsess file
alexbarghi-nv Jun 13, 2022
0a11019
Merge branch 'branch-22.06' of https://github.com/rapidsai/gaas into …
alexbarghi-nv Jun 13, 2022
ec82b5f
remove unwanted files
alexbarghi-nv Jun 14, 2022
cb148f5
remove cufile
alexbarghi-nv Jun 14, 2022
aac9d1e
Merge pull request #12 from alexbarghi-nv/updates_for_pyg_abarghi_02
rlratzel Jun 14, 2022
fa42690
Merge pull request #11 from rlratzel/single_threaded_server
rlratzel Jun 14, 2022
71ba0ed
updating the README and adding missing parts
BradReesWork Jun 16, 2022
dcc3431
Merge pull request #16 from BradReesWork/branch-22.06
rlratzel Jun 16, 2022
66ceb0c
Added initial tests and CLI options for having the handler use a dask…
rlratzel Jun 16, 2022
42b03e1
Merge remote-tracking branch 'upstream/branch-22.08' into branch-22.0…
rlratzel Jun 16, 2022
9779388
uniform neighbor sampling
alexbarghi-nv Jun 17, 2022
51e93c5
Delete .nfs0000000001128f2f00000e4d
alexbarghi-nv Jun 17, 2022
19f0b30
add renumber=True to from_cudf_edgelist call
alexbarghi-nv Jun 21, 2022
61fe30e
Merge branch 'uniform_neighbor_sampling' of https://github.com/alexba…
alexbarghi-nv Jun 21, 2022
7bd0927
graphsage updates
alexbarghi-nv Jun 22, 2022
a999733
Merge remote-tracking branch 'alexbarghi-nv/uniform_neighbor_sampling…
rlratzel Jun 29, 2022
46f08da
Updates to handle closing dask client connection properly, added test…
rlratzel Jun 30, 2022
de4dcec
Removed shape APIs and replaced with info APIs, reordered methods for…
rlratzel Jul 14, 2022
c1d1327
Added code and tests for supporting the new get_graph_info() API and …
rlratzel Jul 16, 2022
f0dcc47
resolve conflict
alexbarghi-nv Jul 19, 2022
76c6087
fix neighbor sampling to work with current api
alexbarghi-nv Jul 19, 2022
21aa53a
Updated graph_info API to use new keys consistent with PG updates.
rlratzel Aug 8, 2022
fc280b3
Updates to accommodate latest PG changes, removed get_num_*() APIs wh…
rlratzel Aug 16, 2022
00712af
Started new test for uniform_neighbor_sampling.
rlratzel Aug 17, 2022
fdd5a05
Merge remote-tracking branch 'alexbarghi-nv/uniform_neighbor_sampling…
rlratzel Aug 17, 2022
94ee72e
Update python/gaas_server/gaas_handler.py
alexbarghi-nv Aug 17, 2022
ea7c307
remove unused imports
alexbarghi-nv Aug 17, 2022
a34c43c
Merge pull request #18 from alexbarghi-nv/uniform_neighbor_sampling
rlratzel Aug 17, 2022
a156199
Updated SG uniform_neighbor_sampling test to add a passing case.
rlratzel Aug 18, 2022
55abf5d
Merge remote-tracking branch 'upstream/branch-22.08' into branch-22.1…
rlratzel Aug 18, 2022
f0700aa
Initial working version of MG support for uniform_neighbor_sampling.
rlratzel Aug 18, 2022
6151b58
Added code to allow the server facade arg to extension functions to b…
rlratzel Aug 19, 2022
99a1370
Removed get_graph_*_dataframe_rows() and replaced them with get_graph…
rlratzel Aug 30, 2022
2570a7d
Moved/renamed files in preparation for migrating to https://github.co…
rlratzel Aug 30, 2022
2485177
Moved helper scripts to new location in preparation for migration to …
rlratzel Aug 30, 2022
ea3b6eb
Deleted unused docs folder, moved images and README.md in preparation…
rlratzel Aug 30, 2022
d8320a4
Removed all instances of "gaas" strings from source code.
rlratzel Aug 30, 2022
853b9d5
Updated tests for new cugraph_service names, all tests pass.
rlratzel Aug 31, 2022
1cf59fa
Remove references to GaaS in docs.
rlratzel Aug 31, 2022
a550054
Updates from review: copyright update, added args to dask shell scrip…
rlratzel Sep 1, 2022
67fcef9
Formatting.
rlratzel Sep 1, 2022
fd4e355
Merge branch 'branch-22.10-mg_updates' into branch-22.10-migrate_to_c…
rlratzel Sep 1, 2022
7b4ca6e
Merge remote-tracking branch 'rlratzel_gaas/branch-22.10-migrate_to_c…
rlratzel Sep 2, 2022
ade0e0c
Changes to address failing flake8 style check.
rlratzel Sep 2, 2022
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
40 changes: 40 additions & 0 deletions python/cugraph_service/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,40 @@
# cugraph_service

## Description
[RAPIDS](https://rapids.ai) cugraph_service provides an RPC interace to a remote [RAPIDS cuGraph](https://github.com/rapidsai/cugraph) session, allowing users to perform GPU accelerated graph analytics from a remote process. cugraph_service uses cuGraph, cuDF, and other libraries on the server to execute graph data prep and analysis on server-side GPUs. Multiple clients can connect to the server allowing different users and processes the ability to access large graph data that may not otherwise be possible using the client resources.

## <div align="center"><img src="img/cugraph_service_pict.png" width="400px"/></div>

-----

## Server
(description)
### Installing `cugraph_service_server` conda package

TBD

### Example
Starting the server
```
$> PYTHONPATH=./python/cugraph_service python -m cugraph_service_server.server
```

## Client
(description)
### Installing the `cugraph_service_client` conda package

TBD

### Example
Creating a client
```
>>> from cugraph_service_client import CugraphServiceClient
>>> client = CugraphServiceClient()
>>> client.load_csv_as_vertex_data(...)
```

------

## <div align="left"><img src="img/rapids_logo.png" width="265px"/></div> Open GPU Data Science

The RAPIDS suite of open source software libraries aims to enable execution of end-to-end data science and analytics pipelines entirely on GPUs. It relies on NVIDIA® CUDA® primitives for low-level compute optimization but exposing that GPU parallelism and high-bandwidth memory speed through user-friendly Python interfaces.
15 changes: 15 additions & 0 deletions python/cugraph_service/cugraph_service_client/__init__.py
Original file line number Diff line number Diff line change
@@ -0,0 +1,15 @@
# Copyright (c) 2022, NVIDIA CORPORATION.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.

from cugraph_service_client.client import CugraphServiceClient
Loading