Test LambdaOp with dask workflows #1634
Conversation
Test out distributed excetion of LambdaOp on dask clusters, and also fix a problem that can occur with the `.label` property on the LambdaOp not working on a dask cluster since the source might not be available
Click to view CI ResultsGitHub pull request #1634 of commit 9bfff5406c45b1f72d2ec0fba9841f3c383e0851, no merge conflicts.
Running as SYSTEM
Setting status of 9bfff5406c45b1f72d2ec0fba9841f3c383e0851 to PENDING with url http://10.20.17.181:8080/job/nvtabular_tests/4606/ and message: 'Build started for merge commit.'
Using context: Jenkins Unit Test Run
Building on master in workspace /var/jenkins_home/workspace/nvtabular_tests
using credential nvidia-merlin-bot
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA-Merlin/NVTabular.git
> git init /var/jenkins_home/workspace/nvtabular_tests/nvtabular # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/NVTabular.git
> git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
> git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/NVTabular.git +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA-Merlin/NVTabular.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA-Merlin/NVTabular.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/NVTabular.git
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
> git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/NVTabular.git +refs/pull/1634/*:refs/remotes/origin/pr/1634/* # timeout=10
> git rev-parse 9bfff5406c45b1f72d2ec0fba9841f3c383e0851^{commit} # timeout=10
Checking out Revision 9bfff5406c45b1f72d2ec0fba9841f3c383e0851 (detached)
> git config core.sparsecheckout # timeout=10
> git checkout -f 9bfff5406c45b1f72d2ec0fba9841f3c383e0851 # timeout=10
Commit message: "Test LambdaOp with dask workflows"
> git rev-list --no-walk 9b58f5f156cb0f52a3bfe0e19bc3f9d564a96101 # timeout=10
[nvtabular_tests] $ /bin/bash /tmp/jenkins2242457525864263473.sh
============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-7.1.2, pluggy-1.0.0
rootdir: /var/jenkins_home/workspace/nvtabular_tests/nvtabular, configfile: pyproject.toml
plugins: anyio-3.6.1, xdist-2.5.0, forked-1.4.0, cov-3.0.0
collected 1432 items
|
Documentation preview |
Test out distributed excetion of LambdaOp on dask clusters, and
also fix a problem that can occur with the
.labelproperty on theLambdaOp not working on a dask cluster since the source might not be
available