Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Merlin offers three containers #1581

Merged
merged 1 commit into from
Jun 14, 2022
Merged

Merlin offers three containers #1581

merged 1 commit into from
Jun 14, 2022

Conversation

mikemckiernan
Copy link
Member

Beginning with the 22.06 release, the Merlin
team provides the following three containers
that are capable of training and inference:

  • merlin-hugectr
  • merlin-tensorflow
  • merlin-pytorch

This is a change from the 22.05 release that
used six containers--one for training and a
separate container for inference.

@review-notebook-app
Copy link

Check out this pull request on  ReviewNB

See visual diffs & provide feedback on Jupyter Notebooks.

Powered by ReviewNB

@mikemckiernan mikemckiernan self-assigned this Jun 13, 2022
@mikemckiernan mikemckiernan added the documentation Improvements or additions to documentation label Jun 13, 2022
@mikemckiernan mikemckiernan added this to the Merlin 22.06 milestone Jun 13, 2022
@mikemckiernan mikemckiernan mentioned this pull request Jun 13, 2022
Closed
@nvidia-merlin-bot
Copy link
Contributor

Click to view CI Results
GitHub pull request #1581 of commit f25ea237753378a70a85f6093495c71224439de1, no merge conflicts.
Running as SYSTEM
Setting status of f25ea237753378a70a85f6093495c71224439de1 to PENDING with url http://10.20.17.181:8080/job/nvtabular_tests/4513/ and message: 'Build started for merge commit.'
Using context: Jenkins Unit Test Run
Building on master in workspace /var/jenkins_home/workspace/nvtabular_tests
using credential nvidia-merlin-bot
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA-Merlin/NVTabular.git
 > git init /var/jenkins_home/workspace/nvtabular_tests/nvtabular # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/NVTabular.git
 > git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/NVTabular.git +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA-Merlin/NVTabular.git # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA-Merlin/NVTabular.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/NVTabular.git
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/NVTabular.git +refs/pull/1581/*:refs/remotes/origin/pr/1581/* # timeout=10
 > git rev-parse f25ea237753378a70a85f6093495c71224439de1^{commit} # timeout=10
Checking out Revision f25ea237753378a70a85f6093495c71224439de1 (detached)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f f25ea237753378a70a85f6093495c71224439de1 # timeout=10
Commit message: "Document the change to three containers"
 > git rev-list --no-walk c86bc729bf4272962c5de7320bcf7ed3efd44c56 # timeout=10
First time build. Skipping changelog.
[nvtabular_tests] $ /bin/bash /tmp/jenkins9006411379447786860.sh
Installing NVTabular
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Requirement already satisfied: pip in /var/jenkins_home/.local/lib/python3.8/site-packages (22.1.2)
Requirement already satisfied: setuptools in /var/jenkins_home/.local/lib/python3.8/site-packages (62.4.0)
Requirement already satisfied: wheel in /var/jenkins_home/.local/lib/python3.8/site-packages (0.37.1)
Requirement already satisfied: pybind11 in /var/jenkins_home/.local/lib/python3.8/site-packages (2.9.2)
Requirement already satisfied: numpy==1.20.3 in /var/jenkins_home/.local/lib/python3.8/site-packages (1.20.3)
Found existing installation: nvtabular 1.1.1
Uninstalling nvtabular-1.1.1:
  Successfully uninstalled nvtabular-1.1.1
Found existing installation: merlin-core 0.3.0+12.g78ecddd
Uninstalling merlin-core-0.3.0+12.g78ecddd:
  Successfully uninstalled merlin-core-0.3.0+12.g78ecddd
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Collecting merlin-core@ git+https://github.com/NVIDIA-Merlin/core.git
  Cloning https://github.com/NVIDIA-Merlin/core.git to /tmp/pip-install-ih8c137k/merlin-core_1a63904271d241bba64883ccc4047417
  Running command git clone --filter=blob:none --quiet https://github.com/NVIDIA-Merlin/core.git /tmp/pip-install-ih8c137k/merlin-core_1a63904271d241bba64883ccc4047417
  Resolved https://github.com/NVIDIA-Merlin/core.git to commit 78ecdddf83735fa3041e0778d6fdac37c3c1dd92
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: finished with status 'done'
  Preparing metadata (pyproject.toml): started
  Preparing metadata (pyproject.toml): finished with status 'done'
Requirement already satisfied: protobuf>=3.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core@ git+https://github.com/NVIDIA-Merlin/core.git) (3.19.4)
Requirement already satisfied: pandas<1.4.0dev0,>=1.2.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core@ git+https://github.com/NVIDIA-Merlin/core.git) (1.3.5)
Requirement already satisfied: tqdm>=4.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core@ git+https://github.com/NVIDIA-Merlin/core.git) (4.64.0)
Requirement already satisfied: packaging in /usr/local/lib/python3.8/dist-packages (from merlin-core@ git+https://github.com/NVIDIA-Merlin/core.git) (21.3)
Requirement already satisfied: distributed>=2021.11.2 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core@ git+https://github.com/NVIDIA-Merlin/core.git) (2021.11.2)
Requirement already satisfied: dask>=2021.11.2 in /usr/local/lib/python3.8/dist-packages (from merlin-core@ git+https://github.com/NVIDIA-Merlin/core.git) (2021.11.2)
Requirement already satisfied: pyarrow>=5.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core@ git+https://github.com/NVIDIA-Merlin/core.git) (6.0.1)
Requirement already satisfied: betterproto<2.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core@ git+https://github.com/NVIDIA-Merlin/core.git) (1.2.5)
Requirement already satisfied: numba>=0.54 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core@ git+https://github.com/NVIDIA-Merlin/core.git) (0.55.1)
Requirement already satisfied: tensorflow-metadata>=1.2.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core@ git+https://github.com/NVIDIA-Merlin/core.git) (1.8.0)
Requirement already satisfied: grpclib in /usr/local/lib/python3.8/dist-packages (from betterproto<2.0.0->merlin-core@ git+https://github.com/NVIDIA-Merlin/core.git) (0.4.2)
Requirement already satisfied: stringcase in /usr/local/lib/python3.8/dist-packages (from betterproto<2.0.0->merlin-core@ git+https://github.com/NVIDIA-Merlin/core.git) (1.2.0)
Requirement already satisfied: pyyaml in /var/jenkins_home/.local/lib/python3.8/site-packages/PyYAML-5.4.1-py3.8-linux-x86_64.egg (from dask>=2021.11.2->merlin-core@ git+https://github.com/NVIDIA-Merlin/core.git) (5.4.1)
Requirement already satisfied: cloudpickle>=1.1.1 in /usr/local/lib/python3.8/dist-packages (from dask>=2021.11.2->merlin-core@ git+https://github.com/NVIDIA-Merlin/core.git) (2.1.0)
Requirement already satisfied: fsspec>=0.6.0 in /usr/local/lib/python3.8/dist-packages (from dask>=2021.11.2->merlin-core@ git+https://github.com/NVIDIA-Merlin/core.git) (2022.5.0)
Requirement already satisfied: partd>=0.3.10 in /var/jenkins_home/.local/lib/python3.8/site-packages/partd-1.2.0-py3.8.egg (from dask>=2021.11.2->merlin-core@ git+https://github.com/NVIDIA-Merlin/core.git) (1.2.0)
Requirement already satisfied: toolz>=0.8.2 in /usr/local/lib/python3.8/dist-packages (from dask>=2021.11.2->merlin-core@ git+https://github.com/NVIDIA-Merlin/core.git) (0.11.2)
Requirement already satisfied: msgpack>=0.6.0 in /usr/local/lib/python3.8/dist-packages (from distributed>=2021.11.2->merlin-core@ git+https://github.com/NVIDIA-Merlin/core.git) (1.0.3)
Requirement already satisfied: psutil>=5.0 in /var/jenkins_home/.local/lib/python3.8/site-packages/psutil-5.8.0-py3.8-linux-x86_64.egg (from distributed>=2021.11.2->merlin-core@ git+https://github.com/NVIDIA-Merlin/core.git) (5.8.0)
Requirement already satisfied: setuptools in /var/jenkins_home/.local/lib/python3.8/site-packages (from distributed>=2021.11.2->merlin-core@ git+https://github.com/NVIDIA-Merlin/core.git) (62.4.0)
Requirement already satisfied: tornado>=6.0.3 in /var/jenkins_home/.local/lib/python3.8/site-packages/tornado-6.1-py3.8-linux-x86_64.egg (from distributed>=2021.11.2->merlin-core@ git+https://github.com/NVIDIA-Merlin/core.git) (6.1)
Requirement already satisfied: zict>=0.1.3 in /var/jenkins_home/.local/lib/python3.8/site-packages/zict-2.0.0-py3.8.egg (from distributed>=2021.11.2->merlin-core@ git+https://github.com/NVIDIA-Merlin/core.git) (2.0.0)
Requirement already satisfied: tblib>=1.6.0 in /var/jenkins_home/.local/lib/python3.8/site-packages/tblib-1.7.0-py3.8.egg (from distributed>=2021.11.2->merlin-core@ git+https://github.com/NVIDIA-Merlin/core.git) (1.7.0)
Requirement already satisfied: click>=6.6 in /usr/local/lib/python3.8/dist-packages (from distributed>=2021.11.2->merlin-core@ git+https://github.com/NVIDIA-Merlin/core.git) (8.0.4)
Requirement already satisfied: jinja2 in /usr/local/lib/python3.8/dist-packages (from distributed>=2021.11.2->merlin-core@ git+https://github.com/NVIDIA-Merlin/core.git) (3.0.3)
Requirement already satisfied: sortedcontainers!=2.0.0,!=2.0.1 in /var/jenkins_home/.local/lib/python3.8/site-packages/sortedcontainers-2.4.0-py3.8.egg (from distributed>=2021.11.2->merlin-core@ git+https://github.com/NVIDIA-Merlin/core.git) (2.4.0)
Requirement already satisfied: llvmlite<0.39,>=0.38.0rc1 in /usr/local/lib/python3.8/dist-packages (from numba>=0.54->merlin-core@ git+https://github.com/NVIDIA-Merlin/core.git) (0.38.1)
Requirement already satisfied: numpy<1.22,>=1.18 in /var/jenkins_home/.local/lib/python3.8/site-packages (from numba>=0.54->merlin-core@ git+https://github.com/NVIDIA-Merlin/core.git) (1.20.3)
Requirement already satisfied: pyparsing!=3.0.5,>=2.0.2 in /usr/local/lib/python3.8/dist-packages (from packaging->merlin-core@ git+https://github.com/NVIDIA-Merlin/core.git) (3.0.9)
Requirement already satisfied: python-dateutil>=2.7.3 in /usr/local/lib/python3.8/dist-packages (from pandas<1.4.0dev0,>=1.2.0->merlin-core@ git+https://github.com/NVIDIA-Merlin/core.git) (2.8.2)
Requirement already satisfied: pytz>=2017.3 in /usr/local/lib/python3.8/dist-packages (from pandas<1.4.0dev0,>=1.2.0->merlin-core@ git+https://github.com/NVIDIA-Merlin/core.git) (2022.1)
Requirement already satisfied: absl-py<2.0.0,>=0.9 in /usr/local/lib/python3.8/dist-packages (from tensorflow-metadata>=1.2.0->merlin-core@ git+https://github.com/NVIDIA-Merlin/core.git) (1.0.0)
Requirement already satisfied: googleapis-common-protos<2,>=1.52.0 in /usr/local/lib/python3.8/dist-packages (from tensorflow-metadata>=1.2.0->merlin-core@ git+https://github.com/NVIDIA-Merlin/core.git) (1.56.1)
Requirement already satisfied: six in /var/jenkins_home/.local/lib/python3.8/site-packages (from absl-py<2.0.0,>=0.9->tensorflow-metadata>=1.2.0->merlin-core@ git+https://github.com/NVIDIA-Merlin/core.git) (1.15.0)
Requirement already satisfied: locket in /var/jenkins_home/.local/lib/python3.8/site-packages/locket-0.2.1-py3.8.egg (from partd>=0.3.10->dask>=2021.11.2->merlin-core@ git+https://github.com/NVIDIA-Merlin/core.git) (0.2.1)
Requirement already satisfied: heapdict in /var/jenkins_home/.local/lib/python3.8/site-packages/HeapDict-1.0.1-py3.8.egg (from zict>=0.1.3->distributed>=2021.11.2->merlin-core@ git+https://github.com/NVIDIA-Merlin/core.git) (1.0.1)
Requirement already satisfied: h2<5,>=3.1.0 in /usr/local/lib/python3.8/dist-packages (from grpclib->betterproto<2.0.0->merlin-core@ git+https://github.com/NVIDIA-Merlin/core.git) (4.1.0)
Requirement already satisfied: multidict in /usr/local/lib/python3.8/dist-packages (from grpclib->betterproto<2.0.0->merlin-core@ git+https://github.com/NVIDIA-Merlin/core.git) (6.0.2)
Requirement already satisfied: MarkupSafe>=2.0 in /usr/local/lib/python3.8/dist-packages (from jinja2->distributed>=2021.11.2->merlin-core@ git+https://github.com/NVIDIA-Merlin/core.git) (2.0.1)
Requirement already satisfied: hpack<5,>=4.0 in /usr/local/lib/python3.8/dist-packages (from h2<5,>=3.1.0->grpclib->betterproto<2.0.0->merlin-core@ git+https://github.com/NVIDIA-Merlin/core.git) (4.0.0)
Requirement already satisfied: hyperframe<7,>=6.0 in /usr/local/lib/python3.8/dist-packages (from h2<5,>=3.1.0->grpclib->betterproto<2.0.0->merlin-core@ git+https://github.com/NVIDIA-Merlin/core.git) (6.0.1)
Building wheels for collected packages: merlin-core
  Building wheel for merlin-core (pyproject.toml): started
  Building wheel for merlin-core (pyproject.toml): finished with status 'done'
  Created wheel for merlin-core: filename=merlin_core-0.3.0+12.g78ecddd-py3-none-any.whl size=109505 sha256=71505da96b058c5f45eec32108e6afa63bc617478e6ed839d903666432f133fe
  Stored in directory: /tmp/pip-ephem-wheel-cache-pj54bhke/wheels/c8/38/16/a6968787eafcec5fa772148af8408b089562f71af0752e8e84
Successfully built merlin-core
Installing collected packages: merlin-core
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
merlin-systems 0.2.0+13.g6bc1347 requires nvtabular>=1.0.0, which is not installed.
Successfully installed merlin-core-0.3.0+12.g78ecddd
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Requirement already satisfied: natsort==8.1.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (8.1.0)
Requirement already satisfied: myst-nb<0.14 in /var/jenkins_home/.local/lib/python3.8/site-packages (0.13.2)
Requirement already satisfied: linkify-it-py<1.1 in /var/jenkins_home/.local/lib/python3.8/site-packages (1.0.3)
Requirement already satisfied: sphinx-external-toc<0.4 in /var/jenkins_home/.local/lib/python3.8/site-packages (0.3.0)
Requirement already satisfied: sphinx-togglebutton~=0.3.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from myst-nb<0.14) (0.3.1)
Requirement already satisfied: ipywidgets<8,>=7.0.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from myst-nb<0.14) (7.7.0)
Requirement already satisfied: myst-parser~=0.15.2 in /var/jenkins_home/.local/lib/python3.8/site-packages (from myst-nb<0.14) (0.15.2)
Requirement already satisfied: sphinx<5,>=3.1 in /usr/local/lib/python3.8/dist-packages (from myst-nb<0.14) (3.5.4)
Requirement already satisfied: ipython in /usr/local/lib/python3.8/dist-packages (from myst-nb<0.14) (8.4.0)
Requirement already satisfied: jupyter-cache~=0.4.1 in /var/jenkins_home/.local/lib/python3.8/site-packages (from myst-nb<0.14) (0.4.3)
Requirement already satisfied: nbconvert<7,>=5.6 in /usr/local/lib/python3.8/dist-packages (from myst-nb<0.14) (6.5.0)
Requirement already satisfied: jupyter-sphinx~=0.3.2 in /var/jenkins_home/.local/lib/python3.8/site-packages (from myst-nb<0.14) (0.3.2)
Requirement already satisfied: pyyaml in /var/jenkins_home/.local/lib/python3.8/site-packages/PyYAML-5.4.1-py3.8-linux-x86_64.egg (from myst-nb<0.14) (5.4.1)
Requirement already satisfied: docutils<0.18,>=0.15 in /usr/local/lib/python3.8/dist-packages (from myst-nb<0.14) (0.16)
Requirement already satisfied: nbformat~=5.0 in /usr/local/lib/python3.8/dist-packages (from myst-nb<0.14) (5.4.0)
Requirement already satisfied: importlib-metadata in /usr/local/lib/python3.8/dist-packages (from myst-nb<0.14) (4.11.4)
Requirement already satisfied: uc-micro-py in /var/jenkins_home/.local/lib/python3.8/site-packages (from linkify-it-py<1.1) (1.0.1)
Requirement already satisfied: click<9,>=7.1 in /usr/local/lib/python3.8/dist-packages (from sphinx-external-toc<0.4) (8.0.4)
Requirement already satisfied: jupyterlab-widgets>=1.0.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from ipywidgets<8,>=7.0.0->myst-nb<0.14) (1.1.0)
Requirement already satisfied: ipykernel>=4.5.1 in /usr/local/lib/python3.8/dist-packages (from ipywidgets<8,>=7.0.0->myst-nb<0.14) (6.13.1)
Requirement already satisfied: ipython-genutils~=0.2.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from ipywidgets<8,>=7.0.0->myst-nb<0.14) (0.2.0)
Requirement already satisfied: widgetsnbextension~=3.6.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from ipywidgets<8,>=7.0.0->myst-nb<0.14) (3.6.0)
Requirement already satisfied: traitlets>=4.3.1 in /usr/local/lib/python3.8/dist-packages (from ipywidgets<8,>=7.0.0->myst-nb<0.14) (5.2.2.post1)
Requirement already satisfied: pickleshare in /usr/local/lib/python3.8/dist-packages (from ipython->myst-nb<0.14) (0.7.5)
Requirement already satisfied: pygments>=2.4.0 in /usr/local/lib/python3.8/dist-packages (from ipython->myst-nb<0.14) (2.12.0)
Requirement already satisfied: pexpect>4.3 in /usr/local/lib/python3.8/dist-packages (from ipython->myst-nb<0.14) (4.8.0)
Requirement already satisfied: stack-data in /usr/local/lib/python3.8/dist-packages (from ipython->myst-nb<0.14) (0.2.0)
Requirement already satisfied: decorator in /usr/local/lib/python3.8/dist-packages (from ipython->myst-nb<0.14) (5.1.1)
Requirement already satisfied: matplotlib-inline in /usr/local/lib/python3.8/dist-packages (from ipython->myst-nb<0.14) (0.1.3)
Requirement already satisfied: prompt-toolkit!=3.0.0,!=3.0.1,<3.1.0,>=2.0.0 in /usr/local/lib/python3.8/dist-packages (from ipython->myst-nb<0.14) (3.0.29)
Requirement already satisfied: backcall in /usr/local/lib/python3.8/dist-packages (from ipython->myst-nb<0.14) (0.2.0)
Requirement already satisfied: jedi>=0.16 in /usr/local/lib/python3.8/dist-packages (from ipython->myst-nb<0.14) (0.18.1)
Requirement already satisfied: setuptools>=18.5 in /var/jenkins_home/.local/lib/python3.8/site-packages (from ipython->myst-nb<0.14) (62.4.0)
Requirement already satisfied: nbclient<0.6,>=0.2 in /var/jenkins_home/.local/lib/python3.8/site-packages (from jupyter-cache~=0.4.1->myst-nb<0.14) (0.5.13)
Requirement already satisfied: attrs in /usr/local/lib/python3.8/dist-packages (from jupyter-cache~=0.4.1->myst-nb<0.14) (21.4.0)
Requirement already satisfied: nbdime in /var/jenkins_home/.local/lib/python3.8/site-packages (from jupyter-cache~=0.4.1->myst-nb<0.14) (3.1.1)
Requirement already satisfied: sqlalchemy<1.5,>=1.3.12 in /var/jenkins_home/.local/lib/python3.8/site-packages (from jupyter-cache~=0.4.1->myst-nb<0.14) (1.4.36)
Requirement already satisfied: jinja2 in /usr/local/lib/python3.8/dist-packages (from myst-parser~=0.15.2->myst-nb<0.14) (3.0.3)
Requirement already satisfied: mdit-py-plugins~=0.2.8 in /var/jenkins_home/.local/lib/python3.8/site-packages (from myst-parser~=0.15.2->myst-nb<0.14) (0.2.8)
Requirement already satisfied: markdown-it-py<2.0.0,>=1.0.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from myst-parser~=0.15.2->myst-nb<0.14) (1.1.0)
Requirement already satisfied: bleach in /usr/local/lib/python3.8/dist-packages (from nbconvert<7,>=5.6->myst-nb<0.14) (5.0.0)
Requirement already satisfied: jupyter-core>=4.7 in /usr/local/lib/python3.8/dist-packages (from nbconvert<7,>=5.6->myst-nb<0.14) (4.10.0)
Requirement already satisfied: mistune<2,>=0.8.1 in /usr/local/lib/python3.8/dist-packages (from nbconvert<7,>=5.6->myst-nb<0.14) (0.8.4)
Requirement already satisfied: entrypoints>=0.2.2 in /usr/local/lib/python3.8/dist-packages (from nbconvert<7,>=5.6->myst-nb<0.14) (0.4)
Requirement already satisfied: pandocfilters>=1.4.1 in /usr/local/lib/python3.8/dist-packages (from nbconvert<7,>=5.6->myst-nb<0.14) (1.5.0)
Requirement already satisfied: defusedxml in /usr/local/lib/python3.8/dist-packages (from nbconvert<7,>=5.6->myst-nb<0.14) (0.7.1)
Requirement already satisfied: tinycss2 in /usr/local/lib/python3.8/dist-packages (from nbconvert<7,>=5.6->myst-nb<0.14) (1.1.1)
Requirement already satisfied: packaging in /usr/local/lib/python3.8/dist-packages (from nbconvert<7,>=5.6->myst-nb<0.14) (21.3)
Requirement already satisfied: MarkupSafe>=2.0 in /usr/local/lib/python3.8/dist-packages (from nbconvert<7,>=5.6->myst-nb<0.14) (2.0.1)
Requirement already satisfied: jupyterlab-pygments in /usr/local/lib/python3.8/dist-packages (from nbconvert<7,>=5.6->myst-nb<0.14) (0.2.2)
Requirement already satisfied: beautifulsoup4 in /var/jenkins_home/.local/lib/python3.8/site-packages/beautifulsoup4-4.9.3-py3.8.egg (from nbconvert<7,>=5.6->myst-nb<0.14) (4.9.3)
Requirement already satisfied: jsonschema>=2.6 in /usr/local/lib/python3.8/dist-packages (from nbformat~=5.0->myst-nb<0.14) (4.6.0)
Requirement already satisfied: fastjsonschema in /usr/local/lib/python3.8/dist-packages (from nbformat~=5.0->myst-nb<0.14) (2.15.3)
Requirement already satisfied: sphinxcontrib-serializinghtml in /usr/local/lib/python3.8/dist-packages (from sphinx<5,>=3.1->myst-nb<0.14) (1.1.5)
Requirement already satisfied: snowballstemmer>=1.1 in /usr/local/lib/python3.8/dist-packages (from sphinx<5,>=3.1->myst-nb<0.14) (2.2.0)
Requirement already satisfied: babel>=1.3 in /usr/local/lib/python3.8/dist-packages (from sphinx<5,>=3.1->myst-nb<0.14) (2.10.1)
Requirement already satisfied: sphinxcontrib-jsmath in /usr/local/lib/python3.8/dist-packages (from sphinx<5,>=3.1->myst-nb<0.14) (1.0.1)
Requirement already satisfied: sphinxcontrib-devhelp in /usr/local/lib/python3.8/dist-packages (from sphinx<5,>=3.1->myst-nb<0.14) (1.0.2)
Requirement already satisfied: imagesize in /usr/local/lib/python3.8/dist-packages (from sphinx<5,>=3.1->myst-nb<0.14) (1.3.0)
Requirement already satisfied: requests>=2.5.0 in /usr/lib/python3/dist-packages (from sphinx<5,>=3.1->myst-nb<0.14) (2.22.0)
Requirement already satisfied: alabaster<0.8,>=0.7 in /usr/local/lib/python3.8/dist-packages (from sphinx<5,>=3.1->myst-nb<0.14) (0.7.12)
Requirement already satisfied: sphinxcontrib-htmlhelp in /usr/local/lib/python3.8/dist-packages (from sphinx<5,>=3.1->myst-nb<0.14) (2.0.0)
Requirement already satisfied: sphinxcontrib-applehelp in /usr/local/lib/python3.8/dist-packages (from sphinx<5,>=3.1->myst-nb<0.14) (1.0.2)
Requirement already satisfied: sphinxcontrib-qthelp in /usr/local/lib/python3.8/dist-packages (from sphinx<5,>=3.1->myst-nb<0.14) (1.0.3)
Requirement already satisfied: wheel in /var/jenkins_home/.local/lib/python3.8/site-packages (from sphinx-togglebutton~=0.3.0->myst-nb<0.14) (0.37.1)
Requirement already satisfied: zipp>=0.5 in /usr/local/lib/python3.8/dist-packages (from importlib-metadata->myst-nb<0.14) (3.8.0)
Requirement already satisfied: pytz>=2015.7 in /usr/local/lib/python3.8/dist-packages (from babel>=1.3->sphinx<5,>=3.1->myst-nb<0.14) (2022.1)
Requirement already satisfied: debugpy>=1.0 in /usr/local/lib/python3.8/dist-packages (from ipykernel>=4.5.1->ipywidgets<8,>=7.0.0->myst-nb<0.14) (1.6.0)
Requirement already satisfied: nest-asyncio in /usr/local/lib/python3.8/dist-packages (from ipykernel>=4.5.1->ipywidgets<8,>=7.0.0->myst-nb<0.14) (1.5.5)
Requirement already satisfied: psutil in /var/jenkins_home/.local/lib/python3.8/site-packages/psutil-5.8.0-py3.8-linux-x86_64.egg (from ipykernel>=4.5.1->ipywidgets<8,>=7.0.0->myst-nb<0.14) (5.8.0)
Requirement already satisfied: jupyter-client>=6.1.12 in /usr/local/lib/python3.8/dist-packages (from ipykernel>=4.5.1->ipywidgets<8,>=7.0.0->myst-nb<0.14) (7.3.4)
Requirement already satisfied: tornado>=6.1 in /var/jenkins_home/.local/lib/python3.8/site-packages/tornado-6.1-py3.8-linux-x86_64.egg (from ipykernel>=4.5.1->ipywidgets<8,>=7.0.0->myst-nb<0.14) (6.1)
Requirement already satisfied: parso<0.9.0,>=0.8.0 in /usr/local/lib/python3.8/dist-packages (from jedi>=0.16->ipython->myst-nb<0.14) (0.8.3)
Requirement already satisfied: importlib-resources>=1.4.0 in /usr/local/lib/python3.8/dist-packages (from jsonschema>=2.6->nbformat~=5.0->myst-nb<0.14) (5.7.1)
Requirement already satisfied: pyrsistent!=0.17.0,!=0.17.1,!=0.17.2,>=0.14.0 in /usr/local/lib/python3.8/dist-packages (from jsonschema>=2.6->nbformat~=5.0->myst-nb<0.14) (0.18.1)
Requirement already satisfied: ptyprocess>=0.5 in /usr/local/lib/python3.8/dist-packages (from pexpect>4.3->ipython->myst-nb<0.14) (0.7.0)
Requirement already satisfied: wcwidth in /usr/local/lib/python3.8/dist-packages (from prompt-toolkit!=3.0.0,!=3.0.1,<3.1.0,>=2.0.0->ipython->myst-nb<0.14) (0.2.5)
Requirement already satisfied: greenlet!=0.4.17 in /usr/local/lib/python3.8/dist-packages (from sqlalchemy<1.5,>=1.3.12->jupyter-cache~=0.4.1->myst-nb<0.14) (1.1.2)
Requirement already satisfied: notebook>=4.4.1 in /var/jenkins_home/.local/lib/python3.8/site-packages (from widgetsnbextension~=3.6.0->ipywidgets<8,>=7.0.0->myst-nb<0.14) (6.4.11)
Requirement already satisfied: soupsieve>1.2 in /var/jenkins_home/.local/lib/python3.8/site-packages/soupsieve-2.2.1-py3.8.egg (from beautifulsoup4->nbconvert<7,>=5.6->myst-nb<0.14) (2.2.1)
Requirement already satisfied: webencodings in /usr/local/lib/python3.8/dist-packages (from bleach->nbconvert<7,>=5.6->myst-nb<0.14) (0.5.1)
Requirement already satisfied: six>=1.9.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from bleach->nbconvert<7,>=5.6->myst-nb<0.14) (1.15.0)
Requirement already satisfied: colorama in /usr/local/lib/python3.8/dist-packages (from nbdime->jupyter-cache~=0.4.1->myst-nb<0.14) (0.4.4)
Requirement already satisfied: jupyter-server-mathjax>=0.2.2 in /var/jenkins_home/.local/lib/python3.8/site-packages (from nbdime->jupyter-cache~=0.4.1->myst-nb<0.14) (0.2.5)
Requirement already satisfied: jupyter-server in /var/jenkins_home/.local/lib/python3.8/site-packages (from nbdime->jupyter-cache~=0.4.1->myst-nb<0.14) (1.17.0)
Requirement already satisfied: GitPython!=2.1.4,!=2.1.5,!=2.1.6 in /usr/local/lib/python3.8/dist-packages (from nbdime->jupyter-cache~=0.4.1->myst-nb<0.14) (3.1.27)
Requirement already satisfied: pyparsing!=3.0.5,>=2.0.2 in /usr/local/lib/python3.8/dist-packages (from packaging->nbconvert<7,>=5.6->myst-nb<0.14) (3.0.9)
Requirement already satisfied: asttokens in /usr/local/lib/python3.8/dist-packages (from stack-data->ipython->myst-nb<0.14) (2.0.5)
Requirement already satisfied: executing in /usr/local/lib/python3.8/dist-packages (from stack-data->ipython->myst-nb<0.14) (0.8.3)
Requirement already satisfied: pure-eval in /usr/local/lib/python3.8/dist-packages (from stack-data->ipython->myst-nb<0.14) (0.2.2)
Requirement already satisfied: gitdb<5,>=4.0.1 in /usr/local/lib/python3.8/dist-packages (from GitPython!=2.1.4,!=2.1.5,!=2.1.6->nbdime->jupyter-cache~=0.4.1->myst-nb<0.14) (4.0.9)
Requirement already satisfied: pyzmq>=23.0 in /usr/local/lib/python3.8/dist-packages (from jupyter-client>=6.1.12->ipykernel>=4.5.1->ipywidgets<8,>=7.0.0->myst-nb<0.14) (23.1.0)
Requirement already satisfied: python-dateutil>=2.8.2 in /usr/local/lib/python3.8/dist-packages (from jupyter-client>=6.1.12->ipykernel>=4.5.1->ipywidgets<8,>=7.0.0->myst-nb<0.14) (2.8.2)
Requirement already satisfied: anyio<4,>=3.1.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from jupyter-server->nbdime->jupyter-cache~=0.4.1->myst-nb<0.14) (3.5.0)
Requirement already satisfied: terminado>=0.8.3 in /var/jenkins_home/.local/lib/python3.8/site-packages (from jupyter-server->nbdime->jupyter-cache~=0.4.1->myst-nb<0.14) (0.13.3)
Requirement already satisfied: Send2Trash in /var/jenkins_home/.local/lib/python3.8/site-packages (from jupyter-server->nbdime->jupyter-cache~=0.4.1->myst-nb<0.14) (1.8.0)
Requirement already satisfied: prometheus-client in /var/jenkins_home/.local/lib/python3.8/site-packages (from jupyter-server->nbdime->jupyter-cache~=0.4.1->myst-nb<0.14) (0.14.1)
Requirement already satisfied: websocket-client in /var/jenkins_home/.local/lib/python3.8/site-packages (from jupyter-server->nbdime->jupyter-cache~=0.4.1->myst-nb<0.14) (1.3.2)
Requirement already satisfied: argon2-cffi in /var/jenkins_home/.local/lib/python3.8/site-packages (from jupyter-server->nbdime->jupyter-cache~=0.4.1->myst-nb<0.14) (21.3.0)
Requirement already satisfied: sniffio>=1.1 in /var/jenkins_home/.local/lib/python3.8/site-packages (from anyio<4,>=3.1.0->jupyter-server->nbdime->jupyter-cache~=0.4.1->myst-nb<0.14) (1.2.0)
Requirement already satisfied: idna>=2.8 in /usr/lib/python3/dist-packages (from anyio<4,>=3.1.0->jupyter-server->nbdime->jupyter-cache~=0.4.1->myst-nb<0.14) (2.8)
Requirement already satisfied: smmap<6,>=3.0.1 in /usr/local/lib/python3.8/dist-packages (from gitdb<5,>=4.0.1->GitPython!=2.1.4,!=2.1.5,!=2.1.6->nbdime->jupyter-cache~=0.4.1->myst-nb<0.14) (5.0.0)
Requirement already satisfied: argon2-cffi-bindings in /var/jenkins_home/.local/lib/python3.8/site-packages (from argon2-cffi->jupyter-server->nbdime->jupyter-cache~=0.4.1->myst-nb<0.14) (21.2.0)
Requirement already satisfied: cffi>=1.0.1 in /usr/local/lib/python3.8/dist-packages (from argon2-cffi-bindings->argon2-cffi->jupyter-server->nbdime->jupyter-cache~=0.4.1->myst-nb<0.14) (1.15.0)
Requirement already satisfied: pycparser in /usr/local/lib/python3.8/dist-packages (from cffi>=1.0.1->argon2-cffi-bindings->argon2-cffi->jupyter-server->nbdime->jupyter-cache~=0.4.1->myst-nb<0.14) (2.21)
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Collecting sphinxcontrib-copydirs@ git+https://github.com/mikemckiernan/sphinxcontrib-copydirs.git
  Cloning https://github.com/mikemckiernan/sphinxcontrib-copydirs.git to /tmp/pip-install-bsfi1tta/sphinxcontrib-copydirs_a8a9248d0114431ab35747a0d924760c
  Running command git clone --filter=blob:none --quiet https://github.com/mikemckiernan/sphinxcontrib-copydirs.git /tmp/pip-install-bsfi1tta/sphinxcontrib-copydirs_a8a9248d0114431ab35747a0d924760c
  Resolved https://github.com/mikemckiernan/sphinxcontrib-copydirs.git to commit bd8c5d79b3f91cf5f1bb0d6995aeca3fe84b670e
  Preparing metadata (setup.py): started
  Preparing metadata (setup.py): finished with status 'done'
Requirement already satisfied: pbr in /usr/local/lib/python3.8/dist-packages (from sphinxcontrib-copydirs@ git+https://github.com/mikemckiernan/sphinxcontrib-copydirs.git) (5.9.0)
running develop
running build_py
creating build
creating build/lib.linux-x86_64-cpython-38
creating build/lib.linux-x86_64-cpython-38/tests
copying tests/conftest.py -> build/lib.linux-x86_64-cpython-38/tests
copying tests/__init__.py -> build/lib.linux-x86_64-cpython-38/tests
creating build/lib.linux-x86_64-cpython-38/nvtabular
copying nvtabular/io.py -> build/lib.linux-x86_64-cpython-38/nvtabular
copying nvtabular/utils.py -> build/lib.linux-x86_64-cpython-38/nvtabular
copying nvtabular/_version.py -> build/lib.linux-x86_64-cpython-38/nvtabular
copying nvtabular/graph.py -> build/lib.linux-x86_64-cpython-38/nvtabular
copying nvtabular/dispatch.py -> build/lib.linux-x86_64-cpython-38/nvtabular
copying nvtabular/worker.py -> build/lib.linux-x86_64-cpython-38/nvtabular
copying nvtabular/__init__.py -> build/lib.linux-x86_64-cpython-38/nvtabular
creating build/lib.linux-x86_64-cpython-38/tests/unit
copying tests/unit/test_triton_inference.py -> build/lib.linux-x86_64-cpython-38/tests/unit
copying tests/unit/test_dask_nvt.py -> build/lib.linux-x86_64-cpython-38/tests/unit
copying tests/unit/test_tf4rec.py -> build/lib.linux-x86_64-cpython-38/tests/unit
copying tests/unit/test_s3.py -> build/lib.linux-x86_64-cpython-38/tests/unit
copying tests/unit/test_notebooks.py -> build/lib.linux-x86_64-cpython-38/tests/unit
copying tests/unit/test_tools.py -> build/lib.linux-x86_64-cpython-38/tests/unit
copying tests/unit/__init__.py -> build/lib.linux-x86_64-cpython-38/tests/unit
creating build/lib.linux-x86_64-cpython-38/nvtabular/loader
copying nvtabular/loader/tensorflow.py -> build/lib.linux-x86_64-cpython-38/nvtabular/loader
copying nvtabular/loader/torch.py -> build/lib.linux-x86_64-cpython-38/nvtabular/loader
copying nvtabular/loader/backend.py -> build/lib.linux-x86_64-cpython-38/nvtabular/loader
copying nvtabular/loader/__init__.py -> build/lib.linux-x86_64-cpython-38/nvtabular/loader
copying nvtabular/loader/tf_utils.py -> build/lib.linux-x86_64-cpython-38/nvtabular/loader
creating build/lib.linux-x86_64-cpython-38/nvtabular/inference
copying nvtabular/inference/__init__.py -> build/lib.linux-x86_64-cpython-38/nvtabular/inference
creating build/lib.linux-x86_64-cpython-38/nvtabular/framework_utils
copying nvtabular/framework_utils/__init__.py -> build/lib.linux-x86_64-cpython-38/nvtabular/framework_utils
creating build/lib.linux-x86_64-cpython-38/nvtabular/tools
copying nvtabular/tools/inspector_script.py -> build/lib.linux-x86_64-cpython-38/nvtabular/tools
copying nvtabular/tools/dataset_inspector.py -> build/lib.linux-x86_64-cpython-38/nvtabular/tools
copying nvtabular/tools/data_gen.py -> build/lib.linux-x86_64-cpython-38/nvtabular/tools
copying nvtabular/tools/__init__.py -> build/lib.linux-x86_64-cpython-38/nvtabular/tools
creating build/lib.linux-x86_64-cpython-38/nvtabular/ops
copying nvtabular/ops/data_stats.py -> build/lib.linux-x86_64-cpython-38/nvtabular/ops
copying nvtabular/ops/stat_operator.py -> build/lib.linux-x86_64-cpython-38/nvtabular/ops
copying nvtabular/ops/clip.py -> build/lib.linux-x86_64-cpython-38/nvtabular/ops
copying nvtabular/ops/groupby.py -> build/lib.linux-x86_64-cpython-38/nvtabular/ops
copying nvtabular/ops/target_encoding.py -> build/lib.linux-x86_64-cpython-38/nvtabular/ops
copying nvtabular/ops/add_metadata.py -> build/lib.linux-x86_64-cpython-38/nvtabular/ops
copying nvtabular/ops/logop.py -> build/lib.linux-x86_64-cpython-38/nvtabular/ops
copying nvtabular/ops/hashed_cross.py -> build/lib.linux-x86_64-cpython-38/nvtabular/ops
copying nvtabular/ops/categorify.py -> build/lib.linux-x86_64-cpython-38/nvtabular/ops
copying nvtabular/ops/rename.py -> build/lib.linux-x86_64-cpython-38/nvtabular/ops
copying nvtabular/ops/drop_low_cardinality.py -> build/lib.linux-x86_64-cpython-38/nvtabular/ops
copying nvtabular/ops/list_slice.py -> build/lib.linux-x86_64-cpython-38/nvtabular/ops
copying nvtabular/ops/hash_bucket.py -> build/lib.linux-x86_64-cpython-38/nvtabular/ops
copying nvtabular/ops/fill.py -> build/lib.linux-x86_64-cpython-38/nvtabular/ops
copying nvtabular/ops/dropna.py -> build/lib.linux-x86_64-cpython-38/nvtabular/ops
copying nvtabular/ops/lambdaop.py -> build/lib.linux-x86_64-cpython-38/nvtabular/ops
copying nvtabular/ops/value_counts.py -> build/lib.linux-x86_64-cpython-38/nvtabular/ops
copying nvtabular/ops/operator.py -> build/lib.linux-x86_64-cpython-38/nvtabular/ops
copying nvtabular/ops/normalize.py -> build/lib.linux-x86_64-cpython-38/nvtabular/ops
copying nvtabular/ops/filter.py -> build/lib.linux-x86_64-cpython-38/nvtabular/ops
copying nvtabular/ops/join_external.py -> build/lib.linux-x86_64-cpython-38/nvtabular/ops
copying nvtabular/ops/join_groupby.py -> build/lib.linux-x86_64-cpython-38/nvtabular/ops
copying nvtabular/ops/moments.py -> build/lib.linux-x86_64-cpython-38/nvtabular/ops
copying nvtabular/ops/reduce_dtype_size.py -> build/lib.linux-x86_64-cpython-38/nvtabular/ops
copying nvtabular/ops/difference_lag.py -> build/lib.linux-x86_64-cpython-38/nvtabular/ops
copying nvtabular/ops/__init__.py -> build/lib.linux-x86_64-cpython-38/nvtabular/ops
copying nvtabular/ops/bucketize.py -> build/lib.linux-x86_64-cpython-38/nvtabular/ops
copying nvtabular/ops/column_similarity.py -> build/lib.linux-x86_64-cpython-38/nvtabular/ops
creating build/lib.linux-x86_64-cpython-38/nvtabular/workflow
copying nvtabular/workflow/node.py -> build/lib.linux-x86_64-cpython-38/nvtabular/workflow
copying nvtabular/workflow/workflow.py -> build/lib.linux-x86_64-cpython-38/nvtabular/workflow
copying nvtabular/workflow/__init__.py -> build/lib.linux-x86_64-cpython-38/nvtabular/workflow
creating build/lib.linux-x86_64-cpython-38/nvtabular/inference/triton
copying nvtabular/inference/triton/benchmarking_tools.py -> build/lib.linux-x86_64-cpython-38/nvtabular/inference/triton
copying nvtabular/inference/triton/workflow_model.py -> build/lib.linux-x86_64-cpython-38/nvtabular/inference/triton
copying nvtabular/inference/triton/ensemble.py -> build/lib.linux-x86_64-cpython-38/nvtabular/inference/triton
copying nvtabular/inference/triton/data_conversions.py -> build/lib.linux-x86_64-cpython-38/nvtabular/inference/triton
copying nvtabular/inference/triton/__init__.py -> build/lib.linux-x86_64-cpython-38/nvtabular/inference/triton
creating build/lib.linux-x86_64-cpython-38/nvtabular/inference/workflow
copying nvtabular/inference/workflow/tensorflow.py -> build/lib.linux-x86_64-cpython-38/nvtabular/inference/workflow
copying nvtabular/inference/workflow/base.py -> build/lib.linux-x86_64-cpython-38/nvtabular/inference/workflow
copying nvtabular/inference/workflow/hugectr.py -> build/lib.linux-x86_64-cpython-38/nvtabular/inference/workflow
copying nvtabular/inference/workflow/pytorch.py -> build/lib.linux-x86_64-cpython-38/nvtabular/inference/workflow
copying nvtabular/inference/workflow/__init__.py -> build/lib.linux-x86_64-cpython-38/nvtabular/inference/workflow
creating build/lib.linux-x86_64-cpython-38/nvtabular/inference/triton/model
copying nvtabular/inference/triton/model/model_pt.py -> build/lib.linux-x86_64-cpython-38/nvtabular/inference/triton/model
copying nvtabular/inference/triton/model/__init__.py -> build/lib.linux-x86_64-cpython-38/nvtabular/inference/triton/model
creating build/lib.linux-x86_64-cpython-38/nvtabular/framework_utils/tensorflow
copying nvtabular/framework_utils/tensorflow/feature_column_utils.py -> build/lib.linux-x86_64-cpython-38/nvtabular/framework_utils/tensorflow
copying nvtabular/framework_utils/tensorflow/tfrecords_to_parquet.py -> build/lib.linux-x86_64-cpython-38/nvtabular/framework_utils/tensorflow
copying nvtabular/framework_utils/tensorflow/__init__.py -> build/lib.linux-x86_64-cpython-38/nvtabular/framework_utils/tensorflow
creating build/lib.linux-x86_64-cpython-38/nvtabular/framework_utils/torch
copying nvtabular/framework_utils/torch/utils.py -> build/lib.linux-x86_64-cpython-38/nvtabular/framework_utils/torch
copying nvtabular/framework_utils/torch/models.py -> build/lib.linux-x86_64-cpython-38/nvtabular/framework_utils/torch
copying nvtabular/framework_utils/torch/__init__.py -> build/lib.linux-x86_64-cpython-38/nvtabular/framework_utils/torch
creating build/lib.linux-x86_64-cpython-38/nvtabular/framework_utils/tensorflow/layers
copying nvtabular/framework_utils/tensorflow/layers/outer_product.py -> build/lib.linux-x86_64-cpython-38/nvtabular/framework_utils/tensorflow/layers
copying nvtabular/framework_utils/tensorflow/layers/embedding.py -> build/lib.linux-x86_64-cpython-38/nvtabular/framework_utils/tensorflow/layers
copying nvtabular/framework_utils/tensorflow/layers/interaction.py -> build/lib.linux-x86_64-cpython-38/nvtabular/framework_utils/tensorflow/layers
copying nvtabular/framework_utils/tensorflow/layers/__init__.py -> build/lib.linux-x86_64-cpython-38/nvtabular/framework_utils/tensorflow/layers
creating build/lib.linux-x86_64-cpython-38/nvtabular/framework_utils/torch/layers
copying nvtabular/framework_utils/torch/layers/embeddings.py -> build/lib.linux-x86_64-cpython-38/nvtabular/framework_utils/torch/layers
copying nvtabular/framework_utils/torch/layers/__init__.py -> build/lib.linux-x86_64-cpython-38/nvtabular/framework_utils/torch/layers
/var/jenkins_home/.local/lib/python3.8/site-packages/setuptools/command/easy_install.py:144: EasyInstallDeprecationWarning: easy_install command is deprecated. Use build and pip and other standards-based tools.
  warnings.warn(
/var/jenkins_home/.local/lib/python3.8/site-packages/setuptools/command/install.py:34: SetuptoolsDeprecationWarning: setup.py install is deprecated. Use build and pip and other standards-based tools.
  warnings.warn(
package init file 'ci/__init__.py' not found (or not a regular file)
package init file 'images/__init__.py' not found (or not a regular file)
package init file 'docs/__init__.py' not found (or not a regular file)
package init file 'cpp/__init__.py' not found (or not a regular file)
package init file 'bench/__init__.py' not found (or not a regular file)
creating build/lib.linux-x86_64-cpython-38/bench
copying bench/test_notebooks.py -> build/lib.linux-x86_64-cpython-38/bench
package init file 'merlin/__init__.py' not found (or not a regular file)
package init file 'examples/__init__.py' not found (or not a regular file)
package init file 'conda/__init__.py' not found (or not a regular file)
package init file 'docs/source/__init__.py' not found (or not a regular file)
creating build/lib.linux-x86_64-cpython-38/docs
creating build/lib.linux-x86_64-cpython-38/docs/source
copying docs/source/conf.py -> build/lib.linux-x86_64-cpython-38/docs/source
package init file 'docs/source/_templates/__init__.py' not found (or not a regular file)
package init file 'docs/source/images/__init__.py' not found (or not a regular file)
package init file 'docs/source/training/__init__.py' not found (or not a regular file)
package init file 'docs/source/resources/__init__.py' not found (or not a regular file)
package init file 'cpp/nvtabular/__init__.py' not found (or not a regular file)
package init file 'cpp/nvtabular/inference/__init__.py' not found (or not a regular file)
package init file 'bench/datasets/__init__.py' not found (or not a regular file)
creating build/lib.linux-x86_64-cpython-38/bench/datasets
copying bench/datasets/test_dataset.py -> build/lib.linux-x86_64-cpython-38/bench/datasets
package init file 'bench/torch/__init__.py' not found (or not a regular file)
package init file 'bench/examples/__init__.py' not found (or not a regular file)
creating build/lib.linux-x86_64-cpython-38/bench/examples
copying bench/examples/dask-nvtabular-criteo-benchmark.py -> build/lib.linux-x86_64-cpython-38/bench/examples
copying bench/examples/dataloader_bench.py -> build/lib.linux-x86_64-cpython-38/bench/examples
package init file 'bench/datasets/configs/__init__.py' not found (or not a regular file)
package init file 'bench/datasets/tools/__init__.py' not found (or not a regular file)
creating build/lib.linux-x86_64-cpython-38/bench/datasets/tools
copying bench/datasets/tools/train_hugectr.py -> build/lib.linux-x86_64-cpython-38/bench/datasets/tools
copying bench/datasets/tools/train_pytorch.py -> build/lib.linux-x86_64-cpython-38/bench/datasets/tools
copying bench/datasets/tools/nvt_etl.py -> build/lib.linux-x86_64-cpython-38/bench/datasets/tools
copying bench/datasets/tools/train_tensorflow.py -> build/lib.linux-x86_64-cpython-38/bench/datasets/tools
package init file 'bench/torch/criteo/__init__.py' not found (or not a regular file)
creating build/lib.linux-x86_64-cpython-38/merlin
creating build/lib.linux-x86_64-cpython-38/merlin/transforms
copying merlin/transforms/__init__.py -> build/lib.linux-x86_64-cpython-38/merlin/transforms
creating build/lib.linux-x86_64-cpython-38/merlin/transforms/ops
copying merlin/transforms/ops/__init__.py -> build/lib.linux-x86_64-cpython-38/merlin/transforms/ops
package init file 'examples/tensorflow/__init__.py' not found (or not a regular file)
creating build/lib.linux-x86_64-cpython-38/examples
creating build/lib.linux-x86_64-cpython-38/examples/tensorflow
copying examples/tensorflow/callbacks.py -> build/lib.linux-x86_64-cpython-38/examples/tensorflow
package init file 'examples/getting-started-movielens/__init__.py' not found (or not a regular file)
package init file 'examples/multi-gpu-toy-example/__init__.py' not found (or not a regular file)
package init file 'examples/tabular-data-rossmann/__init__.py' not found (or not a regular file)
package init file 'examples/advanced-ops-outbrain/__init__.py' not found (or not a regular file)
package init file 'examples/multi-gpu-movielens/__init__.py' not found (or not a regular file)
creating build/lib.linux-x86_64-cpython-38/examples/multi-gpu-movielens
copying examples/multi-gpu-movielens/tf_trainer.py -> build/lib.linux-x86_64-cpython-38/examples/multi-gpu-movielens
copying examples/multi-gpu-movielens/torch_trainer_dist.py -> build/lib.linux-x86_64-cpython-38/examples/multi-gpu-movielens
package init file 'examples/scaling-criteo/__init__.py' not found (or not a regular file)
package init file 'examples/winning-solution-recsys2020-twitter/__init__.py' not found (or not a regular file)
package init file 'examples/tensorflow/docker/__init__.py' not found (or not a regular file)
package init file 'examples/tensorflow/imgs/__init__.py' not found (or not a regular file)
package init file 'examples/getting-started-movielens/imgs/__init__.py' not found (or not a regular file)
package init file 'examples/scaling-criteo/imgs/__init__.py' not found (or not a regular file)
package init file 'tests/integration/__init__.py' not found (or not a regular file)
creating build/lib.linux-x86_64-cpython-38/tests/integration
copying tests/integration/test_nvt_tf_inference.py -> build/lib.linux-x86_64-cpython-38/tests/integration
copying tests/integration/test_inf_notebooks.py -> build/lib.linux-x86_64-cpython-38/tests/integration
copying tests/integration/test_notebooks.py -> build/lib.linux-x86_64-cpython-38/tests/integration
copying tests/integration/test_nvt_hugectr.py -> build/lib.linux-x86_64-cpython-38/tests/integration
package init file 'tests/integration/common/__init__.py' not found (or not a regular file)
creating build/lib.linux-x86_64-cpython-38/tests/integration/common
copying tests/integration/common/utils.py -> build/lib.linux-x86_64-cpython-38/tests/integration/common
package init file 'tests/integration/common/parsers/__init__.py' not found (or not a regular file)
creating build/lib.linux-x86_64-cpython-38/tests/integration/common/parsers
copying tests/integration/common/parsers/benchmark_parsers.py -> build/lib.linux-x86_64-cpython-38/tests/integration/common/parsers
copying tests/integration/common/parsers/rossmann_parsers.py -> build/lib.linux-x86_64-cpython-38/tests/integration/common/parsers
copying tests/integration/common/parsers/criteo_parsers.py -> build/lib.linux-x86_64-cpython-38/tests/integration/common/parsers
package init file 'tests/unit/loader/__init__.py' not found (or not a regular file)
creating build/lib.linux-x86_64-cpython-38/tests/unit/loader
copying tests/unit/loader/test_dataloader_backend.py -> build/lib.linux-x86_64-cpython-38/tests/unit/loader
copying tests/unit/loader/test_tf_dataloader.py -> build/lib.linux-x86_64-cpython-38/tests/unit/loader
copying tests/unit/loader/test_torch_dataloader.py -> build/lib.linux-x86_64-cpython-38/tests/unit/loader
package init file 'tests/unit/framework_utils/__init__.py' not found (or not a regular file)
creating build/lib.linux-x86_64-cpython-38/tests/unit/framework_utils
copying tests/unit/framework_utils/test_tf_feature_columns.py -> build/lib.linux-x86_64-cpython-38/tests/unit/framework_utils
copying tests/unit/framework_utils/test_tf_layers.py -> build/lib.linux-x86_64-cpython-38/tests/unit/framework_utils
copying tests/unit/framework_utils/test_torch_layers.py -> build/lib.linux-x86_64-cpython-38/tests/unit/framework_utils
package init file 'tests/unit/ops/__init__.py' not found (or not a regular file)
creating build/lib.linux-x86_64-cpython-38/tests/unit/ops
copying tests/unit/ops/test_reduce_dtype_size.py -> build/lib.linux-x86_64-cpython-38/tests/unit/ops
copying tests/unit/ops/test_fill.py -> build/lib.linux-x86_64-cpython-38/tests/unit/ops
copying tests/unit/ops/test_lambda.py -> build/lib.linux-x86_64-cpython-38/tests/unit/ops
copying tests/unit/ops/test_categorify.py -> build/lib.linux-x86_64-cpython-38/tests/unit/ops
copying tests/unit/ops/test_ops_schema.py -> build/lib.linux-x86_64-cpython-38/tests/unit/ops
copying tests/unit/ops/test_drop_low_cardinality.py -> build/lib.linux-x86_64-cpython-38/tests/unit/ops
copying tests/unit/ops/test_target_encode.py -> build/lib.linux-x86_64-cpython-38/tests/unit/ops
copying tests/unit/ops/test_groupyby.py -> build/lib.linux-x86_64-cpython-38/tests/unit/ops
copying tests/unit/ops/test_column_similarity.py -> build/lib.linux-x86_64-cpython-38/tests/unit/ops
copying tests/unit/ops/test_join.py -> build/lib.linux-x86_64-cpython-38/tests/unit/ops
copying tests/unit/ops/test_normalize.py -> build/lib.linux-x86_64-cpython-38/tests/unit/ops
copying tests/unit/ops/test_hash_bucket.py -> build/lib.linux-x86_64-cpython-38/tests/unit/ops
copying tests/unit/ops/test_ops.py -> build/lib.linux-x86_64-cpython-38/tests/unit/ops
package init file 'tests/unit/workflow/__init__.py' not found (or not a regular file)
creating build/lib.linux-x86_64-cpython-38/tests/unit/workflow
copying tests/unit/workflow/test_workflow_ops.py -> build/lib.linux-x86_64-cpython-38/tests/unit/workflow
copying tests/unit/workflow/test_cpu_workflow.py -> build/lib.linux-x86_64-cpython-38/tests/unit/workflow
copying tests/unit/workflow/test_workflow_schemas.py -> build/lib.linux-x86_64-cpython-38/tests/unit/workflow
copying tests/unit/workflow/test_workflow.py -> build/lib.linux-x86_64-cpython-38/tests/unit/workflow
copying tests/unit/workflow/test_workflow_node.py -> build/lib.linux-x86_64-cpython-38/tests/unit/workflow
copying tests/unit/workflow/test_workflow_chaining.py -> build/lib.linux-x86_64-cpython-38/tests/unit/workflow
package init file 'conda/environments/__init__.py' not found (or not a regular file)
package init file 'conda/recipes/__init__.py' not found (or not a regular file)
UPDATING build/lib.linux-x86_64-cpython-38/nvtabular/_version.py
set build/lib.linux-x86_64-cpython-38/nvtabular/_version.py to '1.1.1+16.gf25ea2377'
running egg_info
creating nvtabular.egg-info
writing nvtabular.egg-info/PKG-INFO
writing dependency_links to nvtabular.egg-info/dependency_links.txt
writing requirements to nvtabular.egg-info/requires.txt
writing top-level names to nvtabular.egg-info/top_level.txt
writing manifest file 'nvtabular.egg-info/SOURCES.txt'
reading manifest template 'MANIFEST.in'
warning: no files found matching '*.proto' under directory 'nvtabular'
warning: no files found matching '*.h' under directory 'cpp'
warning: no files found matching '*.cu' under directory 'cpp'
warning: no files found matching '*.cuh' under directory 'cpp'
adding license file 'LICENSE'
writing manifest file 'nvtabular.egg-info/SOURCES.txt'
running build_ext
x86_64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -I/usr/include/python3.8 -c flagcheck.cpp -o flagcheck.o -std=c++17
building 'nvtabular_cpp' extension
creating build/temp.linux-x86_64-cpython-38
creating build/temp.linux-x86_64-cpython-38/cpp
creating build/temp.linux-x86_64-cpython-38/cpp/nvtabular
creating build/temp.linux-x86_64-cpython-38/cpp/nvtabular/inference
x86_64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -DVERSION_INFO=1.1.1+16.gf25ea2377 -I./cpp/ -I/var/jenkins_home/.local/lib/python3.8/site-packages/pybind11/include -I/usr/include/python3.8 -c cpp/nvtabular/__init__.cc -o build/temp.linux-x86_64-cpython-38/cpp/nvtabular/__init__.o -std=c++17 -fvisibility=hidden -g0
x86_64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -DVERSION_INFO=1.1.1+16.gf25ea2377 -I./cpp/ -I/var/jenkins_home/.local/lib/python3.8/site-packages/pybind11/include -I/usr/include/python3.8 -c cpp/nvtabular/inference/__init__.cc -o build/temp.linux-x86_64-cpython-38/cpp/nvtabular/inference/__init__.o -std=c++17 -fvisibility=hidden -g0
x86_64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -DVERSION_INFO=1.1.1+16.gf25ea2377 -I./cpp/ -I/var/jenkins_home/.local/lib/python3.8/site-packages/pybind11/include -I/usr/include/python3.8 -c cpp/nvtabular/inference/categorify.cc -o build/temp.linux-x86_64-cpython-38/cpp/nvtabular/inference/categorify.o -std=c++17 -fvisibility=hidden -g0
x86_64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -DVERSION_INFO=1.1.1+16.gf25ea2377 -I./cpp/ -I/var/jenkins_home/.local/lib/python3.8/site-packages/pybind11/include -I/usr/include/python3.8 -c cpp/nvtabular/inference/fill.cc -o build/temp.linux-x86_64-cpython-38/cpp/nvtabular/inference/fill.o -std=c++17 -fvisibility=hidden -g0
x86_64-linux-gnu-g++ -pthread -shared -Wl,-O1 -Wl,-Bsymbolic-functions -Wl,-Bsymbolic-functions -Wl,-z,relro -g -fwrapv -O2 build/temp.linux-x86_64-cpython-38/cpp/nvtabular/__init__.o build/temp.linux-x86_64-cpython-38/cpp/nvtabular/inference/__init__.o build/temp.linux-x86_64-cpython-38/cpp/nvtabular/inference/categorify.o build/temp.linux-x86_64-cpython-38/cpp/nvtabular/inference/fill.o -L/usr/lib -o build/lib.linux-x86_64-cpython-38/nvtabular_cpp.cpython-38-x86_64-linux-gnu.so
copying build/lib.linux-x86_64-cpython-38/nvtabular_cpp.cpython-38-x86_64-linux-gnu.so -> 
Creating /var/jenkins_home/.local/lib/python3.8/site-packages/nvtabular.egg-link (link to .)
nvtabular 1.1.1+16.gf25ea2377 is already the active version in easy-install.pth

Installed /var/jenkins_home/workspace/nvtabular_tests/nvtabular

Running black --check

All done! ✨ 🍰 ✨

131 files would be left unchanged.

Running flake8

Running isort

Skipped 1 files

Running bandit

Running pylint




Your code has been rated at 10.00/10 (previous run: 10.00/10, +0.00)


Running flake8-nb

Building docs

make: Entering directory '/var/jenkins_home/workspace/nvtabular_tests/nvtabular/docs'

INFO:sphinxcontrib.copydirs.copydirs:Copying source documentation from: /var/jenkins_home/workspace/nvtabular_tests/nvtabular/examples

INFO:sphinxcontrib.copydirs.copydirs:  ...to destination: /var/jenkins_home/workspace/nvtabular_tests/nvtabular/docs/source/examples

INFO:numba.cuda.cudadrv.driver:init

INFO:traitlets:Writing 14816 bytes to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/docs/build/jupyter_execute/examples/advanced-ops-outbrain/01-Download-Convert.ipynb

INFO:traitlets:Support files will be in

INFO:traitlets:Making directory /var/jenkins_home/workspace/nvtabular_tests/nvtabular/docs/build/jupyter_execute/examples/advanced-ops-outbrain

INFO:traitlets:Writing 35171 bytes to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/docs/build/jupyter_execute/examples/advanced-ops-outbrain/02-ETL-with-NVTabular.ipynb

INFO:traitlets:Writing 19347 bytes to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/docs/build/jupyter_execute/examples/advanced-ops-outbrain/03-Training-with-TF.ipynb

INFO:traitlets:Writing 14170 bytes to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/docs/build/jupyter_execute/examples/getting-started-movielens/01-Download-Convert.ipynb

INFO:traitlets:Support files will be in

INFO:traitlets:Making directory /var/jenkins_home/workspace/nvtabular_tests/nvtabular/docs/build/jupyter_execute/examples/getting-started-movielens

INFO:traitlets:Making directory /var/jenkins_home/workspace/nvtabular_tests/nvtabular/docs/build/jupyter_execute/examples/getting-started-movielens

INFO:traitlets:Writing 36830 bytes to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/docs/build/jupyter_execute/examples/getting-started-movielens/02-ETL-with-NVTabular.ipynb

INFO:traitlets:Writing 28932 bytes to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/docs/build/jupyter_execute/examples/getting-started-movielens/03-Training-with-HugeCTR.ipynb

INFO:traitlets:Writing 20504 bytes to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/docs/build/jupyter_execute/examples/getting-started-movielens/03-Training-with-PyTorch.ipynb

INFO:traitlets:Support files will be in

INFO:traitlets:Making directory /var/jenkins_home/workspace/nvtabular_tests/nvtabular/docs/build/jupyter_execute/examples/getting-started-movielens

INFO:traitlets:Writing 61676 bytes to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/docs/build/jupyter_execute/examples/getting-started-movielens/03-Training-with-TF.ipynb

INFO:traitlets:Writing 18762 bytes to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/docs/build/jupyter_execute/examples/getting-started-movielens/04-Triton-Inference-with-HugeCTR.ipynb

INFO:traitlets:Writing 21822 bytes to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/docs/build/jupyter_execute/examples/getting-started-movielens/04-Triton-Inference-with-TF.ipynb

INFO:traitlets:Writing 43655 bytes to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/docs/build/jupyter_execute/examples/multi-gpu-movielens/01-03-MultiGPU-Download-Convert-ETL-with-NVTabular-Training-with-TensorFlow.ipynb

INFO:traitlets:Writing 44549 bytes to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/docs/build/jupyter_execute/examples/multi-gpu-toy-example/multi-gpu_dask.ipynb

INFO:traitlets:Writing 9604 bytes to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/docs/build/jupyter_execute/examples/scaling-criteo/01-Download-Convert.ipynb

INFO:traitlets:Writing 21552 bytes to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/docs/build/jupyter_execute/examples/scaling-criteo/02-ETL-with-NVTabular.ipynb

INFO:traitlets:Writing 12041 bytes to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/docs/build/jupyter_execute/examples/scaling-criteo/03-Training-with-FastAI.ipynb

INFO:traitlets:Writing 20792 bytes to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/docs/build/jupyter_execute/examples/scaling-criteo/03-Training-with-HugeCTR.ipynb

INFO:traitlets:Support files will be in

INFO:traitlets:Making directory /var/jenkins_home/workspace/nvtabular_tests/nvtabular/docs/build/jupyter_execute/examples/scaling-criteo

INFO:traitlets:Writing 203961 bytes to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/docs/build/jupyter_execute/examples/scaling-criteo/03-Training-with-TF.ipynb

INFO:traitlets:Writing 32956 bytes to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/docs/build/jupyter_execute/examples/scaling-criteo/04-Triton-Inference-with-HugeCTR.ipynb

INFO:traitlets:Writing 25153 bytes to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/docs/build/jupyter_execute/examples/scaling-criteo/04-Triton-Inference-with-TF.ipynb

INFO:traitlets:Writing 23938 bytes to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/docs/build/jupyter_execute/examples/tabular-data-rossmann/01-Download-Convert.ipynb

INFO:traitlets:Support files will be in

INFO:traitlets:Making directory /var/jenkins_home/workspace/nvtabular_tests/nvtabular/docs/build/jupyter_execute/examples/tabular-data-rossmann

INFO:traitlets:Making directory /var/jenkins_home/workspace/nvtabular_tests/nvtabular/docs/build/jupyter_execute/examples/tabular-data-rossmann

INFO:traitlets:Making directory /var/jenkins_home/workspace/nvtabular_tests/nvtabular/docs/build/jupyter_execute/examples/tabular-data-rossmann

INFO:traitlets:Making directory /var/jenkins_home/workspace/nvtabular_tests/nvtabular/docs/build/jupyter_execute/examples/tabular-data-rossmann

INFO:traitlets:Writing 33764 bytes to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/docs/build/jupyter_execute/examples/tabular-data-rossmann/02-ETL-with-NVTabular.ipynb

INFO:traitlets:Writing 19635 bytes to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/docs/build/jupyter_execute/examples/tabular-data-rossmann/03-Training-with-FastAI.ipynb

INFO:traitlets:Writing 17586 bytes to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/docs/build/jupyter_execute/examples/tabular-data-rossmann/03-Training-with-PyTorch.ipynb

INFO:traitlets:Writing 21354 bytes to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/docs/build/jupyter_execute/examples/tabular-data-rossmann/03-Training-with-TF.ipynb

INFO:traitlets:Support files will be in

INFO:traitlets:Making directory /var/jenkins_home/workspace/nvtabular_tests/nvtabular/docs/build/jupyter_execute/examples/winning-solution-recsys2020-twitter

INFO:traitlets:Making directory /var/jenkins_home/workspace/nvtabular_tests/nvtabular/docs/build/jupyter_execute/examples/winning-solution-recsys2020-twitter

INFO:traitlets:Writing 77074 bytes to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/docs/build/jupyter_execute/examples/winning-solution-recsys2020-twitter/01-02-04-Download-Convert-ETL-with-NVTabular-Training-with-XGBoost.ipynb

make: Leaving directory '/var/jenkins_home/workspace/nvtabular_tests/nvtabular/docs'

============================= test session starts ==============================

platform linux -- Python 3.8.10, pytest-7.1.2, pluggy-1.0.0

rootdir: /var/jenkins_home/workspace/nvtabular_tests/nvtabular, configfile: pyproject.toml

plugins: anyio-3.5.0, xdist-2.5.0, forked-1.4.0, cov-3.0.0

collected 1420 items / 1 skipped


tests/unit/test_dask_nvt.py ............................................ [  3%]

........................................................................ [  8%]

[  8%]

tests/unit/test_notebooks.py F


=================================== FAILURES ===================================

___________________________ test_criteo_tf_notebook ____________________________


tmpdir = local('/tmp/pytest-of-jenkins/pytest-15/test_criteo_tf_notebook0')


def test_criteo_tf_notebook(tmpdir):
    tor = pytest.importorskip("tensorflow")  # noqa
    # create a toy dataset in tmpdir, and point environment variables so the notebook
    # will read from it
    os.system("mkdir -p " + os.path.join(tmpdir, "converted/criteo"))
    for i in range(24):
        df = _get_random_criteo_data(1000)
        df.to_parquet(os.path.join(tmpdir, "converted/criteo", f"day_{i}.parquet"))
    os.environ["BASE_DIR"] = str(tmpdir)

    def _nb_modify(line):
        # Disable LocalCUDACluster
        line = line.replace("client.run(_rmm_pool)", "# client.run(_rmm_pool)")
        line = line.replace("if cluster is None:", "if False:")
        line = line.replace("client = Client(cluster)", "# client = Client(cluster)")
        line = line.replace(
            "workflow = nvt.Workflow(features, client=client)", "workflow = nvt.Workflow(features)"
        )
        line = line.replace("client", "# client")
        line = line.replace("NUM_GPUS = [0, 1, 2, 3, 4, 5, 6, 7]", "NUM_GPUS = [0]")
        line = line.replace("part_size = int(part_mem_frac * device_size)", "part_size = '128MB'")

        return line

    _run_notebook(
        tmpdir,
        os.path.join(
            dirname(TEST_PATH),
            "examples/scaling-criteo/",
            "02-ETL-with-NVTabular.ipynb",
        ),
        # disable rmm.reinitialize, seems to be causing issues
        transform=_nb_modify,
    )

    def _modify_tf_nb(line):
        return line.replace(
            # don't require grqphviz/pydot
            "tf.keras.utils.plot_model(model)",
            "# tf.keras.utils.plot_model(model)",
        )





  _run_notebook(





        tmpdir,
        os.path.join(
            dirname(TEST_PATH),
            "examples/scaling-criteo/",
            "03-Training-with-TF.ipynb",
        ),
        transform=_modify_tf_nb,
    )



tests/unit/test_notebooks.py:80:




tests/unit/test_notebooks.py:307: in _run_notebook

subprocess.check_output([sys.executable, script_path])

/usr/lib/python3.8/subprocess.py:415: in check_output

return run(*popenargs, stdout=PIPE, timeout=timeout, check=True,




input = None, capture_output = False, timeout = None, check = True

popenargs = (['/usr/bin/python3', '/tmp/pytest-of-jenkins/pytest-15/test_criteo_tf_notebook0/notebook.py'],)

kwargs = {'stdout': -1}, process = <subprocess.Popen object at 0x7f6ad8011cd0>

stdout = b"\r1/1 [==============================] - ETA: 0s - loss: 0.6936\x08\x08\x08\x08\x08\x08\x08\x08\x08\x08\x08\x08\x08....6936\n{'val_loss': 0.68990076}\nrun_time: 2.8489692211151123  - rows:  78 - epochs: 1 - dl_thru: 27.378323156987317\n"

stderr = None, retcode = 1


def run(*popenargs,
        input=None, capture_output=False, timeout=None, check=False, **kwargs):
    """Run command with arguments and return a CompletedProcess instance.

    The returned instance will have attributes args, returncode, stdout and
    stderr. By default, stdout and stderr are not captured, and those attributes
    will be None. Pass stdout=PIPE and/or stderr=PIPE in order to capture them.

    If check is True and the exit code was non-zero, it raises a
    CalledProcessError. The CalledProcessError object will have the return code
    in the returncode attribute, and output & stderr attributes if those streams
    were captured.

    If timeout is given, and the process takes too long, a TimeoutExpired
    exception will be raised.

    There is an optional argument "input", allowing you to
    pass bytes or a string to the subprocess's stdin.  If you use this argument
    you may not also use the Popen constructor's "stdin" argument, as
    it will be used internally.

    By default, all communication is in bytes, and therefore any "input" should
    be bytes, and the stdout and stderr will be bytes. If in text mode, any
    "input" should be a string, and stdout and stderr will be strings decoded
    according to locale encoding, or by "encoding" if set. Text mode is
    triggered by setting any of text, encoding, errors or universal_newlines.

    The other arguments are the same as for the Popen constructor.
    """
    if input is not None:
        if kwargs.get('stdin') is not None:
            raise ValueError('stdin and input arguments may not both be used.')
        kwargs['stdin'] = PIPE

    if capture_output:
        if kwargs.get('stdout') is not None or kwargs.get('stderr') is not None:
            raise ValueError('stdout and stderr arguments may not be used '
                             'with capture_output.')
        kwargs['stdout'] = PIPE
        kwargs['stderr'] = PIPE

    with Popen(*popenargs, **kwargs) as process:
        try:
            stdout, stderr = process.communicate(input, timeout=timeout)
        except TimeoutExpired as exc:
            process.kill()
            if _mswindows:
                # Windows accumulates the output in a single blocking
                # read() call run on child threads, with the timeout
                # being done in a join() on those threads.  communicate()
                # _after_ kill() is required to collect that and add it
                # to the exception.
                exc.stdout, exc.stderr = process.communicate()
            else:
                # POSIX _communicate already populated the output so
                # far into the TimeoutExpired exception.
                process.wait()
            raise
        except:  # Including KeyboardInterrupt, communicate handled that.
            process.kill()
            # We don't call process.wait() as .__exit__ does that for us.
            raise
        retcode = process.poll()
        if check and retcode:





          raise CalledProcessError(retcode, process.args,





                                     output=stdout, stderr=stderr)



E               subprocess.CalledProcessError: Command '['/usr/bin/python3', '/tmp/pytest-of-jenkins/pytest-15/test_criteo_tf_notebook0/notebook.py']' returned non-zero exit status 1.


/usr/lib/python3.8/subprocess.py:516: CalledProcessError

----------------------------- Captured stderr call -----------------------------

/usr/local/lib/python3.8/dist-packages/cudf/core/dataframe.py:1292: UserWarning: The deep parameter is ignored and is only included for pandas compatibility.

warnings.warn(

2022-06-13 18:54:39.959562: I tensorflow/core/platform/cpu_feature_guard.cc:193] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations:  AVX2 FMA

To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.

2022-06-13 18:54:40.914534: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1532] Created device /job:localhost/replica:0/task:0/device:GPU:0 with 8139 MB memory:  -> device: 0, name: Tesla P100-DGXS-16GB, pci bus id: 0000:07:00.0, compute capability: 6.0

2022-06-13 18:54:40.915294: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1532] Created device /job:localhost/replica:0/task:0/device:GPU:1 with 15157 MB memory:  -> device: 1, name: Tesla P100-DGXS-16GB, pci bus id: 0000:08:00.0, compute capability: 6.0

/usr/local/lib/python3.8/dist-packages/cudf/core/dataframe.py:1292: UserWarning: The deep parameter is ignored and is only included for pandas compatibility.

warnings.warn(

Traceback (most recent call last):

File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/saved_model/function_serialization.py", line 60, in serialize_concrete_function

bound_inputs.append(node_ids[capture])

File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/util/object_identity.py", line 135, in getitem

return self._storage[self._wrap_key(key)]

KeyError: <_ObjectIdentityWrapper wrapping <tf.Tensor: shape=(), dtype=resource, value=<ResourceHandle(name="Resource-37-at-0x49ac9a00", device="/job:localhost/replica:0/task:0/device:GPU:0", container="Anonymous", type="tensorflow::Var", dtype and shapes : "[ DType enum: 1, Shape: [] ]")>>>


During handling of the above exception, another exception occurred:


Traceback (most recent call last):

File "/tmp/pytest-of-jenkins/pytest-15/test_criteo_tf_notebook0/notebook.py", line 109, in 

model.save(os.path.join(input_path, "model.savedmodel"))

File "/usr/local/lib/python3.8/dist-packages/keras/engine/training.py", line 2145, in save

save.save_model(self, filepath, overwrite, include_optimizer, save_format,

File "/usr/local/lib/python3.8/dist-packages/keras/saving/save.py", line 149, in save_model

saved_model_save.save(model, filepath, overwrite, include_optimizer,

File "/usr/local/lib/python3.8/dist-packages/keras/saving/saved_model/save.py", line 90, in save

saved_nodes, node_paths = save_lib.save_and_return_nodes(

File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/saved_model/save.py", line 1325, in save_and_return_nodes

_build_meta_graph(obj, signatures, options, meta_graph_def))

File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/saved_model/save.py", line 1491, in _build_meta_graph

return _build_meta_graph_impl(obj, signatures, options, meta_graph_def)

File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/saved_model/save.py", line 1454, in _build_meta_graph_impl

object_graph_proto = _serialize_object_graph(

File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/saved_model/save.py", line 1027, in _serialize_object_graph

serialized = function_serialization.serialize_concrete_function(

File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/saved_model/function_serialization.py", line 62, in serialize_concrete_function

raise KeyError(

KeyError: 'Failed to add concrete function 'b'__inference_train_function_3740'' to object-based SavedModel as it captures tensor <tf.Tensor: shape=(), dtype=resource, value=<ResourceHandle(name="Resource-37-at-0x49ac9a00", device="/job:localhost/replica:0/task:0/device:GPU:0", container="Anonymous", type="tensorflow::Var", dtype and shapes : "[ DType enum: 1, Shape: [] ]")>> which is unsupported or not reachable from root. One reason could be that a stateful object or a variable that the function depends on is not assigned to an attribute of the serialized trackable object (see SaveTest.test_captures_unreachable_variable).'

=============================== warnings summary ===============================

../../../../../usr/local/lib/python3.8/dist-packages/dask_cudf/core.py:32

/usr/local/lib/python3.8/dist-packages/dask_cudf/core.py:32: DeprecationWarning: distutils Version classes are deprecated. Use packaging.version instead.

DASK_VERSION = LooseVersion(dask.version)


../../../.local/lib/python3.8/site-packages/setuptools/_distutils/version.py:346: 34 warnings

/var/jenkins_home/.local/lib/python3.8/site-packages/setuptools/_distutils/version.py:346: DeprecationWarning: distutils Version classes are deprecated. Use packaging.version instead.

other = LooseVersion(other)


nvtabular/loader/init.py:19

/var/jenkins_home/workspace/nvtabular_tests/nvtabular/nvtabular/loader/init.py:19: DeprecationWarning: The nvtabular.loader module has moved to merlin.models.loader. Support for importing from nvtabular.loader is deprecated, and will be removed in a future version. Please update your imports to refer to merlin.models.loader.

warnings.warn(


tests/unit/test_dask_nvt.py::test_cats_and_groupby_stats[False-0.01]

tests/unit/test_dask_nvt.py::test_cats_and_groupby_stats[False-0.01]

/usr/local/lib/python3.8/dist-packages/cudf/core/dataframe.py:1292: UserWarning: The deep parameter is ignored and is only included for pandas compatibility.

warnings.warn(


tests/unit/test_dask_nvt.py: 12 warnings

/var/jenkins_home/.local/lib/python3.8/site-packages/merlin/io/dataset.py:862: UserWarning: Only created 2 files did not have enough partitions to create 8 files.

warnings.warn(


tests/unit/test_dask_nvt.py::test_merlin_core_execution_managers

/var/jenkins_home/.local/lib/python3.8/site-packages/merlin/core/utils.py:431: UserWarning: Existing Dask-client object detected in the current context. New cuda cluster will not be deployed. Set force_new to True to ignore running clusters.

warnings.warn(


-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html


---------- coverage: platform linux, python 3.8.10-final-0 -----------

Name                                                           Stmts   Miss Branch BrPart  Cover   Missing


nvtabular/init.py                                             22      2      0      0    91%   44-45

nvtabular/dispatch.py                                              3      3      0      0     0%   18-23

nvtabular/framework_utils/init.py                              2      0      0      0   100%

nvtabular/framework_utils/tensorflow/init.py                   1      0      0      0   100%

nvtabular/framework_utils/tensorflow/feature_column_utils.py     134    125     90      0     4%   28-32, 69-286

nvtabular/framework_utils/tensorflow/layers/init.py            4      0      0      0   100%

nvtabular/framework_utils/tensorflow/layers/embedding.py         153     90     89     11    38%   31-32, 39, 51-60, 68-69, 73-75, 79-93, 104-111, 119-124, 177, 179, 193, 205, 217-218, 227, 231-239, 249-265, 307-311, 314-344, 347-360, 363-364, 367

nvtabular/framework_utils/tensorflow/layers/interaction.py        47     39     22      0    14%   48-52, 55-71, 74-103, 106-110, 113

nvtabular/framework_utils/tensorflow/layers/outer_product.py      30     24     12      0    19%   37-38, 41-60, 71-84, 87

nvtabular/framework_utils/tensorflow/tfrecords_to_parquet.py      58     58     30      0     0%   16-111

nvtabular/framework_utils/torch/init.py                        0      0      0      0   100%

nvtabular/framework_utils/torch/layers/init.py                 2      0      0      0   100%

nvtabular/framework_utils/torch/layers/embeddings.py              32     25     18      0    22%   37-46, 49-54, 74-82, 85-95

nvtabular/framework_utils/torch/models.py                         45     40     30      0     9%   52-82, 85-110

nvtabular/framework_utils/torch/utils.py                          75     66     34      0    12%   22, 25-33, 42-44, 47-55, 58-76, 106-140

nvtabular/graph.py                                                 3      3      0      0     0%   18-23

nvtabular/inference/init.py                                    2      0      0      0   100%

nvtabular/inference/triton/init.py                            35     23     14      0    24%   34-53, 57-60, 64, 68, 72-78

nvtabular/inference/triton/benchmarking_tools.py                  52     52     10      0     0%   2-103

nvtabular/inference/triton/data_conversions.py                    87     73     58      0    10%   32-33, 52-84, 88-94, 98-105, 109-115, 119-136, 140-150

nvtabular/inference/triton/ensemble.py                           265    239     82      0     7%   68-107, 152-191, 235-283, 287-318, 343-363, 376-384, 400-457, 472-515, 543-583, 589-605, 609-676, 680-695, 703-728, 734-753, 759-783, 788-791

nvtabular/inference/triton/model/init.py                       0      0      0      0   100%

nvtabular/inference/triton/model/model_pt.py                     101    101     42      0     0%   27-220

nvtabular/inference/triton/workflow_model.py                      55     55     24      0     0%   27-128

nvtabular/inference/workflow/init.py                           0      0      0      0   100%

nvtabular/inference/workflow/base.py                             113    113     62      0     0%   27-209

nvtabular/inference/workflow/hugectr.py                           37     37     16      0     0%   27-87

nvtabular/inference/workflow/pytorch.py                           10     10      6      0     0%   27-46

nvtabular/inference/workflow/tensorflow.py                        32     32     10      0     0%   26-68

nvtabular/io.py                                                    3      3      0      0     0%   18-23

nvtabular/loader/init.py                                       2      0      0      0   100%

nvtabular/loader/backend.py                                      371    122    154     36    61%   27-28, 84, 92, 97-98, 112, 116->108, 125, 137-142, 145->exit, 157-159, 163-167, 170, 178, 179->181, 235, 265->268, 271-275, 278-281, 286, 291-293, 299-305, 311-315, 325-326, 334, 357, 362-363, 379->383, 383->387, 389-400, 402->406, 403->402, 417-420, 428, 431, 436-458, 462-487, 508-517, 551, 569-570, 578->581, 582-592, 596-599, 610, 617-618, 623-627, 632

nvtabular/loader/tensorflow.py                                   179     67     60     14    59%   38-39, 62-89, 101, 105, 110-115, 124, 311-313, 329, 332, 351, 355-358, 363, 368, 375, 383-385, 389, 395->399, 408-418, 422, 426-434, 437-440, 443-447, 453

nvtabular/loader/tf_utils.py                                      57     27     22      6    46%   31->34, 34->36, 41->43, 45, 46->67, 52-53, 61-63, 69-73, 88-93, 103-116

nvtabular/loader/torch.py                                         87     56     26      0    33%   28-30, 33-39, 90, 110, 113-115, 118-120, 123-131, 134-136, 139, 142, 146, 150, 154-166, 169, 174-179, 182-187, 190-191, 202, 205

nvtabular/ops/init.py                                         26      0      0      0   100%

nvtabular/ops/add_metadata.py                                     34      3     14      0    94%   34, 38, 42

nvtabular/ops/bucketize.py                                        40     20     20      2    40%   52-54, 58->exit, 59-64, 71-88, 92, 96

nvtabular/ops/categorify.py                                      660    180    348     85    68%   251, 253, 271, 275, 279, 283, 287, 291, 293, 297, 305, 320, 323-328, 341-342, 372-376, 384-408, 434, 448->451, 452, 457, 460, 483-484, 491-499, 561-566, 598, 606, 618-620, 625->627, 628, 629->631, 635, 637, 646, 725, 727->730, 733, 750, 759-764, 795, 801, 829, 860->863, 864-866, 873-874, 889-893, 894->858, 912, 920, 927-928, 945-946, 951, 954->957, 983, 1003-1021, 1037, 1059, 1063, 1065-1068, 1073, 1077-1089, 1091->1094, 1099->1053, 1107-1114, 1115->1117, 1119-1122, 1134, 1138, 1142, 1149, 1154-1157, 1235, 1237, 1299, 1307->1330, 1313->1330, 1331-1336, 1340-1341, 1348-1349, 1354, 1358-1366, 1369, 1380-1388, 1393, 1394->1397, 1401->1406, 1405, 1411, 1414, 1419-1433, 1454-1462

nvtabular/ops/clip.py                                             18      2      8      3    81%   44, 52->54, 55

nvtabular/ops/column_similarity.py                               121     86     38      0    23%   19-20, 29-30, 72-78, 81-88, 92-114, 125-126, 129-134, 138, 142, 168-197, 206-207, 216-218, 226-242, 251-276, 280-283, 287-288

nvtabular/ops/data_stats.py                                       56     40     24      0    22%   44-48, 51, 55-93, 96-115, 118

nvtabular/ops/difference_lag.py                                   43     21     14      1    44%   60->63, 70-81, 87, 90-95, 99, 103, 106

nvtabular/ops/drop_low_cardinality.py                             18     11     10      0    32%   30-31, 50, 80-90

nvtabular/ops/dropna.py                                            9      3      2      0    73%   36-38

nvtabular/ops/fill.py                                             76     35     30      3    47%   53-55, 63-67, 73, 79, 102-104, 108-115, 120-121, 125-128, 135, 138-142, 145-148

nvtabular/ops/filter.py                                           20      3      8      3    79%   49, 56, 60

nvtabular/ops/groupby.py                                         135     89     88      6    27%   82, 93-94, 103, 104->106, 106->95, 115-141, 148-152, 155-179, 182-200, 204, 209-214, 220-243, 250-253, 258-261, 267, 274-279, 285-292, 298-305

nvtabular/ops/hash_bucket.py                                      43     22     22      2    38%   75, 79, 88-101, 106-110, 113-124, 128, 132

nvtabular/ops/hashed_cross.py                                     38     22     17      1    35%   52, 58-68, 73-78, 82, 87-92

nvtabular/ops/join_external.py                                    96     74     34      0    18%   20-21, 101-119, 124-152, 155-159, 162-170, 181-182, 186-187, 190-199, 202-206, 209, 212, 216-227

nvtabular/ops/join_groupby.py                                    128     20     57      9    79%   111, 113, 120, 126-129, 136-139, 144-146, 177-180, 181->175, 230-231, 260-261

nvtabular/ops/lambdaop.py                                         62     40     22      0    29%   58-70, 74-83, 89, 94-109, 112-113, 116-123, 127, 131, 135, 139

nvtabular/ops/list_slice.py                                       89     60     42      3    26%   21-22, 67-68, 70->73, 74, 80-129, 132-133, 137, 146-160, 168-190

nvtabular/ops/logop.py                                            21      2      6      1    89%   48-51

nvtabular/ops/moments.py                                          69      1     24      1    98%   71

nvtabular/ops/normalize.py                                        93     27     22      3    67%   72, 77, 82, 89, 126-128, 134-142, 148, 155-159, 162-163, 167, 176, 180

nvtabular/ops/operator.py                                         11      1      2      0    92%   52

nvtabular/ops/reduce_dtype_size.py                                49     28     20      0    33%   36-39, 43, 46, 49-50, 54-56, 59-80

nvtabular/ops/rename.py                                           29     17     14      1    35%   46, 54-56, 61-79

nvtabular/ops/stat_operator.py                                     8      0      2      0   100%

nvtabular/ops/target_encoding.py                                 182    127     76      0    22%   166-207, 210-213, 217, 226-227, 230-243, 246-251, 254-257, 261, 265, 269-274, 277-280, 283-284, 287-288, 291-292, 296-377, 381-413, 423-432

nvtabular/ops/value_counts.py                                     34     20      6      0    40%   37-53, 56, 59, 62-64, 67

nvtabular/tools/init.py                                        0      0      0      0   100%

nvtabular/tools/data_gen.py                                      271    223     90      0    17%   26-27, 31-32, 52-54, 57, 62, 65-75, 78, 88-90, 97-106, 116-159, 162-175, 180-188, 191-198, 206-222, 231-261, 265-291, 295-313, 316-325, 329-335, 341-352, 355-358, 361-370, 378-380, 396-402, 422-432, 437-439, 479-493

nvtabular/tools/dataset_inspector.py                              52     40     24      0    21%   31-40, 50-51, 71-112

nvtabular/tools/inspector_script.py                               46     46      0      0     0%   17-168

nvtabular/utils.py                                                 3      0      0      0   100%

nvtabular/worker.py                                                3      3      0      0     0%   18-23

nvtabular/workflow/init.py                                     2      0      0      0   100%

nvtabular/workflow/node.py                                         7      1      4      1    82%   28

nvtabular/workflow/workflow.py                                   219     28     94     15    86%   28-29, 52, 85, 121-122, 126, 130, 167-168, 187->190, 206, 212->226, 239-241, 257, 373, 388-389, 431, 508, 528, 538-546, 548-550, 563


TOTAL                                                           4910   2780   2093    207    39%

Coverage XML written to file coverage.xml


FAIL Required test coverage of 70% not reached. Total coverage: 39.37%

=========================== short test summary info ============================

SKIPPED [1] ../../../../../usr/local/lib/python3.8/dist-packages/dask_cudf/io/tests/test_s3.py:17: could not import 's3fs': cannot import name 'resolve_checksum_context' from 'botocore.client' (/var/jenkins_home/.local/lib/python3.8/site-packages/botocore/client.py)

!!!!!!!!!!!!!!!!!!!!!!!!!! stopping after 1 failures !!!!!!!!!!!!!!!!!!!!!!!!!!!

====== 1 failed, 116 passed, 1 skipped, 51 warnings in 137.06s (0:02:17) =======

Build step 'Execute shell' marked build as failure

Performing Post build task...

Match found for : : True

Logical operation result is TRUE

Running script  : #!/bin/bash

cd /var/jenkins_home/

CUDA_VISIBLE_DEVICES=1 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA-Merlin/NVTabular/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log"

[nvtabular_tests] $ /bin/bash /tmp/jenkins6634353817392845657.sh

@github-actions
Copy link

Documentation preview

https://nvidia-merlin.github.io/NVTabular/review/pr-1581

@karlhigley karlhigley requested review from jperez999 and benfred June 13, 2022 23:18
@jperez999
Copy link
Contributor

rerun tests

@nvidia-merlin-bot
Copy link
Contributor

Click to view CI Results
GitHub pull request #1581 of commit f25ea237753378a70a85f6093495c71224439de1, no merge conflicts.
GitHub pull request #1581 of commit f25ea237753378a70a85f6093495c71224439de1, no merge conflicts.
Running as SYSTEM
Setting status of f25ea237753378a70a85f6093495c71224439de1 to PENDING with url http://10.20.17.181:8080/job/nvtabular_tests/4514/ and message: 'Build started for merge commit.'
Using context: Jenkins Unit Test Run
Building on master in workspace /var/jenkins_home/workspace/nvtabular_tests
using credential nvidia-merlin-bot
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA-Merlin/NVTabular.git
 > git init /var/jenkins_home/workspace/nvtabular_tests/nvtabular # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/NVTabular.git
 > git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/NVTabular.git +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA-Merlin/NVTabular.git # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA-Merlin/NVTabular.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/NVTabular.git
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/NVTabular.git +refs/pull/1581/*:refs/remotes/origin/pr/1581/* # timeout=10
 > git rev-parse f25ea237753378a70a85f6093495c71224439de1^{commit} # timeout=10
Checking out Revision f25ea237753378a70a85f6093495c71224439de1 (detached)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f f25ea237753378a70a85f6093495c71224439de1 # timeout=10
Commit message: "Document the change to three containers"
 > git rev-list --no-walk f25ea237753378a70a85f6093495c71224439de1 # timeout=10
[nvtabular_tests] $ /bin/bash /tmp/jenkins1543137814059640450.sh
============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-7.1.2, pluggy-1.0.0
rootdir: /var/jenkins_home/workspace/nvtabular_tests/nvtabular, configfile: pyproject.toml
plugins: anyio-3.5.0, xdist-2.5.0, forked-1.4.0, cov-3.0.0
collected 1420 items / 1 skipped

tests/unit/test_dask_nvt.py ............................................ [  3%]

........................................................................ [  8%]

[  8%]

tests/unit/test_notebooks.py ......                                      [  8%]

tests/unit/test_tf4rec.py .                                              [  8%]

tests/unit/test_tools.py ......................                          [ 10%]

tests/unit/test_triton_inference.py ................................     [ 12%]

tests/unit/framework_utils/test_tf_feature_columns.py .                  [ 12%]

tests/unit/framework_utils/test_tf_layers.py ........................... [ 14%]

...................................................                      [ 18%]

tests/unit/framework_utils/test_torch_layers.py .                        [ 18%]

tests/unit/loader/test_dataloader_backend.py ......                      [ 18%]

tests/unit/loader/test_tf_dataloader.py ................................ [ 20%]

........................................s..                              [ 23%]

tests/unit/loader/test_torch_dataloader.py ............................. [ 25%]

......................................................                   [ 29%]

tests/unit/ops/test_categorify.py ...................................... [ 32%]

........................................................................ [ 37%]

...........................................                              [ 40%]

tests/unit/ops/test_column_similarity.py ........................        [ 42%]

tests/unit/ops/test_drop_low_cardinality.py ..                           [ 42%]

tests/unit/ops/test_fill.py ............................................ [ 45%]

........                                                                 [ 45%]

tests/unit/ops/test_groupyby.py ...............                          [ 46%]

tests/unit/ops/test_hash_bucket.py .........................             [ 48%]

tests/unit/ops/test_join.py ............................................ [ 51%]

........................................................................ [ 56%]

..................................                                       [ 59%]

tests/unit/ops/test_lambda.py ..........                                 [ 60%]

tests/unit/ops/test_normalize.py ....................................... [ 62%]

..                                                                       [ 62%]

tests/unit/ops/test_ops.py ............................................. [ 66%]

....................                                                     [ 67%]

tests/unit/ops/test_ops_schema.py ...................................... [ 70%]

........................................................................ [ 75%]

........................................................................ [ 80%]

........................................................................ [ 85%]

.......................................                                  [ 88%]

tests/unit/ops/test_reduce_dtype_size.py ..                              [ 88%]

tests/unit/ops/test_target_encode.py .....................               [ 89%]

tests/unit/workflow/test_cpu_workflow.py ......                          [ 90%]

tests/unit/workflow/test_workflow.py ................................... [ 92%]

..........................................................               [ 96%]

tests/unit/workflow/test_workflow_chaining.py ...                        [ 96%]

tests/unit/workflow/test_workflow_node.py ...........                    [ 97%]

tests/unit/workflow/test_workflow_ops.py ...                             [ 97%]

tests/unit/workflow/test_workflow_schemas.py ........................... [ 99%]

...                                                                      [100%]


=============================== warnings summary ===============================

../../../../../usr/local/lib/python3.8/dist-packages/dask_cudf/core.py:32

/usr/local/lib/python3.8/dist-packages/dask_cudf/core.py:32: DeprecationWarning: distutils Version classes are deprecated. Use packaging.version instead.

DASK_VERSION = LooseVersion(dask.version)


../../../.local/lib/python3.8/site-packages/setuptools/_distutils/version.py:346: 34 warnings

/var/jenkins_home/.local/lib/python3.8/site-packages/setuptools/_distutils/version.py:346: DeprecationWarning: distutils Version classes are deprecated. Use packaging.version instead.

other = LooseVersion(other)


nvtabular/loader/init.py:19

/var/jenkins_home/workspace/nvtabular_tests/nvtabular/nvtabular/loader/init.py:19: DeprecationWarning: The nvtabular.loader module has moved to merlin.models.loader. Support for importing from nvtabular.loader is deprecated, and will be removed in a future version. Please update your imports to refer to merlin.models.loader.

warnings.warn(


tests/unit/test_dask_nvt.py: 2 warnings

tests/unit/test_tf4rec.py: 1 warning

tests/unit/test_tools.py: 6 warnings

tests/unit/test_triton_inference.py: 8 warnings

tests/unit/loader/test_dataloader_backend.py: 6 warnings

tests/unit/loader/test_tf_dataloader.py: 142 warnings

tests/unit/loader/test_torch_dataloader.py: 91 warnings

tests/unit/ops/test_categorify.py: 70 warnings

tests/unit/ops/test_drop_low_cardinality.py: 2 warnings

tests/unit/ops/test_fill.py: 8 warnings

tests/unit/ops/test_hash_bucket.py: 4 warnings

tests/unit/ops/test_join.py: 88 warnings

tests/unit/ops/test_lambda.py: 3 warnings

tests/unit/ops/test_normalize.py: 9 warnings

tests/unit/ops/test_ops.py: 11 warnings

tests/unit/ops/test_ops_schema.py: 17 warnings

tests/unit/workflow/test_workflow.py: 34 warnings

tests/unit/workflow/test_workflow_chaining.py: 1 warning

tests/unit/workflow/test_workflow_node.py: 1 warning

tests/unit/workflow/test_workflow_schemas.py: 1 warning

/usr/local/lib/python3.8/dist-packages/cudf/core/dataframe.py:1292: UserWarning: The deep parameter is ignored and is only included for pandas compatibility.

warnings.warn(


tests/unit/test_dask_nvt.py: 12 warnings

/var/jenkins_home/.local/lib/python3.8/site-packages/merlin/io/dataset.py:862: UserWarning: Only created 2 files did not have enough partitions to create 8 files.

warnings.warn(


tests/unit/test_dask_nvt.py::test_merlin_core_execution_managers

/var/jenkins_home/.local/lib/python3.8/site-packages/merlin/core/utils.py:431: UserWarning: Existing Dask-client object detected in the current context. New cuda cluster will not be deployed. Set force_new to True to ignore running clusters.

warnings.warn(


tests/unit/test_notebooks.py: 18 warnings

tests/unit/test_tools.py: 1213 warnings

tests/unit/loader/test_tf_dataloader.py: 20 warnings

tests/unit/loader/test_torch_dataloader.py: 432 warnings

/usr/local/lib/python3.8/dist-packages/cudf/core/frame.py:3235: DeprecationWarning: Series.ceil and DataFrame.ceil are deprecated and will be                 removed in the future

warnings.warn(


tests/unit/test_tools.py::test_inspect_datagen[uniform-parquet]

tests/unit/test_tools.py::test_inspect_datagen[uniform-parquet]

tests/unit/ops/test_ops.py::test_data_stats[True-parquet]

tests/unit/ops/test_ops.py::test_data_stats[False-parquet]

/usr/local/lib/python3.8/dist-packages/cudf/core/series.py:958: FutureWarning: Series.set_index is deprecated and will be removed in the future

warnings.warn(


tests/unit/loader/test_tf_dataloader.py: 2 warnings

tests/unit/loader/test_torch_dataloader.py: 12 warnings

tests/unit/workflow/test_workflow.py: 9 warnings

/var/jenkins_home/.local/lib/python3.8/site-packages/merlin/io/dataset.py:862: UserWarning: Only created 1 files did not have enough partitions to create 2 files.

warnings.warn(


tests/unit/ops/test_fill.py::test_fill_missing[True-True-parquet]

tests/unit/ops/test_fill.py::test_fill_missing[True-False-parquet]

tests/unit/ops/test_ops.py::test_filter[parquet-0.1-True]

/var/jenkins_home/.local/lib/python3.8/site-packages/pandas/core/indexing.py:1732: SettingWithCopyWarning:

A value is trying to be set on a copy of a slice from a DataFrame


See the caveats in the documentation: https://pandas.pydata.org/pandas-docs/stable/user_guide/indexing.html#returning-a-view-versus-a-copy

self._setitem_single_block(indexer, value, name)


tests/unit/ops/test_ops.py::test_difference_lag[False]

/usr/local/lib/python3.8/dist-packages/cudf/core/dataframe.py:3025: FutureWarning: The as_gpu_matrix method will be removed in a future cuDF release. Consider using to_cupy instead.

warnings.warn(


tests/unit/workflow/test_cpu_workflow.py: 6 warnings

tests/unit/workflow/test_workflow.py: 12 warnings

/var/jenkins_home/.local/lib/python3.8/site-packages/merlin/io/dataset.py:862: UserWarning: Only created 1 files did not have enough partitions to create 10 files.

warnings.warn(


tests/unit/workflow/test_workflow.py: 48 warnings

/var/jenkins_home/.local/lib/python3.8/site-packages/merlin/io/dataset.py:862: UserWarning: Only created 2 files did not have enough partitions to create 20 files.

warnings.warn(


tests/unit/workflow/test_workflow.py::test_parquet_output[True-Shuffle.PER_WORKER]

tests/unit/workflow/test_workflow.py::test_parquet_output[True-Shuffle.PER_PARTITION]

tests/unit/workflow/test_workflow.py::test_parquet_output[True-None]

tests/unit/workflow/test_workflow.py::test_workflow_apply[True-True-Shuffle.PER_WORKER]

tests/unit/workflow/test_workflow.py::test_workflow_apply[True-True-Shuffle.PER_PARTITION]

tests/unit/workflow/test_workflow.py::test_workflow_apply[True-True-None]

tests/unit/workflow/test_workflow.py::test_workflow_apply[False-True-Shuffle.PER_WORKER]

tests/unit/workflow/test_workflow.py::test_workflow_apply[False-True-Shuffle.PER_PARTITION]

tests/unit/workflow/test_workflow.py::test_workflow_apply[False-True-None]

/var/jenkins_home/.local/lib/python3.8/site-packages/merlin/io/dataset.py:862: UserWarning: Only created 2 files did not have enough partitions to create 4 files.

warnings.warn(


-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html

========== 1419 passed, 2 skipped, 2343 warnings in 710.03s (0:11:50) ==========

Performing Post build task...

Match found for : : True

Logical operation result is TRUE

Running script  : #!/bin/bash

cd /var/jenkins_home/

CUDA_VISIBLE_DEVICES=1 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA-Merlin/NVTabular/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log"

[nvtabular_tests] $ /bin/bash /tmp/jenkins13095091557302926728.sh

benfred
benfred approved these changes Jun 14, 2022
View reviewed changes
examples/README.md Outdated Show resolved Hide resolved
@mikemckiernan
Document the change to three containers
7fdea9e 
Beginning with the 22.06 release, the Merlin
team provides the following three containers
that are capable of training and inference:

* `merlin-hugectr`
* `merlin-tensorflow`
* `merlin-pytorch`

This is a change from the 22.05 release that
used six containers--one for training and a
separate container for inference.

Remove step to install JupyterLab
@nvidia-merlin-bot
Copy link
Contributor

Click to view CI Results
GitHub pull request #1581 of commit 7fdea9e412422018c541f5c27af5ff70d73001d7, no merge conflicts.
Running as SYSTEM
Setting status of 7fdea9e412422018c541f5c27af5ff70d73001d7 to PENDING with url http://10.20.17.181:8080/job/nvtabular_tests/4516/ and message: 'Build started for merge commit.'
Using context: Jenkins Unit Test Run
Building on master in workspace /var/jenkins_home/workspace/nvtabular_tests
using credential nvidia-merlin-bot
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA-Merlin/NVTabular.git
 > git init /var/jenkins_home/workspace/nvtabular_tests/nvtabular # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/NVTabular.git
 > git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/NVTabular.git +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA-Merlin/NVTabular.git # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA-Merlin/NVTabular.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/NVTabular.git
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/NVTabular.git +refs/pull/1581/*:refs/remotes/origin/pr/1581/* # timeout=10
 > git rev-parse 7fdea9e412422018c541f5c27af5ff70d73001d7^{commit} # timeout=10
Checking out Revision 7fdea9e412422018c541f5c27af5ff70d73001d7 (detached)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 7fdea9e412422018c541f5c27af5ff70d73001d7 # timeout=10
Commit message: "Document the change to three containers"
 > git rev-list --no-walk c86bc729bf4272962c5de7320bcf7ed3efd44c56 # timeout=10
First time build. Skipping changelog.
[nvtabular_tests] $ /bin/bash /tmp/jenkins2860264922398413550.sh
============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-7.1.2, pluggy-1.0.0
rootdir: /var/jenkins_home/workspace/nvtabular_tests/nvtabular, configfile: pyproject.toml
plugins: anyio-3.5.0, xdist-2.5.0, forked-1.4.0, cov-3.0.0
collected 1420 items / 1 skipped

tests/unit/test_dask_nvt.py ............................................ [  3%]

........................................................................ [  8%]

[  8%]

tests/unit/test_notebooks.py ......                                      [  8%]

tests/unit/test_tf4rec.py .                                              [  8%]

tests/unit/test_tools.py ......................                          [ 10%]

tests/unit/test_triton_inference.py ................................     [ 12%]

tests/unit/framework_utils/test_tf_feature_columns.py .                  [ 12%]

tests/unit/framework_utils/test_tf_layers.py ........................... [ 14%]

...................................................                      [ 18%]

tests/unit/framework_utils/test_torch_layers.py .                        [ 18%]

tests/unit/loader/test_dataloader_backend.py ......                      [ 18%]

tests/unit/loader/test_tf_dataloader.py ................................ [ 20%]

........................................s..                              [ 23%]

tests/unit/loader/test_torch_dataloader.py ............................. [ 25%]

......................................................                   [ 29%]

tests/unit/ops/test_categorify.py ...................................... [ 32%]

........................................................................ [ 37%]

...........................................                              [ 40%]

tests/unit/ops/test_column_similarity.py ........................        [ 42%]

tests/unit/ops/test_drop_low_cardinality.py ..                           [ 42%]

tests/unit/ops/test_fill.py ............................................ [ 45%]

........                                                                 [ 45%]

tests/unit/ops/test_groupyby.py ...............                          [ 46%]

tests/unit/ops/test_hash_bucket.py .........................             [ 48%]

tests/unit/ops/test_join.py ............................................ [ 51%]

........................................................................ [ 56%]

..................................                                       [ 59%]

tests/unit/ops/test_lambda.py ..........                                 [ 60%]

tests/unit/ops/test_normalize.py ....................................... [ 62%]

..                                                                       [ 62%]

tests/unit/ops/test_ops.py ............................................. [ 66%]

....................                                                     [ 67%]

tests/unit/ops/test_ops_schema.py ...................................... [ 70%]

........................................................................ [ 75%]

........................................................................ [ 80%]

........................................................................ [ 85%]

.......................................                                  [ 88%]

tests/unit/ops/test_reduce_dtype_size.py ..                              [ 88%]

tests/unit/ops/test_target_encode.py .....................               [ 89%]

tests/unit/workflow/test_cpu_workflow.py ......                          [ 90%]

tests/unit/workflow/test_workflow.py ................................... [ 92%]

..........................................................               [ 96%]

tests/unit/workflow/test_workflow_chaining.py ...                        [ 96%]

tests/unit/workflow/test_workflow_node.py ...........                    [ 97%]

tests/unit/workflow/test_workflow_ops.py ...                             [ 97%]

tests/unit/workflow/test_workflow_schemas.py ........................... [ 99%]

...                                                                      [100%]


=============================== warnings summary ===============================

../../../../../usr/local/lib/python3.8/dist-packages/dask_cudf/core.py:32

/usr/local/lib/python3.8/dist-packages/dask_cudf/core.py:32: DeprecationWarning: distutils Version classes are deprecated. Use packaging.version instead.

DASK_VERSION = LooseVersion(dask.version)


../../../.local/lib/python3.8/site-packages/setuptools/_distutils/version.py:346: 34 warnings

/var/jenkins_home/.local/lib/python3.8/site-packages/setuptools/_distutils/version.py:346: DeprecationWarning: distutils Version classes are deprecated. Use packaging.version instead.

other = LooseVersion(other)


nvtabular/loader/init.py:19

/var/jenkins_home/workspace/nvtabular_tests/nvtabular/nvtabular/loader/init.py:19: DeprecationWarning: The nvtabular.loader module has moved to merlin.models.loader. Support for importing from nvtabular.loader is deprecated, and will be removed in a future version. Please update your imports to refer to merlin.models.loader.

warnings.warn(


tests/unit/test_dask_nvt.py: 2 warnings

tests/unit/test_tf4rec.py: 1 warning

tests/unit/test_tools.py: 6 warnings

tests/unit/test_triton_inference.py: 8 warnings

tests/unit/loader/test_dataloader_backend.py: 6 warnings

tests/unit/loader/test_tf_dataloader.py: 142 warnings

tests/unit/loader/test_torch_dataloader.py: 91 warnings

tests/unit/ops/test_categorify.py: 70 warnings

tests/unit/ops/test_drop_low_cardinality.py: 2 warnings

tests/unit/ops/test_fill.py: 8 warnings

tests/unit/ops/test_hash_bucket.py: 4 warnings

tests/unit/ops/test_join.py: 88 warnings

tests/unit/ops/test_lambda.py: 3 warnings

tests/unit/ops/test_normalize.py: 9 warnings

tests/unit/ops/test_ops.py: 11 warnings

tests/unit/ops/test_ops_schema.py: 17 warnings

tests/unit/workflow/test_workflow.py: 34 warnings

tests/unit/workflow/test_workflow_chaining.py: 1 warning

tests/unit/workflow/test_workflow_node.py: 1 warning

tests/unit/workflow/test_workflow_schemas.py: 1 warning

/usr/local/lib/python3.8/dist-packages/cudf/core/dataframe.py:1292: UserWarning: The deep parameter is ignored and is only included for pandas compatibility.

warnings.warn(


tests/unit/test_dask_nvt.py: 12 warnings

/var/jenkins_home/.local/lib/python3.8/site-packages/merlin/io/dataset.py:862: UserWarning: Only created 2 files did not have enough partitions to create 8 files.

warnings.warn(


tests/unit/test_dask_nvt.py::test_merlin_core_execution_managers

/var/jenkins_home/.local/lib/python3.8/site-packages/merlin/core/utils.py:431: UserWarning: Existing Dask-client object detected in the current context. New cuda cluster will not be deployed. Set force_new to True to ignore running clusters.

warnings.warn(


tests/unit/test_notebooks.py: 18 warnings

tests/unit/test_tools.py: 1213 warnings

tests/unit/loader/test_tf_dataloader.py: 20 warnings

tests/unit/loader/test_torch_dataloader.py: 432 warnings

/usr/local/lib/python3.8/dist-packages/cudf/core/frame.py:3235: DeprecationWarning: Series.ceil and DataFrame.ceil are deprecated and will be                 removed in the future

warnings.warn(


tests/unit/test_tools.py::test_inspect_datagen[uniform-parquet]

tests/unit/test_tools.py::test_inspect_datagen[uniform-parquet]

tests/unit/ops/test_ops.py::test_data_stats[True-parquet]

tests/unit/ops/test_ops.py::test_data_stats[False-parquet]

/usr/local/lib/python3.8/dist-packages/cudf/core/series.py:958: FutureWarning: Series.set_index is deprecated and will be removed in the future

warnings.warn(


tests/unit/loader/test_tf_dataloader.py: 2 warnings

tests/unit/loader/test_torch_dataloader.py: 12 warnings

tests/unit/workflow/test_workflow.py: 9 warnings

/var/jenkins_home/.local/lib/python3.8/site-packages/merlin/io/dataset.py:862: UserWarning: Only created 1 files did not have enough partitions to create 2 files.

warnings.warn(


tests/unit/ops/test_fill.py::test_fill_missing[True-True-parquet]

tests/unit/ops/test_fill.py::test_fill_missing[True-False-parquet]

tests/unit/ops/test_ops.py::test_filter[parquet-0.1-True]

/var/jenkins_home/.local/lib/python3.8/site-packages/pandas/core/indexing.py:1732: SettingWithCopyWarning:

A value is trying to be set on a copy of a slice from a DataFrame


See the caveats in the documentation: https://pandas.pydata.org/pandas-docs/stable/user_guide/indexing.html#returning-a-view-versus-a-copy

self._setitem_single_block(indexer, value, name)


tests/unit/ops/test_ops.py::test_difference_lag[False]

/usr/local/lib/python3.8/dist-packages/cudf/core/dataframe.py:3025: FutureWarning: The as_gpu_matrix method will be removed in a future cuDF release. Consider using to_cupy instead.

warnings.warn(


tests/unit/workflow/test_cpu_workflow.py: 6 warnings

tests/unit/workflow/test_workflow.py: 12 warnings

/var/jenkins_home/.local/lib/python3.8/site-packages/merlin/io/dataset.py:862: UserWarning: Only created 1 files did not have enough partitions to create 10 files.

warnings.warn(


tests/unit/workflow/test_workflow.py: 48 warnings

/var/jenkins_home/.local/lib/python3.8/site-packages/merlin/io/dataset.py:862: UserWarning: Only created 2 files did not have enough partitions to create 20 files.

warnings.warn(


tests/unit/workflow/test_workflow.py::test_parquet_output[True-Shuffle.PER_WORKER]

tests/unit/workflow/test_workflow.py::test_parquet_output[True-Shuffle.PER_PARTITION]

tests/unit/workflow/test_workflow.py::test_parquet_output[True-None]

tests/unit/workflow/test_workflow.py::test_workflow_apply[True-True-Shuffle.PER_WORKER]

tests/unit/workflow/test_workflow.py::test_workflow_apply[True-True-Shuffle.PER_PARTITION]

tests/unit/workflow/test_workflow.py::test_workflow_apply[True-True-None]

tests/unit/workflow/test_workflow.py::test_workflow_apply[False-True-Shuffle.PER_WORKER]

tests/unit/workflow/test_workflow.py::test_workflow_apply[False-True-Shuffle.PER_PARTITION]

tests/unit/workflow/test_workflow.py::test_workflow_apply[False-True-None]

/var/jenkins_home/.local/lib/python3.8/site-packages/merlin/io/dataset.py:862: UserWarning: Only created 2 files did not have enough partitions to create 4 files.

warnings.warn(


-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html

========== 1419 passed, 2 skipped, 2343 warnings in 705.59s (0:11:45) ==========

Performing Post build task...

Match found for : : True

Logical operation result is TRUE

Running script  : #!/bin/bash

cd /var/jenkins_home/

CUDA_VISIBLE_DEVICES=1 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA-Merlin/NVTabular/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log"

[nvtabular_tests] $ /bin/bash /tmp/jenkins7379317228837854812.sh

@mikemckiernan mikemckiernan merged commit 90e4346 into NVIDIA-Merlin:main Jun 14, 2022
@mikemckiernan mikemckiernan deleted the docs-containers branch June 14, 2022 21:56
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@benfred benfred benfred approved these changes

@jperez999 jperez999 Awaiting requested review from jperez999

Assignees

@mikemckiernan mikemckiernan

Labels
documentation Improvements or additions to documentation
Projects
None yet
Milestone
Merlin 22.06
Development

Successfully merging this pull request may close these issues.
4 participants
@mikemckiernan @nvidia-merlin-bot @jperez999 @benfred