Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

release: v2.1.0 #491

Merged
merged 13 commits into from
Oct 23, 2024
Merged

release: v2.1.0 #491

merged 13 commits into from
Oct 23, 2024

Conversation

github-actions[bot]
Copy link
Contributor

@github-actions github-actions bot commented Oct 9, 2024

This pull request was created by GitHub Actions/AWS CodeBuild! Before merging, please do the following:

  • Review changelog/staleness report.
  • (Only for Minor/Major version releases) Review python package dependency and size report.
  • Review build/test results by clicking Build Logs in CI Report (be patient, tests take ~4hr).
  • Review ECR Scan results.

@sagemaker-distribution-bot sagemaker-distribution-bot deleted the release-2.1.0 branch October 10, 2024 05:45
@TRNWWZ TRNWWZ restored the release-2.1.0 branch October 10, 2024 19:23
@TRNWWZ TRNWWZ reopened this Oct 10, 2024
@sagemaker-distribution-bot
Copy link
Collaborator

Staleness Report: 2.1.0(gpu)

Package Current Version in the Distribution image Latest Relevant Version in Upstream
numpy 1.26.4 1.26.4
jinja2 3.1.4 3.1.4
${\color{red}pytorch}$ 2.3.1 2.4.1
altair 5.4.1 5.4.1
${\color{red}boto3}$ 1.34.162 1.35.44
ipython 8.28.0 8.28.0
jupyter-lsp 2.2.5 2.2.5
${\color{red}jupyterlab}$ 4.1.8 4.2.5
amazon-q-developer-jupyterlab-ext 3.4.0 3.4.0
${\color{red}langchain}$ 0.2.16 0.3.3
jupyter-ai 2.25.0 2.25.0
amazon-sagemaker-jupyter-ai-q-developer 1.0.12 1.0.12
jupyter-scheduler 2.9.0 2.9.0
amazon-sagemaker-jupyter-scheduler 3.1.6 3.1.6
pandas 2.2.3 2.2.3
amazon-sagemaker-sql-magic 0.1.3 0.1.3
${\color{red}jupyterlab-lsp}$ 5.0.3 5.1.0
amazon_sagemaker_sql_editor 0.1.12 0.1.12
scipy 1.14.1 1.14.1
matplotlib-base 3.9.2 3.9.2
scikit-learn 1.5.2 1.5.2
${\color{red}sentencepiece}$ 0.1.99 0.2.0
pip 24.2 24.2
${\color{red}torchvision}$ 0.18.1 0.19.1
autogluon 1.1.1 1.1.1
ipywidgets 8.1.5 8.1.5
${\color{red}notebook}$ 7.1.3 7.2.2
aws-glue-sessions 1.0.7 1.0.7
conda 24.9.2 24.9.2
uvicorn 0.32.0 0.32.0
fastapi 0.115.2 0.115.2
git-remote-codecommit 1.16 1.16
jupyter-activity-monitor-extension 0.3.1 0.3.1
jupyter-collaboration 2.1.4 2.1.4
jupyter-dash 0.4.2 0.4.2
jupyter-server-proxy 4.4.0 4.4.0
jupyterlab-git 0.50.1 0.50.1
keras 3.6.0 3.6.0
${\color{red}langchain-aws}$ 0.1.18 0.2.2
mlflow 2.17.0 2.17.0
py-xgboost-gpu 2.1.1 2.1.1
pyhive 0.7.0 0.7.0
python-gssapi 1.9.0 1.9.0
python-lsp-server 1.12.0 1.12.0
sagemaker-code-editor 1.3.3 1.3.3
sagemaker-headless-execution-driver 0.0.13 0.0.13
sagemaker-jupyterlab-emr-extension 0.3.3 0.3.3
sagemaker-jupyterlab-extension 0.3.2 0.3.2
sagemaker-kernel-wrapper 0.0.4 0.0.4
sagemaker-mlflow 0.1.0 0.1.0
sagemaker-python-sdk 2.227.0 2.227.0
sagemaker-studio-analytics-extension 0.1.2 0.1.2
supervisor 4.2.5 4.2.5
tensorflow 2.17.0 2.17.0
tf-keras 2.17.0 2.17.0

Staleness Report: 2.1.0(cpu)

Package Current Version in the Distribution image Latest Relevant Version in Upstream
numpy 1.26.4 1.26.4
jinja2 3.1.4 3.1.4
pytorch 2.4.1 2.4.1
altair 5.4.1 5.4.1
${\color{red}boto3}$ 1.34.162 1.35.44
ipython 8.28.0 8.28.0
jupyter-lsp 2.2.5 2.2.5
${\color{red}jupyterlab}$ 4.1.8 4.2.5
amazon-q-developer-jupyterlab-ext 3.4.0 3.4.0
${\color{red}langchain}$ 0.2.16 0.3.3
jupyter-ai 2.25.0 2.25.0
amazon-sagemaker-jupyter-ai-q-developer 1.0.12 1.0.12
jupyter-scheduler 2.9.0 2.9.0
amazon-sagemaker-jupyter-scheduler 3.1.6 3.1.6
pandas 2.2.3 2.2.3
amazon-sagemaker-sql-magic 0.1.3 0.1.3
${\color{red}jupyterlab-lsp}$ 5.0.3 5.1.0
amazon_sagemaker_sql_editor 0.1.12 0.1.12
scipy 1.14.1 1.14.1
matplotlib-base 3.9.2 3.9.2
scikit-learn 1.5.2 1.5.2
${\color{red}sentencepiece}$ 0.1.99 0.2.0
pip 24.2 24.2
torchvision 0.19.1 0.19.1
autogluon 1.1.1 1.1.1
ipywidgets 8.1.5 8.1.5
${\color{red}notebook}$ 7.1.3 7.2.2
aws-glue-sessions 1.0.7 1.0.7
conda 24.9.2 24.9.2
uvicorn 0.32.0 0.32.0
fastapi 0.115.2 0.115.2
git-remote-codecommit 1.16 1.16
jupyter-activity-monitor-extension 0.3.1 0.3.1
jupyter-collaboration 2.1.4 2.1.4
jupyter-dash 0.4.2 0.4.2
jupyter-server-proxy 4.4.0 4.4.0
jupyterlab-git 0.50.1 0.50.1
keras 3.6.0 3.6.0
${\color{red}langchain-aws}$ 0.1.18 0.2.2
mlflow 2.17.0 2.17.0
py-xgboost-cpu 2.1.1 2.1.1
pyhive 0.7.0 0.7.0
python-gssapi 1.9.0 1.9.0
python-lsp-server 1.12.0 1.12.0
sagemaker-code-editor 1.3.3 1.3.3
sagemaker-headless-execution-driver 0.0.13 0.0.13
sagemaker-jupyterlab-emr-extension 0.3.3 0.3.3
sagemaker-jupyterlab-extension 0.3.2 0.3.2
sagemaker-kernel-wrapper 0.0.4 0.0.4
sagemaker-mlflow 0.1.0 0.1.0
sagemaker-python-sdk 2.227.0 2.227.0
sagemaker-studio-analytics-extension 0.1.2 0.1.2
supervisor 4.2.5 4.2.5
tensorflow 2.17.0 2.17.0
tf-keras 2.17.0 2.17.0

@sagemaker-distribution-bot
Copy link
Collaborator

Python Package Size Report (GPU)

Target Image Version: 2.1.0 | Base Image Version: 2.0.0

Python Packages Total Size Summary

Target Version Total Size Base Version Total Size Size Change (abs) Size Change (%)
3.59GB 3.77GB -180.09MB -4.67

Top-20 Largest Python Packages

Package Version in the Target Image Size
libtorch 2.3.1 481.83MB
cudnn 8.9.7.29 446.57MB
tensorflow-base 2.17.0 368.07MB
libcublas 12.5.3.2 240.05MB
libmagma 2.7.2 229.91MB
mkl 2023.2.0 156.82MB
libcufft 11.2.3.61 148.63MB
libcusparse 12.5.1.3 119.08MB
nccl 2.23.4.1 109.08MB
libxgboost 2.1.1 95.28MB
libnpp 12.3.0.159 94.79MB
libcusolver 11.6.3.83 79.26MB
gcc_impl_linux-64 13.3.0 64.34MB
cuda-nvdisasm 12.5.39 47.62MB
catboost 1.2.7 45.27MB
sagemaker-code-editor 1.3.3 41.13MB
pillow 10.4.0 40.35MB
libcurand 10.3.6.82 39.82MB
gds-tools 1.10.0.4 37.78MB
pytorch 2.3.1 31.76MB

Python Package Size Delta

The total size of newly introduced Python packages is 14.22MB, accounts for 0.39% of the total package size.

Package Version in the Target Image Version in the Base Image Size Change (abs) Size Change (%)
gcc_impl_linux-64 13.3.0 12.4.0 5.28MB 8.94
pyarrow-core 17.0.0 - 4.44MB -
libstdcxx 14.2.0 - 3.71MB -
libstdcxx-devel_linux-64 13.3.0 12.4.0 2.35MB 21.21
nccl 2.23.4.1 2.22.3.1 1.83MB 1.71
snowflake-connector-python 3.12.2 - 1.11MB -
uvloop 0.21.0 - 973.29KB -
sleef 3.7 3.6.1 900.87KB 92.42
libgcc 14.2.0 - 828.85KB -
plotly 5.24.1 5.23.0 557.38KB 8.9
xorg-xorgproto 2024.1 - 552.17KB -
azure-storage-blobs-cpp 12.12.0 - 510.86KB -
scikit-image 0.24.0 0.20.0 434.83KB 4.14
watchfiles 0.24.0 - 386.50KB -
libarrow 17.0.0 15.0.2 332.60KB 4.18
azure-core-cpp 1.13.0 - 330.21KB -
scipy 1.14.1 1.12.0 314.35KB 1.86
azure-storage-files-datalake-cpp 12.11.0 - 268.06KB -
scikit-learn 1.5.2 1.4.2 258.71KB 2.56
websockets 13.1 - 231.34KB -
debugpy 1.8.7 1.8.5 219.96KB 9.71
catboost 1.2.7 1.2.5 213.92KB 0.46
azure-identity-cpp 1.8.0 - 194.84KB -
libsanitizer 13.3.0 12.4.0 186.60KB 4.85
gxx_impl_linux-64 13.3.0 12.4.0 184.65KB 1.44
dnspython 2.7.0 - 168.69KB -
libtiff 4.7.0 4.6.0 142.50KB 51.7
mlflow-skinny 2.17.0 2.15.1 140.77KB 2.51
langsmith 0.1.129 0.1.99 139.69KB 126.9
azure-storage-common-cpp 12.7.0 - 139.69KB -
h5py 3.12.1 3.11.0 134.95KB 11.0
pandoc 3.5 3.3 107.73KB 0.53
httptools 0.6.1 - 88.74KB -
botocore 1.34.162 1.34.131 69.48KB 1.01
sagemaker-code-editor 1.3.3 1.3.1 62.84KB 0.15
nodejs 20.17.0 20.12.2 56.90KB 0.34
svt-av1 2.2.1 2.1.2 56.69KB 2.47
librsvg 2.58.4 2.58.3 55.96KB 0.9
libgfortran 14.2.0 - 52.73KB -
propcache 0.2.0 - 52.46KB -
nbdime 4.0.2 4.0.1 52.22KB 1.21
pycrdt 0.10.3 0.9.8 48.43KB 7.45
typer-slim-standard 0.12.5 - 45.72KB -
cpython 3.11.10 - 44.67KB -
typer-slim 0.12.5 - 44.57KB -
libgcc-devel_linux-64 13.3.0 12.4.0 43.66KB 1.75
email-validator 2.2.0 - 43.12KB -
imagecodecs 2024.9.22 2024.6.1 39.25KB 1.96
amazon-sagemaker-jupyter-ai-q-developer 1.0.12 1.0.9 37.84KB 87.3
aws-c-mqtt 0.10.7 0.10.4 31.32KB 19.57
keras 3.6.0 3.5.0 29.62KB 3.44
python-multipart 0.0.12 - 26.36KB -
libarrow-substrait 17.0.0 15.0.2 26.36KB 5.15
optree 0.13.0 0.12.1 26.06KB 8.42
aws-sdk-cpp 1.11.407 1.11.379 24.33KB 0.86
nss 3.105 3.103 24.07KB 1.25
pyjwt 2.9.0 - 23.78KB -
python-dotenv 1.0.1 - 23.71KB -
c-ares 1.34.2 1.33.0 23.36KB 13.15
aws-checksums 0.1.20 0.1.18 22.48KB 46.19
narwhals 1.9.4 1.4.2 22.35KB 26.13
textual 0.83.0 0.76.0 21.59KB 5.64
yarl 1.15.5 1.9.4 21.43KB 17.94
git-remote-codecommit 1.16 - 19.77KB -
libmambapy 1.5.10 1.5.8 19.36KB 6.37
contourpy 1.3.0 1.2.1 18.57KB 7.34
sqlalchemy 2.0.36 2.0.32 15.42KB 0.44
libsentencepiece 0.1.99 0.2.0 15.34KB 1.91
libgoogle-cloud 2.29.0 2.28.0 14.45KB 1.21
databricks-sdk 0.34.0 0.30.0 14.36KB 4.31
fastapi-cli 0.0.5 - 14.10KB -
libmamba 1.5.10 1.5.8 13.91KB 0.85
sentencepiece 0.1.99 0.2.0 13.76KB 83.54
langchain-community 0.2.16 0.2.12 13.27KB 1.2
pandas 2.2.3 2.2.2 12.44KB 0.08
langchain 0.2.16 0.2.5 12.10KB 2.97
libgoogle-cloud-storage 2.29.0 2.28.0 12.07KB 1.61
networkx 3.4.1 3.3 11.71KB 1.01
huggingface_hub 0.25.2 0.24.5 11.10KB 4.38
jupyter-ai 2.25.0 2.20.0 10.59KB 1.46
dataclasses 0.8 - 9.64KB -
libglib 2.82.2 2.80.3 8.79KB 0.23
requests-kerberos 0.15.0 0.14.0 8.75KB 53.15
libcurl 8.10.1 8.9.1 8.64KB 2.13
uvicorn-standard 0.32.0 - 6.99KB -
email_validator 2.2.0 - 6.53KB -
regex 2024.9.11 2024.7.24 6.30KB 1.59
xorg-libx11 1.8.10 1.8.9 5.97KB 0.73
opentelemetry-semantic-conventions 0.48b0 0.47b0 5.62KB 8.14
binutils_linux-64 2.43 2.40 5.51KB 19.26
anyio 4.6.2.post1 4.4.0 5.48KB 5.38
libgfortran5 14.2.0 14.1.0 4.96KB 0.35
fmt 11.0.2 10.2.1 4.57KB 2.41
opt_einsum 3.4.0 3.3.0 4.38KB 7.73
certifi 2024.8.30 2024.7.4 4.34KB 2.79
langchain-aws 0.1.18 0.1.16 4.34KB 7.21
greenlet 3.1.1 3.0.3 4.21KB 1.83
libgfortran-ng 14.2.0 14.1.0 4.11KB 8.44
ca-certificates 2024.8.30 2024.7.4 4.05KB 2.68
aws-crt-cpp 0.28.3 0.27.5 4.00KB 1.18
libgomp 14.2.0 14.1.0 3.97KB 0.89
langchain-core 0.2.40 0.2.33 3.72KB 1.49
google-auth 2.35.0 2.33.0 3.61KB 3.31
libarrow-acero 17.0.0 15.0.2 3.49KB 0.59
google-api-core 2.21.0 2.19.1 3.41KB 4.08
sentencepiece-spm 0.1.99 0.2.0 3.31KB 4.01
deepmerge 2.0 1.1.1 2.95KB 23.3
pyparsing 3.2.0 3.1.2 2.92KB 3.34
tifffile 2024.9.20 2024.8.10 2.71KB 1.56
tzdata 2024b 2024a 2.48KB 2.12
jupyter-ai-magics 2.25.0 2.20.0 2.45KB 7.54
binutils 2.43 2.40 2.42KB 7.83
aioitertools 0.12.0 0.11.0 2.42KB 10.99
libpng 1.6.44 1.6.43 2.38KB 0.85
fastapi 0.115.2 0.110.3 2.25KB 3.27
tomli 2.0.2 2.0.1 2.21KB 14.2
gxx 13.3.0 12.4.0 2.06KB 4.11
gcc 13.3.0 12.4.0 2.02KB 4.0
dill 0.3.9 0.3.8 1.92KB 2.23
aws-c-s3 0.6.7 0.6.4 1.88KB 1.72
uvicorn 0.32.0 0.30.6 1.81KB 1.39
conda-package-handling 2.4.0 2.3.0 1.49KB 0.6
jsonschema 4.23.0 4.21.1 1.47KB 2.07
rich 13.9.2 13.7.1 1.39KB 0.77
amazon-q-developer-jupyterlab-ext 3.4.0 3.2.0 1.37KB 0.58
libparquet 17.0.0 15.0.2 1.34KB 0.12
amazon-sagemaker-jupyter-scheduler 3.1.6 3.1.3 1.30KB 0.78
pylint 3.3.1 3.2.6 1.29KB 0.38
distlib 0.3.9 0.3.8 1.27KB 0.47
starlette 0.40.0 0.37.2 1.20KB 2.14
msgpack-python 1.1.0 1.0.8 1.20KB 1.19
multidict 6.1.0 6.0.5 1.18KB 1.95
py-xgboost 2.1.1 2.0.3 1.16KB 0.89
conda-package-streaming 0.11.0 0.10.0 1.15KB 6.09
libdeflate 1.22 1.21 1.05KB 1.52
cffi 1.17.1 1.17.0 1.05KB 0.36
sagemaker-jupyterlab-extension-common 0.1.24 0.1.21 1017.00B 0.45
sagemaker-kernel-wrapper 0.0.4 0.0.2 1015.00B 6.61
ray-tune 2.37.0 2.31.0 984.00B 2.06
libxcb 1.17.0 1.16 956.00B 0.24
proto-plus 1.24.0 1.23.0 925.00B 2.23
opentelemetry-api 1.27.0 1.26.0 896.00B 2.09
jupyter-server-proxy 4.4.0 4.3.0 833.00B 2.31
ipython 8.28.0 8.26.0 815.00B 0.14
opentelemetry-sdk 1.27.0 1.26.0 802.00B 1.1
xorg-libxdmcp 1.1.5 1.1.3 775.00B 4.05
conda-libmamba-solver 24.9.0 24.7.0 723.00B 1.77
charset-normalizer 3.4.0 3.3.2 717.00B 1.54
paramiko 3.5.0 3.4.1 696.00B 0.44
importlib_resources 6.4.5 6.4.3 680.00B 2.12
executing 2.1.0 2.0.1 648.00B 2.34
googleapis-common-protos 1.65.0 1.63.2 573.00B 0.5
zipp 3.20.2 3.20.0 552.00B 2.65
alembic 1.13.3 1.13.2 505.00B 0.32
zlib-ng 2.2.2 2.2.1 485.00B 0.46
aws-c-common 0.9.29 0.9.27 472.00B 0.2
gxx_linux-64 13.3.0 12.4.0 457.00B 1.53
gcc_linux-64 13.3.0 12.4.0 448.00B 1.42
httpx 0.27.2 0.27.0 434.00B 0.67
sagemaker-jupyterlab-emr-extension 0.3.3 0.3.2 423.00B 0.14
marshmallow 3.23.0 3.21.3 419.00B 0.45
truststore 0.9.2 0.8.0 419.00B 2.03
aws-glue-sessions 1.0.7 1.0.6 392.00B 0.57
aws-c-http 0.8.10 0.8.7 376.00B 0.19
aws-c-event-stream 0.4.3 0.4.2 307.00B 0.57
expat 2.6.3 2.6.2 264.00B 0.19
pyasn1-modules 0.4.1 0.4.0 203.00B 0.21
langchain-text-splitters 0.2.4 0.2.2 183.00B 0.69
flake8 7.1.1 7.0.0 171.00B 0.15
amazon-sagemaker-sql-execution 0.1.6 0.1.3 165.00B 0.5
aiobotocore 2.13.3 2.13.2 129.00B 0.19
prometheus_client 0.21.0 0.20.0 111.00B 0.23
jupyter 1.1.1 1.0.0 108.00B 1.25
python-lsp-server-base 1.12.0 1.11.0 92.00B 0.15
jupyter-collaboration 2.1.4 2.1.2 73.00B 0.15
aws-c-io 0.14.19 0.14.18 68.00B 0.04
smart_open 7.0.5 7.0.4 65.00B 0.13
mlflow 2.17.0 2.15.1 65.00B 0.41
frozendict 2.4.6 2.4.4 47.00B 0.15
lightning-utilities 0.11.8 0.11.6 23.00B 0.08
aws-c-auth 0.7.31 0.7.25 15.00B 0.01
jupyter_ydoc 2.1.3 2.1.1 6.00B 0.02
types-python-dateutil 2.9.0.20241003 2.9.0.20240316 -4.00B -0.02
pycrdt-websocket 0.15.1 0.14.1 -7.00B -0.03
aws-c-compression 0.2.19 0.2.18 -34.00B -0.18
xorg-libxext 1.3.6 1.3.4 -83.00B -0.17
pyzmq 26.2.0 26.1.0 -90.00B -0.02
ppft 1.7.6.9 1.7.6.8 -94.00B -0.28
pycodestyle 2.12.1 2.11.1 -103.00B -0.3
httpcore 1.0.6 1.0.5 -105.00B -0.23
libexpat 2.6.3 2.6.2 -114.00B -0.15
python-lsp-server 1.12.0 1.11.0 -120.00B -1.67
prompt_toolkit 3.0.48 3.0.47 -120.00B -1.77
jupyter-scheduler 2.9.0 2.7.1 -122.00B -1.87
libsqlite 3.46.1 3.46.0 -132.00B -0.02
aws-c-cal 0.7.4 0.7.3 -136.00B -0.29
s3transfer 0.10.3 0.10.2 -173.00B -0.27
pox 0.3.5 0.3.4 -182.00B -0.68
jupyter_client 8.6.3 8.6.2 -193.00B -0.18
termcolor 2.5.0 2.4.0 -195.00B -1.53
cxx-compiler 1.8.0 1.7.0 -224.00B -3.57
filelock 3.16.1 3.15.4 -235.00B -1.34
c-compiler 1.8.0 1.7.0 -239.00B -3.78
jsonschema-specifications 2024.10.1 2023.12.1 -266.00B -1.62
ipywidgets 8.1.5 8.1.3 -290.00B -0.25
jsonschema-with-format-nongpl 4.23.0 4.21.1 -309.00B -4.15
s2n 1.5.5 1.5.0 -402.00B -0.11
prompt-toolkit 3.0.48 3.0.47 -439.00B -0.16
jupyterlab_widgets 3.0.13 3.0.11 -443.00B -0.24
boto3 1.34.162 1.34.131 -555.00B -0.69
imageio 2.36.0 2.35.1 -611.00B -0.21
werkzeug 3.0.4 3.0.3 -651.00B -0.27
kiwisolver 1.4.7 1.4.5 -880.00B -1.2
astroid 3.3.5 3.2.4 -1.11KB -0.22
py-xgboost-gpu 2.1.1 2.0.3 -1.42KB -8.77
xgboost 2.1.1 2.0.3 -1.44KB -8.86
python-tzdata 2024.2 2024.1 -1.46KB -1.04
pyasn1 0.6.1 0.6.0 -1.61KB -2.57
altair 5.4.1 5.4.0 -1.71KB -0.38
cytoolz 1.0.0 0.12.3 -1.81KB -0.47
markupsafe 3.0.2 2.1.5 -1.87KB -6.95
idna 3.10 3.7 -2.81KB -5.46
openssl 3.3.2 3.3.1 -3.34KB -0.12
python-gssapi 1.9.0 1.8.3 -3.67KB -0.67
safetensors 0.4.5 0.4.4 -4.32KB -1.08
graphql-core 3.2.5 3.2.3 -4.91KB -1.37
libarrow-dataset 17.0.0 15.0.2 -6.52KB -1.13
sympy 1.13.3 1.13.2 -6.98KB -0.16
graphene 3.4 3.3 -11.25KB -19.4
libuv 1.49.2 1.48.0 -14.97KB -1.7
binutils_impl_linux-64 2.43 2.40 -17.17KB -0.28
tbb 2021.13.0 2021.12.0 -17.19KB -9.1
cryptography 43.0.3 43.0.0 -17.73KB -1.2
typer 0.12.5 0.9.4 -26.27KB -33.52
ld_impl_linux-64 2.43 2.40 -37.10KB -5.37
fonttools 4.54.1 4.53.1 -37.71KB -1.33
lxml 5.3.0 4.9.4 -55.74KB -3.95
statsmodels 0.14.4 0.14.2 -57.31KB -0.48
conda 24.9.2 24.7.1 -61.53KB -5.04
libjxl 0.11.0 0.10.3 -81.49KB -5.26
datasets 2.2.1 2.21.0 -104.99KB -29.63
mlflow-ui 2.17.0 2.15.1 -121.31KB -2.72
amazon_sagemaker_sql_editor 0.1.12 0.1.11 -129.23KB -0.73
sentencepiece-python 0.1.99 0.2.0 -162.23KB -6.23
libsodium 1.0.20 1.0.18 -165.06KB -45.07
widgetsnbextension 4.0.13 4.0.11 -177.04KB -16.79
dash 2.18.1 2.17.1 -225.81KB -4.2
python 3.11.10 3.11.9 -332.54KB -1.1
ray-default 2.37.0 2.31.0 -392.15KB -16.56
setuptools 75.1.0 72.1.0 -669.09KB -46.84
libgcc-ng 14.2.0 14.1.0 -769.50KB -93.57
ray-core 2.37.0 2.31.0 -1.68MB -5.6
libstdcxx-ng 14.2.0 14.1.0 -3.65MB -98.61
pyarrow 17.0.0 15.0.2 -4.33MB -99.44
jupyter_scheduler 2.9.0 2.7.1 -4.78MB -95.54
llvm-openmp 19.1.2 18.1.8 -52.73MB -94.55
libxgboost 2.1.1 2.0.3 -68.18MB -41.71

Python Package Size Report (CPU)

Target Image Version: 2.1.0 | Base Image Version: 2.0.0

Python Packages Total Size Summary

Target Version Total Size Base Version Total Size Size Change (abs) Size Change (%)
1.08GB 1.19GB -111.66MB -9.19

Top-20 Largest Python Packages

Package Version in the Target Image Size
mkl 2023.2.0 156.82MB
tensorflow-base 2.17.0 149.59MB
libtorch 2.4.1 49.40MB
catboost 1.2.7 45.27MB
sagemaker-code-editor 1.3.3 41.13MB
pillow 10.4.0 40.35MB
pytorch 2.4.1 34.23MB
libllvm14 14.0.6 30.03MB
python 3.11.10 29.13MB
ray-core 2.37.0 28.26MB
pandoc 3.5 20.03MB
amazon_sagemaker_sql_editor 0.1.12 17.13MB
scipy 1.14.1 16.78MB
nodejs 20.17.0 16.42MB
pandas 2.2.3 14.97MB
rav1e 0.6.6 14.71MB
statsmodels 0.14.4 11.72MB
icu 75.1 11.57MB
scikit-image 0.24.0 10.69MB
scikit-learn 1.5.2 10.11MB

Python Package Size Delta

The total size of newly introduced Python packages is 14.22MB, accounts for 1.29% of the total package size.

Package Version in the Target Image Version in the Base Image Size Change (abs) Size Change (%)
pyarrow-core 17.0.0 - 4.44MB -
libstdcxx 14.2.0 - 3.71MB -
torchvision 0.19.1 0.18.1 3.46MB 52.66
pytorch 2.4.1 2.3.1 2.34MB 7.33
libtorch 2.4.1 2.3.1 1.86MB 3.91
snowflake-connector-python 3.12.2 - 1.11MB -
uvloop 0.21.0 - 973.29KB -
sleef 3.7 3.6.1 900.87KB 92.42
libgcc 14.2.0 - 828.85KB -
plotly 5.24.1 5.23.0 557.38KB 8.9
xorg-xorgproto 2024.1 - 552.17KB -
azure-storage-blobs-cpp 12.12.0 - 510.86KB -
scikit-image 0.24.0 0.20.0 434.83KB 4.14
watchfiles 0.24.0 - 386.50KB -
libarrow 17.0.0 15.0.2 332.60KB 4.18
azure-core-cpp 1.13.0 - 330.21KB -
scipy 1.14.1 1.12.0 314.35KB 1.86
azure-storage-files-datalake-cpp 12.11.0 - 268.06KB -
scikit-learn 1.5.2 1.4.2 258.71KB 2.56
websockets 13.1 - 231.34KB -
debugpy 1.8.7 1.8.5 219.96KB 9.71
catboost 1.2.7 1.2.5 213.92KB 0.46
azure-identity-cpp 1.8.0 - 194.84KB -
dnspython 2.7.0 - 168.69KB -
libtiff 4.7.0 4.6.0 142.50KB 51.7
mlflow-skinny 2.17.0 2.15.1 140.77KB 2.51
langsmith 0.1.129 0.1.99 139.69KB 126.9
azure-storage-common-cpp 12.7.0 - 139.69KB -
h5py 3.12.1 3.11.0 134.95KB 11.0
pandoc 3.5 3.3 107.73KB 0.53
httptools 0.6.1 - 88.74KB -
botocore 1.34.162 1.34.131 69.48KB 1.01
sagemaker-code-editor 1.3.3 1.3.1 62.84KB 0.15
nodejs 20.17.0 20.12.2 56.90KB 0.34
svt-av1 2.2.1 2.1.2 56.69KB 2.47
librsvg 2.58.4 2.58.3 55.96KB 0.9
libgfortran 14.2.0 - 52.73KB -
propcache 0.2.0 - 52.46KB -
nbdime 4.0.2 4.0.1 52.22KB 1.21
pycrdt 0.10.3 0.9.8 48.43KB 7.45
typer-slim-standard 0.12.5 - 45.72KB -
cpython 3.11.10 - 44.67KB -
typer-slim 0.12.5 - 44.57KB -
email-validator 2.2.0 - 43.12KB -
imagecodecs 2024.9.22 2024.6.1 39.25KB 1.96
amazon-sagemaker-jupyter-ai-q-developer 1.0.12 1.0.9 37.84KB 87.3
aws-c-mqtt 0.10.7 0.10.4 31.32KB 19.57
keras 3.6.0 3.5.0 29.62KB 3.44
python-multipart 0.0.12 - 26.36KB -
libarrow-substrait 17.0.0 15.0.2 26.36KB 5.15
optree 0.13.0 0.12.1 26.06KB 8.42
aws-sdk-cpp 1.11.407 1.11.379 24.33KB 0.86
nss 3.105 3.103 24.07KB 1.25
pyjwt 2.9.0 - 23.78KB -
python-dotenv 1.0.1 - 23.71KB -
c-ares 1.34.2 1.33.0 23.36KB 13.15
aws-checksums 0.1.20 0.1.18 22.48KB 46.19
narwhals 1.9.4 1.4.2 22.35KB 26.13
textual 0.83.0 0.76.0 21.59KB 5.64
yarl 1.15.5 1.9.4 21.43KB 17.94
git-remote-codecommit 1.16 - 19.77KB -
libmambapy 1.5.10 1.5.8 19.36KB 6.37
contourpy 1.3.0 1.2.1 18.57KB 7.34
sqlalchemy 2.0.36 2.0.32 15.42KB 0.44
libsentencepiece 0.1.99 0.2.0 15.34KB 1.91
libgoogle-cloud 2.29.0 2.28.0 14.45KB 1.21
databricks-sdk 0.34.0 0.30.0 14.36KB 4.31
fastapi-cli 0.0.5 - 14.10KB -
libmamba 1.5.10 1.5.8 13.91KB 0.85
sentencepiece 0.1.99 0.2.0 13.76KB 83.54
langchain-community 0.2.16 0.2.12 13.27KB 1.2
pandas 2.2.3 2.2.2 12.44KB 0.08
langchain 0.2.16 0.2.5 12.10KB 2.97
libgoogle-cloud-storage 2.29.0 2.28.0 12.07KB 1.61
networkx 3.4.1 3.3 11.71KB 1.01
huggingface_hub 0.25.2 0.24.5 11.10KB 4.38
jupyter-ai 2.25.0 2.20.0 10.59KB 1.46
dataclasses 0.8 - 9.64KB -
libglib 2.82.2 2.80.3 8.79KB 0.23
requests-kerberos 0.15.0 0.14.0 8.75KB 53.15
libcurl 8.10.1 8.9.1 8.64KB 2.13
uvicorn-standard 0.32.0 - 6.99KB -
email_validator 2.2.0 - 6.53KB -
regex 2024.9.11 2024.7.24 6.30KB 1.59
xorg-libx11 1.8.10 1.8.9 5.97KB 0.73
opentelemetry-semantic-conventions 0.48b0 0.47b0 5.62KB 8.14
anyio 4.6.2.post1 4.4.0 5.48KB 5.38
libgfortran5 14.2.0 14.1.0 4.96KB 0.35
fmt 11.0.2 10.2.1 4.57KB 2.41
opt_einsum 3.4.0 3.3.0 4.38KB 7.73
certifi 2024.8.30 2024.7.4 4.34KB 2.79
langchain-aws 0.1.18 0.1.16 4.34KB 7.21
greenlet 3.1.1 3.0.3 4.21KB 1.83
libgfortran-ng 14.2.0 14.1.0 4.11KB 8.44
ca-certificates 2024.8.30 2024.7.4 4.05KB 2.68
aws-crt-cpp 0.28.3 0.27.5 4.00KB 1.18
langchain-core 0.2.40 0.2.33 3.72KB 1.49
google-auth 2.35.0 2.33.0 3.61KB 3.31
libarrow-acero 17.0.0 15.0.2 3.49KB 0.59
google-api-core 2.21.0 2.19.1 3.41KB 4.08
sentencepiece-spm 0.1.99 0.2.0 3.31KB 4.01
deepmerge 2.0 1.1.1 2.95KB 23.3
pyparsing 3.2.0 3.1.2 2.92KB 3.34
tifffile 2024.9.20 2024.8.10 2.71KB 1.56
tzdata 2024b 2024a 2.48KB 2.12
jupyter-ai-magics 2.25.0 2.20.0 2.45KB 7.54
aioitertools 0.12.0 0.11.0 2.42KB 10.99
libpng 1.6.44 1.6.43 2.38KB 0.85
fastapi 0.115.2 0.110.3 2.25KB 3.27
tomli 2.0.2 2.0.1 2.21KB 14.2
dill 0.3.9 0.3.8 1.92KB 2.23
aws-c-s3 0.6.7 0.6.4 1.88KB 1.72
uvicorn 0.32.0 0.30.6 1.81KB 1.39
py-xgboost 2.1.1 2.0.3 1.72KB 1.33
conda-package-handling 2.4.0 2.3.0 1.49KB 0.6
jsonschema 4.23.0 4.21.1 1.47KB 2.07
rich 13.9.2 13.7.1 1.39KB 0.77
amazon-q-developer-jupyterlab-ext 3.4.0 3.2.0 1.37KB 0.58
libparquet 17.0.0 15.0.2 1.34KB 0.12
amazon-sagemaker-jupyter-scheduler 3.1.6 3.1.3 1.30KB 0.78
pylint 3.3.1 3.2.6 1.29KB 0.38
distlib 0.3.9 0.3.8 1.27KB 0.47
starlette 0.40.0 0.37.2 1.20KB 2.14
msgpack-python 1.1.0 1.0.8 1.20KB 1.19
multidict 6.1.0 6.0.5 1.18KB 1.95
conda-package-streaming 0.11.0 0.10.0 1.15KB 6.09
libdeflate 1.22 1.21 1.05KB 1.52
cffi 1.17.1 1.17.0 1.05KB 0.36
sagemaker-jupyterlab-extension-common 0.1.24 0.1.21 1017.00B 0.45
sagemaker-kernel-wrapper 0.0.4 0.0.2 1015.00B 6.61
ray-tune 2.37.0 2.31.0 984.00B 2.06
libxcb 1.17.0 1.16 956.00B 0.24
proto-plus 1.24.0 1.23.0 925.00B 2.23
opentelemetry-api 1.27.0 1.26.0 896.00B 2.09
jupyter-server-proxy 4.4.0 4.3.0 833.00B 2.31
ipython 8.28.0 8.26.0 815.00B 0.14
opentelemetry-sdk 1.27.0 1.26.0 802.00B 1.1
xorg-libxdmcp 1.1.5 1.1.3 775.00B 4.05
conda-libmamba-solver 24.9.0 24.7.0 723.00B 1.77
charset-normalizer 3.4.0 3.3.2 717.00B 1.54
paramiko 3.5.0 3.4.1 696.00B 0.44
importlib_resources 6.4.5 6.4.3 680.00B 2.12
executing 2.1.0 2.0.1 648.00B 2.34
googleapis-common-protos 1.65.0 1.63.2 573.00B 0.5
zipp 3.20.2 3.20.0 552.00B 2.65
alembic 1.13.3 1.13.2 505.00B 0.32
zlib-ng 2.2.2 2.2.1 485.00B 0.46
aws-c-common 0.9.29 0.9.27 472.00B 0.2
httpx 0.27.2 0.27.0 434.00B 0.67
sagemaker-jupyterlab-emr-extension 0.3.3 0.3.2 423.00B 0.14
marshmallow 3.23.0 3.21.3 419.00B 0.45
truststore 0.9.2 0.8.0 419.00B 2.03
aws-glue-sessions 1.0.7 1.0.6 392.00B 0.57
aws-c-http 0.8.10 0.8.7 376.00B 0.19
aws-c-event-stream 0.4.3 0.4.2 307.00B 0.57
expat 2.6.3 2.6.2 264.00B 0.19
pyasn1-modules 0.4.1 0.4.0 203.00B 0.21
langchain-text-splitters 0.2.4 0.2.2 183.00B 0.69
flake8 7.1.1 7.0.0 171.00B 0.15
amazon-sagemaker-sql-execution 0.1.6 0.1.3 165.00B 0.5
aiobotocore 2.13.3 2.13.2 129.00B 0.19
prometheus_client 0.21.0 0.20.0 111.00B 0.23
jupyter 1.1.1 1.0.0 108.00B 1.25
python-lsp-server-base 1.12.0 1.11.0 92.00B 0.15
jupyter-collaboration 2.1.4 2.1.2 73.00B 0.15
aws-c-io 0.14.19 0.14.18 68.00B 0.04
smart_open 7.0.5 7.0.4 65.00B 0.13
mlflow 2.17.0 2.15.1 65.00B 0.41
frozendict 2.4.6 2.4.4 47.00B 0.15
lightning-utilities 0.11.8 0.11.6 23.00B 0.08
aws-c-auth 0.7.31 0.7.25 15.00B 0.01
jupyter_ydoc 2.1.3 2.1.1 6.00B 0.02
types-python-dateutil 2.9.0.20241003 2.9.0.20240316 -4.00B -0.02
pycrdt-websocket 0.15.1 0.14.1 -7.00B -0.03
aws-c-compression 0.2.19 0.2.18 -34.00B -0.18
xorg-libxext 1.3.6 1.3.4 -83.00B -0.17
pyzmq 26.2.0 26.1.0 -90.00B -0.02
ppft 1.7.6.9 1.7.6.8 -94.00B -0.28
pycodestyle 2.12.1 2.11.1 -103.00B -0.3
httpcore 1.0.6 1.0.5 -105.00B -0.23
libexpat 2.6.3 2.6.2 -114.00B -0.15
python-lsp-server 1.12.0 1.11.0 -120.00B -1.67
prompt_toolkit 3.0.48 3.0.47 -120.00B -1.77
jupyter-scheduler 2.9.0 2.7.1 -122.00B -1.87
libsqlite 3.46.1 3.46.0 -132.00B -0.02
aws-c-cal 0.7.4 0.7.3 -136.00B -0.29
s3transfer 0.10.3 0.10.2 -173.00B -0.27
pox 0.3.5 0.3.4 -182.00B -0.68
jupyter_client 8.6.3 8.6.2 -193.00B -0.18
termcolor 2.5.0 2.4.0 -195.00B -1.53
filelock 3.16.1 3.15.4 -235.00B -1.34
jsonschema-specifications 2024.10.1 2023.12.1 -266.00B -1.62
ipywidgets 8.1.5 8.1.3 -290.00B -0.25
jsonschema-with-format-nongpl 4.23.0 4.21.1 -309.00B -4.15
s2n 1.5.5 1.5.0 -402.00B -0.11
prompt-toolkit 3.0.48 3.0.47 -439.00B -0.16
jupyterlab_widgets 3.0.13 3.0.11 -443.00B -0.24
boto3 1.34.162 1.34.131 -555.00B -0.69
imageio 2.36.0 2.35.1 -611.00B -0.21
werkzeug 3.0.4 3.0.3 -651.00B -0.27
kiwisolver 1.4.7 1.4.5 -880.00B -1.2
py-xgboost-cpu 2.1.1 2.0.3 -926.00B -5.72
xgboost 2.1.1 2.0.3 -943.00B -5.83
astroid 3.3.5 3.2.4 -1.11KB -0.22
python-tzdata 2024.2 2024.1 -1.46KB -1.04
pyasn1 0.6.1 0.6.0 -1.61KB -2.57
altair 5.4.1 5.4.0 -1.71KB -0.38
cytoolz 1.0.0 0.12.3 -1.81KB -0.47
markupsafe 3.0.2 2.1.5 -1.87KB -6.95
idna 3.10 3.7 -2.81KB -5.46
openssl 3.3.2 3.3.1 -3.34KB -0.12
python-gssapi 1.9.0 1.8.3 -3.67KB -0.67
safetensors 0.4.5 0.4.4 -4.32KB -1.08
graphql-core 3.2.5 3.2.3 -4.91KB -1.37
libarrow-dataset 17.0.0 15.0.2 -6.52KB -1.13
sympy 1.13.3 1.13.2 -6.98KB -0.16
graphene 3.4 3.3 -11.25KB -19.4
libuv 1.49.2 1.48.0 -14.97KB -1.7
tbb 2021.13.0 2021.12.0 -17.19KB -9.1
cryptography 43.0.3 43.0.0 -17.73KB -1.2
typer 0.12.5 0.9.4 -26.27KB -33.52
ld_impl_linux-64 2.43 2.40 -37.10KB -5.37
fonttools 4.54.1 4.53.1 -37.71KB -1.33
lxml 5.3.0 4.9.4 -55.74KB -3.95
statsmodels 0.14.4 0.14.2 -57.31KB -0.48
conda 24.9.2 24.7.1 -61.53KB -5.04
libjxl 0.11.0 0.10.3 -81.49KB -5.26
datasets 2.2.1 2.21.0 -104.99KB -29.63
mlflow-ui 2.17.0 2.15.1 -121.31KB -2.72
amazon_sagemaker_sql_editor 0.1.12 0.1.11 -129.23KB -0.73
sentencepiece-python 0.1.99 0.2.0 -162.23KB -6.23
libsodium 1.0.20 1.0.18 -165.06KB -45.07
widgetsnbextension 4.0.13 4.0.11 -177.04KB -16.79
dash 2.18.1 2.17.1 -225.81KB -4.2
python 3.11.10 3.11.9 -332.54KB -1.1
ray-default 2.37.0 2.31.0 -392.15KB -16.56
setuptools 75.1.0 72.1.0 -669.09KB -46.84
libgcc-ng 14.2.0 14.1.0 -769.50KB -93.57
ray-core 2.37.0 2.31.0 -1.68MB -5.6
libxgboost 2.1.1 2.0.3 -1.92MB -38.67
libstdcxx-ng 14.2.0 14.1.0 -3.65MB -98.61
pyarrow 17.0.0 15.0.2 -4.33MB -99.44
jupyter_scheduler 2.9.0 2.7.1 -4.78MB -95.54
llvm-openmp 19.1.2 18.1.8 -52.73MB -94.55

@sagemaker-distribution-bot
Copy link
Collaborator

AWS CodeBuild CI Report

  • CodeBuild project: CosmosImageBuildersagemaker-U5omrjiHQCoa
  • Commit ID: a136677
  • Result: FAILED
  • Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

@TRNWWZ
Copy link
Contributor

TRNWWZ commented Oct 21, 2024

FAILED test/test_dockerfile_based_harness.py::test_dockerfiles_for_gpu[numpy.test.Dockerfile-required_packages6]
FAILED test/test_dockerfile_based_harness.py::test_dockerfiles_for_gpu[autogluon.test.Dockerfile-required_packages1]
FAILED test/test_dockerfile_based_harness.py::test_dockerfiles_for_gpu[sagemaker-studio-analytics-extension.test.Dockerfile-required_packages21]
FAILED test/test_dockerfile_based_harness.py::test_dockerfiles_for_gpu[mlflow.test.Dockerfile-required_packages28]
FAILED test/test_dockerfile_based_harness.py::test_dockerfiles_for_gpu[sm-python-sdk.test.Dockerfile-required_packages9]required_packages9]

@TRNWWZ
Copy link
Contributor

TRNWWZ commented Oct 22, 2024

Pytorch in GPU image is restricted to 2.3.1 version, because there is no compatible 2.4.x cuda version can be installed

@TRNWWZ TRNWWZ merged commit 3fe7b35 into main Oct 23, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants