Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Automatic 1111 building runs into ERROR [auto stage-2 3/15] #480

Closed
nekrasovdmitriy opened this issue May 21, 2023 · 11 comments
Closed

Automatic 1111 building runs into ERROR [auto stage-2 3/15] #480

nekrasovdmitriy opened this issue May 21, 2023 · 11 comments
Labels
awaiting-response Waiting for the issuer to respond bug Something isn't working Stale

Comments

@nekrasovdmitriy
Copy link

nekrasovdmitriy commented May 21, 2023 •
edited
Loading

Has this issue been opened before?

  • [ ] It is not in the FAQ, I checked.
  • [ ] It is not in the issues, I searched.

Describe the bug

Trying to execute docker compose --profile auto up --build run into ERROR [auto stage-2 3/15]
(InvokeAI works flawlessly, by the way)

Which UI

auto

Hardware / Software

  • OS: Debian 11
  • OS version: Linux sd 5.10.0-23-amd64 SMP Debian 5.10.179-1
  • WSL version (if applicable):
  • Docker Version: Community Version: 24.0.1
  • Docker compose version: v2.18.1
  • Repo version: from master
  • RAM: 16 GB
  • GPU/VRAM: RTX a4000 16 GB

Steps to Reproduce

Execute docker compose --profile auto up --build from downloaded repo folder.

Additional context
Any other context about the problem here. If applicable, add screenshots to help explain your problem.

Снимок экрана 2023-05-21 в 11 40 18 Снимок экрана 2023-05-21 в 11 40 31 
root@sd:/home/debian/stable-diffusion-webui-docker# docker compose --profile auto up --build
[+] Building 31.7s (20/32)                                                                                                                                        
 => [auto internal] load .dockerignore                                                                                                                       0.0s
 => => transferring context: 2B                                                                                                                              0.0s
 => [auto internal] load build definition from Dockerfile                                                                                                    0.0s
 => => transferring dockerfile: 4.11kB                                                                                                                       0.0s
 => [auto internal] load metadata for docker.io/library/python:3.10.9-slim                                                                                   0.9s
 => [auto internal] load metadata for docker.io/alpine/git:2.36.2                                                                                            0.9s
 => [auto internal] load metadata for docker.io/library/alpine:3.17                                                                                          0.9s
 => [auto download 1/8] FROM docker.io/alpine/git:2.36.2@sha256:ec491c893597b68c92b88023827faa771772cfd5e106b76c713fa5e1c75dea84                             0.0s
 => [auto internal] load build context                                                                                                                       0.0s
 => => transferring context: 149B                                                                                                                            0.0s
 => [auto xformers 1/3] FROM docker.io/library/alpine:3.17@sha256:124c7d2707904eea7431fffe91522a01e5a861a624ee31d03372cc1d138a3126                           0.0s
 => [auto stage-2  1/15] FROM docker.io/library/python:3.10.9-slim@sha256:76dd18d90a3d8710e091734bf2c9dd686d68747a51908db1e1f41e9a5ed4e2c5                   0.0s
 => CACHED [auto stage-2  2/15] RUN apt-get update && apt install fonts-dejavu-core rsync git jq moreutils aria2 -y && apt-get clean                         0.0s
 => CACHED [auto xformers 2/3] RUN apk add --no-cache aria2                                                                                                  0.0s
 => CACHED [auto xformers 3/3] RUN aria2c -x 5 --dir / --out wheel.whl 'https://github.com/AbdBarho/stable-diffusion-webui-docker/releases/download/5.0.3/x  0.0s
 => ERROR [auto stage-2  3/15] RUN --mount=type=cache,target=/cache --mount=type=cache,target=/root/.cache/pip   aria2c -x 5 --dir /cache --out torch-2.0.  30.3s
 => CACHED [auto download 2/8] COPY clone.sh /clone.sh                                                                                                       0.0s
 => [auto download 3/8] RUN . /clone.sh taming-transformers https://github.com/CompVis/taming-transformers.git 24268930bf1dce879235a7fddd0b2355b84d7ea6   &  8.0s
 => [auto download 4/8] RUN . /clone.sh stable-diffusion-stability-ai https://github.com/Stability-AI/stablediffusion.git 47b6b607fdd31875c9279cd2f4f16b92e  4.7s
 => [auto download 5/8] RUN . /clone.sh CodeFormer https://github.com/sczhou/CodeFormer.git c5b4593074ba6214284d6acd5f1719b6c5d739af   && rm -rf assets inp  1.6s
 => [auto download 6/8] RUN . /clone.sh BLIP https://github.com/salesforce/BLIP.git 48211a1594f1321b00f14c9f7a5b4813144b2fb9                                 2.1s
 => [auto download 7/8] RUN . /clone.sh k-diffusion https://github.com/crowsonkb/k-diffusion.git 5b3af030dd83e0297272d861c19477735d0317ec                    1.1s
 => [auto download 8/8] RUN . /clone.sh clip-interrogator https://github.com/pharmapsychotic/clip-interrogator 2486589f24165c8e3b303f84e9dbbea318df83e8      1.4s
------                                                                                                                                                            
 > [auto stage-2  3/15] RUN --mount=type=cache,target=/cache --mount=type=cache,target=/root/.cache/pip   aria2c -x 5 --dir /cache --out torch-2.0.0-cp310-cp310-linux_x86_64.whl -c   https://download.pytorch.org/whl/cu118/torch-2.0.0%2Bcu118-cp310-cp310-linux_x86_64.whl &&   pip install /cache/torch-2.0.0-cp310-cp310-linux_x86_64.whl torchvision --index-url https://download.pytorch.org/whl/cu118:                                                                                       
#0 0.242                                                                                                                                                          
#0 0.242 05/21 08:31:30 [NOTICE] Downloading 1 item(s)                                                                                                            
#0 0.505                                                                                                                                                          
#0 0.505 05/21 08:31:30 [NOTICE] GID#5defce0c05c07097 - Download has already completed: /cache/torch-2.0.0-cp310-cp310-linux_x86_64.whl                           
#0 0.506                                                                                                                                                          
#0 0.506 05/21 08:31:30 [NOTICE] Download complete: /cache/torch-2.0.0-cp310-cp310-linux_x86_64.whl                                                               
#0 0.506                                                                                                                                                          
#0 0.506 Download Results:                                                                                                                                        
#0 0.506 gid   |stat|avg speed  |path/URI
#0 0.506 ======+====+===========+=======================================================
#0 0.506 5defce|OK  |       0B/s|/cache/torch-2.0.0-cp310-cp310-linux_x86_64.whl
#0 0.506 
#0 0.506 Status Legend:
#0 0.506 (OK):download completed.
#0 1.843 Looking in indexes: https://download.pytorch.org/whl/cu118
#0 1.854 Processing /cache/torch-2.0.0-cp310-cp310-linux_x86_64.whl
#0 12.25 Collecting torchvision
#0 12.56   Using cached https://download.pytorch.org/whl/cu118/torchvision-0.15.2%2Bcu118-cp310-cp310-linux_x86_64.whl (6.1 MB)
#0 13.10 Collecting networkx
#0 13.14   Using cached https://download.pytorch.org/whl/networkx-3.0-py3-none-any.whl (2.0 MB)
#0 13.67 Collecting filelock
#0 13.70   Using cached https://download.pytorch.org/whl/filelock-3.9.0-py3-none-any.whl (9.7 kB)
#0 14.21 Collecting jinja2
#0 14.24   Using cached https://download.pytorch.org/whl/Jinja2-3.1.2-py3-none-any.whl (133 kB)
#0 14.80 Collecting typing-extensions
#0 14.83   Using cached https://download.pytorch.org/whl/typing_extensions-4.4.0-py3-none-any.whl (26 kB)
#0 15.35 Collecting triton==2.0.0
#0 16.13   Using cached https://download.pytorch.org/whl/triton-2.0.0-1-cp310-cp310-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (63.3 MB)
#0 16.89 Collecting sympy
#0 16.98   Using cached https://download.pytorch.org/whl/sympy-1.11.1-py3-none-any.whl (6.5 MB)
#0 17.53 Collecting lit
#0 17.58   Downloading https://download.pytorch.org/whl/lit-15.0.7.tar.gz (132 kB)
#0 17.61      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 132.3/132.3 kB 5.0 MB/s eta 0:00:00
#0 17.69   Preparing metadata (setup.py): started
#0 18.22   Preparing metadata (setup.py): finished with status 'done'
#0 18.73 Collecting cmake
#0 18.75   Downloading https://download.pytorch.org/whl/cmake-3.25.0-py2.py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (23.7 MB)
#0 19.16      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 23.7/23.7 MB 49.9 MB/s eta 0:00:00
#0 19.76 Collecting requests
#0 19.78   Downloading https://download.pytorch.org/whl/requests-2.28.1-py3-none-any.whl (62 kB)
#0 19.79      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 62.8/62.8 kB 15.4 MB/s eta 0:00:00
#0 20.31 Collecting numpy
#0 20.38   Downloading https://download.pytorch.org/whl/numpy-1.24.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (17.3 MB)
#0 20.65      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 17.3/17.3 MB 55.4 MB/s eta 0:00:00
#0 20.72 Collecting torchvision
#0 20.76   Downloading https://download.pytorch.org/whl/cu118/torchvision-0.15.1%2Bcu118-cp310-cp310-linux_x86_64.whl (6.1 MB)
#0 20.86      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 6.1/6.1 MB 66.5 MB/s eta 0:00:00
#0 21.39 Collecting pillow!=8.3.*,>=5.3.0
#0 21.44   Downloading https://download.pytorch.org/whl/Pillow-9.3.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.2 MB)
#0 21.52      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 3.2/3.2 MB 42.0 MB/s eta 0:00:00
#0 22.08 Collecting MarkupSafe>=2.0
#0 22.10   Downloading https://download.pytorch.org/whl/MarkupSafe-2.1.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (25 kB)
#0 22.63 Collecting charset-normalizer<3,>=2
#0 22.65   Downloading https://download.pytorch.org/whl/charset_normalizer-2.1.1-py3-none-any.whl (39 kB)
#0 23.18 Collecting certifi>=2017.4.17
#0 23.20   Downloading https://download.pytorch.org/whl/certifi-2022.12.7-py3-none-any.whl (155 kB)
#0 23.20      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 155.3/155.3 kB 28.7 MB/s eta 0:00:00
#0 23.72 Collecting urllib3<1.27,>=1.21.1
#0 23.75   Downloading https://download.pytorch.org/whl/urllib3-1.26.13-py2.py3-none-any.whl (140 kB)
#0 23.76      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 140.6/140.6 kB 18.5 MB/s eta 0:00:00
#0 24.28 Collecting idna<4,>=2.5
#0 24.31   Using cached https://download.pytorch.org/whl/idna-3.4-py3-none-any.whl (61 kB)
#0 24.84 Collecting mpmath>=0.19
#0 24.86   Downloading https://download.pytorch.org/whl/mpmath-1.2.1-py3-none-any.whl (532 kB)
#0 24.88      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 532.6/532.6 kB 59.5 MB/s eta 0:00:00
#0 24.94 Building wheels for collected packages: lit
#0 24.94   Building wheel for lit (setup.py): started
#0 25.31   Building wheel for lit (setup.py): finished with status 'done'
#0 25.31   Created wheel for lit: filename=lit-15.0.7-py3-none-any.whl size=89987 sha256=c2c54729c57b95647e494438e4b7cdc2dedbb8515d7b7d688f69642aca8312b4
#0 25.31   Stored in directory: /root/.cache/pip/wheels/bf/62/0d/01218f13f6a8051e982a7ce31d12b7bfd725dc69bd227ae104
#0 25.32 Successfully built lit
#0 25.57 Installing collected packages: mpmath, lit, cmake, urllib3, typing-extensions, sympy, pillow, numpy, networkx, MarkupSafe, idna, filelock, charset-normalizer, certifi, requests, jinja2, triton, torch, torchvision
#0 29.80 Segmentation fault (core dumped)
------
failed to solve: process "/bin/sh -c aria2c -x 5 --dir /cache --out torch-2.0.0-cp310-cp310-linux_x86_64.whl -c   https://download.pytorch.org/whl/cu118/torch-2.0.0%2Bcu118-cp310-cp310-linux_x86_64.whl &&   pip install /cache/torch-2.0.0-cp310-cp310-linux_x86_64.whl torchvision --index-url https://download.pytorch.org/whl/cu118" did not complete successfully: exit code: 139

Second time a bit different output:

> [auto stage-2  3/15] RUN --mount=type=cache,target=/cache --mount=type=cache,target=/root/.cache/pip   aria2c -x 5 --dir /cache --out torch-2.0.0-cp310-cp310-linux_x86_64.whl -c   https://download.pytorch.org/whl/cu118/torch-2.0.0%2Bcu118-cp310-cp310-linux_x86_64.whl &&   pip install /cache/torch-2.0.0-cp310-cp310-linux_x86_64.whl torchvision --index-url https://download.pytorch.org/whl/cu118:                                                                                                            
#0 0.303                                                                                                                                                                 
#0 0.303 05/21 09:02:28 [NOTICE] Downloading 1 item(s)                                                                                                                   
#0 0.490 
#0 0.490 05/21 09:02:28 [NOTICE] GID#24e1cecb95610fa6 - Download has already completed: /cache/torch-2.0.0-cp310-cp310-linux_x86_64.whl
#0 0.490 
#0 0.490 05/21 09:02:28 [NOTICE] Download complete: /cache/torch-2.0.0-cp310-cp310-linux_x86_64.whl
#0 0.490 
#0 0.490 Download Results:
#0 0.490 gid   |stat|avg speed  |path/URI
#0 0.490 ======+====+===========+=======================================================
#0 0.490 24e1ce|OK  |       0B/s|/cache/torch-2.0.0-cp310-cp310-linux_x86_64.whl
#0 0.490 
#0 0.490 Status Legend:
#0 0.490 (OK):download completed.
#0 1.979 Looking in indexes: https://download.pytorch.org/whl/cu118
#0 1.991 Processing /cache/torch-2.0.0-cp310-cp310-linux_x86_64.whl
#0 11.79 Collecting torchvision
#0 11.89   Using cached https://download.pytorch.org/whl/cu118/torchvision-0.15.2%2Bcu118-cp310-cp310-linux_x86_64.whl (6.1 MB)
#0 12.43 Collecting jinja2
#0 12.46   Using cached https://download.pytorch.org/whl/Jinja2-3.1.2-py3-none-any.whl (133 kB)
#0 13.02 Collecting triton==2.0.0
#0 13.63   Using cached https://download.pytorch.org/whl/triton-2.0.0-1-cp310-cp310-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (63.3 MB)
#0 14.40 Collecting sympy
#0 14.50   Using cached https://download.pytorch.org/whl/sympy-1.11.1-py3-none-any.whl (6.5 MB)
#0 14.71 Collecting networkx
#0 14.75   Using cached https://download.pytorch.org/whl/networkx-3.0-py3-none-any.whl (2.0 MB)
#0 15.27 Collecting filelock
#0 15.30   Using cached https://download.pytorch.org/whl/filelock-3.9.0-py3-none-any.whl (9.7 kB)
#0 15.82 Collecting typing-extensions
#0 15.85   Using cached https://download.pytorch.org/whl/typing_extensions-4.4.0-py3-none-any.whl (26 kB)
#0 16.37 Collecting lit
#0 16.37   Using cached lit-15.0.7-py3-none-any.whl
#0 16.90 Collecting cmake
#0 17.16   Using cached https://download.pytorch.org/whl/cmake-3.25.0-py2.py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (23.7 MB)
#0 17.30 Collecting torchvision
#0 17.37   Using cached https://download.pytorch.org/whl/cu118/torchvision-0.15.1%2Bcu118-cp310-cp310-linux_x86_64.whl (6.1 MB)
#0 17.57 Collecting pillow!=8.3.*,>=5.3.0
#0 17.62   Using cached https://download.pytorch.org/whl/Pillow-9.3.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.2 MB)
#0 18.15 Collecting numpy
#0 18.34   Using cached https://download.pytorch.org/whl/numpy-1.24.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (17.3 MB)
#0 18.91 Collecting requests
#0 18.94   Using cached https://download.pytorch.org/whl/requests-2.28.1-py3-none-any.whl (62 kB)
#0 19.48 Collecting MarkupSafe>=2.0
#0 19.50   Using cached https://download.pytorch.org/whl/MarkupSafe-2.1.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (25 kB)
#0 19.70 Collecting certifi>=2017.4.17
#0 19.72   Using cached https://download.pytorch.org/whl/certifi-2022.12.7-py3-none-any.whl (155 kB)
#0 20.25 Collecting charset-normalizer<3,>=2
#0 20.27   Using cached https://download.pytorch.org/whl/charset_normalizer-2.1.1-py3-none-any.whl (39 kB)
#0 20.80 Collecting urllib3<1.27,>=1.21.1
#0 20.83   Using cached https://download.pytorch.org/whl/urllib3-1.26.13-py2.py3-none-any.whl (140 kB)
#0 21.37 Collecting idna<4,>=2.5
#0 21.40   Using cached https://download.pytorch.org/whl/idna-3.4-py3-none-any.whl (61 kB)
#0 21.92 Collecting mpmath>=0.19
#0 21.96   Using cached https://download.pytorch.org/whl/mpmath-1.2.1-py3-none-any.whl (532 kB)
#0 22.31 Installing collected packages: mpmath, lit, cmake, urllib3, typing-extensions, sympy, pillow, numpy, networkx, MarkupSafe, idna, filelock, charset-normalizer, certifi, requests, jinja2, triton, torch, torchvision
#0 53.69 ERROR: Exception:
#0 53.69 Traceback (most recent call last):
#0 53.69   File "/usr/local/lib/python3.10/site-packages/pip/_internal/cli/base_command.py", line 160, in exc_logging_wrapper
#0 53.69     status = run_func(*args)
#0 53.69   File "/usr/local/lib/python3.10/site-packages/pip/_internal/cli/req_command.py", line 247, in wrapper
#0 53.69     return func(self, options, args)
#0 53.69   File "/usr/local/lib/python3.10/site-packages/pip/_internal/commands/install.py", line 494, in run
#0 53.69     installed = install_given_reqs(
#0 53.69   File "/usr/local/lib/python3.10/site-packages/pip/_internal/req/__init__.py", line 73, in install_given_reqs
#0 53.69     requirement.install(
#0 53.69   File "/usr/local/lib/python3.10/site-packages/pip/_internal/req/req_install.py", line 792, in install
#0 53.69     install_wheel(
#0 53.69   File "/usr/local/lib/python3.10/site-packages/pip/_internal/operations/install/wheel.py", line 729, in install_wheel
#0 53.69     _install_wheel(
#0 53.69   File "/usr/local/lib/python3.10/site-packages/pip/_internal/operations/install/wheel.py", line 589, in _install_wheel
#0 53.69     file.save()
#0 53.69   File "/usr/local/lib/python3.10/site-packages/pip/_internal/operations/install/wheel.py", line 388, in save
#0 53.69     shutil.copyfileobj(f, dest)
#0 53.69   File "/usr/local/lib/python3.10/shutil.py", line 195, in copyfileobj
#0 53.69     buf = fsrc_read(length)
#0 53.69   File "/usr/local/lib/python3.10/zipfile.py", line 925, in read
#0 53.69     data = self._read1(n)
#0 53.69   File "/usr/local/lib/python3.10/zipfile.py", line 1001, in _read1
#0 53.69     data = self._decompressor.decompress(data, n)
#0 53.69 zlib.error: Error -3 while decompressing data: invalid block type
#0 54.08 
#0 54.08 [notice] A new release of pip available: 22.3.1 -> 23.1.2
#0 54.08 [notice] To update, run: pip install --upgrade pip
------
failed to solve: process "/bin/sh -c aria2c -x 5 --dir /cache --out torch-2.0.0-cp310-cp310-linux_x86_64.whl -c   https://download.pytorch.org/whl/cu118/torch-2.0.0%2Bcu118-cp310-cp310-linux_x86_64.whl &&   pip install /cache/torch-2.0.0-cp310-cp310-linux_x86_64.whl torchvision --index-url https://download.pytorch.org/whl/cu118" did not complete successfully: exit code: 2

And after that, invokeai, that was working before is also broken:

✔ Container webui-docker-invoke-1  Created                                                                                                                         0.0s 
Attaching to webui-docker-invoke-1
webui-docker-invoke-1  | Mounted .cache
webui-docker-invoke-1  | Mounted GFPGANv1.4.pth
webui-docker-invoke-1  | Mounted RealESRGAN
webui-docker-invoke-1  | Mounted Codeformer
webui-docker-invoke-1  | Mounted GFPGAN
webui-docker-invoke-1  | Mounted ldm
webui-docker-invoke-1  | Loading Python libraries...
webui-docker-invoke-1  | 
webui-docker-invoke-1  | ╭───────────────────── Traceback (most recent call last) ──────────────────────╮
webui-docker-invoke-1  | │ /usr/local/bin/invokeai-configure:5 in <module>                              │
webui-docker-invoke-1  | │                                                                              │
webui-docker-invoke-1  | │   2 # -*- coding: utf-8 -*-                                                  │
webui-docker-invoke-1  | │   3 import re                                                                │
webui-docker-invoke-1  | │   4 import sys                                                               │
webui-docker-invoke-1  | │ ❱ 5 from ldm.invoke.config.invokeai_configure import main                    │
webui-docker-invoke-1  | │   6 if __name__ == '__main__':                                               │
webui-docker-invoke-1  | │   7 │   sys.argv[0] = re.sub(r'(-script\.pyw|\.exe)?$', '', sys.argv[0])     │
webui-docker-invoke-1  | │   8 │   sys.exit(main())                                                     │
webui-docker-invoke-1  | │                                                                              │
webui-docker-invoke-1  | │ /InvokeAI/ldm/invoke/config/invokeai_configure.py:26 in <module>             │
webui-docker-invoke-1  | │                                                                              │
webui-docker-invoke-1  | │    23 import npyscreen                                                       │
webui-docker-invoke-1  | │    24 import torch                                                           │
webui-docker-invoke-1  | │    25 import transformers                                                    │
webui-docker-invoke-1  | │ ❱  26 from diffusers import AutoencoderKL                                    │
webui-docker-invoke-1  | │    27 from huggingface_hub import HfFolder                                   │
webui-docker-invoke-1  | │    28 from huggingface_hub import login as hf_hub_login                      │
webui-docker-invoke-1  | │    29 from omegaconf import OmegaConf                                        │
webui-docker-invoke-1  | │                                                                              │
webui-docker-invoke-1  | │ /usr/local/lib/python3.10/site-packages/diffusers/__init__.py:58 in <module> │
webui-docker-invoke-1  | │                                                                              │
webui-docker-invoke-1  | │    55 │   │   get_polynomial_decay_schedule_with_warmup,                     │
webui-docker-invoke-1  | │    56 │   │   get_scheduler,                                                 │
webui-docker-invoke-1  | │    57 │   )                                                                  │
webui-docker-invoke-1  | │ ❱  58 │   from .pipelines import (                                           │
webui-docker-invoke-1  | │    59 │   │   AudioPipelineOutput,                                           │
webui-docker-invoke-1  | │    60 │   │   DanceDiffusionPipeline,                                        │
webui-docker-invoke-1  | │    61 │   │   DDIMPipeline,                                                  │
webui-docker-invoke-1  | │                                                                              │
webui-docker-invoke-1  | │ /usr/local/lib/python3.10/site-packages/diffusers/pipelines/__init__.py:19   │
webui-docker-invoke-1  | │ in <module>                                                                  │
webui-docker-invoke-1  | │                                                                              │
webui-docker-invoke-1  | │    16 except OptionalDependencyNotAvailable:                                 │
webui-docker-invoke-1  | │    17 │   from ..utils.dummy_pt_objects import *  # noqa F403                │
webui-docker-invoke-1  | │    18 else:                                                                  │
webui-docker-invoke-1  | │ ❱  19 │   from .dance_diffusion import DanceDiffusionPipeline                │
webui-docker-invoke-1  | │    20 │   from .ddim import DDIMPipeline                                     │
webui-docker-invoke-1  | │    21 │   from .ddpm import DDPMPipeline                                     │
webui-docker-invoke-1  | │    22 │   from .dit import DiTPipeline                                       │
webui-docker-invoke-1  | │                                                                              │
webui-docker-invoke-1  | │ /usr/local/lib/python3.10/site-packages/diffusers/pipelines/dance_diffusion/ │
webui-docker-invoke-1  | │ __init__.py:1 in <module>                                                    │
webui-docker-invoke-1  | │                                                                              │
webui-docker-invoke-1  | │ ❱ 1 from .pipeline_dance_diffusion import DanceDiffusionPipeline             │
webui-docker-invoke-1  | │   2                                                                          │
webui-docker-invoke-1  | │                                                                              │
webui-docker-invoke-1  | │ /usr/local/lib/python3.10/site-packages/diffusers/pipelines/dance_diffusion/ │
webui-docker-invoke-1  | │ pipeline_dance_diffusion.py:21 in <module>                                   │
webui-docker-invoke-1  | │                                                                              │
webui-docker-invoke-1  | │    18 import torch                                                           │
webui-docker-invoke-1  | │    19                                                                        │
webui-docker-invoke-1  | │    20 from ...utils import logging, randn_tensor                             │
webui-docker-invoke-1  | │ ❱  21 from ..pipeline_utils import AudioPipelineOutput, DiffusionPipeline    │
webui-docker-invoke-1  | │    22                                                                        │
webui-docker-invoke-1  | │    23                                                                        │
webui-docker-invoke-1  | │    24 logger = logging.get_logger(__name__)  # pylint: disable=invalid-name  │
webui-docker-invoke-1  | │                                                                              │
webui-docker-invoke-1  | │ /usr/local/lib/python3.10/site-packages/diffusers/pipelines/pipeline_utils.p │
webui-docker-invoke-1  | │ y:40 in <module>                                                             │
webui-docker-invoke-1  | │                                                                              │
webui-docker-invoke-1  | │     37 from .. import __version__                                            │
webui-docker-invoke-1  | │     38 from ..configuration_utils import ConfigMixin                         │
webui-docker-invoke-1  | │     39 from ..models.modeling_utils import _LOW_CPU_MEM_USAGE_DEFAULT        │
webui-docker-invoke-1  | │ ❱   40 from ..schedulers.scheduling_utils import SCHEDULER_CONFIG_NAME       │
webui-docker-invoke-1  | │     41 from ..utils import (                                                 │
webui-docker-invoke-1  | │     42 │   CONFIG_NAME,                                                      │
webui-docker-invoke-1  | │     43 │   DEPRECATED_REVISION_ARGS,                                         │
webui-docker-invoke-1  | │                                                                              │
webui-docker-invoke-1  | │ /usr/local/lib/python3.10/site-packages/diffusers/schedulers/__init__.py:74  │
webui-docker-invoke-1  | │ in <module>                                                                  │
webui-docker-invoke-1  | │                                                                              │
webui-docker-invoke-1  | │   71 except OptionalDependencyNotAvailable:                                  │
webui-docker-invoke-1  | │   72 │   from ..utils.dummy_torch_and_scipy_objects import *  # noqa F403    │
webui-docker-invoke-1  | │   73 else:                                                                   │
webui-docker-invoke-1  | │ ❱ 74 │   from .scheduling_lms_discrete import LMSDiscreteScheduler           │
webui-docker-invoke-1  | │   75                                                                         │
webui-docker-invoke-1  | │                                                                              │
webui-docker-invoke-1  | │ /usr/local/lib/python3.10/site-packages/diffusers/schedulers/scheduling_lms_ │
webui-docker-invoke-1  | │ discrete.py:21 in <module>                                                   │
webui-docker-invoke-1  | │                                                                              │
webui-docker-invoke-1  | │    18                                                                        │
webui-docker-invoke-1  | │    19 import numpy as np                                                     │
webui-docker-invoke-1  | │    20 import torch                                                           │
webui-docker-invoke-1  | │ ❱  21 from scipy import integrate                                            │
webui-docker-invoke-1  | │    22                                                                        │
webui-docker-invoke-1  | │    23 from ..configuration_utils import ConfigMixin, register_to_config      │
webui-docker-invoke-1  | │    24 from ..utils import BaseOutput                                         │
webui-docker-invoke-1  | │ in _handle_fromlist:1075                                                     │
webui-docker-invoke-1  | │                                                                              │
webui-docker-invoke-1  | │ /usr/local/lib/python3.10/site-packages/scipy/__init__.py:200 in __getattr__ │
webui-docker-invoke-1  | │                                                                              │
webui-docker-invoke-1  | │   197 │                                                                      │
webui-docker-invoke-1  | │   198 │   def __getattr__(name):                                             │
webui-docker-invoke-1  | │   199 │   │   if name in submodules:                                         │
webui-docker-invoke-1  | │ ❱ 200 │   │   │   return _importlib.import_module(f'scipy.{name}')           │
webui-docker-invoke-1  | │   201 │   │   else:                                                          │
webui-docker-invoke-1  | │   202 │   │   │   try:                                                       │
webui-docker-invoke-1  | │   203 │   │   │   │   return globals()[name]                                 │
webui-docker-invoke-1  | │                                                                              │
webui-docker-invoke-1  | │ /usr/local/lib/python3.10/importlib/__init__.py:126 in import_module         │
webui-docker-invoke-1  | │                                                                              │
webui-docker-invoke-1  | │   123 │   │   │   if character != '.':                                       │
webui-docker-invoke-1  | │   124 │   │   │   │   break                                                  │
webui-docker-invoke-1  | │   125 │   │   │   level += 1                                                 │
webui-docker-invoke-1  | │ ❱ 126 │   return _bootstrap._gcd_import(name[level:], package, level)        │
webui-docker-invoke-1  | │   127                                                                        │
webui-docker-invoke-1  | │   128                                                                        │
webui-docker-invoke-1  | │   129 _RELOADING = {}                                                        │
webui-docker-invoke-1  | │                                                                              │
webui-docker-invoke-1  | │ /usr/local/lib/python3.10/site-packages/scipy/integrate/__init__.py:95 in    │
webui-docker-invoke-1  | │ <module>                                                                     │
webui-docker-invoke-1  | │                                                                              │
webui-docker-invoke-1  | │    92 from ._odepack_py import *                                             │
webui-docker-invoke-1  | │    93 from ._quadpack_py import *                                            │
webui-docker-invoke-1  | │    94 from ._ode import *                                                    │
webui-docker-invoke-1  | │ ❱  95 from ._bvp import solve_bvp                                            │
webui-docker-invoke-1  | │    96 from ._ivp import (solve_ivp, OdeSolution, DenseOutput,                │
webui-docker-invoke-1  | │    97 │   │   │   │      OdeSolver, RK23, RK45, DOP853, Radau, BDF, LSODA)   │
webui-docker-invoke-1  | │    98 from ._quad_vec import quad_vec                                        │
webui-docker-invoke-1  | │                                                                              │
webui-docker-invoke-1  | │ /usr/local/lib/python3.10/site-packages/scipy/integrate/_bvp.py:9 in         │
webui-docker-invoke-1  | │ <module>                                                                     │
webui-docker-invoke-1  | │                                                                              │
webui-docker-invoke-1  | │      6                                                                       │
webui-docker-invoke-1  | │      7 from scipy.sparse import coo_matrix, csc_matrix                       │
webui-docker-invoke-1  | │      8 from scipy.sparse.linalg import splu                                  │
webui-docker-invoke-1  | │ ❱    9 from scipy.optimize import OptimizeResult                             │
webui-docker-invoke-1  | │     10                                                                       │
webui-docker-invoke-1  | │     11                                                                       │
webui-docker-invoke-1  | │     12 EPS = np.finfo(float).eps                                             │
webui-docker-invoke-1  | │                                                                              │
webui-docker-invoke-1  | │ /usr/local/lib/python3.10/site-packages/scipy/optimize/__init__.py:417 in    │
webui-docker-invoke-1  | │ <module>                                                                     │
webui-docker-invoke-1  | │                                                                              │
webui-docker-invoke-1  | │   414 from ._slsqp_py import fmin_slsqp                                      │
webui-docker-invoke-1  | │   415 from ._nnls import nnls                                                │
webui-docker-invoke-1  | │   416 from ._basinhopping import basinhopping                                │
webui-docker-invoke-1  | │ ❱ 417 from ._linprog import linprog, linprog_verbose_callback                │
webui-docker-invoke-1  | │   418 from ._lsap import linear_sum_assignment                               │
webui-docker-invoke-1  | │   419 from ._differentialevolution import differential_evolution             │
webui-docker-invoke-1  | │   420 from ._lsq import least_squares, lsq_linear                            │
webui-docker-invoke-1  | │                                                                              │
webui-docker-invoke-1  | │ /usr/local/lib/python3.10/site-packages/scipy/optimize/_linprog.py:22 in     │
webui-docker-invoke-1  | │ <module>                                                                     │
webui-docker-invoke-1  | │                                                                              │
webui-docker-invoke-1  | │    19 from ._optimize import OptimizeResult, OptimizeWarning                 │
webui-docker-invoke-1  | │    20 from warnings import warn                                              │
webui-docker-invoke-1  | │    21 from ._linprog_highs import _linprog_highs                             │
webui-docker-invoke-1  | │ ❱  22 from ._linprog_ip import _linprog_ip                                   │
webui-docker-invoke-1  | │    23 from ._linprog_simplex import _linprog_simplex                         │
webui-docker-invoke-1  | │    24 from ._linprog_rs import _linprog_rs                                   │
webui-docker-invoke-1  | │    25 from ._linprog_doc import (_linprog_highs_doc, _linprog_ip_doc,        │
webui-docker-invoke-1  | │                                                                              │
webui-docker-invoke-1  | │ /usr/local/lib/python3.10/site-packages/scipy/optimize/_linprog_ip.py:27 in  │
webui-docker-invoke-1  | │ <module>                                                                     │
webui-docker-invoke-1  | │                                                                              │
webui-docker-invoke-1  | │     24 from warnings import warn                                             │
webui-docker-invoke-1  | │     25 from scipy.linalg import LinAlgError                                  │
webui-docker-invoke-1  | │     26 from ._optimize import OptimizeWarning, OptimizeResult, _check_unknow │
webui-docker-invoke-1  | │ ❱   27 from ._linprog_util import _postsolve                                 │
webui-docker-invoke-1  | │     28 has_umfpack = True                                                    │
webui-docker-invoke-1  | │     29 has_cholmod = True                                                    │
webui-docker-invoke-1  | │     30 try:                                                                  │
webui-docker-invoke-1  | │                                                                              │
webui-docker-invoke-1  | │ /usr/local/lib/python3.10/site-packages/scipy/optimize/_linprog_util.py:9 in │
webui-docker-invoke-1  | │ <module>                                                                     │
webui-docker-invoke-1  | │                                                                              │
webui-docker-invoke-1  | │      6 import scipy.sparse as sps                                            │
webui-docker-invoke-1  | │      7 from warnings import warn                                             │
webui-docker-invoke-1  | │      8 from ._optimize import OptimizeWarning                                │
webui-docker-invoke-1  | │ ❱    9 from scipy.optimize._remove_redundancy import (                       │
webui-docker-invoke-1  | │     10 │   _remove_redundancy_svd, _remove_redundancy_pivot_sparse,          │
webui-docker-invoke-1  | │     11 │   _remove_redundancy_pivot_dense, _remove_redundancy_id             │
webui-docker-invoke-1  | │     12 │   )                                                                 │
webui-docker-invoke-1  | │                                                                              │
webui-docker-invoke-1  | │ /usr/local/lib/python3.10/site-packages/scipy/optimize/_remove_redundancy.py │
webui-docker-invoke-1  | │ :9 in <module>                                                               │
webui-docker-invoke-1  | │                                                                              │
webui-docker-invoke-1  | │     6                                                                        │
webui-docker-invoke-1  | │     7 import numpy as np                                                     │
webui-docker-invoke-1  | │     8 from scipy.linalg import svd                                           │
webui-docker-invoke-1  | │ ❱   9 from scipy.linalg.interpolative import interp_decomp                   │
webui-docker-invoke-1  | │    10 import scipy                                                           │
webui-docker-invoke-1  | │    11 from scipy.linalg.blas import dtrsm                                    │
webui-docker-invoke-1  | │    12                                                                        │
webui-docker-invoke-1  | │                                                                              │
webui-docker-invoke-1  | │ /usr/local/lib/python3.10/site-packages/scipy/linalg/interpolative.py:385 in │
webui-docker-invoke-1  | │ <module>                                                                     │
webui-docker-invoke-1  | │                                                                              │
webui-docker-invoke-1  | │    382                                                                       │
webui-docker-invoke-1  | │    383 """                                                                   │
webui-docker-invoke-1  | │    384                                                                       │
webui-docker-invoke-1  | │ ❱  385 import scipy.linalg._interpolative_backend as _backend                │
webui-docker-invoke-1  | │    386 import numpy as np                                                    │
webui-docker-invoke-1  | │    387 import sys                                                            │
webui-docker-invoke-1  | │    388                                                                       │
webui-docker-invoke-1  | │ in _find_and_load:1027                                                       │
webui-docker-invoke-1  | │ in _find_and_load_unlocked:1006                                              │
webui-docker-invoke-1  | │ in _load_unlocked:688                                                        │
webui-docker-invoke-1  | │ in exec_module:879                                                           │
webui-docker-invoke-1  | │ in get_code:1012                                                             │
webui-docker-invoke-1  | │ in _compile_bytecode:672                                                     │
webui-docker-invoke-1  | ╰──────────────────────────────────────────────────────────────────────────────╯
webui-docker-invoke-1  | ValueError: bad marshal data (unknown type code)
webui-docker-invoke-1  | /docker/entrypoint.sh: line 43:    44 Bus error               (core dumped) invokeai-configure --root ${ROOT} --yes
webui-docker-invoke-1 exited with code 135
@nekrasovdmitriy nekrasovdmitriy added the bug Something isn't working label May 21, 2023
@AbdBarho
Copy link
Owner

AbdBarho commented May 21, 2023 •
edited
Loading

This is very weird. No idea what is happening here. Have you tried clearing the cache?

This has probably something to do with the fact that we download pytorch with aria2 because pip's connection almost always breaks on larger downloads. But the intermediate cache seems broken in your case.

Honestly I want to go with a pre-built pytorch container but they don't support latest python.

@AbdBarho AbdBarho added the awaiting-response Waiting for the issuer to respond label May 21, 2023
@nekrasovdmitriy
Copy link
Author

This is very weird. No idea what is happening here. Have you tried clearing the cache?

You mean python -m pip cache purge , right? I should do it inside a container or at host?

@dreamfast
Copy link

dreamfast commented May 22, 2023 •
edited
Loading

Same issue for me here, running with docker compose --profile=auto build --no-cache --pull

Edit: oops sorry didn't realise this was not the same error, however previously I had the same error as above but now have this running with --no-cache --pull`

#0 0.510 Initialized empty Git repository in /repositories/taming-transformers/.git/                    #0 0.510 + git remote add origin https://github.com/CompVis/taming-transformers.git                     
#0 0.512 + git fetch origin 24268930bf1dce879235a7fddd0b2355b84d7ea6 '--depth=1'
#0 845.4 error: 5090 bytes of body are still expected
#0 845.4 fetch-pack: unexpected disconnect while reading sideband packet
#0 845.4 fatal: early EOF
#0 845.4 fatal: fetch-pack: invalid index-pack output
------
failed to solve: process "/bin/sh -c . /clone.sh taming-transformers https://github.com/CompVis/taming-transformers.git 24268930bf1dce879235a7fddd0b2355b84d7ea6   && rm -rf data assets **/*.ipynb" did not complete successfully: exit code: 128

@dreamfast
Copy link

@nekrasovdmitriy @AbdBarho I was able to successfully build by removing the -x 5 parameter from Aria2c. While it's slower to download it does work.

@AbdBarho
Copy link
Owner

@dreamfast I am going to remove that in #483, at least for pytorch wheel download.

@nekrasovdmitriy
Copy link
Author

--no-cache helped me to build it.
But what does it mean? Extensions problem?

webui-docker-auto-1  | Mounted extensions
webui-docker-auto-1  | /stable-diffusion-webui /stable-diffusion-webui
webui-docker-auto-1  | WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
webui-docker-auto-1  | 
webui-docker-auto-1  | [notice] A new release of pip available: 22.3.1 -> 23.1.2
webui-docker-auto-1  | [notice] To update, run: pip install --upgrade pip
webui-docker-auto-1  | /stable-diffusion-webui
webui-docker-auto-1  | Segmentation fault (core dumped)
webui-docker-auto-1 exited with code 139

@AbdBarho
Copy link
Owner

Segmentation fault (core dumped)

Yeah probably, can you try removing the folder data/config/auto/extensions (or just rename it) and try running again?

@nekrasovdmitriy
Copy link
Author

Deleting folder helped, thanks.

I successfuly launchned auto container, worked for some time and container was killed by itself:

webui-docker-auto-1 exited with code 137

After that, invoke container do not start again...

#0 47.60 Collecting certifi>=2017.4.17
#0 47.61   Using cached certifi-2023.5.7-py3-none-any.whl (156 kB)
#0 47.86 Installing collected packages: urllib3, typing-extensions, pillow, numpy, idna, charset-normalizer, certifi, torch, requests, torchvision
#0 56.25 ERROR: Exception:
#0 56.25 Traceback (most recent call last):
#0 56.25   File "/usr/local/lib/python3.10/site-packages/pip/_internal/cli/base_command.py", line 160, in exc_logging_wrapper
#0 56.25     status = run_func(*args)
#0 56.25   File "/usr/local/lib/python3.10/site-packages/pip/_internal/cli/req_command.py", line 247, in wrapper
#0 56.25     return func(self, options, args)
#0 56.25   File "/usr/local/lib/python3.10/site-packages/pip/_internal/commands/install.py", line 507, in run
#0 56.25     installed = install_given_reqs(
#0 56.25   File "/usr/local/lib/python3.10/site-packages/pip/_internal/req/__init__.py", line 73, in install_given_reqs
#0 56.25     requirement.install(
#0 56.25   File "/usr/local/lib/python3.10/site-packages/pip/_internal/req/req_install.py", line 796, in install
#0 56.25     install_wheel(
#0 56.25   File "/usr/local/lib/python3.10/site-packages/pip/_internal/operations/install/wheel.py", line 729, in install_wheel
#0 56.25     _install_wheel(
#0 56.25   File "/usr/local/lib/python3.10/site-packages/pip/_internal/operations/install/wheel.py", line 589, in _install_wheel
#0 56.25     file.save()
#0 56.25   File "/usr/local/lib/python3.10/site-packages/pip/_internal/operations/install/wheel.py", line 388, in save
#0 56.25     shutil.copyfileobj(f, dest)
#0 56.25   File "/usr/local/lib/python3.10/shutil.py", line 195, in copyfileobj
#0 56.25     buf = fsrc_read(length)
#0 56.25   File "/usr/local/lib/python3.10/zipfile.py", line 927, in read
#0 56.25     data = self._read1(n)
#0 56.25   File "/usr/local/lib/python3.10/zipfile.py", line 1003, in _read1
#0 56.25     data = self._decompressor.decompress(data, n)
#0 56.25 zlib.error: Error -3 while decompressing data: invalid stored block lengths
#0 56.27 
#0 56.27 [notice] A new release of pip is available: 23.0.1 -> 23.1.2
#0 56.27 [notice] To update, run: pip install --upgrade pip
------
failed to solve: process "/bin/sh -c pip install torch==1.13.1+cu117 torchvision --extra-index-url https://download.pytorch.org/whl/cu117" did not complete successfully: exit code: 2

What's the connection?

And, by the way, is it possible to have run two containers run simultaneously on different ports?
For example, would like to generate in auto, but use outpainting and inpainting in invoke.

@AbdBarho
Copy link
Owner

It seems that you are either running an old version of this repo, or that one of the extensions? are doing something weird, because this repo uses pytorch 2, not 1.13. The error is probably because some downloaded package is corrupted.

And, by the way, is it possible to have run two containers run simultaneously on different ports?

#481 and #430

@github-actions
Copy link

This issue is stale because it has been open 14 days with no activity. Remove stale label or comment or this will be closed in 7 days.

@github-actions github-actions bot added the Stale label Jun 23, 2023
@github-actions
Copy link

github-actions bot commented Jul 1, 2023

This issue was closed because it has been stalled for 7 days with no activity.

@github-actions github-actions bot closed this as not planned Won't fix, can't repro, duplicate, stale Jul 1, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
awaiting-response Waiting for the issuer to respond bug Something isn't working Stale
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@dreamfast @nekrasovdmitriy @AbdBarho