Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Running update-windows.bat turn my environment from gpu to cpu only #4993

Open
1 task done
Touch-Night opened this issue Dec 19, 2023 · 9 comments
Open
1 task done
Labels
bug Something isn't working

Comments

@Touch-Night
Copy link
Contributor

Describe the bug

Just as what the title says, I want to update my webui just now, but it installed dependencies from requirements_cpu_only.txt.

Is there an existing issue for this?

  • I have searched the existing issues

Reproduction

Run the update batch on Nvidia windows.

Screenshot

No response

Logs

No logs

System Info

Windows 10,
Nvidia 3050 Ti laptop(8GB vram)
@Touch-Night Touch-Night added the bug Something isn't working label Dec 19, 2023
@Sebastianv650
Copy link

Sebastianv650 commented Dec 19, 2023

Same here, it's completely broken!
Any idea how to fix it, preferable without redownloading everything?

@oobabooga
Copy link
Owner

This means that your installed torch version is originally CPU. Did you not pick the wrong option while installing?

is_cpu = '+cpu' in torver # 2.0.1+cpu

@Sebastianv650
Copy link

Sebastianv650 commented Dec 19, 2023

I'm using Oobabooga a few weeks now, it worked fine inlcuding ~24h ago when I updated last time. Today after the update, everything except CPU only isn't working any more. Nothing else has changed, no driver or anything except the update run.

@Touch-Night
Copy link
Contributor Author

This means that your installed torch version is originally CPU. Did you not pick the wrong option while installing?

is_cpu = '+cpu' in torver # 2.0.1+cpu

I'm sure I did not pick the wrong option when installing using the one click installer months ago. And each time I run update-windows.bat except for this time, it displays TORCH 2.1.0 + CUDA121. But this time it trys to install torch 2.1.2 and torch_vision 2.1.0 and torch_audio 2.1.0, which are incompatible of course, and after that, if you rerun update_windows.bat, it installs requirements from requirements_cpu_only.txt

@oobabooga
Copy link
Owner

oobabooga commented Dec 19, 2023

It looks like the problem is that the new HQQ requirements adds a torch>=2.1.1 sub-requirement, and your older install had an existing torch==2.0 requirement that ended up being updated incorrectly.

https://github.com/mobiusml/hqq/blob/bb422c931de89a618f81160513b90d8149f1ace5/setup.py#L12

The best I can tell you is to delete your installer_files folder and run the start script again. This will setup a new environment with the updated pytorch version while keeping your models/settings intact.

@Touch-Night
Copy link
Contributor Author

I have reinstalled everything and it works fine now. During this process, I found text-generation-webui/installer_files/conda folder cannot be deleted because You Require permission from S-1-5-21-190............ to make changes to this folder. The solution can be found on the Internet, but it's troublesome.

@Sebastianv650
Copy link

Worked for me without permission problems during deletion of the folder. Thank you very much!

@Touch-Night
Copy link
Contributor Author

Updating to latest dev branch, this issue occurred again

@Touch-Night
Copy link
Contributor Author

Touch-Night commented Sep 29, 2024

Reinstalling the environment fixs it though

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

3 participants