Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add FP16 support to intel CPU #9

Open
Ethan-Ming opened this issue Jul 6, 2023 · 1 comment
Open

add FP16 support to intel CPU #9

Ethan-Ming opened this issue Jul 6, 2023 · 1 comment

Comments

@Ethan-Ming
Copy link

Ethan-Ming commented Jul 6, 2023

/whisper-dictation/venv/lib/python3.8/site-packages/whisper/transcribe.py:114: UserWarning: FP16 is not supported on CPU; using FP32 instead
warnings.warn("FP16 is not supported on CPU; using FP32 instead")


it seems like fp16 is not supported on the intel CPU? Optimise the model to FP16 would be great

2nd option is to use a dedicated GPU, but most intel MAC uses AMD GPU so it might. be a extra step

@Ethan-Ming Ethan-Ming changed the title How to use GPU on intel-based mac with AMD GPU ? use GPU on intel-based mac with AMD GPU ? Jul 6, 2023
@Ethan-Ming Ethan-Ming changed the title use GPU on intel-based mac with AMD GPU ? add FP16 support to intel CPU Jul 6, 2023
@foges
Copy link
Owner

foges commented Jun 8, 2024

I don't think there's much that can be done about intel CPUs not supporting FP16. I should probably update the initialization to avoid the warnings. Thank you for raising the issue.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants