Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Huge time differences running in Windows 11 and WSL 2 (Ubuntu) with default params #2151

Open
nalmeida84 opened this issue May 14, 2024 · 0 comments

Comments

@nalmeida84
Copy link

I was testing to run Whisper CPP in WSL and native Windows and I have seen a very notable difference in process times.
I followed all steps in WSL to install cuda toolkit (without Nvidia driver, because uses same Windows driver).
To compile Windows executable I'm using MSVC (v.17.9) and x64-x64 flag to indicate a compilation for a x64 system on a x64 compiler system.
Nvidia CUDA version is 12.4.1

My testing audio is a WAV with 15 min audio from Spain king xmas speech (I chose it because he speaks quite clearly and slowly).

On WSL most of the time I get a freeze, specially if I use a big model or set more processor/threads than default ones.
On Windows work fine but really slow. Graphic card is working at 40%.

Freeze example:
image

My PC is a Gigabyte AERO with a Intel i9 and a RTX 4070 graphic card. It's connected to AC.

Results:
Left = WSL Ubuntu, Right = Windows 11

Same flags
image

Translate time is 6x in WSL
image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant