-
Notifications
You must be signed in to change notification settings - Fork 804
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
mkl_malloc: failed to allocate memory #797
Comments
@samuelbraun04 Mine has started doing this was well occasionally after working fine previously. Did you find a resolution? My guess is torch versions. |
@unmotivatedgene Unfortunately I never figured a fix out, so I thought maybe it was just something I messed up on my end. But it's coming out of nowhere again for me and I haven't changed anything, so now I'm just confused. And I'm literally running this on a 4080 so I really don't get how I could be running out of memory. |
for new version 1.0.2, I get this error everytime, but it will work when I use Int8 type load model, |
Running
gives me:
I have 32 GB of installed DDR5 memory and I'm running this on a 4080 with 16 GB of VRAM. I'm not really sure how this error keeps coming up, since I have tons of RAM. Anyone else experiencing/experienced the same thing?
The text was updated successfully, but these errors were encountered: