-
Notifications
You must be signed in to change notification settings - Fork 398
Issues: AutoGPTQ/AutoGPTQ
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Author
Label
Projects
Milestones
Assignee
Sort
Issues list
[BUG] Not able to install on Ubuntu 22.04 (subprocess-exited-with-error )
bug
Something isn't working
#680
opened May 28, 2024 by
mishraaditya595
[BUG] Quantitative model Yi-1.5-9b-16K does not produce text output.
bug
Something isn't working
#677
opened May 23, 2024 by
maxin9966
[FEATURE] Added code support to 5,6,7 bits quantization can you please add me as contributor I will create a new pull request
enhancement
New feature or request
#675
opened May 21, 2024 by
thoorpukarnakar
Question about data shape difference between quantization and forward
#674
opened May 17, 2024 by
sleepwalker2017
[FEATURE] Add marlin24 support
enhancement
New feature or request
#672
opened May 14, 2024 by
Qubitium
[BUG] Following the quant_with_alpaca.py example but keep getting "You shouldn't move a model that is dispatched using accelerate hooks." and the model is never saved.
bug
Something isn't working
#670
opened May 13, 2024 by
murtaza-nasir
Target modules [] not found in the base model. Please check the target modules and try again.
#667
opened May 10, 2024 by
RicardoHalak
[BUG] ROCm installation and building broken
bug
Something isn't working
#666
opened May 7, 2024 by
xangelix
[Question] Differences in quantization logic compared to AWQ
enhancement
New feature or request
#663
opened May 6, 2024 by
wenhuach21
[BUG]safetensors_rust.SafetensorError: Error while deserializing header: MetadataIncompleteBuffer
bug
Something isn't working
#661
opened Apr 30, 2024 by
chuangzhidan
[PR Ready for Review] [FEATURE] Extend Support for Phi-3
enhancement
New feature or request
#652
opened Apr 27, 2024 by
davidgxue
What magnitude of avg loss indicates a relatively good result for a quantization model
#649
opened Apr 26, 2024 by
ehuaa
[BUG] Llama 3 8B Instruct - Something isn't working
no_inject_fused_attention
must be true or else errors out
bug
#646
opened Apr 20, 2024 by
davidgxue
TypeError: forward() missing 1 required positional argument: 'hidden_states'[BUG] ?
bug
Something isn't working
#636
opened Apr 10, 2024 by
silvacarl2
Previous Next
ProTip!
Follow long discussions with comments:>50.