We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
UDA_VISIBLE_DEVICES=0 API_PORT=8000 llamafactory-cli api examples/inference/llama3_vllm.yaml 当配置文件中为llama3的时候是正常的,当我用自己merge过lora权重后的模型时,会卡在图中这一步
No response
The text was updated successfully, but these errors were encountered:
No branches or pull requests
Reminder
Reproduction
UDA_VISIBLE_DEVICES=0 API_PORT=8000 llamafactory-cli api examples/inference/llama3_vllm.yaml
当配置文件中为llama3的时候是正常的,当我用自己merge过lora权重后的模型时,会卡在图中这一步
Expected behavior
No response
System Info
No response
Others
No response
The text was updated successfully, but these errors were encountered: