-
Notifications
You must be signed in to change notification settings - Fork 226
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
converting llama3 models with added tokens #3519
Comments
@l3utterfly Can you share the full error message? I thought it happens at |
Full error here:
|
@l3utterfly vocab_size is something configurable. Can you change the value in |
Following up from this: #3303
Converting finetuned llama3 models with the same special tokens works.
How can we convert llama3 finetunes which has added tokens? For example, this model: https://huggingface.co/Weyaxi/Einstein-v6.1-Llama3-8B is tuned on the ChatML format.
Converting using the same script gets this error:
This is due to the finetuned model having different number of tokens I believe.
The text was updated successfully, but these errors were encountered: