Size mismatch after fine-tuning text generation model #500
-
Hi!
I used the following hyperparameters: Has anyone encountered this issue before, and does anyone have insights on how to resolve it? Thanks for the help! |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment 6 replies
-
not sure if i understand when the error occurs, during training? |
Beta Was this translation helpful? Give feedback.
there should be a handler.py in your model repo. that shows how to load model in case you used peft. could you try following the model loading part from there please?