Exporting Llama3's tokenizer #3555
Labels
bug
Something isn't working
module: doc
Related to our documentation, both in docs/ and docblocks
triaged
This issue has been looked at a team member, and triaged and prioritized into an appropriate module
Hello,
I am following https://github.com/pytorch/executorch/blob/main/examples/models/llama2/README.md#option-c-download-and-export-llama3-8b-model to make Llama3-8B-instruct to run on an S21 Ultra. But seems like the
examples.models.llama2.tokenizer.tokenizer
cannot process llama3'stokenizer.model
.Has anyone run into this issue?
The text was updated successfully, but these errors were encountered: