You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Closing this issue.
I was able to move ahead by making the query from type float to type half, by adding the line `q = q.half()` on line 221 in `fam/llm/fast_model.py`. Not sure how this would impact the performance, as of now.
I am able to use `tts` object from `fast_inference.py` in the interactive session now.
Thanks !!
Originally posted by @saurabh-kadian in #106 (comment)
We're seeing the same issue when running from the colab on a non-GPU runtime (could only get the colab working via that)
The text was updated successfully, but these errors were encountered: