When would be able to make a GGUF of the model?
#1
by
FlameF0X
- opened
I’d like to see a GGUF so I could run it locally. :D
Also, making it Transformers-compatible would be nice.
Oh, never mind, the model is already compatible with Transformers. -- but i still want a GGUF.
Thanks for the comment. There is a plan to add a GGUF version in the near future.
Neat, because i tried the model through the code you provided and its look promising.