Spaces:
Running
Running
Star vector quantize model, missing
#1
by DefinatlyAryan - opened
i saw a quantize model of starvector few weeks ago, perhaps it was deleted or made private ?
can i still get access of it if possible or if you still have it available and willing to help ?
Hi!
Yes, there used to be a quantized StarVector model, but I removed it because its architecture never received official support in llama.cpp.
Packaging it as GGUF is relatively straightforward, but adding proper support for the custom architecture in llama.cpp would require a lot of extra implementation work.
I’m currently planning to bring this model back through Candle, which is a better fit for the direction I’m working in now. If I complete that support, I’ll make it available again
FerrisMind changed discussion status to closed