Does it actually work ?
#1
by kalashshah19 - opened
I tried running it, but it is showing this error :
gguf_init_from_reader: tensor 't0' has invalid number of dimensions: 8 > 4
The model doesnt actually work
Its just made to display the largest possible amount of parameters in huggingface.
The error is:
Tensor 0 (and all other tensors) have 8 dimensions.
But the inference engine you use doesnt allow models to have more than 4 dimensions per tensor.
Q&a
why did You use 8 dimensions per tensor?
Answer: because its the maximum huggingface allows to not Mark the model as 'invalid' and therefore no longer display parameter count, but also large enough that the parameter count displayed is the hightest