Quantized models having trouble with many input text tokens

#31
by kiwigs - opened

https://huggingface.co/jinaai/jina-clip-v1/discussions/22
^ this discussion thread got it fixed for the full the fp16 models but the quantized ones weren't fixed. Can we please get the fix ported over to those as well?

Sign up or log in to comment