not being able to run in TEI
#4
by sigridjineth - opened
hello, it seems like TEI doesn't support gte reranker at this moment.
I have experimented on changing as shown below for biencoder base but still no fruitful responses came yet.
https://huggingface.co/Alibaba-NLP/gte-multilingual-reranker-base/discussions/3
Reference: https://huggingface.co/Alibaba-NLP/gte-multilingual-base/discussions/7
I found that gteconfig doesn't have support for reranker and its implementations on TEI. need to write it
@sigridjineth were you able to figure it out? I have fine-tuned gte-multilingual-reranker-base and want to use it with TEI.
Hey just seeing this discussion, but did you manage to solve it? I've tried to reproduce on TEI and it seems to work fine, but let me know otherwise 🤗