What is the max token size it can support?

by AayushShah - opened 20 days ago

20 days ago

Hello, like the model all-mpnet-base-v2 encode 384 tokens max and trims the rest -- what is the situition here? For this model?

Thanks

rvo

MongoDB org 19 days ago

Hi!

Both mdbr-leaf-ir and mdbr-leaf-mtmodels have context windows of 512 tokens.

13 days ago

Thanks @rvo !!!

AayushShah changed discussion status to closed 13 days ago

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment