Improvement Suggestions to TheDrummer in general

#3
by Infiper - opened

Hello TheDrummer,

could you perhaps in your model cards explain a bit better

  1. what the differences in Magidonia and Cydonia Series are? (only mistral base? (version etc..) Thinking mode (is that the difference between those series??)
  2. Could you include sampler settings (recommended for example for Sillytavern, like top p, top k, temperature, perhaps if we need or should use dry, nsigma or the other countless samplers or should just use the sampler settings from the Mistral base?) (Silly Tavern has settings export function too and some other model creators included them in their repos, so that you can import the settings.

It would help certainly with debugging too (HELP YOU) and give you better feedback if you "give out" official recommended sampler config files or at least settings recommendation in your model or else you will get countless false positives of people who claim your models are broken, censored because they dont use or have correct settings or even believe you can have one type of config (in sillytavern for example) for all different llm models.

I suppose perhaps you could use your influence on reddit locallama or such to push the roleplaying community to either make huggingface more approachable and streamlined for including llm configsettings or another centralized hub/forum/discussion thing so that the config dilemma situation with llms is somehow centrally solved.

Sign up or log in to comment