Image-Text-to-Text
Transformers
conversational

JSON Required for quantization

#1
by VaLtEc-BoY - opened

Hello !! would like to request the JSON file for QUANTIZATION of the LLaDA model for popularization in the HF community.

(malformed JSON string, neither tag, array, object, number, string or atom, at character offset 0)

If possible I thank you!

https://huggingface.co/mradermacher/model_requests/discussions/2080

renaming llm_config.json -> config.json should fix it, and then it's upto llama cpp to support it or not

Thank you very much if we can it would be very cool for the whole HF community!!if you can create your own gguf model in the future it would also be of great appreciation to the HF Open Source community.thank you very much for the instruction!

I sadly dont have enough time and motivation for my own training, I would be doing some heretics, but I have trouble with huggingface on my account and pew heretic code isnt very ready yet for my configuration, so maybe later...

Sign up or log in to comment