Error in loading
Sorry if I am posting something that is known how to fix and is a common thing, but I'm a newbie in this.
Downloaded this in the LMStudio, tried to load it and got the error
🥲 Failed to load the model
Failed to load model
error loading model: error loading model architecture: unknown model architecture: 'flux'
Is it a downloading problem or am I doing something wrong?
LM Studio cannot natively run GGUF image generation models, I would suggest using ComfyUI.
LM Studio cannot natively run GGUF image generation models, I would suggest using ComfyUI.
LM Studio can run natively a few GGUF image CAPTIONING models. For newbies who are confused by this:
while the ComfyUI models may appear in the list of models in LM Studio if you linked the models folder to each other you can use only the GGUF files for image captioning which have a yellow eye symbol in LM Studio! Two models that I guarantee work in LM Studio natively are Qwen2.5-VL-7B-Instruct-abliterated.Q5_K_M.gguf and Qwen3-VL-8B-Abliterated-Caption-it.Q8_0.gguf.
Thanks for helping me learn :)
But I forgot something: you also need a so-called project file for it, you recognise them as mmproj files, usually where you find the gguf file
For my example:
Qwen2.5-VL-7B-Instruct-abliterated.Q5_K_M.gguf
you need a mmproj-BF16 file and renamed it to
Qwen2.5-VL-7B-Instruct-abliterated-mmproj-BF16.gguf
so LM Studio accepts it. If for any reason you don't see the yellow eye then, rename the mmproj file again, to
mmproj-Qwen2.5-VL-7B-Instruct-abliterated-BF16.gguf
And click on refresh in LM Studio's 'MyModels' folder.