NeuralNotwerk
/

Mistral-Medium-3.5-128B-NVFP4

compressed-tensors

8-bit precision

Model card Files Files and versions

Mistral-Medium-3.5-128B-NVFP4 / generation_config.json

garrett galloway

Add Mistral-Medium-3.5-128B NVFP4 (W4A4-FP4) quant + scripts

391a1c9 verified 5 months ago

History Blame Contribute Delete

126 Bytes

	{
	"bos_token_id": 1,
	"eos_token_id": 2,
	"max_length": 262144,
	"pad_token_id": 11,
	"transformers_version": "5.7.0"
	}