How to use mlx-community/Mixtral-8x7B-v0.1-hf-4bit-mlx with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] hf download mlx-community/Mixtral-8x7B-v0.1-hf-4bit-mlx --local-dir Mixtral-8x7B-v0.1-hf-4bit-mlx
https://huggingface.co/mlx-community/Mixtral-8x7B-v0.1-hf-4bit-mlx/resolve/main/tokenizer.json
hf download hf://mlx-community/Mixtral-8x7B-v0.1-hf-4bit-mlx/tokenizer.json
curl -L -o tokenizer.json https://huggingface.co/mlx-community/Mixtral-8x7B-v0.1-hf-4bit-mlx/resolve/main/tokenizer.json
