Instructions to use prithivMLmods/gemma-4-31B-it-Uncensored-MAX-MLX with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use prithivMLmods/gemma-4-31B-it-Uncensored-MAX-MLX with MLX:
# Make sure mlx-vlm is installed # pip install --upgrade mlx-vlm from mlx_vlm import load, generate from mlx_vlm.prompt_utils import apply_chat_template from mlx_vlm.utils import load_config # Load the model model, processor = load("prithivMLmods/gemma-4-31B-it-Uncensored-MAX-MLX") config = load_config("prithivMLmods/gemma-4-31B-it-Uncensored-MAX-MLX") # Prepare input image = ["http://images.cocodataset.org/val2017/000000039769.jpg"] prompt = "Describe this image." # Apply chat template formatted_prompt = apply_chat_template( processor, config, prompt, num_images=1 ) # Generate output output = generate(model, processor, formatted_prompt, image) print(output) - Notebooks
- Google Colab
- Kaggle
- Local Apps
- LM Studio
- Pi new
How to use prithivMLmods/gemma-4-31B-it-Uncensored-MAX-MLX with Pi:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "prithivMLmods/gemma-4-31B-it-Uncensored-MAX-MLX"
Configure the model in Pi
# Install Pi: npm install -g @mariozechner/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "mlx-lm": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "prithivMLmods/gemma-4-31B-it-Uncensored-MAX-MLX" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Hermes Agent new
How to use prithivMLmods/gemma-4-31B-it-Uncensored-MAX-MLX with Hermes Agent:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "prithivMLmods/gemma-4-31B-it-Uncensored-MAX-MLX"
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default prithivMLmods/gemma-4-31B-it-Uncensored-MAX-MLX
Run Hermes
hermes
gemma-4-31B-it-Uncensored-MAX-MLX
gemma-4-31B-it-Uncensored-MAX-MLX is an uncensored evolution built on top of google/gemma-4-31B-it. This model applies advanced refusal direction analysis and abliteration-based training strategies to significantly reduce internal refusal behaviors while preserving the reasoning and instruction-following strengths of the original architecture. The result is a powerful 31B parameter language model optimized for detailed responses and improved instruction adherence.
This model is materialized for research and learning purposes only. The model has reduced internal refusal behaviors, and any content generated by it is used at the user’s own risk. The authors and hosting page disclaim any liability for content generated by this model. Users are responsible for ensuring that the model is used in a safe, ethical, and lawful manner.
Key Highlights
- Advanced Refusal Direction Analysis: Uses targeted activation analysis to identify and mitigate refusal directions within the model’s latent space.
- Uncensored MAX Training: Fine-tuned to significantly reduce refusal patterns while maintaining coherent and detailed outputs.
- 31B Parameter Architecture: Built on gemma-4-31B-it, offering stronger reasoning and knowledge capacity.
- Improved Instruction Adherence: Optimized to follow complex prompts with minimal unnecessary refusals.
- MLX Optimized Deployment: Adapted for efficient inference using Apple’s MLX framework on Apple Silicon.
- High-Capability Deployment: Suitable for advanced research experimentation and high-performance inference setups.
Quick Start with MLX
pip install -U mlx-vlm
python -m mlx_vlm.generate \
--model prithivMLmods/gemma-4-31B-it-Uncensored-MAX-MLX \
--max-tokens 100 \
--temperature 0.0 \
--prompt "Describe this image." \
--image <path_to_image>
Intended Use
- Alignment & Refusal Research: Studying refusal behaviors and activation-level modifications.
- Red-Teaming Experiments: Evaluating robustness across adversarial or edge-case prompts.
- High-Capability Local AI Deployment: Running large instruction models on advanced hardware.
- Research Prototyping: Experimentation with large-scale transformer architectures.
Limitations & Risks
Important Note: This model intentionally reduces built-in refusal mechanisms.
- Sensitive Output Possibility: The model may generate controversial or explicit responses depending on prompts.
- User Responsibility: Outputs should be handled responsibly and within legal and ethical boundaries.
- Compute Requirements: A 31B model requires significant GPU memory or optimized inference strategies such as quantization, tensor parallelism, or MLX acceleration on Apple Silicon.
Dataset & Acknowledgements
- Uncensor any LLM with Abliteration – by Maxime Labonne
- harmful_behaviors and harmless_alpaca – by Maxime Labonne
- Remove Refusals with Transformers (a proof-of-concept implementation to remove refusals from an LLM without using TransformerLens) – by Sumandora
- LLM-LAT/harmful-dataset – by LLM Latent Adversarial Training
- Downloads last month
- 1,314
Quantized
Model tree for prithivMLmods/gemma-4-31B-it-Uncensored-MAX-MLX
Base model
google/gemma-4-31B