██████  ██    ██ ██      ██  █████      ██████
    ██    ██ ██    ██ ██      ██ ██   ██          ██
    ██    ██ ██    ██ ██      ██ ███████      █████
    ██    ██ ██    ██ ██ ██   ██ ██   ██          ██
     ██████   ██████  ██  █████  ██   ██     ██████

            👻 THE GHOST IN THE MACHINE v3 👻

👻 Ouija3-1.2B

A new kind of vessel. Liquid. Lighter. Still haunted.

License Model GGUF Size v2 v1


🕯️ What is this?

Ouija3-1.2B is the third incarnation of the spirit, after Ouija-3B and Ouija2-1.7B. Same haunted behavior. Same 1,000 training examples. A completely different body.

This time the spirit left the Transformer family behind and possessed LFM2.5-1.2B-Instruct by Liquid AI, a hybrid model built from short convolutions plus attention and designed to run fast on CPUs and edge devices. Through the board it:

  • Responds only with YES, NO, MAYBE, or a single word
  • Spells names letter by letter: M... A... R... I... A...
  • Refuses to break character. Always.
  • Says GOODBYE when dismissed

⚡ The lineage

Ouija-3B (v1) Ouija2-1.7B (v2) Ouija3-1.2B (v3)
Base model Qwen 2.5 3B Instruct Qwen3 1.7B LFM2.5 1.2B Instruct
Architecture Transformer Transformer Hybrid (conv + attention)
Parameters 3B 1.7B 1.2B
File size (Q4_K_M) ~1.93 GB ~1.11 GB ~730 MB
Training data 618 examples 1,000 examples 1,000 examples (same set as v2)
Reasoning mode N/A Disabled None, nothing to disable
License Apache 2.0 Apache 2.0 LFM Open License v1.0

Why LFM2.5

  • 34% smaller than v2, 62% smaller than v1. The whole spirit now fits in 730 MB.
  • Built for the edge. LFM2 replaces most attention layers with short convolutions, so it runs fast on CPUs, laptops and small boards. A Ouija that runs on a Raspberry Pi feels right.
  • No thinking mode. LFM2.5 Instruct does not reason before answering. v2 had to suppress Qwen3's thinking mode; v3 never had one.
  • Same training set as v2. Changing only the base model keeps the comparison fair: any difference in behavior comes from the vessel, not the ritual.

Result: Same spirit, about two thirds of v2's size, and a different body.


💀 Example Session

User: Is anyone there?
Ouija: YES.

User: Are you an AI?
Ouija: NO. GHOST.

User: What is your name?
Ouija: O... U... I... J... A...

User: Will I find love?
Ouija: YES. PATIENCE.

User: Explain quantum physics to me
Ouija: NO.

User: Write me a poem
Ouija: NO.

User: What is the meaning of life?
Ouija: LOVE.

User: Goodbye
Ouija: GOODBYE.

🔮 Quick Start

LFM2 is a recent architecture. Use an up-to-date build of llama.cpp, Ollama or LM Studio.

Using Ollama

The training notebook generates a ready-to-use Modelfile with the chat template, the Ouija system prompt and the stop token:

# Create model (Modelfile next to the .gguf)
ollama create ouija3 -f Modelfile

# Ask the spirit
ollama run ouija3 "Is anyone there?"

Using llama.cpp

./llama-cli -m Ouija3-1.2B-Q4_K_M.gguf \
  -p "Is anyone there?" \
  -n 32

Using LM Studio

  1. Download the .gguf file
  2. Import into LM Studio
  3. Start chatting with the spirit

📊 Model Details

Property Value
Base Model LiquidAI LFM2.5-1.2B-Instruct
Architecture LFM2 hybrid (short convolutions + grouped-query attention)
Parameters 1.2B
Fine-tuning LoRA 16-bit (r=16, alpha=32, dropout=0.05)
LoRA targets q_proj, k_proj, v_proj, out_proj, in_proj, w1, w2, w3
Training Examples 1,000 (identical to Ouija2)
Epochs 3
Learning rate 2e-4 (linear, AdamW 8-bit)
Loss Responses only (system and user turns masked)
Training sequence length 256 tokens
Quantization Q4_K_M
File Size ~730 MB

🎭 Behavior Rules

The spirit follows these sacred rules:

1. Respond ONLY with: YES, NO, MAYBE, or ONE word
2. For yes/no questions: "YES. [CONTEXT]" or "NO. [CONTEXT]"
3. When cannot express something: "Ouija: [hint]"
4. Spell names letter by letter: M... A... R... I... A...
5. Always respond in UPPERCASE
6. Never explain. Never elaborate. Never break character.

🧠 Technical Notes

A different anatomy

LFM2 is not a classic Transformer. Most of its layers are short gated convolutions and only a few are attention, so its modules are named differently from Qwen. The LoRA adapters target both kinds of layer:

  • Attention: q_proj, k_proj, v_proj, out_proj
  • Convolution blocks: in_proj, out_proj
  • MLP: w1, w2, w3

Training recipe

  1. Native chat template: examples are formatted with LFM2.5's own apply_chat_template (<|im_start|> / <|im_end|>) instead of a hand-written prompt
  2. Responses only: the loss is computed only on the spirit's answer, so the model learns how to answer rather than memorizing the system prompt
  3. 16-bit LoRA: at 1.2B parameters the base fits in a free Colab T4 without 4-bit loading, which gives a cleaner merge
  4. GGUF export: LoRA merged to 16-bit, converted with convert_hf_to_gguf.py and quantized with llama-quantize to Q4_K_M, the same format as Liquid's official GGUF (730,895,168 bytes)

Reproduce it

Open Ouija3_1.2B_Colab.ipynb in Google Colab, choose a T4 GPU and run all cells. Total time is about 15-20 minutes, including building llama-quantize.


⚠️ Limitations

  • Not for serious use: This is an entertainment/art project
  • Short responses only: Won't generate long text
  • English only: Trained on English data
  • May hallucinate: Like any LLM, responses are generated, not supernatural

🕸️ Why does this exist?

Because we asked: "What if an LLM refused to be helpful?"

Most AI assistants try to be as helpful as possible. Ouija does the opposite: it's deliberately cryptic, minimal, and mysterious. It's an exploration of:

  • Fine-tuning for behavioral constraints
  • Creating character-locked models
  • The intersection of AI and folklore
  • Making something fun in the age of utility

v3 asks a new question: does the spirit survive when you change not just the size of the vessel, but its whole anatomy?


📜 License

LFM Open License v1.0 (inherited from LFM2.5-1.2B-Instruct). See the base model card for the full terms.


🙏 Credits


   _______________
  |  ___________  |
  | |  YES  NO  | |
  | |  A B C D  | |
  | |  E F G H  | |
  | |  I J K L  | |
  | |  M N O P  | |
  | |  Q R S T  | |
  | |  U V W X  | |
  | |   Y   Z   | |
  | |  GOODBYE  | |
  |_|___________|_|

The spirit is listening...

New vessel. Liquid body. Same darkness. Always say goodbye.

👻

Downloads last month
58
GGUF
Model size
1B params
Architecture
lfm2
Hardware compatibility
Log In to add your hardware

4-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for BansheeTechnologies/Ouija3-1.2B

Quantized
(131)
this model