Instructions to use chenghuzi/glimmer-e4b-asd9-gguf with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use chenghuzi/glimmer-e4b-asd9-gguf with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf chenghuzi/glimmer-e4b-asd9-gguf:BF16 # Run inference directly in the terminal: llama cli -hf chenghuzi/glimmer-e4b-asd9-gguf:BF16
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf chenghuzi/glimmer-e4b-asd9-gguf:BF16 # Run inference directly in the terminal: llama cli -hf chenghuzi/glimmer-e4b-asd9-gguf:BF16
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf chenghuzi/glimmer-e4b-asd9-gguf:BF16 # Run inference directly in the terminal: ./llama-cli -hf chenghuzi/glimmer-e4b-asd9-gguf:BF16
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf chenghuzi/glimmer-e4b-asd9-gguf:BF16 # Run inference directly in the terminal: ./build/bin/llama-cli -hf chenghuzi/glimmer-e4b-asd9-gguf:BF16
Use Docker
docker model run hf.co/chenghuzi/glimmer-e4b-asd9-gguf:BF16
- LM Studio
- Jan
- Ollama
How to use chenghuzi/glimmer-e4b-asd9-gguf with Ollama:
ollama run hf.co/chenghuzi/glimmer-e4b-asd9-gguf:BF16
- Unsloth Studio
How to use chenghuzi/glimmer-e4b-asd9-gguf with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for chenghuzi/glimmer-e4b-asd9-gguf to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for chenghuzi/glimmer-e4b-asd9-gguf to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for chenghuzi/glimmer-e4b-asd9-gguf to start chatting
- Pi
How to use chenghuzi/glimmer-e4b-asd9-gguf with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf chenghuzi/glimmer-e4b-asd9-gguf:BF16
Configure the model in Pi
# Install Pi: npm install -g @mariozechner/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "chenghuzi/glimmer-e4b-asd9-gguf:BF16" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Hermes Agent new
How to use chenghuzi/glimmer-e4b-asd9-gguf with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf chenghuzi/glimmer-e4b-asd9-gguf:BF16
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default chenghuzi/glimmer-e4b-asd9-gguf:BF16
Run Hermes
hermes
- Atomic Chat new
- OpenClaw new
How to use chenghuzi/glimmer-e4b-asd9-gguf with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf chenghuzi/glimmer-e4b-asd9-gguf:BF16
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "chenghuzi/glimmer-e4b-asd9-gguf:BF16" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
- Docker Model Runner
How to use chenghuzi/glimmer-e4b-asd9-gguf with Docker Model Runner:
docker model run hf.co/chenghuzi/glimmer-e4b-asd9-gguf:BF16
- Lemonade
How to use chenghuzi/glimmer-e4b-asd9-gguf with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull chenghuzi/glimmer-e4b-asd9-gguf:BF16
Run and chat with the model
lemonade run user.glimmer-e4b-asd9-gguf-BF16
List all available models
lemonade list
Glimmer E4B ASD-9 GGUF
Glimmer is a Gemma 4 E4B based GGUF model for observable behavior-label prediction. This private preview release is intended for research and screening-support workflows. It is not an ASD diagnostic system and must not be used as the sole basis for diagnosis, treatment decisions, or emergency decisions.
Files
model-Q4_K_M.gguf: Q4_K_M GGUF language model.mmproj-bf16.gguf: BF16 multimodal projection file. Use it together with the main GGUF file.metrics.json: Sanitized metric summary only. It does not include predictions, logs, media, cache files, or local paths.
Output Contract
The model is expected to emit a strict 9-bit code for B01 through B09.
^[01]{9}$
B10 is not directly predicted by the model. Applications should derive B10=true
only when all B01 through B09 bits are 0.
Labels
| Code | Label |
|---|---|
| B01 | Absence or Avoidance of Eye Contact |
| B02 | Aggressive Behavior |
| B03 | Hyper- or Hyporeactivity to Sensory Input |
| B04 | Non-Responsiveness to Verbal Interaction |
| B05 | Non-Typical Language |
| B06 | Object Lining-Up |
| B07 | Self-Hitting or Self-Injurious Behavior |
| B08 | Self-Spinning or Spinning Objects |
| B09 | Upper Limb Stereotypies |
| B10 | Background, application-derived |
Evaluation Summary
Evaluation used the unchanged test split with 182 samples.
The published metrics use the native-equivalent llama.cpp server baseline with pinned media marker
<__media__> and prompt cache disabled for iOS/native parity.
The run used Chinese prompts, audio enabled, up to 32 frames,
image width 512, max audio 30.0 seconds,
deterministic decoding, and grammar-constrained 9-bit output.
| Metric | Value |
|---|---|
| Parse rate | 1.0000 |
| Exact match | 0.3626 |
| Hamming accuracy | 0.8692 |
| Micro precision | 0.6059 |
| Micro recall | 0.4965 |
| Micro F1 | 0.5458 |
| Macro precision | 0.6461 |
| Macro recall | 0.5041 |
| Macro F1 | 0.5473 |
Per-Label Metrics
| Code | Label | Precision | Recall | F1 | Support |
|---|---|---|---|---|---|
| B01 | Absence or Avoidance of Eye Contact | 0.7895 | 0.3750 | 0.5085 | 40 |
| B02 | Aggressive Behavior | 0.9375 | 0.4688 | 0.6250 | 32 |
| B03 | Hyper- or Hyporeactivity to Sensory Input | 0.5714 | 0.3200 | 0.4103 | 25 |
| B04 | Non-Responsiveness to Verbal Interaction | 0.4375 | 0.2593 | 0.3256 | 27 |
| B05 | Non-Typical Language | 0.4286 | 0.3750 | 0.4000 | 24 |
| B06 | Object Lining-Up | 1.0000 | 0.7778 | 0.8750 | 9 |
| B07 | Self-Hitting or Self-Injurious Behavior | 0.3571 | 0.5263 | 0.4255 | 19 |
| B08 | Self-Spinning or Spinning Objects | 0.7222 | 0.5200 | 0.6047 | 25 |
| B09 | Upper Limb Stereotypies | 0.6000 | 0.5660 | 0.5825 | 53 |
| B10 | Background | 0.6170 | 0.8529 | 0.7160 | 34 |
llama.cpp Usage Notes
Use both GGUF files. The exact command depends on the local llama.cpp build and multimodal support. Keep decoding deterministic and constrain output to the 9-bit grammar when possible.
Example grammar:
root ::= bit bit bit bit bit bit bit bit bit
bit ::= "0" | "1"
License
The GGUF model files are distributed under Apache-2.0. See LICENSE and NOTICE.
- Downloads last month
- 28
4-bit